Note: This is test shard 3 of 3.
[==========] Running 1 test from 1 test suite.
[----------] Global test environment set-up.
[----------] 1 test from CatalogManagerConfigurations/MasterStressTest
[ RUN ] CatalogManagerConfigurations/MasterStressTest.Test/2
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20250831 19:54:25.051553 1031 test_util.cc:276] Using random seed: -1623783556
2025-08-31T19:54:25Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2025-08-31T19:54:25Z Disabled control of system clock
Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/derby.log -Djava.security.properties=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/security.properties
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/tmp/dist-test-taskfwTdIj/thirdparty/src/hive-3.1.2/lib/log4j-slf4j-impl-2.10.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/tmp/dist-test-taskfwTdIj/thirdparty/src/hadoop-3.4.1/share/hadoop/common/lib/slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
Metastore connection URL: jdbc:derby:/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/metadb;create=true
Metastore Connection Driver : org.apache.derby.jdbc.EmbeddedDriver
Metastore connection User: APP
Starting metastore schema initialization to 3.1.0
Initialization script hive-schema-3.1.0.derby.sql
Initialization script completed
schemaTool completed
Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/derby.log -Djava.security.properties=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/security.properties
2025-08-31 19:54:30: Starting Hive Metastore Server
Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/derby.log -Djava.security.properties=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/security.properties
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/tmp/dist-test-taskfwTdIj/thirdparty/src/hive-3.1.2/lib/log4j-slf4j-impl-2.10.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/tmp/dist-test-taskfwTdIj/thirdparty/src/hadoop-3.4.1/share/hadoop/common/lib/slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
Starting hive metastore on port 0
I20250831 19:54:37.713229 1031 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskfwTdIj/build/asan/bin/kudu
/tmp/dist-test-taskfwTdIj/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.1.254:34259
--webserver_interface=127.1.1.254
--webserver_port=0
--builtin_ntp_servers=127.1.1.212:44077
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943
--hive_metastore_uris=thrift://127.0.0.1:46163
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20250831 19:54:38.001874 1272 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20250831 19:54:38.002167 1272 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20250831 19:54:38.002292 1272 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20250831 19:54:38.009783 1272 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20250831 19:54:38.009868 1272 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20250831 19:54:38.009935 1272 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20250831 19:54:38.010007 1272 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20250831 19:54:38.019268 1272 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.1.212:44077
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-0/wal
--hive_metastore_uris=thrift://127.0.0.1:46163
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.1.254:34259
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.1.254
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 06466b25e294b4d7d455e6c56263318dc34a80ef
build type FASTDEBUG
built by None at 31 Aug 2025 19:43:25 UTC on 24a791456cd2
build id 7836
ASAN enabled
I20250831 19:54:38.021205 1272 env_posix.cc:2264] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20250831 19:54:38.023020 1272 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250831 19:54:38.030895 1278 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250831 19:54:38.030864 1277 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250831 19:54:38.031473 1280 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250831 19:54:38.031793 1272 server_base.cc:1047] running on GCE node
I20250831 19:54:38.032454 1272 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20250831 19:54:38.033788 1272 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20250831 19:54:38.034969 1272 hybrid_clock.cc:648] HybridClock initialized: now 1756670078034893 us; error 70 us; skew 500 ppm
I20250831 19:54:38.035246 1272 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250831 19:54:38.037539 1272 webserver.cc:480] Webserver started at http://127.1.1.254:34345/ using document root <none> and password file <none>
I20250831 19:54:38.038422 1272 fs_manager.cc:362] Metadata directory not provided
I20250831 19:54:38.038575 1272 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250831 19:54:38.038987 1272 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20250831 19:54:38.041929 1272 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-0/data/instance:
uuid: "6c830f6055d64a3b8a9f78b405ad8aa3"
format_stamp: "Formatted at 2025-08-31 19:54:38 on dist-test-slave-v4kn"
I20250831 19:54:38.042879 1272 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-0/wal/instance:
uuid: "6c830f6055d64a3b8a9f78b405ad8aa3"
format_stamp: "Formatted at 2025-08-31 19:54:38 on dist-test-slave-v4kn"
I20250831 19:54:38.048103 1272 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20250831 19:54:38.052390 1286 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250831 19:54:38.053984 1272 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20250831 19:54:38.054147 1272 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-0/data,/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-0/wal
uuid: "6c830f6055d64a3b8a9f78b405ad8aa3"
format_stamp: "Formatted at 2025-08-31 19:54:38 on dist-test-slave-v4kn"
I20250831 19:54:38.054339 1272 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250831 19:54:38.079797 1272 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250831 19:54:38.080597 1272 env_posix.cc:2264] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20250831 19:54:38.080840 1272 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250831 19:54:38.099210 1272 rpc_server.cc:307] RPC server started. Bound to: 127.1.1.254:34259
I20250831 19:54:38.099231 1337 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.1.254:34259 every 8 connection(s)
I20250831 19:54:38.100630 1272 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-0/data/info.pb
I20250831 19:54:38.104070 1338 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:38.109453 1031 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskfwTdIj/build/asan/bin/kudu as pid 1272
I20250831 19:54:38.109755 1031 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-0/wal/instance
I20250831 19:54:38.109584 1338 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } has no permanent_uuid. Determining permanent_uuid...
I20250831 19:54:38.112709 1031 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskfwTdIj/build/asan/bin/kudu
/tmp/dist-test-taskfwTdIj/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.1.253:45581
--webserver_interface=127.1.1.253
--webserver_port=0
--builtin_ntp_servers=127.1.1.212:44077
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943
--hive_metastore_uris=thrift://127.0.0.1:46163
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20250831 19:54:38.129576 1338 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } has no permanent_uuid. Determining permanent_uuid...
W20250831 19:54:38.130558 1287 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.1.253:45581: connect: Connection refused (error 111)
W20250831 19:54:38.131956 1338 consensus_peers.cc:648] Error getting permanent uuid from config peer 127.1.1.253:45581: Network error: Client connection negotiation failed: client connection to 127.1.1.253:45581: connect: Connection refused (error 111)
I20250831 19:54:38.181306 1338 consensus_peers.cc:658] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } attempt: 1
W20250831 19:54:38.183140 1338 consensus_peers.cc:648] Error getting permanent uuid from config peer 127.1.1.253:45581: Network error: Client connection negotiation failed: client connection to 127.1.1.253:45581: connect: Connection refused (error 111)
I20250831 19:54:38.251443 1338 consensus_peers.cc:658] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } attempt: 2
W20250831 19:54:38.253511 1338 consensus_peers.cc:648] Error getting permanent uuid from config peer 127.1.1.253:45581: Network error: Client connection negotiation failed: client connection to 127.1.1.253:45581: connect: Connection refused (error 111)
I20250831 19:54:38.344830 1338 consensus_peers.cc:658] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } attempt: 3
W20250831 19:54:38.346529 1338 consensus_peers.cc:648] Error getting permanent uuid from config peer 127.1.1.253:45581: Network error: Client connection negotiation failed: client connection to 127.1.1.253:45581: connect: Connection refused (error 111)
W20250831 19:54:38.405684 1341 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20250831 19:54:38.406035 1341 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20250831 19:54:38.406173 1341 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20250831 19:54:38.413431 1341 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20250831 19:54:38.413553 1341 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20250831 19:54:38.413640 1341 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20250831 19:54:38.413690 1341 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20250831 19:54:38.422482 1341 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.1.212:44077
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-1/wal
--hive_metastore_uris=thrift://127.0.0.1:46163
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.1.253:45581
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.1.1.253
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 06466b25e294b4d7d455e6c56263318dc34a80ef
build type FASTDEBUG
built by None at 31 Aug 2025 19:43:25 UTC on 24a791456cd2
build id 7836
ASAN enabled
I20250831 19:54:38.423964 1341 env_posix.cc:2264] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20250831 19:54:38.425657 1341 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250831 19:54:38.432758 1347 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250831 19:54:38.432736 1348 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250831 19:54:38.433033 1350 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250831 19:54:38.434262 1341 server_base.cc:1047] running on GCE node
I20250831 19:54:38.434914 1341 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20250831 19:54:38.436180 1341 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20250831 19:54:38.437381 1341 hybrid_clock.cc:648] HybridClock initialized: now 1756670078437331 us; error 40 us; skew 500 ppm
I20250831 19:54:38.437722 1341 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250831 19:54:38.439658 1341 webserver.cc:480] Webserver started at http://127.1.1.253:43003/ using document root <none> and password file <none>
I20250831 19:54:38.440326 1341 fs_manager.cc:362] Metadata directory not provided
I20250831 19:54:38.440428 1341 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250831 19:54:38.440765 1341 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20250831 19:54:38.442972 1341 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-1/data/instance:
uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5"
format_stamp: "Formatted at 2025-08-31 19:54:38 on dist-test-slave-v4kn"
I20250831 19:54:38.443677 1341 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-1/wal/instance:
uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5"
format_stamp: "Formatted at 2025-08-31 19:54:38 on dist-test-slave-v4kn"
I20250831 19:54:38.448338 1341 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.001s sys 0.005s
I20250831 19:54:38.451391 1356 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250831 19:54:38.452535 1341 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20250831 19:54:38.452672 1341 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-1/data,/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-1/wal
uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5"
format_stamp: "Formatted at 2025-08-31 19:54:38 on dist-test-slave-v4kn"
I20250831 19:54:38.452837 1341 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250831 19:54:38.471321 1341 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250831 19:54:38.472072 1341 env_posix.cc:2264] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20250831 19:54:38.472281 1341 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250831 19:54:38.489809 1341 rpc_server.cc:307] RPC server started. Bound to: 127.1.1.253:45581
I20250831 19:54:38.489753 1338 consensus_peers.cc:658] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } attempt: 4
I20250831 19:54:38.489856 1407 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.1.253:45581 every 8 connection(s)
I20250831 19:54:38.491422 1341 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-1/data/info.pb
I20250831 19:54:38.495150 1409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:38.498059 1031 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskfwTdIj/build/asan/bin/kudu as pid 1341
I20250831 19:54:38.498242 1031 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-1/wal/instance
I20250831 19:54:38.499626 1031 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskfwTdIj/build/asan/bin/kudu
/tmp/dist-test-taskfwTdIj/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.1.252:35943
--webserver_interface=127.1.1.252
--webserver_port=0
--builtin_ntp_servers=127.1.1.212:44077
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943
--hive_metastore_uris=thrift://127.0.0.1:46163
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20250831 19:54:38.502148 1409 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } has no permanent_uuid. Determining permanent_uuid...
I20250831 19:54:38.503297 1338 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } has no permanent_uuid. Determining permanent_uuid...
W20250831 19:54:38.504982 1338 consensus_peers.cc:648] Error getting permanent uuid from config peer 127.1.1.252:35943: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
I20250831 19:54:38.510777 1409 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } has no permanent_uuid. Determining permanent_uuid...
I20250831 19:54:38.515714 1409 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } has no permanent_uuid. Determining permanent_uuid...
W20250831 19:54:38.516508 1357 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
W20250831 19:54:38.517812 1409 consensus_peers.cc:648] Error getting permanent uuid from config peer 127.1.1.252:35943: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
I20250831 19:54:38.564247 1338 consensus_peers.cc:658] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } attempt: 1
W20250831 19:54:38.566253 1338 consensus_peers.cc:648] Error getting permanent uuid from config peer 127.1.1.252:35943: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
I20250831 19:54:38.567052 1409 consensus_peers.cc:658] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } attempt: 1
W20250831 19:54:38.568588 1409 consensus_peers.cc:648] Error getting permanent uuid from config peer 127.1.1.252:35943: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
I20250831 19:54:38.633491 1338 consensus_peers.cc:658] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } attempt: 2
W20250831 19:54:38.635346 1338 consensus_peers.cc:648] Error getting permanent uuid from config peer 127.1.1.252:35943: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
I20250831 19:54:38.636778 1409 consensus_peers.cc:658] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } attempt: 2
W20250831 19:54:38.638139 1409 consensus_peers.cc:648] Error getting permanent uuid from config peer 127.1.1.252:35943: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
I20250831 19:54:38.729327 1409 consensus_peers.cc:658] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } attempt: 3
W20250831 19:54:38.731243 1409 consensus_peers.cc:648] Error getting permanent uuid from config peer 127.1.1.252:35943: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
I20250831 19:54:38.735617 1338 consensus_peers.cc:658] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } attempt: 3
W20250831 19:54:38.737123 1338 consensus_peers.cc:648] Error getting permanent uuid from config peer 127.1.1.252:35943: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
W20250831 19:54:38.799975 1410 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20250831 19:54:38.800299 1410 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20250831 19:54:38.800426 1410 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20250831 19:54:38.808319 1410 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20250831 19:54:38.808418 1410 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20250831 19:54:38.808496 1410 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20250831 19:54:38.808563 1410 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20250831 19:54:38.817128 1410 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.1.212:44077
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-2/wal
--hive_metastore_uris=thrift://127.0.0.1:46163
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.1.252:35943
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.1.1.252
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 06466b25e294b4d7d455e6c56263318dc34a80ef
build type FASTDEBUG
built by None at 31 Aug 2025 19:43:25 UTC on 24a791456cd2
build id 7836
ASAN enabled
I20250831 19:54:38.818604 1410 env_posix.cc:2264] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20250831 19:54:38.820194 1410 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250831 19:54:38.828078 1417 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250831 19:54:38.828050 1418 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250831 19:54:38.828613 1420 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250831 19:54:38.829133 1410 server_base.cc:1047] running on GCE node
I20250831 19:54:38.829847 1410 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20250831 19:54:38.831115 1410 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20250831 19:54:38.832288 1410 hybrid_clock.cc:648] HybridClock initialized: now 1756670078832251 us; error 29 us; skew 500 ppm
I20250831 19:54:38.832576 1410 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250831 19:54:38.843957 1410 webserver.cc:480] Webserver started at http://127.1.1.252:45703/ using document root <none> and password file <none>
I20250831 19:54:38.844712 1410 fs_manager.cc:362] Metadata directory not provided
I20250831 19:54:38.844821 1410 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250831 19:54:38.845144 1410 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20250831 19:54:38.847343 1410 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-2/data/instance:
uuid: "ac75f6e7a0634a89beb9670950e95220"
format_stamp: "Formatted at 2025-08-31 19:54:38 on dist-test-slave-v4kn"
I20250831 19:54:38.848093 1410 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-2/wal/instance:
uuid: "ac75f6e7a0634a89beb9670950e95220"
format_stamp: "Formatted at 2025-08-31 19:54:38 on dist-test-slave-v4kn"
I20250831 19:54:38.852864 1410 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.006s sys 0.001s
I20250831 19:54:38.855873 1426 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250831 19:54:38.856971 1410 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20250831 19:54:38.857117 1410 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-2/data,/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-2/wal
uuid: "ac75f6e7a0634a89beb9670950e95220"
format_stamp: "Formatted at 2025-08-31 19:54:38 on dist-test-slave-v4kn"
I20250831 19:54:38.857304 1410 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250831 19:54:38.874418 1409 consensus_peers.cc:658] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } attempt: 4
W20250831 19:54:38.876659 1409 consensus_peers.cc:648] Error getting permanent uuid from config peer 127.1.1.252:35943: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
I20250831 19:54:38.891789 1410 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250831 19:54:38.892839 1410 env_posix.cc:2264] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20250831 19:54:38.893113 1410 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250831 19:54:38.907310 1338 consensus_peers.cc:658] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } attempt: 4
W20250831 19:54:38.909617 1338 consensus_peers.cc:648] Error getting permanent uuid from config peer 127.1.1.252:35943: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
I20250831 19:54:38.915599 1410 rpc_server.cc:307] RPC server started. Bound to: 127.1.1.252:35943
I20250831 19:54:38.915622 1477 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.1.252:35943 every 8 connection(s)
I20250831 19:54:38.917268 1410 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-2/data/info.pb
I20250831 19:54:38.919227 1031 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskfwTdIj/build/asan/bin/kudu as pid 1410
I20250831 19:54:38.919428 1031 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-2/wal/instance
I20250831 19:54:38.920789 1478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:38.926996 1478 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } has no permanent_uuid. Determining permanent_uuid...
I20250831 19:54:38.939018 1478 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } has no permanent_uuid. Determining permanent_uuid...
I20250831 19:54:38.947283 1478 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } has no permanent_uuid. Determining permanent_uuid...
I20250831 19:54:38.957934 1478 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220: Bootstrap starting.
I20250831 19:54:38.960947 1478 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:38.961994 1478 log.cc:826] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220: Log is configured to *not* fsync() on all Append() calls
I20250831 19:54:38.964130 1478 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220: No bootstrap required, opened a new log
I20250831 19:54:38.969159 1478 raft_consensus.cc:357] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } }
I20250831 19:54:38.969404 1478 raft_consensus.cc:383] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:38.969518 1478 raft_consensus.cc:738] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac75f6e7a0634a89beb9670950e95220, State: Initialized, Role: FOLLOWER
I20250831 19:54:38.970070 1478 consensus_queue.cc:260] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } }
I20250831 19:54:38.970827 1486 sys_catalog.cc:455] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } } }
I20250831 19:54:38.971055 1486 sys_catalog.cc:458] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220 [sys.catalog]: This master's current role is: FOLLOWER
I20250831 19:54:38.971668 1478 sys_catalog.cc:564] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220 [sys.catalog]: configured and running, proceeding with master startup.
W20250831 19:54:38.982244 1500 catalog_manager.cc:1560] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250831 19:54:38.982359 1500 catalog_manager.cc:875] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20250831 19:54:38.983116 1410 master_runner.cc:186] Error getting master registration for 127.1.1.254:34259: OK, instance_id { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" instance_seqno: 1756670078094294 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20250831 19:54:38.988304 1410 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20250831 19:54:39.145352 1432 tablet.cc:2378] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20250831 19:54:39.175977 1409 consensus_peers.cc:658] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } attempt: 5
I20250831 19:54:39.185636 1409 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Bootstrap starting.
I20250831 19:54:39.189462 1409 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:39.190807 1409 log.cc:826] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Log is configured to *not* fsync() on all Append() calls
I20250831 19:54:39.193506 1409 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: No bootstrap required, opened a new log
I20250831 19:54:39.200317 1409 raft_consensus.cc:357] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } }
I20250831 19:54:39.200624 1409 raft_consensus.cc:383] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:39.200747 1409 raft_consensus.cc:738] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4d46bc3ef5a4fbb8c9e4349c86c54a5, State: Initialized, Role: FOLLOWER
I20250831 19:54:39.201632 1409 consensus_queue.cc:260] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } }
I20250831 19:54:39.201960 1504 raft_consensus.cc:491] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:39.202280 1504 raft_consensus.cc:513] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } }
I20250831 19:54:39.203665 1409 sys_catalog.cc:564] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [sys.catalog]: configured and running, proceeding with master startup.
I20250831 19:54:39.204532 1505 sys_catalog.cc:455] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } } }
I20250831 19:54:39.204838 1505 sys_catalog.cc:458] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [sys.catalog]: This master's current role is: FOLLOWER
I20250831 19:54:39.205036 1504 leader_election.cc:290] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259), ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943)
I20250831 19:54:39.205036 1453 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac75f6e7a0634a89beb9670950e95220" is_pre_election: true
I20250831 19:54:39.205504 1453 raft_consensus.cc:2466] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4d46bc3ef5a4fbb8c9e4349c86c54a5 in term 0.
I20250831 19:54:39.206105 1357 leader_election.cc:304] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4d46bc3ef5a4fbb8c9e4349c86c54a5, ac75f6e7a0634a89beb9670950e95220; no voters:
I20250831 19:54:39.206440 1504 raft_consensus.cc:2802] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:39.206591 1504 raft_consensus.cc:491] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:39.206707 1504 raft_consensus.cc:3058] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:39.210425 1504 raft_consensus.cc:513] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } }
I20250831 19:54:39.211719 1453 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac75f6e7a0634a89beb9670950e95220"
I20250831 19:54:39.211899 1453 raft_consensus.cc:3058] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:39.214838 1338 consensus_peers.cc:658] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } attempt: 5
I20250831 19:54:39.218397 1453 raft_consensus.cc:2466] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4d46bc3ef5a4fbb8c9e4349c86c54a5 in term 1.
I20250831 19:54:39.222641 1357 leader_election.cc:304] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4d46bc3ef5a4fbb8c9e4349c86c54a5, ac75f6e7a0634a89beb9670950e95220; no voters:
I20250831 19:54:39.222982 1505 raft_consensus.cc:2802] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:39.223668 1505 raft_consensus.cc:695] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 1 LEADER]: Becoming Leader. State: Replica: a4d46bc3ef5a4fbb8c9e4349c86c54a5, State: Running, Role: LEADER
I20250831 19:54:39.224232 1505 consensus_queue.cc:237] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } }
W20250831 19:54:39.226858 1362 tablet.cc:2378] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20250831 19:54:39.227838 1504 leader_election.cc:290] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 1 election: Requested vote from peers 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259), ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943)
I20250831 19:54:39.235985 1513 sys_catalog.cc:455] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a4d46bc3ef5a4fbb8c9e4349c86c54a5. Latest consensus state: current_term: 1 leader_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } } }
I20250831 19:54:39.236294 1513 sys_catalog.cc:458] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [sys.catalog]: This master's current role is: LEADER
I20250831 19:54:39.236855 1338 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3: Bootstrap starting.
I20250831 19:54:39.248660 1338 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:39.250263 1338 log.cc:826] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3: Log is configured to *not* fsync() on all Append() calls
I20250831 19:54:39.257371 1518 catalog_manager.cc:1477] Loading table and tablet metadata into memory...
I20250831 19:54:39.259891 1524 catalog_manager.cc:797] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20250831 19:54:39.260975 1338 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3: No bootstrap required, opened a new log
I20250831 19:54:39.262645 1341 master_runner.cc:186] Error getting master registration for 127.1.1.254:34259: OK, instance_id { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" instance_seqno: 1756670078094294 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20250831 19:54:39.271370 1341 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20250831 19:54:39.277899 1338 raft_consensus.cc:357] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } }
I20250831 19:54:39.278231 1338 raft_consensus.cc:383] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:39.278338 1338 raft_consensus.cc:738] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c830f6055d64a3b8a9f78b405ad8aa3, State: Initialized, Role: FOLLOWER
I20250831 19:54:39.279021 1338 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } }
I20250831 19:54:39.280436 1526 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } } }
I20250831 19:54:39.281174 1526 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [sys.catalog]: This master's current role is: FOLLOWER
I20250831 19:54:39.281519 1338 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [sys.catalog]: configured and running, proceeding with master startup.
I20250831 19:54:39.281544 1312 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3"
I20250831 19:54:39.281920 1312 raft_consensus.cc:3058] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:39.284282 1518 catalog_manager.cc:1486] Initializing Kudu cluster ID...
I20250831 19:54:39.285548 1313 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" is_pre_election: true
I20250831 19:54:39.288563 1312 raft_consensus.cc:2466] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4d46bc3ef5a4fbb8c9e4349c86c54a5 in term 1.
I20250831 19:54:39.306382 1453 raft_consensus.cc:1273] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220 [term 1 FOLLOWER]: Refusing update from remote peer a4d46bc3ef5a4fbb8c9e4349c86c54a5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250831 19:54:39.308656 1513 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:39.314713 1312 raft_consensus.cc:1273] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [term 1 FOLLOWER]: Refusing update from remote peer a4d46bc3ef5a4fbb8c9e4349c86c54a5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250831 19:54:39.321557 1513 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250831 19:54:39.333400 1292 tablet.cc:2378] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20250831 19:54:39.343403 1486 sys_catalog.cc:455] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a4d46bc3ef5a4fbb8c9e4349c86c54a5. Latest consensus state: current_term: 1 leader_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } } }
I20250831 19:54:39.343690 1486 sys_catalog.cc:458] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220 [sys.catalog]: This master's current role is: FOLLOWER
I20250831 19:54:39.346606 1528 mvcc.cc:204] Tried to move back new op lower bound from 7195320644792647680 to 7195320644508053504. Current Snapshot: MvccSnapshot[applied={T|T < 7195320644792647680}]
I20250831 19:54:39.348282 1543 mvcc.cc:204] Tried to move back new op lower bound from 7195320644792647680 to 7195320644508053504. Current Snapshot: MvccSnapshot[applied={T|T < 7195320644792647680}]
I20250831 19:54:39.350970 1518 catalog_manager.cc:1349] Generated new cluster ID: 003a9cb4df1f460dbfc9d2f57d96ced1
I20250831 19:54:39.351065 1518 catalog_manager.cc:1497] Initializing Kudu internal certificate authority...
I20250831 19:54:39.351198 1505 sys_catalog.cc:455] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } } }
I20250831 19:54:39.351395 1505 sys_catalog.cc:458] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [sys.catalog]: This master's current role is: LEADER
I20250831 19:54:39.351598 1505 sys_catalog.cc:455] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } } }
I20250831 19:54:39.351560 1526 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a4d46bc3ef5a4fbb8c9e4349c86c54a5. Latest consensus state: current_term: 1 leader_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } } }
I20250831 19:54:39.351758 1526 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [sys.catalog]: This master's current role is: FOLLOWER
I20250831 19:54:39.351778 1505 sys_catalog.cc:458] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [sys.catalog]: This master's current role is: LEADER
W20250831 19:54:39.362164 1542 catalog_manager.cc:1560] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250831 19:54:39.362288 1542 catalog_manager.cc:875] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20250831 19:54:39.368566 1486 sys_catalog.cc:455] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } } }
I20250831 19:54:39.368790 1486 sys_catalog.cc:458] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220 [sys.catalog]: This master's current role is: FOLLOWER
I20250831 19:54:39.388110 1526 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } } }
I20250831 19:54:39.388339 1526 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [sys.catalog]: This master's current role is: FOLLOWER
I20250831 19:54:39.389521 1518 catalog_manager.cc:1372] Generated new certificate authority record
I20250831 19:54:39.391062 1518 catalog_manager.cc:1506] Loading token signing keys...
I20250831 19:54:39.426126 1518 catalog_manager.cc:5955] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Generated new TSK 0
I20250831 19:54:39.427224 1518 catalog_manager.cc:1516] Initializing in-progress tserver states...
I20250831 19:54:39.428447 1518 catalog_manager.cc:1529] Loading latest processed Hive Metastore notification log event ID...
I20250831 19:54:39.429589 1518 catalog_manager.cc:5804] Last processed Hive Metastore notification event ID: -1
I20250831 19:54:39.452827 1031 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskfwTdIj/build/asan/bin/kudu
/tmp/dist-test-taskfwTdIj/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.1.193:0
--local_ip_for_outbound_sockets=127.1.1.193
--webserver_interface=127.1.1.193
--webserver_port=0
--tserver_master_addrs=127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943
--builtin_ntp_servers=127.1.1.212:44077
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
W20250831 19:54:39.778954 1552 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20250831 19:54:39.779237 1552 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20250831 19:54:39.779362 1552 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20250831 19:54:39.787365 1552 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20250831 19:54:39.787597 1552 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.1.193
I20250831 19:54:39.796985 1552 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.1.212:44077
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.1.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.1.193
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.1.193
--log_dir=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 06466b25e294b4d7d455e6c56263318dc34a80ef
build type FASTDEBUG
built by None at 31 Aug 2025 19:43:25 UTC on 24a791456cd2
build id 7836
ASAN enabled
I20250831 19:54:39.798583 1552 env_posix.cc:2264] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20250831 19:54:39.800230 1552 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250831 19:54:39.808919 1557 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250831 19:54:39.810683 1558 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250831 19:54:39.817847 1560 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250831 19:54:39.818401 1552 server_base.cc:1047] running on GCE node
I20250831 19:54:39.818943 1552 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20250831 19:54:39.820348 1552 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20250831 19:54:39.821527 1552 hybrid_clock.cc:648] HybridClock initialized: now 1756670079821471 us; error 47 us; skew 500 ppm
I20250831 19:54:39.821794 1552 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250831 19:54:39.828389 1552 webserver.cc:480] Webserver started at http://127.1.1.193:43615/ using document root <none> and password file <none>
I20250831 19:54:39.829137 1552 fs_manager.cc:362] Metadata directory not provided
I20250831 19:54:39.829233 1552 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250831 19:54:39.829617 1552 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20250831 19:54:39.831920 1552 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/data/instance:
uuid: "89aa85d59c53436ebdf3074b13d14825"
format_stamp: "Formatted at 2025-08-31 19:54:39 on dist-test-slave-v4kn"
I20250831 19:54:39.832600 1552 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/instance:
uuid: "89aa85d59c53436ebdf3074b13d14825"
format_stamp: "Formatted at 2025-08-31 19:54:39 on dist-test-slave-v4kn"
I20250831 19:54:39.837808 1552 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20250831 19:54:39.840839 1566 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250831 19:54:39.842118 1552 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20250831 19:54:39.842259 1552 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/data,/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal
uuid: "89aa85d59c53436ebdf3074b13d14825"
format_stamp: "Formatted at 2025-08-31 19:54:39 on dist-test-slave-v4kn"
I20250831 19:54:39.842435 1552 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250831 19:54:39.896426 1552 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250831 19:54:39.897357 1552 env_posix.cc:2264] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20250831 19:54:39.897675 1552 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250831 19:54:39.899262 1552 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20250831 19:54:39.900918 1552 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250831 19:54:39.901013 1552 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20250831 19:54:39.901126 1552 ts_tablet_manager.cc:610] Registered 0 tablets
I20250831 19:54:39.901211 1552 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20250831 19:54:39.942564 1552 rpc_server.cc:307] RPC server started. Bound to: 127.1.1.193:46197
I20250831 19:54:39.942615 1678 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.1.193:46197 every 8 connection(s)
I20250831 19:54:39.943847 1552 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/data/info.pb
I20250831 19:54:39.945957 1031 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskfwTdIj/build/asan/bin/kudu as pid 1552
I20250831 19:54:39.946149 1031 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/instance
I20250831 19:54:39.951830 1031 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskfwTdIj/build/asan/bin/kudu
/tmp/dist-test-taskfwTdIj/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.1.194:0
--local_ip_for_outbound_sockets=127.1.1.194
--webserver_interface=127.1.1.194
--webserver_port=0
--tserver_master_addrs=127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943
--builtin_ntp_servers=127.1.1.212:44077
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20250831 19:54:39.963789 1681 heartbeater.cc:344] Connected to a master server at 127.1.1.253:45581
I20250831 19:54:39.963825 1680 heartbeater.cc:344] Connected to a master server at 127.1.1.254:34259
I20250831 19:54:39.964214 1681 heartbeater.cc:461] Registering TS with master...
I20250831 19:54:39.964215 1680 heartbeater.cc:461] Registering TS with master...
I20250831 19:54:39.965095 1679 heartbeater.cc:344] Connected to a master server at 127.1.1.252:35943
I20250831 19:54:39.965224 1679 heartbeater.cc:461] Registering TS with master...
I20250831 19:54:39.965574 1680 heartbeater.cc:507] Master 127.1.1.254:34259 requested a full tablet report, sending...
I20250831 19:54:39.965754 1679 heartbeater.cc:507] Master 127.1.1.252:35943 requested a full tablet report, sending...
I20250831 19:54:39.965791 1681 heartbeater.cc:507] Master 127.1.1.253:45581 requested a full tablet report, sending...
I20250831 19:54:39.967604 1373 ts_manager.cc:194] Registered new tserver with Master: 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:39.967830 1443 ts_manager.cc:194] Registered new tserver with Master: 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:39.967847 1302 ts_manager.cc:194] Registered new tserver with Master: 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:39.969313 1373 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.1.1.193:59357
I20250831 19:54:39.984881 1500 catalog_manager.cc:1261] Loaded cluster ID: 003a9cb4df1f460dbfc9d2f57d96ced1
I20250831 19:54:39.984980 1500 catalog_manager.cc:1554] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220: loading cluster ID for follower catalog manager: success
I20250831 19:54:39.988198 1500 catalog_manager.cc:1576] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220: acquiring CA information for follower catalog manager: success
I20250831 19:54:39.990236 1500 catalog_manager.cc:1604] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20250831 19:54:40.258865 1689 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20250831 19:54:40.259150 1689 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20250831 19:54:40.259267 1689 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20250831 19:54:40.269199 1689 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20250831 19:54:40.269522 1689 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.1.194
I20250831 19:54:40.279600 1689 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.1.212:44077
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.1.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.1.194
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.1.194
--log_dir=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 06466b25e294b4d7d455e6c56263318dc34a80ef
build type FASTDEBUG
built by None at 31 Aug 2025 19:43:25 UTC on 24a791456cd2
build id 7836
ASAN enabled
I20250831 19:54:40.281253 1689 env_posix.cc:2264] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20250831 19:54:40.283099 1689 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250831 19:54:40.295624 1695 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250831 19:54:40.295619 1694 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250831 19:54:40.295571 1697 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250831 19:54:40.296350 1689 server_base.cc:1047] running on GCE node
I20250831 19:54:40.296862 1689 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20250831 19:54:40.297762 1689 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20250831 19:54:40.298944 1689 hybrid_clock.cc:648] HybridClock initialized: now 1756670080298896 us; error 47 us; skew 500 ppm
I20250831 19:54:40.299284 1689 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250831 19:54:40.301188 1689 webserver.cc:480] Webserver started at http://127.1.1.194:45315/ using document root <none> and password file <none>
I20250831 19:54:40.301909 1689 fs_manager.cc:362] Metadata directory not provided
I20250831 19:54:40.301987 1689 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250831 19:54:40.302239 1689 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20250831 19:54:40.304852 1689 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/data/instance:
uuid: "de831f40fa1348a48a1f0260f4130197"
format_stamp: "Formatted at 2025-08-31 19:54:40 on dist-test-slave-v4kn"
I20250831 19:54:40.305576 1689 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/instance:
uuid: "de831f40fa1348a48a1f0260f4130197"
format_stamp: "Formatted at 2025-08-31 19:54:40 on dist-test-slave-v4kn"
I20250831 19:54:40.310428 1689 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20250831 19:54:40.313398 1703 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250831 19:54:40.314587 1689 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20250831 19:54:40.314716 1689 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/data,/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal
uuid: "de831f40fa1348a48a1f0260f4130197"
format_stamp: "Formatted at 2025-08-31 19:54:40 on dist-test-slave-v4kn"
I20250831 19:54:40.314891 1689 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250831 19:54:40.326680 1708 raft_consensus.cc:491] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a4d46bc3ef5a4fbb8c9e4349c86c54a5)
I20250831 19:54:40.326858 1708 raft_consensus.cc:513] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } }
I20250831 19:54:40.328017 1708 leader_election.cc:290] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259), a4d46bc3ef5a4fbb8c9e4349c86c54a5 (127.1.1.253:45581)
I20250831 19:54:40.328516 1313 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ac75f6e7a0634a89beb9670950e95220" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" is_pre_election: true
I20250831 19:54:40.328683 1383 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ac75f6e7a0634a89beb9670950e95220" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" is_pre_election: true
I20250831 19:54:40.329411 1427 leader_election.cc:304] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac75f6e7a0634a89beb9670950e95220; no voters: 6c830f6055d64a3b8a9f78b405ad8aa3, a4d46bc3ef5a4fbb8c9e4349c86c54a5
I20250831 19:54:40.329771 1708 raft_consensus.cc:2747] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250831 19:54:40.335342 1689 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250831 19:54:40.336134 1689 env_posix.cc:2264] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20250831 19:54:40.336340 1689 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250831 19:54:40.337097 1689 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20250831 19:54:40.338505 1689 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250831 19:54:40.338582 1689 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20250831 19:54:40.338654 1689 ts_tablet_manager.cc:610] Registered 0 tablets
I20250831 19:54:40.338704 1689 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20250831 19:54:40.363996 1542 catalog_manager.cc:1261] Loaded cluster ID: 003a9cb4df1f460dbfc9d2f57d96ced1
I20250831 19:54:40.364109 1542 catalog_manager.cc:1554] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3: loading cluster ID for follower catalog manager: success
I20250831 19:54:40.367411 1542 catalog_manager.cc:1576] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3: acquiring CA information for follower catalog manager: success
I20250831 19:54:40.369473 1542 catalog_manager.cc:1604] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20250831 19:54:40.371152 1689 rpc_server.cc:307] RPC server started. Bound to: 127.1.1.194:41475
I20250831 19:54:40.371207 1816 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.1.194:41475 every 8 connection(s)
I20250831 19:54:40.372409 1689 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/data/info.pb
I20250831 19:54:40.380295 1031 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskfwTdIj/build/asan/bin/kudu as pid 1689
I20250831 19:54:40.380506 1031 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/instance
I20250831 19:54:40.387518 1031 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskfwTdIj/build/asan/bin/kudu
/tmp/dist-test-taskfwTdIj/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.1.195:0
--local_ip_for_outbound_sockets=127.1.1.195
--webserver_interface=127.1.1.195
--webserver_port=0
--tserver_master_addrs=127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943
--builtin_ntp_servers=127.1.1.212:44077
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20250831 19:54:40.388657 1819 heartbeater.cc:344] Connected to a master server at 127.1.1.253:45581
I20250831 19:54:40.388706 1817 heartbeater.cc:344] Connected to a master server at 127.1.1.252:35943
I20250831 19:54:40.389014 1817 heartbeater.cc:461] Registering TS with master...
I20250831 19:54:40.389019 1819 heartbeater.cc:461] Registering TS with master...
I20250831 19:54:40.389068 1818 heartbeater.cc:344] Connected to a master server at 127.1.1.254:34259
I20250831 19:54:40.389216 1818 heartbeater.cc:461] Registering TS with master...
I20250831 19:54:40.390177 1819 heartbeater.cc:507] Master 127.1.1.253:45581 requested a full tablet report, sending...
I20250831 19:54:40.390184 1818 heartbeater.cc:507] Master 127.1.1.254:34259 requested a full tablet report, sending...
I20250831 19:54:40.390226 1817 heartbeater.cc:507] Master 127.1.1.252:35943 requested a full tablet report, sending...
I20250831 19:54:40.391755 1443 ts_manager.cc:194] Registered new tserver with Master: de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:40.391763 1373 ts_manager.cc:194] Registered new tserver with Master: de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:40.391906 1302 ts_manager.cc:194] Registered new tserver with Master: de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:40.392760 1373 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.1.1.194:48177
I20250831 19:54:40.472083 1681 heartbeater.cc:499] Master 127.1.1.253:45581 was elected leader, sending a full tablet report...
W20250831 19:54:40.695850 1824 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20250831 19:54:40.696102 1824 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20250831 19:54:40.696177 1824 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20250831 19:54:40.703826 1824 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20250831 19:54:40.703975 1824 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.1.195
I20250831 19:54:40.713119 1824 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.1.212:44077
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.1.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.1.195
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.1.195
--log_dir=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 06466b25e294b4d7d455e6c56263318dc34a80ef
build type FASTDEBUG
built by None at 31 Aug 2025 19:43:25 UTC on 24a791456cd2
build id 7836
ASAN enabled
I20250831 19:54:40.714588 1824 env_posix.cc:2264] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20250831 19:54:40.716255 1824 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250831 19:54:40.725303 1829 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250831 19:54:40.725311 1830 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250831 19:54:40.725910 1832 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250831 19:54:40.726433 1824 server_base.cc:1047] running on GCE node
I20250831 19:54:40.726975 1824 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20250831 19:54:40.727856 1824 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20250831 19:54:40.729055 1824 hybrid_clock.cc:648] HybridClock initialized: now 1756670080729008 us; error 42 us; skew 500 ppm
I20250831 19:54:40.729352 1824 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250831 19:54:40.731264 1824 webserver.cc:480] Webserver started at http://127.1.1.195:36877/ using document root <none> and password file <none>
I20250831 19:54:40.731926 1824 fs_manager.cc:362] Metadata directory not provided
I20250831 19:54:40.731999 1824 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250831 19:54:40.732255 1824 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20250831 19:54:40.734354 1824 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/data/instance:
uuid: "2441fafe1d62429386f4631ad423567d"
format_stamp: "Formatted at 2025-08-31 19:54:40 on dist-test-slave-v4kn"
I20250831 19:54:40.735033 1824 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/instance:
uuid: "2441fafe1d62429386f4631ad423567d"
format_stamp: "Formatted at 2025-08-31 19:54:40 on dist-test-slave-v4kn"
I20250831 19:54:40.739750 1824 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20250831 19:54:40.742697 1838 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250831 19:54:40.743832 1824 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20250831 19:54:40.743975 1824 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/data,/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal
uuid: "2441fafe1d62429386f4631ad423567d"
format_stamp: "Formatted at 2025-08-31 19:54:40 on dist-test-slave-v4kn"
I20250831 19:54:40.744138 1824 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250831 19:54:40.755841 1824 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250831 19:54:40.756584 1824 env_posix.cc:2264] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20250831 19:54:40.756829 1824 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250831 19:54:40.757748 1824 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20250831 19:54:40.759259 1824 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250831 19:54:40.759347 1824 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20250831 19:54:40.759449 1824 ts_tablet_manager.cc:610] Registered 0 tablets
I20250831 19:54:40.759524 1824 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20250831 19:54:40.793099 1824 rpc_server.cc:307] RPC server started. Bound to: 127.1.1.195:43237
I20250831 19:54:40.793160 1950 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.1.195:43237 every 8 connection(s)
I20250831 19:54:40.794524 1824 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/data/info.pb
I20250831 19:54:40.804719 1031 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskfwTdIj/build/asan/bin/kudu as pid 1824
I20250831 19:54:40.804936 1031 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/instance
I20250831 19:54:40.811755 1951 heartbeater.cc:344] Connected to a master server at 127.1.1.252:35943
I20250831 19:54:40.811874 1952 heartbeater.cc:344] Connected to a master server at 127.1.1.254:34259
I20250831 19:54:40.812198 1951 heartbeater.cc:461] Registering TS with master...
I20250831 19:54:40.812350 1953 heartbeater.cc:344] Connected to a master server at 127.1.1.253:45581
I20250831 19:54:40.812475 1953 heartbeater.cc:461] Registering TS with master...
I20250831 19:54:40.812196 1952 heartbeater.cc:461] Registering TS with master...
I20250831 19:54:40.813490 1952 heartbeater.cc:507] Master 127.1.1.254:34259 requested a full tablet report, sending...
I20250831 19:54:40.813535 1951 heartbeater.cc:507] Master 127.1.1.252:35943 requested a full tablet report, sending...
I20250831 19:54:40.813563 1953 heartbeater.cc:507] Master 127.1.1.253:45581 requested a full tablet report, sending...
I20250831 19:54:40.815187 1373 ts_manager.cc:194] Registered new tserver with Master: 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237)
I20250831 19:54:40.815203 1302 ts_manager.cc:194] Registered new tserver with Master: 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237)
I20250831 19:54:40.815203 1443 ts_manager.cc:194] Registered new tserver with Master: 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237)
I20250831 19:54:40.816291 1373 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.1.1.195:40781
I20250831 19:54:40.829504 1031 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
I20250831 19:54:40.857873 1373 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41708:
name: "default.Table_8e964bae65cf414eb9661de9e7a89fbf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:40.857923 1371 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41708:
name: "default.Table_9b6f788ff1a344e389223816b5593761"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:40.858798 1372 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41708:
name: "default.Table_9f89ae10786e4a2ca85d49ff2a7b7800"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:40.858758 1369 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41708:
name: "default.Table_3691be9921f145f4a9495f2d669a5728"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:40.859365 1370 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41708:
name: "default.Table_d961171a98f341b5945cfe0300337aec"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:40.859797 1368 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41708:
name: "default.Table_c3535015c99247ec86adfa665b7bc01c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:40.860572 1367 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41708:
name: "default.Table_ae8ede59b2ad492daba0f5e783332e25"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:40.861308 1366 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41708:
name: "default.Table_5b498fbba7b34ca49b2d2706a1787053"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:40.861714 1365 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41708:
name: "default.Table_5d4cd226dc464a4f9faa6c6e65e4345c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:40.863643 1364 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41708:
name: "default.Table_2f4abeeb816647b88ebe1d9e9e09c99f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250831 19:54:40.865401 1373 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_8e964bae65cf414eb9661de9e7a89fbf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250831 19:54:40.878401 1031 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-taskfwTdIj/build/asan/bin/kudu pid 1341
I20250831 19:54:40.879803 1403 generic_service.cc:196] Checking for leaks (request via RPC)
I20250831 19:54:40.894901 1819 heartbeater.cc:499] Master 127.1.1.253:45581 was elected leader, sending a full tablet report...
I20250831 19:54:40.921552 1998 raft_consensus.cc:491] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a4d46bc3ef5a4fbb8c9e4349c86c54a5)
I20250831 19:54:40.924557 1998 raft_consensus.cc:513] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } }
I20250831 19:54:40.925657 1998 leader_election.cc:290] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259), a4d46bc3ef5a4fbb8c9e4349c86c54a5 (127.1.1.253:45581)
I20250831 19:54:40.926024 1313 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ac75f6e7a0634a89beb9670950e95220" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" is_pre_election: true
I20250831 19:54:41.026348 1383 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ac75f6e7a0634a89beb9670950e95220" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" is_pre_election: true
I20250831 19:54:41.027053 1427 leader_election.cc:304] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac75f6e7a0634a89beb9670950e95220; no voters: 6c830f6055d64a3b8a9f78b405ad8aa3, a4d46bc3ef5a4fbb8c9e4349c86c54a5
I20250831 19:54:41.027520 1998 raft_consensus.cc:2747] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250831 19:54:41.028462 1031 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskfwTdIj/build/asan/bin/kudu with pid 1341
W20250831 19:54:41.061965 1428 connection.cc:537] server connection from 127.0.0.1:51226 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20250831 19:54:41.062273 1958 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.1.1.253:45581)
W20250831 19:54:41.066794 1964 negotiation.cc:337] Failed RPC negotiation. Trace:
0831 19:54:41.063658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.1.253:45581 (local address 127.0.0.1:41714)
0831 19:54:41.065135 (+ 1477us) negotiation.cc:107] Waiting for socket to connect
0831 19:54:41.065275 (+ 140us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.1.253:45581: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":1217}
W20250831 19:54:41.067178 1819 heartbeater.cc:646] Failed to heartbeat to 127.1.1.253:45581 (0 consecutive failures): Network error: Failed to send heartbeat to master: recv got EOF from 127.1.1.253:45581 (error 108)
W20250831 19:54:41.067538 1681 heartbeater.cc:646] Failed to heartbeat to 127.1.1.253:45581 (0 consecutive failures): Network error: Failed to send heartbeat to master: recv got EOF from 127.1.1.253:45581 (error 108)
I20250831 19:54:41.173779 1999 raft_consensus.cc:491] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a4d46bc3ef5a4fbb8c9e4349c86c54a5)
I20250831 19:54:41.173981 1999 raft_consensus.cc:513] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } }
I20250831 19:54:41.175432 1999 leader_election.cc:290] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a4d46bc3ef5a4fbb8c9e4349c86c54a5 (127.1.1.253:45581), ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943)
I20250831 19:54:41.176354 1452 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac75f6e7a0634a89beb9670950e95220" is_pre_election: true
W20250831 19:54:41.177857 1287 leader_election.cc:336] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a4d46bc3ef5a4fbb8c9e4349c86c54a5 (127.1.1.253:45581): Network error: Client connection negotiation failed: client connection to 127.1.1.253:45581: connect: Connection refused (error 111)
I20250831 19:54:41.178037 1287 leader_election.cc:304] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c830f6055d64a3b8a9f78b405ad8aa3; no voters: a4d46bc3ef5a4fbb8c9e4349c86c54a5, ac75f6e7a0634a89beb9670950e95220
I20250831 19:54:41.178344 1999 raft_consensus.cc:2747] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250831 19:54:41.318181 1953 heartbeater.cc:499] Master 127.1.1.253:45581 was elected leader, sending a full tablet report...
W20250831 19:54:41.319900 1953 heartbeater.cc:646] Failed to heartbeat to 127.1.1.253:45581 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.1.1.253:45581: connect: Connection refused (error 111)
I20250831 19:54:41.529630 2003 raft_consensus.cc:491] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a4d46bc3ef5a4fbb8c9e4349c86c54a5)
I20250831 19:54:41.529781 2003 raft_consensus.cc:513] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } }
I20250831 19:54:41.530262 2003 leader_election.cc:290] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259), a4d46bc3ef5a4fbb8c9e4349c86c54a5 (127.1.1.253:45581)
I20250831 19:54:41.530716 1313 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ac75f6e7a0634a89beb9670950e95220" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" is_pre_election: true
I20250831 19:54:41.531026 1313 raft_consensus.cc:2466] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac75f6e7a0634a89beb9670950e95220 in term 1.
I20250831 19:54:41.531476 1430 leader_election.cc:304] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c830f6055d64a3b8a9f78b405ad8aa3, ac75f6e7a0634a89beb9670950e95220; no voters:
W20250831 19:54:41.531628 1427 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.1.253:45581: connect: Connection refused (error 111)
I20250831 19:54:41.531780 2003 raft_consensus.cc:2802] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20250831 19:54:41.531903 2003 raft_consensus.cc:491] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a4d46bc3ef5a4fbb8c9e4349c86c54a5)
I20250831 19:54:41.532006 2003 raft_consensus.cc:3058] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220 [term 1 FOLLOWER]: Advancing to term 2
W20250831 19:54:41.532977 1427 leader_election.cc:336] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a4d46bc3ef5a4fbb8c9e4349c86c54a5 (127.1.1.253:45581): Network error: Client connection negotiation failed: client connection to 127.1.1.253:45581: connect: Connection refused (error 111)
I20250831 19:54:41.534070 2003 raft_consensus.cc:513] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } }
I20250831 19:54:41.534521 2003 leader_election.cc:290] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220 [CANDIDATE]: Term 2 election: Requested vote from peers 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259), a4d46bc3ef5a4fbb8c9e4349c86c54a5 (127.1.1.253:45581)
I20250831 19:54:41.534871 1313 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ac75f6e7a0634a89beb9670950e95220" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3"
I20250831 19:54:41.535085 1313 raft_consensus.cc:3058] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [term 1 FOLLOWER]: Advancing to term 2
W20250831 19:54:41.535531 1427 leader_election.cc:336] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer a4d46bc3ef5a4fbb8c9e4349c86c54a5 (127.1.1.253:45581): Network error: Client connection negotiation failed: client connection to 127.1.1.253:45581: connect: Connection refused (error 111)
I20250831 19:54:41.536866 1313 raft_consensus.cc:2466] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac75f6e7a0634a89beb9670950e95220 in term 2.
I20250831 19:54:41.537190 1430 leader_election.cc:304] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c830f6055d64a3b8a9f78b405ad8aa3, ac75f6e7a0634a89beb9670950e95220; no voters: a4d46bc3ef5a4fbb8c9e4349c86c54a5
I20250831 19:54:41.537473 2003 raft_consensus.cc:2802] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220 [term 2 FOLLOWER]: Leader election won for term 2
I20250831 19:54:41.537797 2003 raft_consensus.cc:695] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220 [term 2 LEADER]: Becoming Leader. State: Replica: ac75f6e7a0634a89beb9670950e95220, State: Running, Role: LEADER
I20250831 19:54:41.538170 2003 consensus_queue.cc:237] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } }
I20250831 19:54:41.539449 2006 sys_catalog.cc:455] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ac75f6e7a0634a89beb9670950e95220. Latest consensus state: current_term: 2 leader_uuid: "ac75f6e7a0634a89beb9670950e95220" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } } }
I20250831 19:54:41.539640 2006 sys_catalog.cc:458] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220 [sys.catalog]: This master's current role is: LEADER
I20250831 19:54:41.540198 2008 catalog_manager.cc:1477] Loading table and tablet metadata into memory...
I20250831 19:54:41.541859 2008 catalog_manager.cc:1486] Initializing Kudu cluster ID...
I20250831 19:54:41.542517 2008 catalog_manager.cc:1261] Loaded cluster ID: 003a9cb4df1f460dbfc9d2f57d96ced1
I20250831 19:54:41.542598 2008 catalog_manager.cc:1497] Initializing Kudu internal certificate authority...
I20250831 19:54:41.543529 2008 catalog_manager.cc:1506] Loading token signing keys...
I20250831 19:54:41.544173 2008 catalog_manager.cc:5966] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220: Loaded TSK: 0
I20250831 19:54:41.544950 2008 catalog_manager.cc:1516] Initializing in-progress tserver states...
I20250831 19:54:41.545639 2008 catalog_manager.cc:1529] Loading latest processed Hive Metastore notification log event ID...
I20250831 19:54:41.546262 2008 catalog_manager.cc:5804] Last processed Hive Metastore notification event ID: -1
I20250831 19:54:41.561548 1442 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51254:
name: "default.Table_5d4cd226dc464a4f9faa6c6e65e4345c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:41.561646 1441 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51254:
name: "default.Table_5b498fbba7b34ca49b2d2706a1787053"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:41.562093 1437 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51254:
name: "default.Table_9b6f788ff1a344e389223816b5593761"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:41.561587 1443 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51254:
name: "default.Table_2f4abeeb816647b88ebe1d9e9e09c99f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:41.562531 1439 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51254:
name: "default.Table_9f89ae10786e4a2ca85d49ff2a7b7800"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:41.562621 1440 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51254:
name: "default.Table_ae8ede59b2ad492daba0f5e783332e25"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:41.563023 1434 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51254:
name: "default.Table_c3535015c99247ec86adfa665b7bc01c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:41.563103 1435 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51254:
name: "default.Table_3691be9921f145f4a9495f2d669a5728"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:41.563663 1436 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51254:
name: "default.Table_d961171a98f341b5945cfe0300337aec"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:41.563685 1438 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51254:
name: "default.Table_8e964bae65cf414eb9661de9e7a89fbf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:41.571599 1313 raft_consensus.cc:1273] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [term 2 FOLLOWER]: Refusing update from remote peer ac75f6e7a0634a89beb9670950e95220: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 6. (index mismatch)
I20250831 19:54:41.572131 2006 consensus_queue.cc:1035] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20250831 19:54:41.572345 1427 consensus_peers.cc:489] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220 -> Peer a4d46bc3ef5a4fbb8c9e4349c86c54a5 (127.1.1.253:45581): Couldn't send request to peer a4d46bc3ef5a4fbb8c9e4349c86c54a5. Status: Network error: Client connection negotiation failed: client connection to 127.1.1.253:45581: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250831 19:54:41.574257 1999 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ac75f6e7a0634a89beb9670950e95220. Latest consensus state: current_term: 2 leader_uuid: "ac75f6e7a0634a89beb9670950e95220" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } } }
I20250831 19:54:41.574435 1999 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [sys.catalog]: This master's current role is: FOLLOWER
I20250831 19:54:41.575577 2006 sys_catalog.cc:455] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "ac75f6e7a0634a89beb9670950e95220" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } } }
I20250831 19:54:41.575789 2006 sys_catalog.cc:458] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220 [sys.catalog]: This master's current role is: LEADER
I20250831 19:54:41.575793 2012 mvcc.cc:204] Tried to move back new op lower bound from 7195320654111637504 to 7195320653983125504. Current Snapshot: MvccSnapshot[applied={T|T < 7195320654111637504}]
I20250831 19:54:41.576398 1999 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "ac75f6e7a0634a89beb9670950e95220" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } } }
I20250831 19:54:41.576581 1999 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [sys.catalog]: This master's current role is: FOLLOWER
W20250831 19:54:41.577270 1437 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_9b6f788ff1a344e389223816b5593761 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250831 19:54:41.578986 1441 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_5b498fbba7b34ca49b2d2706a1787053 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250831 19:54:41.579814 1442 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_5d4cd226dc464a4f9faa6c6e65e4345c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250831 19:54:41.620265 1437 catalog_manager.cc:2149] created HMS catalog entry for table [id=bd456415108d49989ef0bc2af91eb2f0]
I20250831 19:54:41.634721 1437 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51254:
table { table_name: "default.Table_9b6f788ff1a344e389223816b5593761" } new_table_name: "default.Table_ca86d7dcbfdc477da58b5308247443e7" modify_external_catalogs: true
I20250831 19:54:41.670596 1441 catalog_manager.cc:2149] created HMS catalog entry for table [id=42fb4ac1f28146339375e6c29735ed44]
I20250831 19:54:41.681200 1752 tablet_service.cc:1468] Processing CreateTablet for tablet 74a45437c2974edf9ba8d9f3aa8a7434 (DEFAULT_TABLE table=default.table_9b6f788ff1a344e389223816b5593761 [id=bd456415108d49989ef0bc2af91eb2f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:41.683512 1441 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51254:
table { table_name: "default.Table_5b498fbba7b34ca49b2d2706a1787053" } new_table_name: "default.Table_cc2bfcade74f4778bfa8e873869aba43" modify_external_catalogs: true
I20250831 19:54:41.682785 1752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74a45437c2974edf9ba8d9f3aa8a7434. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:41.689496 1751 tablet_service.cc:1468] Processing CreateTablet for tablet 7ef711d0a4334824b216c1cd58a22a90 (DEFAULT_TABLE table=default.table_5b498fbba7b34ca49b2d2706a1787053 [id=42fb4ac1f28146339375e6c29735ed44]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:41.690004 1751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ef711d0a4334824b216c1cd58a22a90. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:41.692096 1614 tablet_service.cc:1468] Processing CreateTablet for tablet 74a45437c2974edf9ba8d9f3aa8a7434 (DEFAULT_TABLE table=default.table_9b6f788ff1a344e389223816b5593761 [id=bd456415108d49989ef0bc2af91eb2f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:41.693456 1614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74a45437c2974edf9ba8d9f3aa8a7434. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:41.702207 1613 tablet_service.cc:1468] Processing CreateTablet for tablet 7ef711d0a4334824b216c1cd58a22a90 (DEFAULT_TABLE table=default.table_5b498fbba7b34ca49b2d2706a1787053 [id=42fb4ac1f28146339375e6c29735ed44]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:41.702677 1613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ef711d0a4334824b216c1cd58a22a90. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:41.705066 2022 tablet_bootstrap.cc:492] T 7ef711d0a4334824b216c1cd58a22a90 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:41.708716 2022 tablet_bootstrap.cc:654] T 7ef711d0a4334824b216c1cd58a22a90 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:41.710736 2023 tablet_bootstrap.cc:492] T 74a45437c2974edf9ba8d9f3aa8a7434 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:41.713565 1442 catalog_manager.cc:2149] created HMS catalog entry for table [id=1137b2754d104964bbe5bbaa4a0578b8]
I20250831 19:54:41.717934 2023 tablet_bootstrap.cc:654] T 74a45437c2974edf9ba8d9f3aa8a7434 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:41.719861 2023 log.cc:826] T 74a45437c2974edf9ba8d9f3aa8a7434 P 89aa85d59c53436ebdf3074b13d14825: Log is configured to *not* fsync() on all Append() calls
I20250831 19:54:41.726294 1442 master_service.cc:948] ReplaceTablet: received request to replace tablet 74a45437c2974edf9ba8d9f3aa8a7434 from {username='slave'} at 127.0.0.1:51254
W20250831 19:54:41.727509 1443 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_2f4abeeb816647b88ebe1d9e9e09c99f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250831 19:54:41.727598 2022 log.cc:826] T 7ef711d0a4334824b216c1cd58a22a90 P de831f40fa1348a48a1f0260f4130197: Log is configured to *not* fsync() on all Append() calls
I20250831 19:54:41.728430 2023 tablet_bootstrap.cc:492] T 74a45437c2974edf9ba8d9f3aa8a7434 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
W20250831 19:54:41.728474 1439 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_9f89ae10786e4a2ca85d49ff2a7b7800 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250831 19:54:41.728761 2023 ts_tablet_manager.cc:1397] T 74a45437c2974edf9ba8d9f3aa8a7434 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.018s user 0.005s sys 0.005s
W20250831 19:54:41.729367 1440 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_ae8ede59b2ad492daba0f5e783332e25 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250831 19:54:41.730294 1434 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_c3535015c99247ec86adfa665b7bc01c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250831 19:54:41.731232 1435 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_3691be9921f145f4a9495f2d669a5728 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250831 19:54:41.731453 1752 tablet_service.cc:1468] Processing CreateTablet for tablet e6bd41bdbeab4442b2f01f3b074ea0bf (DEFAULT_TABLE table=default.table_5d4cd226dc464a4f9faa6c6e65e4345c [id=1137b2754d104964bbe5bbaa4a0578b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:41.731823 1752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6bd41bdbeab4442b2f01f3b074ea0bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:41.732559 1614 tablet_service.cc:1468] Processing CreateTablet for tablet e6bd41bdbeab4442b2f01f3b074ea0bf (DEFAULT_TABLE table=default.table_5d4cd226dc464a4f9faa6c6e65e4345c [id=1137b2754d104964bbe5bbaa4a0578b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:41.732940 1614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6bd41bdbeab4442b2f01f3b074ea0bf. 1 dirs total, 0 dirs full, 0 dirs failed
W20250831 19:54:41.732545 1438 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_8e964bae65cf414eb9661de9e7a89fbf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250831 19:54:41.738337 1436 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_d961171a98f341b5945cfe0300337aec in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250831 19:54:41.743193 2023 raft_consensus.cc:357] T 74a45437c2974edf9ba8d9f3aa8a7434 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:41.745388 2022 tablet_bootstrap.cc:492] T 7ef711d0a4334824b216c1cd58a22a90 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:41.745760 2022 ts_tablet_manager.cc:1397] T 7ef711d0a4334824b216c1cd58a22a90 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.041s user 0.014s sys 0.000s
I20250831 19:54:41.747681 1442 catalog_manager.cc:5869] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220: Sending DeleteTablet for 3 replicas of tablet 74a45437c2974edf9ba8d9f3aa8a7434
I20250831 19:54:41.748366 1442 catalog_manager.cc:6652] ReplaceTablet: tablet 74a45437c2974edf9ba8d9f3aa8a7434 deleted and replaced by tablet 87385809a6b648149025f41da6cc5070
I20250831 19:54:41.748706 1442 master_service.cc:948] ReplaceTablet: received request to replace tablet 7ef711d0a4334824b216c1cd58a22a90 from {username='slave'} at 127.0.0.1:51254
I20250831 19:54:41.751209 1752 tablet_service.cc:1515] Processing DeleteTablet for tablet 74a45437c2974edf9ba8d9f3aa8a7434 with delete_type TABLET_DATA_DELETED (replaced by tablet 87385809a6b648149025f41da6cc5070) from {username='slave'} at 127.0.0.1:50662
I20250831 19:54:41.752031 1883 tablet_service.cc:1515] Processing DeleteTablet for tablet 74a45437c2974edf9ba8d9f3aa8a7434 with delete_type TABLET_DATA_DELETED (replaced by tablet 87385809a6b648149025f41da6cc5070) from {username='slave'} at 127.0.0.1:45900
I20250831 19:54:41.752772 1886 tablet_service.cc:1468] Processing CreateTablet for tablet 74a45437c2974edf9ba8d9f3aa8a7434 (DEFAULT_TABLE table=default.table_9b6f788ff1a344e389223816b5593761 [id=bd456415108d49989ef0bc2af91eb2f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:41.755275 1886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74a45437c2974edf9ba8d9f3aa8a7434. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:41.753929 1885 tablet_service.cc:1468] Processing CreateTablet for tablet 7ef711d0a4334824b216c1cd58a22a90 (DEFAULT_TABLE table=default.table_5b498fbba7b34ca49b2d2706a1787053 [id=42fb4ac1f28146339375e6c29735ed44]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:41.753647 1884 tablet_service.cc:1468] Processing CreateTablet for tablet e6bd41bdbeab4442b2f01f3b074ea0bf (DEFAULT_TABLE table=default.table_5d4cd226dc464a4f9faa6c6e65e4345c [id=1137b2754d104964bbe5bbaa4a0578b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:41.756664 1884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6bd41bdbeab4442b2f01f3b074ea0bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:41.756901 1885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ef711d0a4334824b216c1cd58a22a90. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:41.751953 1614 tablet_service.cc:1515] Processing DeleteTablet for tablet 74a45437c2974edf9ba8d9f3aa8a7434 with delete_type TABLET_DATA_DELETED (replaced by tablet 87385809a6b648149025f41da6cc5070) from {username='slave'} at 127.0.0.1:51018
I20250831 19:54:41.770550 2023 raft_consensus.cc:383] T 74a45437c2974edf9ba8d9f3aa8a7434 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:41.770714 2023 raft_consensus.cc:738] T 74a45437c2974edf9ba8d9f3aa8a7434 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:41.773940 2023 consensus_queue.cc:260] T 74a45437c2974edf9ba8d9f3aa8a7434 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:41.776336 1443 catalog_manager.cc:2149] created HMS catalog entry for table [id=6063834030bb409d8ee666a753351551]
W20250831 19:54:41.789199 1428 catalog_manager.cc:4895] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): delete failed for tablet 74a45437c2974edf9ba8d9f3aa8a7434 because the tablet was not found. No further retry: Not found: Tablet not found: 74a45437c2974edf9ba8d9f3aa8a7434
I20250831 19:54:41.792877 2022 raft_consensus.cc:357] T 7ef711d0a4334824b216c1cd58a22a90 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:41.793349 2022 raft_consensus.cc:383] T 7ef711d0a4334824b216c1cd58a22a90 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:41.793501 2022 raft_consensus.cc:738] T 7ef711d0a4334824b216c1cd58a22a90 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:41.794277 2022 consensus_queue.cc:260] T 7ef711d0a4334824b216c1cd58a22a90 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:41.796455 2032 tablet_bootstrap.cc:492] T 7ef711d0a4334824b216c1cd58a22a90 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
W20250831 19:54:41.799511 1429 catalog_manager.cc:4908] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): delete failed for tablet 74a45437c2974edf9ba8d9f3aa8a7434 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 74a45437c2974edf9ba8d9f3aa8a7434 already in progress: creating tablet
I20250831 19:54:41.802779 2023 ts_tablet_manager.cc:1428] T 74a45437c2974edf9ba8d9f3aa8a7434 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.074s user 0.011s sys 0.004s
W20250831 19:54:41.803603 1430 catalog_manager.cc:4908] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): delete failed for tablet 74a45437c2974edf9ba8d9f3aa8a7434 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 74a45437c2974edf9ba8d9f3aa8a7434 already in progress: creating tablet
I20250831 19:54:41.806872 2032 tablet_bootstrap.cc:654] T 7ef711d0a4334824b216c1cd58a22a90 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:41.807699 2023 tablet_bootstrap.cc:492] T 7ef711d0a4334824b216c1cd58a22a90 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:41.808205 2032 log.cc:826] T 7ef711d0a4334824b216c1cd58a22a90 P 2441fafe1d62429386f4631ad423567d: Log is configured to *not* fsync() on all Append() calls
I20250831 19:54:41.809351 2023 tablet_bootstrap.cc:654] T 7ef711d0a4334824b216c1cd58a22a90 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:41.820293 2032 tablet_bootstrap.cc:492] T 7ef711d0a4334824b216c1cd58a22a90 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:41.820648 2032 ts_tablet_manager.cc:1397] T 7ef711d0a4334824b216c1cd58a22a90 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.024s user 0.008s sys 0.000s
I20250831 19:54:41.823046 1614 tablet_service.cc:1515] Processing DeleteTablet for tablet 74a45437c2974edf9ba8d9f3aa8a7434 with delete_type TABLET_DATA_DELETED (replaced by tablet 87385809a6b648149025f41da6cc5070) from {username='slave'} at 127.0.0.1:51018
I20250831 19:54:41.823387 2030 tablet_replica.cc:331] T 74a45437c2974edf9ba8d9f3aa8a7434 P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:54:41.823782 2030 raft_consensus.cc:2241] T 74a45437c2974edf9ba8d9f3aa8a7434 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:41.824126 2030 raft_consensus.cc:2270] T 74a45437c2974edf9ba8d9f3aa8a7434 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:41.824985 1679 heartbeater.cc:499] Master 127.1.1.252:35943 was elected leader, sending a full tablet report...
I20250831 19:54:41.825968 2030 ts_tablet_manager.cc:1905] T 74a45437c2974edf9ba8d9f3aa8a7434 P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:41.827536 2032 raft_consensus.cc:357] T 7ef711d0a4334824b216c1cd58a22a90 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:41.827863 2032 raft_consensus.cc:383] T 7ef711d0a4334824b216c1cd58a22a90 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:41.827965 2032 raft_consensus.cc:738] T 7ef711d0a4334824b216c1cd58a22a90 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:41.828538 2032 consensus_queue.cc:260] T 7ef711d0a4334824b216c1cd58a22a90 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:41.832873 2030 ts_tablet_manager.cc:1918] T 74a45437c2974edf9ba8d9f3aa8a7434 P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250831 19:54:41.833046 2030 log.cc:1199] T 74a45437c2974edf9ba8d9f3aa8a7434 P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/74a45437c2974edf9ba8d9f3aa8a7434
I20250831 19:54:41.833448 2030 ts_tablet_manager.cc:1939] T 74a45437c2974edf9ba8d9f3aa8a7434 P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
I20250831 19:54:41.834863 1429 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet 74a45437c2974edf9ba8d9f3aa8a7434 (table default.table_9b6f788ff1a344e389223816b5593761 [id=bd456415108d49989ef0bc2af91eb2f0]) successfully deleted
I20250831 19:54:41.835840 1442 catalog_manager.cc:5869] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220: Sending DeleteTablet for 3 replicas of tablet 7ef711d0a4334824b216c1cd58a22a90
I20250831 19:54:41.836344 1442 catalog_manager.cc:6652] ReplaceTablet: tablet 7ef711d0a4334824b216c1cd58a22a90 deleted and replaced by tablet a53bd61ca20a4e879c22f22852749324
I20250831 19:54:41.836567 1442 master_service.cc:948] ReplaceTablet: received request to replace tablet 7ef711d0a4334824b216c1cd58a22a90 from {username='slave'} at 127.0.0.1:51254
I20250831 19:54:41.837034 2023 tablet_bootstrap.cc:492] T 7ef711d0a4334824b216c1cd58a22a90 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:41.837154 1885 tablet_service.cc:1515] Processing DeleteTablet for tablet 7ef711d0a4334824b216c1cd58a22a90 with delete_type TABLET_DATA_DELETED (replaced by tablet a53bd61ca20a4e879c22f22852749324) from {username='slave'} at 127.0.0.1:45900
I20250831 19:54:41.837232 2023 ts_tablet_manager.cc:1397] T 7ef711d0a4334824b216c1cd58a22a90 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.030s user 0.010s sys 0.015s
W20250831 19:54:41.837846 1428 catalog_manager.cc:4908] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): delete failed for tablet 7ef711d0a4334824b216c1cd58a22a90 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7ef711d0a4334824b216c1cd58a22a90 already in progress: creating tablet
I20250831 19:54:41.838248 2023 raft_consensus.cc:357] T 7ef711d0a4334824b216c1cd58a22a90 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:41.838435 2023 raft_consensus.cc:383] T 7ef711d0a4334824b216c1cd58a22a90 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:41.838500 2023 raft_consensus.cc:738] T 7ef711d0a4334824b216c1cd58a22a90 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:41.838810 1752 tablet_service.cc:1515] Processing DeleteTablet for tablet 7ef711d0a4334824b216c1cd58a22a90 with delete_type TABLET_DATA_DELETED (replaced by tablet a53bd61ca20a4e879c22f22852749324) from {username='slave'} at 127.0.0.1:50662
I20250831 19:54:41.838779 2023 consensus_queue.cc:260] T 7ef711d0a4334824b216c1cd58a22a90 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:41.839176 2023 ts_tablet_manager.cc:1428] T 7ef711d0a4334824b216c1cd58a22a90 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20250831 19:54:41.839491 2023 tablet_bootstrap.cc:492] T e6bd41bdbeab4442b2f01f3b074ea0bf P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
W20250831 19:54:41.839872 1430 catalog_manager.cc:4908] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): delete failed for tablet 7ef711d0a4334824b216c1cd58a22a90 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7ef711d0a4334824b216c1cd58a22a90 already in progress: creating tablet
I20250831 19:54:41.840133 1614 tablet_service.cc:1515] Processing DeleteTablet for tablet 7ef711d0a4334824b216c1cd58a22a90 with delete_type TABLET_DATA_DELETED (replaced by tablet a53bd61ca20a4e879c22f22852749324) from {username='slave'} at 127.0.0.1:51018
I20250831 19:54:41.841048 2023 tablet_bootstrap.cc:654] T e6bd41bdbeab4442b2f01f3b074ea0bf P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:41.843219 2032 ts_tablet_manager.cc:1428] T 7ef711d0a4334824b216c1cd58a22a90 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.022s user 0.009s sys 0.000s
I20250831 19:54:41.843220 2022 ts_tablet_manager.cc:1428] T 7ef711d0a4334824b216c1cd58a22a90 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.097s user 0.014s sys 0.016s
I20250831 19:54:41.844985 2022 tablet_bootstrap.cc:492] T 74a45437c2974edf9ba8d9f3aa8a7434 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:41.846632 2022 tablet_bootstrap.cc:654] T 74a45437c2974edf9ba8d9f3aa8a7434 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:41.848201 2030 tablet_replica.cc:331] T 7ef711d0a4334824b216c1cd58a22a90 P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:54:41.848516 2032 tablet_bootstrap.cc:492] T e6bd41bdbeab4442b2f01f3b074ea0bf P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:41.848836 1752 tablet_service.cc:1468] Processing CreateTablet for tablet 87385809a6b648149025f41da6cc5070 (DEFAULT_TABLE table=default.table_9b6f788ff1a344e389223816b5593761 [id=bd456415108d49989ef0bc2af91eb2f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:41.849216 1752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87385809a6b648149025f41da6cc5070. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:41.850100 2032 tablet_bootstrap.cc:654] T e6bd41bdbeab4442b2f01f3b074ea0bf P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:41.853961 1885 tablet_service.cc:1468] Processing CreateTablet for tablet 87385809a6b648149025f41da6cc5070 (DEFAULT_TABLE table=default.table_9b6f788ff1a344e389223816b5593761 [id=bd456415108d49989ef0bc2af91eb2f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:41.854319 1885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87385809a6b648149025f41da6cc5070. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:41.857220 1442 master_service.cc:948] ReplaceTablet: received request to replace tablet 74a45437c2974edf9ba8d9f3aa8a7434 from {username='slave'} at 127.0.0.1:51254
I20250831 19:54:41.858105 1817 heartbeater.cc:499] Master 127.1.1.252:35943 was elected leader, sending a full tablet report...
I20250831 19:54:41.860520 1751 tablet_service.cc:1515] Processing DeleteTablet for tablet 7ef711d0a4334824b216c1cd58a22a90 with delete_type TABLET_DATA_DELETED (replaced by tablet a53bd61ca20a4e879c22f22852749324) from {username='slave'} at 127.0.0.1:50662
I20250831 19:54:41.860970 2028 tablet_replica.cc:331] T 7ef711d0a4334824b216c1cd58a22a90 P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:54:41.861531 2028 raft_consensus.cc:2241] T 7ef711d0a4334824b216c1cd58a22a90 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:41.861985 2028 raft_consensus.cc:2270] T 7ef711d0a4334824b216c1cd58a22a90 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:41.858304 1614 tablet_service.cc:1468] Processing CreateTablet for tablet 87385809a6b648149025f41da6cc5070 (DEFAULT_TABLE table=default.table_9b6f788ff1a344e389223816b5593761 [id=bd456415108d49989ef0bc2af91eb2f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:41.863363 1614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87385809a6b648149025f41da6cc5070. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:41.865653 2028 ts_tablet_manager.cc:1905] T 7ef711d0a4334824b216c1cd58a22a90 P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:41.862865 2023 tablet_bootstrap.cc:492] T e6bd41bdbeab4442b2f01f3b074ea0bf P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:41.868870 2023 ts_tablet_manager.cc:1397] T e6bd41bdbeab4442b2f01f3b074ea0bf P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.029s user 0.003s sys 0.000s
I20250831 19:54:41.869751 2023 raft_consensus.cc:357] T e6bd41bdbeab4442b2f01f3b074ea0bf P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:41.869920 2023 raft_consensus.cc:383] T e6bd41bdbeab4442b2f01f3b074ea0bf P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:41.870026 2023 raft_consensus.cc:738] T e6bd41bdbeab4442b2f01f3b074ea0bf P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:41.870261 2023 consensus_queue.cc:260] T e6bd41bdbeab4442b2f01f3b074ea0bf P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:41.870927 2023 ts_tablet_manager.cc:1428] T e6bd41bdbeab4442b2f01f3b074ea0bf P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250831 19:54:41.871172 2023 tablet_bootstrap.cc:492] T 87385809a6b648149025f41da6cc5070 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:41.872831 1443 master_service.cc:948] ReplaceTablet: received request to replace tablet 74a45437c2974edf9ba8d9f3aa8a7434 from {username='slave'} at 127.0.0.1:51254
I20250831 19:54:41.872941 2023 tablet_bootstrap.cc:654] T 87385809a6b648149025f41da6cc5070 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:41.874063 2030 raft_consensus.cc:2241] T 7ef711d0a4334824b216c1cd58a22a90 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:41.874254 2030 raft_consensus.cc:2270] T 7ef711d0a4334824b216c1cd58a22a90 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:41.875778 1031 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskfwTdIj/build/asan/bin/kudu
/tmp/dist-test-taskfwTdIj/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.1.253:45581
--webserver_interface=127.1.1.253
--webserver_port=43003
--builtin_ntp_servers=127.1.1.212:44077
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943
--hive_metastore_uris=thrift://127.0.0.1:46163
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20250831 19:54:41.876709 1613 tablet_service.cc:1515] Processing DeleteTablet for tablet 74a45437c2974edf9ba8d9f3aa8a7434 with delete_type TABLET_DATA_DELETED (replaced by tablet 87385809a6b648149025f41da6cc5070) from {username='slave'} at 127.0.0.1:51018
I20250831 19:54:41.876758 1614 tablet_service.cc:1468] Processing CreateTablet for tablet 8262f1d1898840c2822feda5279542bd (DEFAULT_TABLE table=default.table_2f4abeeb816647b88ebe1d9e9e09c99f [id=6063834030bb409d8ee666a753351551]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:41.877089 1614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8262f1d1898840c2822feda5279542bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:41.873312 1443 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51254:
table { table_name: "default.Table_5d4cd226dc464a4f9faa6c6e65e4345c" } new_table_name: "default.Table_9ad6a372f33845d4a9d69bd4b6a04c08" modify_external_catalogs: true
I20250831 19:54:41.880213 1751 tablet_service.cc:1515] Processing DeleteTablet for tablet 74a45437c2974edf9ba8d9f3aa8a7434 with delete_type TABLET_DATA_DELETED (replaced by tablet 87385809a6b648149025f41da6cc5070) from {username='slave'} at 127.0.0.1:50662
I20250831 19:54:41.882107 1884 tablet_service.cc:1468] Processing CreateTablet for tablet a53bd61ca20a4e879c22f22852749324 (DEFAULT_TABLE table=default.table_5b498fbba7b34ca49b2d2706a1787053 [id=42fb4ac1f28146339375e6c29735ed44]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:41.882302 1613 tablet_service.cc:1468] Processing CreateTablet for tablet a53bd61ca20a4e879c22f22852749324 (DEFAULT_TABLE table=default.table_5b498fbba7b34ca49b2d2706a1787053 [id=42fb4ac1f28146339375e6c29735ed44]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:41.882525 1884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a53bd61ca20a4e879c22f22852749324. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:41.882589 1613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a53bd61ca20a4e879c22f22852749324. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:41.885825 2030 ts_tablet_manager.cc:1905] T 7ef711d0a4334824b216c1cd58a22a90 P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:41.886353 1751 tablet_service.cc:1468] Processing CreateTablet for tablet a53bd61ca20a4e879c22f22852749324 (DEFAULT_TABLE table=default.table_5b498fbba7b34ca49b2d2706a1787053 [id=42fb4ac1f28146339375e6c29735ed44]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:41.888899 1951 heartbeater.cc:499] Master 127.1.1.252:35943 was elected leader, sending a full tablet report...
I20250831 19:54:41.894039 1442 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51254:
table { table_name: "default.Table_2f4abeeb816647b88ebe1d9e9e09c99f" } new_table_name: "default.Table_f2750ddd8ef049ef8bca6b19ca6b68a6" modify_external_catalogs: true
I20250831 19:54:41.894273 1886 tablet_service.cc:1515] Processing DeleteTablet for tablet 7ef711d0a4334824b216c1cd58a22a90 with delete_type TABLET_DATA_DELETED (replaced by tablet a53bd61ca20a4e879c22f22852749324) from {username='slave'} at 127.0.0.1:45900
I20250831 19:54:41.894379 1884 tablet_service.cc:1515] Processing DeleteTablet for tablet 74a45437c2974edf9ba8d9f3aa8a7434 with delete_type TABLET_DATA_DELETED (replaced by tablet 87385809a6b648149025f41da6cc5070) from {username='slave'} at 127.0.0.1:45900
I20250831 19:54:41.894580 2029 tablet_replica.cc:331] T 7ef711d0a4334824b216c1cd58a22a90 P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:54:41.894665 1751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a53bd61ca20a4e879c22f22852749324. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:41.895087 2029 raft_consensus.cc:2241] T 7ef711d0a4334824b216c1cd58a22a90 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:41.895467 2029 raft_consensus.cc:2270] T 7ef711d0a4334824b216c1cd58a22a90 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:41.895893 1752 tablet_service.cc:1468] Processing CreateTablet for tablet 8262f1d1898840c2822feda5279542bd (DEFAULT_TABLE table=default.table_2f4abeeb816647b88ebe1d9e9e09c99f [id=6063834030bb409d8ee666a753351551]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:41.897059 2029 ts_tablet_manager.cc:1905] T 7ef711d0a4334824b216c1cd58a22a90 P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:41.897011 1885 tablet_service.cc:1468] Processing CreateTablet for tablet 8262f1d1898840c2822feda5279542bd (DEFAULT_TABLE table=default.table_2f4abeeb816647b88ebe1d9e9e09c99f [id=6063834030bb409d8ee666a753351551]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:41.897334 1752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8262f1d1898840c2822feda5279542bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:41.897621 1885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8262f1d1898840c2822feda5279542bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:41.902858 2028 ts_tablet_manager.cc:1918] T 7ef711d0a4334824b216c1cd58a22a90 P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250831 19:54:41.903167 2028 log.cc:1199] T 7ef711d0a4334824b216c1cd58a22a90 P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/7ef711d0a4334824b216c1cd58a22a90
I20250831 19:54:41.903276 2029 ts_tablet_manager.cc:1918] T 7ef711d0a4334824b216c1cd58a22a90 P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250831 19:54:41.903421 2029 log.cc:1199] T 7ef711d0a4334824b216c1cd58a22a90 P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/7ef711d0a4334824b216c1cd58a22a90
I20250831 19:54:41.903774 2029 ts_tablet_manager.cc:1939] T 7ef711d0a4334824b216c1cd58a22a90 P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:54:41.903795 2028 ts_tablet_manager.cc:1939] T 7ef711d0a4334824b216c1cd58a22a90 P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
I20250831 19:54:41.903842 2022 tablet_bootstrap.cc:492] T 74a45437c2974edf9ba8d9f3aa8a7434 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:41.905328 1428 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet 7ef711d0a4334824b216c1cd58a22a90 (table default.table_5b498fbba7b34ca49b2d2706a1787053 [id=42fb4ac1f28146339375e6c29735ed44]) successfully deleted
I20250831 19:54:41.905328 1430 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet 7ef711d0a4334824b216c1cd58a22a90 (table default.table_5b498fbba7b34ca49b2d2706a1787053 [id=42fb4ac1f28146339375e6c29735ed44]) successfully deleted
I20250831 19:54:41.905750 2022 ts_tablet_manager.cc:1397] T 74a45437c2974edf9ba8d9f3aa8a7434 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.061s user 0.010s sys 0.007s
I20250831 19:54:41.906522 2022 raft_consensus.cc:357] T 74a45437c2974edf9ba8d9f3aa8a7434 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:41.906783 2022 raft_consensus.cc:383] T 74a45437c2974edf9ba8d9f3aa8a7434 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:41.906920 2022 raft_consensus.cc:738] T 74a45437c2974edf9ba8d9f3aa8a7434 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:41.907194 2022 consensus_queue.cc:260] T 74a45437c2974edf9ba8d9f3aa8a7434 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:41.907837 2022 ts_tablet_manager.cc:1428] T 74a45437c2974edf9ba8d9f3aa8a7434 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
W20250831 19:54:41.908391 1430 catalog_manager.cc:4908] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): delete failed for tablet 74a45437c2974edf9ba8d9f3aa8a7434 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 74a45437c2974edf9ba8d9f3aa8a7434 already in progress: creating tablet
I20250831 19:54:41.909466 2022 tablet_bootstrap.cc:492] T e6bd41bdbeab4442b2f01f3b074ea0bf P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:41.911932 2030 ts_tablet_manager.cc:1918] T 7ef711d0a4334824b216c1cd58a22a90 P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250831 19:54:41.913559 2022 tablet_bootstrap.cc:654] T e6bd41bdbeab4442b2f01f3b074ea0bf P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:41.914553 2032 tablet_bootstrap.cc:492] T e6bd41bdbeab4442b2f01f3b074ea0bf P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:41.914767 2032 ts_tablet_manager.cc:1397] T e6bd41bdbeab4442b2f01f3b074ea0bf P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.066s user 0.000s sys 0.017s
W20250831 19:54:41.915155 1428 catalog_manager.cc:4908] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): delete failed for tablet 74a45437c2974edf9ba8d9f3aa8a7434 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 74a45437c2974edf9ba8d9f3aa8a7434 already in progress: creating tablet
I20250831 19:54:41.915786 2032 raft_consensus.cc:357] T e6bd41bdbeab4442b2f01f3b074ea0bf P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:41.916033 2032 raft_consensus.cc:383] T e6bd41bdbeab4442b2f01f3b074ea0bf P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:41.916136 2032 raft_consensus.cc:738] T e6bd41bdbeab4442b2f01f3b074ea0bf P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:41.916422 2032 consensus_queue.cc:260] T e6bd41bdbeab4442b2f01f3b074ea0bf P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:41.916875 2032 ts_tablet_manager.cc:1428] T e6bd41bdbeab4442b2f01f3b074ea0bf P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20250831 19:54:41.917929 2032 tablet_bootstrap.cc:492] T 74a45437c2974edf9ba8d9f3aa8a7434 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:41.920584 2032 tablet_bootstrap.cc:654] T 74a45437c2974edf9ba8d9f3aa8a7434 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:41.921532 2030 log.cc:1199] T 7ef711d0a4334824b216c1cd58a22a90 P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/7ef711d0a4334824b216c1cd58a22a90
I20250831 19:54:41.922042 2030 ts_tablet_manager.cc:1939] T 7ef711d0a4334824b216c1cd58a22a90 P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
I20250831 19:54:41.923408 1429 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet 7ef711d0a4334824b216c1cd58a22a90 (table default.table_5b498fbba7b34ca49b2d2706a1787053 [id=42fb4ac1f28146339375e6c29735ed44]) successfully deleted
W20250831 19:54:41.925778 1429 catalog_manager.cc:4895] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): delete failed for tablet 74a45437c2974edf9ba8d9f3aa8a7434 because the tablet was not found. No further retry: Not found: Tablet not found: 74a45437c2974edf9ba8d9f3aa8a7434
I20250831 19:54:41.932497 2023 tablet_bootstrap.cc:492] T 87385809a6b648149025f41da6cc5070 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:41.932716 2023 ts_tablet_manager.cc:1397] T 87385809a6b648149025f41da6cc5070 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.062s user 0.020s sys 0.016s
I20250831 19:54:41.933465 2032 tablet_bootstrap.cc:492] T 74a45437c2974edf9ba8d9f3aa8a7434 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:41.933475 2023 raft_consensus.cc:357] T 87385809a6b648149025f41da6cc5070 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:41.933669 2023 raft_consensus.cc:383] T 87385809a6b648149025f41da6cc5070 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:41.933737 2023 raft_consensus.cc:738] T 87385809a6b648149025f41da6cc5070 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:41.933854 2032 ts_tablet_manager.cc:1397] T 74a45437c2974edf9ba8d9f3aa8a7434 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.016s user 0.000s sys 0.007s
I20250831 19:54:41.933981 2023 consensus_queue.cc:260] T 87385809a6b648149025f41da6cc5070 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:41.934996 2032 raft_consensus.cc:357] T 74a45437c2974edf9ba8d9f3aa8a7434 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:41.935143 2023 ts_tablet_manager.cc:1428] T 87385809a6b648149025f41da6cc5070 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250831 19:54:41.935236 2032 raft_consensus.cc:383] T 74a45437c2974edf9ba8d9f3aa8a7434 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:41.935361 2032 raft_consensus.cc:738] T 74a45437c2974edf9ba8d9f3aa8a7434 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:41.935429 2023 tablet_bootstrap.cc:492] T a53bd61ca20a4e879c22f22852749324 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:41.935701 2032 consensus_queue.cc:260] T 74a45437c2974edf9ba8d9f3aa8a7434 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:41.936208 2032 ts_tablet_manager.cc:1428] T 74a45437c2974edf9ba8d9f3aa8a7434 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20250831 19:54:41.936832 2032 tablet_bootstrap.cc:492] T 87385809a6b648149025f41da6cc5070 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:41.937016 2023 tablet_bootstrap.cc:654] T a53bd61ca20a4e879c22f22852749324 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:41.938768 2032 tablet_bootstrap.cc:654] T 87385809a6b648149025f41da6cc5070 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:41.939720 2022 tablet_bootstrap.cc:492] T e6bd41bdbeab4442b2f01f3b074ea0bf P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:41.939939 2022 ts_tablet_manager.cc:1397] T e6bd41bdbeab4442b2f01f3b074ea0bf P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.031s user 0.004s sys 0.004s
I20250831 19:54:41.940896 2022 raft_consensus.cc:357] T e6bd41bdbeab4442b2f01f3b074ea0bf P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:41.941138 2022 raft_consensus.cc:383] T e6bd41bdbeab4442b2f01f3b074ea0bf P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:41.941272 2022 raft_consensus.cc:738] T e6bd41bdbeab4442b2f01f3b074ea0bf P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:41.941591 2022 consensus_queue.cc:260] T e6bd41bdbeab4442b2f01f3b074ea0bf P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:41.944132 1439 catalog_manager.cc:2149] created HMS catalog entry for table [id=b1daf7387b1749019e5377ab08146d20]
I20250831 19:54:41.950806 2022 ts_tablet_manager.cc:1428] T e6bd41bdbeab4442b2f01f3b074ea0bf P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.011s user 0.001s sys 0.001s
I20250831 19:54:41.953806 2022 tablet_bootstrap.cc:492] T 87385809a6b648149025f41da6cc5070 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
W20250831 19:54:41.954989 1682 tablet.cc:2378] T 87385809a6b648149025f41da6cc5070 P 89aa85d59c53436ebdf3074b13d14825: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20250831 19:54:41.959089 1752 tablet_service.cc:1515] Processing DeleteTablet for tablet 74a45437c2974edf9ba8d9f3aa8a7434 with delete_type TABLET_DATA_DELETED (replaced by tablet 87385809a6b648149025f41da6cc5070) from {username='slave'} at 127.0.0.1:50662
I20250831 19:54:41.959383 2028 tablet_replica.cc:331] T 74a45437c2974edf9ba8d9f3aa8a7434 P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:54:41.959573 2028 raft_consensus.cc:2241] T 74a45437c2974edf9ba8d9f3aa8a7434 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:41.959741 2028 raft_consensus.cc:2270] T 74a45437c2974edf9ba8d9f3aa8a7434 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:41.960491 2028 ts_tablet_manager.cc:1905] T 74a45437c2974edf9ba8d9f3aa8a7434 P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:41.961429 2022 tablet_bootstrap.cc:654] T 87385809a6b648149025f41da6cc5070 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:41.966110 2028 ts_tablet_manager.cc:1918] T 74a45437c2974edf9ba8d9f3aa8a7434 P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250831 19:54:41.966254 2028 log.cc:1199] T 74a45437c2974edf9ba8d9f3aa8a7434 P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/74a45437c2974edf9ba8d9f3aa8a7434
I20250831 19:54:41.966595 2028 ts_tablet_manager.cc:1939] T 74a45437c2974edf9ba8d9f3aa8a7434 P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
I20250831 19:54:41.967625 1614 tablet_service.cc:1468] Processing CreateTablet for tablet a9cf9cf5d78a484087a8369ff5b547aa (DEFAULT_TABLE table=default.table_9f89ae10786e4a2ca85d49ff2a7b7800 [id=b1daf7387b1749019e5377ab08146d20]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:41.967859 1430 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet 74a45437c2974edf9ba8d9f3aa8a7434 (table default.table_9b6f788ff1a344e389223816b5593761 [id=bd456415108d49989ef0bc2af91eb2f0]) successfully deleted
I20250831 19:54:41.968104 1614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9cf9cf5d78a484087a8369ff5b547aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:41.968206 1752 tablet_service.cc:1468] Processing CreateTablet for tablet a9cf9cf5d78a484087a8369ff5b547aa (DEFAULT_TABLE table=default.table_9f89ae10786e4a2ca85d49ff2a7b7800 [id=b1daf7387b1749019e5377ab08146d20]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:41.968604 1752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9cf9cf5d78a484087a8369ff5b547aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:41.971683 1884 tablet_service.cc:1515] Processing DeleteTablet for tablet 74a45437c2974edf9ba8d9f3aa8a7434 with delete_type TABLET_DATA_DELETED (replaced by tablet 87385809a6b648149025f41da6cc5070) from {username='slave'} at 127.0.0.1:45900
I20250831 19:54:41.971977 2029 tablet_replica.cc:331] T 74a45437c2974edf9ba8d9f3aa8a7434 P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:54:41.972115 1885 tablet_service.cc:1468] Processing CreateTablet for tablet a9cf9cf5d78a484087a8369ff5b547aa (DEFAULT_TABLE table=default.table_9f89ae10786e4a2ca85d49ff2a7b7800 [id=b1daf7387b1749019e5377ab08146d20]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:41.972225 2029 raft_consensus.cc:2241] T 74a45437c2974edf9ba8d9f3aa8a7434 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:41.972404 2029 raft_consensus.cc:2270] T 74a45437c2974edf9ba8d9f3aa8a7434 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:41.972532 1885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9cf9cf5d78a484087a8369ff5b547aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:41.973194 2029 ts_tablet_manager.cc:1905] T 74a45437c2974edf9ba8d9f3aa8a7434 P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:41.975453 1439 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51254:
name: "default.Table_f940275fb42644d4935e49d6143fb4ba"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:41.977638 1751 tablet_service.cc:1515] Processing DeleteTablet for tablet 74a45437c2974edf9ba8d9f3aa8a7434 with delete_type TABLET_DATA_DELETED (replaced by tablet 87385809a6b648149025f41da6cc5070) from {username='slave'} at 127.0.0.1:50662
I20250831 19:54:41.979547 2029 ts_tablet_manager.cc:1918] T 74a45437c2974edf9ba8d9f3aa8a7434 P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250831 19:54:41.979724 2029 log.cc:1199] T 74a45437c2974edf9ba8d9f3aa8a7434 P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/74a45437c2974edf9ba8d9f3aa8a7434
I20250831 19:54:41.980105 2029 ts_tablet_manager.cc:1939] T 74a45437c2974edf9ba8d9f3aa8a7434 P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:54:41.981033 1428 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet 74a45437c2974edf9ba8d9f3aa8a7434 (table default.table_9b6f788ff1a344e389223816b5593761 [id=bd456415108d49989ef0bc2af91eb2f0]) successfully deleted
W20250831 19:54:41.982931 1430 catalog_manager.cc:4895] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): delete failed for tablet 74a45437c2974edf9ba8d9f3aa8a7434 because the tablet was not found. No further retry: Not found: Tablet not found: 74a45437c2974edf9ba8d9f3aa8a7434
I20250831 19:54:41.983603 2032 tablet_bootstrap.cc:492] T 87385809a6b648149025f41da6cc5070 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:41.983673 2023 tablet_bootstrap.cc:492] T a53bd61ca20a4e879c22f22852749324 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:41.983804 2023 ts_tablet_manager.cc:1397] T a53bd61ca20a4e879c22f22852749324 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.048s user 0.011s sys 0.013s
I20250831 19:54:41.983843 2032 ts_tablet_manager.cc:1397] T 87385809a6b648149025f41da6cc5070 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.047s user 0.003s sys 0.003s
I20250831 19:54:41.984490 2023 raft_consensus.cc:357] T a53bd61ca20a4e879c22f22852749324 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:41.984678 2023 raft_consensus.cc:383] T a53bd61ca20a4e879c22f22852749324 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:41.984555 2032 raft_consensus.cc:357] T 87385809a6b648149025f41da6cc5070 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:41.984776 2023 raft_consensus.cc:738] T a53bd61ca20a4e879c22f22852749324 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:41.984901 2032 raft_consensus.cc:383] T 87385809a6b648149025f41da6cc5070 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:41.985004 2032 raft_consensus.cc:738] T 87385809a6b648149025f41da6cc5070 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:41.984961 2023 consensus_queue.cc:260] T a53bd61ca20a4e879c22f22852749324 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:41.985280 2032 consensus_queue.cc:260] T 87385809a6b648149025f41da6cc5070 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:41.985414 2023 ts_tablet_manager.cc:1428] T a53bd61ca20a4e879c22f22852749324 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20250831 19:54:41.985754 2023 tablet_bootstrap.cc:492] T 8262f1d1898840c2822feda5279542bd P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:41.985908 2032 ts_tablet_manager.cc:1428] T 87385809a6b648149025f41da6cc5070 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20250831 19:54:41.986203 2032 tablet_bootstrap.cc:492] T a53bd61ca20a4e879c22f22852749324 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:41.987341 2023 tablet_bootstrap.cc:654] T 8262f1d1898840c2822feda5279542bd P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:41.989195 2032 tablet_bootstrap.cc:654] T a53bd61ca20a4e879c22f22852749324 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:41.989910 2022 tablet_bootstrap.cc:492] T 87385809a6b648149025f41da6cc5070 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:41.990106 2022 ts_tablet_manager.cc:1397] T 87385809a6b648149025f41da6cc5070 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.036s user 0.005s sys 0.001s
I20250831 19:54:41.990936 2022 raft_consensus.cc:357] T 87385809a6b648149025f41da6cc5070 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:41.991178 2022 raft_consensus.cc:383] T 87385809a6b648149025f41da6cc5070 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:41.991294 2022 raft_consensus.cc:738] T 87385809a6b648149025f41da6cc5070 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:41.991593 2022 consensus_queue.cc:260] T 87385809a6b648149025f41da6cc5070 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:41.994298 2022 ts_tablet_manager.cc:1428] T 87385809a6b648149025f41da6cc5070 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.004s user 0.000s sys 0.001s
I20250831 19:54:41.996872 2022 tablet_bootstrap.cc:492] T a53bd61ca20a4e879c22f22852749324 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:41.999066 2022 tablet_bootstrap.cc:654] T a53bd61ca20a4e879c22f22852749324 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:42.006474 2022 tablet_bootstrap.cc:492] T a53bd61ca20a4e879c22f22852749324 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:42.006883 2022 ts_tablet_manager.cc:1397] T a53bd61ca20a4e879c22f22852749324 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.006s
I20250831 19:54:42.007695 2022 raft_consensus.cc:357] T a53bd61ca20a4e879c22f22852749324 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:42.008433 2022 raft_consensus.cc:383] T a53bd61ca20a4e879c22f22852749324 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:42.008579 2022 raft_consensus.cc:738] T a53bd61ca20a4e879c22f22852749324 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:42.008881 2023 tablet_bootstrap.cc:492] T 8262f1d1898840c2822feda5279542bd P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:42.009020 2023 ts_tablet_manager.cc:1397] T 8262f1d1898840c2822feda5279542bd P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.023s user 0.004s sys 0.019s
I20250831 19:54:42.008890 2022 consensus_queue.cc:260] T a53bd61ca20a4e879c22f22852749324 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:42.009650 2023 raft_consensus.cc:357] T 8262f1d1898840c2822feda5279542bd P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:42.009805 2023 raft_consensus.cc:383] T 8262f1d1898840c2822feda5279542bd P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:42.009860 2023 raft_consensus.cc:738] T 8262f1d1898840c2822feda5279542bd P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:42.010039 2023 consensus_queue.cc:260] T 8262f1d1898840c2822feda5279542bd P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:42.010402 2023 ts_tablet_manager.cc:1428] T 8262f1d1898840c2822feda5279542bd P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250831 19:54:42.011324 2023 tablet_bootstrap.cc:492] T a9cf9cf5d78a484087a8369ff5b547aa P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:42.012034 2022 ts_tablet_manager.cc:1428] T a53bd61ca20a4e879c22f22852749324 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.005s user 0.000s sys 0.001s
I20250831 19:54:42.012887 2023 tablet_bootstrap.cc:654] T a9cf9cf5d78a484087a8369ff5b547aa P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:42.013073 2032 tablet_bootstrap.cc:492] T a53bd61ca20a4e879c22f22852749324 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:42.013274 2032 ts_tablet_manager.cc:1397] T a53bd61ca20a4e879c22f22852749324 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.027s user 0.004s sys 0.002s
I20250831 19:54:42.014165 2032 raft_consensus.cc:357] T a53bd61ca20a4e879c22f22852749324 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:42.014403 2032 raft_consensus.cc:383] T a53bd61ca20a4e879c22f22852749324 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:42.014541 2032 raft_consensus.cc:738] T a53bd61ca20a4e879c22f22852749324 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:42.014849 2032 consensus_queue.cc:260] T a53bd61ca20a4e879c22f22852749324 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:42.017302 2032 ts_tablet_manager.cc:1428] T a53bd61ca20a4e879c22f22852749324 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20250831 19:54:42.019076 2032 tablet_bootstrap.cc:492] T 8262f1d1898840c2822feda5279542bd P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:42.021071 2023 tablet_bootstrap.cc:492] T a9cf9cf5d78a484087a8369ff5b547aa P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:42.021188 2023 ts_tablet_manager.cc:1397] T a9cf9cf5d78a484087a8369ff5b547aa P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.003s
I20250831 19:54:42.021862 2023 raft_consensus.cc:357] T a9cf9cf5d78a484087a8369ff5b547aa P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:42.022002 2023 raft_consensus.cc:383] T a9cf9cf5d78a484087a8369ff5b547aa P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:42.022070 2023 raft_consensus.cc:738] T a9cf9cf5d78a484087a8369ff5b547aa P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:42.022255 2023 consensus_queue.cc:260] T a9cf9cf5d78a484087a8369ff5b547aa P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:42.023356 2023 ts_tablet_manager.cc:1428] T a9cf9cf5d78a484087a8369ff5b547aa P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250831 19:54:42.023456 2022 tablet_bootstrap.cc:492] T 8262f1d1898840c2822feda5279542bd P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:42.024977 2022 tablet_bootstrap.cc:654] T 8262f1d1898840c2822feda5279542bd P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:42.025664 2032 tablet_bootstrap.cc:654] T 8262f1d1898840c2822feda5279542bd P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:42.027097 2032 tablet_bootstrap.cc:492] T 8262f1d1898840c2822feda5279542bd P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:42.027272 2032 ts_tablet_manager.cc:1397] T 8262f1d1898840c2822feda5279542bd P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.000s
I20250831 19:54:42.027976 2032 raft_consensus.cc:357] T 8262f1d1898840c2822feda5279542bd P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:42.028195 2032 raft_consensus.cc:383] T 8262f1d1898840c2822feda5279542bd P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:42.028297 2032 raft_consensus.cc:738] T 8262f1d1898840c2822feda5279542bd P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:42.028558 2032 consensus_queue.cc:260] T 8262f1d1898840c2822feda5279542bd P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:42.029017 2032 ts_tablet_manager.cc:1428] T 8262f1d1898840c2822feda5279542bd P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250831 19:54:42.029388 2032 tablet_bootstrap.cc:492] T a9cf9cf5d78a484087a8369ff5b547aa P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:42.030864 2032 tablet_bootstrap.cc:654] T a9cf9cf5d78a484087a8369ff5b547aa P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:42.040307 2022 tablet_bootstrap.cc:492] T 8262f1d1898840c2822feda5279542bd P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:42.040439 2032 tablet_bootstrap.cc:492] T a9cf9cf5d78a484087a8369ff5b547aa P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:42.040596 2022 ts_tablet_manager.cc:1397] T 8262f1d1898840c2822feda5279542bd P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.018s user 0.009s sys 0.005s
I20250831 19:54:42.040603 2032 ts_tablet_manager.cc:1397] T a9cf9cf5d78a484087a8369ff5b547aa P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.008s
I20250831 19:54:42.041363 2032 raft_consensus.cc:357] T a9cf9cf5d78a484087a8369ff5b547aa P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:42.041558 2032 raft_consensus.cc:383] T a9cf9cf5d78a484087a8369ff5b547aa P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:42.041646 2032 raft_consensus.cc:738] T a9cf9cf5d78a484087a8369ff5b547aa P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:42.041893 2032 consensus_queue.cc:260] T a9cf9cf5d78a484087a8369ff5b547aa P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:42.041360 2022 raft_consensus.cc:357] T 8262f1d1898840c2822feda5279542bd P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:42.042544 2022 raft_consensus.cc:383] T 8262f1d1898840c2822feda5279542bd P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:42.042660 2022 raft_consensus.cc:738] T 8262f1d1898840c2822feda5279542bd P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:42.042905 2022 consensus_queue.cc:260] T 8262f1d1898840c2822feda5279542bd P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:42.043346 2022 ts_tablet_manager.cc:1428] T 8262f1d1898840c2822feda5279542bd P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20250831 19:54:42.043676 2022 tablet_bootstrap.cc:492] T a9cf9cf5d78a484087a8369ff5b547aa P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:42.045295 2022 tablet_bootstrap.cc:654] T a9cf9cf5d78a484087a8369ff5b547aa P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:42.045545 2032 ts_tablet_manager.cc:1428] T a9cf9cf5d78a484087a8369ff5b547aa P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
W20250831 19:54:42.048353 1954 tablet.cc:2378] T 8262f1d1898840c2822feda5279542bd P 2441fafe1d62429386f4631ad423567d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20250831 19:54:42.049081 2022 tablet_bootstrap.cc:492] T a9cf9cf5d78a484087a8369ff5b547aa P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:42.049273 2022 ts_tablet_manager.cc:1397] T a9cf9cf5d78a484087a8369ff5b547aa P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20250831 19:54:42.050009 2022 raft_consensus.cc:357] T a9cf9cf5d78a484087a8369ff5b547aa P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:42.050165 2022 raft_consensus.cc:383] T a9cf9cf5d78a484087a8369ff5b547aa P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:42.050246 2022 raft_consensus.cc:738] T a9cf9cf5d78a484087a8369ff5b547aa P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:42.050431 2022 consensus_queue.cc:260] T a9cf9cf5d78a484087a8369ff5b547aa P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:42.051712 2022 ts_tablet_manager.cc:1428] T a9cf9cf5d78a484087a8369ff5b547aa P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250831 19:54:42.065605 1440 catalog_manager.cc:2149] created HMS catalog entry for table [id=a8017c2a018f4bd28637a2b8c5677286]
I20250831 19:54:42.075788 1440 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51254:
name: "default.Table_8adc00cc53274835bfe463ebf3bd3f45"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:42.088531 1614 tablet_service.cc:1468] Processing CreateTablet for tablet 223b0437260545beb12c8aa2235c5d38 (DEFAULT_TABLE table=default.table_ae8ede59b2ad492daba0f5e783332e25 [id=a8017c2a018f4bd28637a2b8c5677286]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:42.088631 1885 tablet_service.cc:1468] Processing CreateTablet for tablet 223b0437260545beb12c8aa2235c5d38 (DEFAULT_TABLE table=default.table_ae8ede59b2ad492daba0f5e783332e25 [id=a8017c2a018f4bd28637a2b8c5677286]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:42.088994 1614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 223b0437260545beb12c8aa2235c5d38. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:42.089069 1885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 223b0437260545beb12c8aa2235c5d38. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:42.094398 1751 tablet_service.cc:1468] Processing CreateTablet for tablet 223b0437260545beb12c8aa2235c5d38 (DEFAULT_TABLE table=default.table_ae8ede59b2ad492daba0f5e783332e25 [id=a8017c2a018f4bd28637a2b8c5677286]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:42.094794 1751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 223b0437260545beb12c8aa2235c5d38. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:42.097860 2032 tablet_bootstrap.cc:492] T 223b0437260545beb12c8aa2235c5d38 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:42.099623 2032 tablet_bootstrap.cc:654] T 223b0437260545beb12c8aa2235c5d38 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:42.103950 2023 tablet_bootstrap.cc:492] T 223b0437260545beb12c8aa2235c5d38 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:42.105409 2023 tablet_bootstrap.cc:654] T 223b0437260545beb12c8aa2235c5d38 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:42.108186 2022 tablet_bootstrap.cc:492] T 223b0437260545beb12c8aa2235c5d38 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:42.109854 2022 tablet_bootstrap.cc:654] T 223b0437260545beb12c8aa2235c5d38 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:42.128520 2022 tablet_bootstrap.cc:492] T 223b0437260545beb12c8aa2235c5d38 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:42.128767 2022 ts_tablet_manager.cc:1397] T 223b0437260545beb12c8aa2235c5d38 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.021s user 0.009s sys 0.002s
W20250831 19:54:42.128855 1820 tablet.cc:2378] T 8262f1d1898840c2822feda5279542bd P de831f40fa1348a48a1f0260f4130197: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20250831 19:54:42.129597 2022 raft_consensus.cc:357] T 223b0437260545beb12c8aa2235c5d38 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:42.130060 2022 raft_consensus.cc:383] T 223b0437260545beb12c8aa2235c5d38 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:42.130172 2022 raft_consensus.cc:738] T 223b0437260545beb12c8aa2235c5d38 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:42.130439 2022 consensus_queue.cc:260] T 223b0437260545beb12c8aa2235c5d38 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:42.131747 1434 catalog_manager.cc:2149] created HMS catalog entry for table [id=ec56be26e67b43bfa7c5cb71edb64c8b]
I20250831 19:54:42.133212 2022 ts_tablet_manager.cc:1428] T 223b0437260545beb12c8aa2235c5d38 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20250831 19:54:42.136456 2023 tablet_bootstrap.cc:492] T 223b0437260545beb12c8aa2235c5d38 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:42.136657 2023 ts_tablet_manager.cc:1397] T 223b0437260545beb12c8aa2235c5d38 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.033s user 0.005s sys 0.007s
I20250831 19:54:42.137799 2023 raft_consensus.cc:357] T 223b0437260545beb12c8aa2235c5d38 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:42.138034 2023 raft_consensus.cc:383] T 223b0437260545beb12c8aa2235c5d38 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:42.138121 2023 raft_consensus.cc:738] T 223b0437260545beb12c8aa2235c5d38 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:42.138444 2023 consensus_queue.cc:260] T 223b0437260545beb12c8aa2235c5d38 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:42.141232 2023 ts_tablet_manager.cc:1428] T 223b0437260545beb12c8aa2235c5d38 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
W20250831 19:54:42.145547 1427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.1.253:45581, user_credentials={real_user=slave}} blocked reactor thread for 51402.3us
I20250831 19:54:42.147244 2032 tablet_bootstrap.cc:492] T 223b0437260545beb12c8aa2235c5d38 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:42.147404 2032 ts_tablet_manager.cc:1397] T 223b0437260545beb12c8aa2235c5d38 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.050s user 0.011s sys 0.022s
I20250831 19:54:42.148185 2032 raft_consensus.cc:357] T 223b0437260545beb12c8aa2235c5d38 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:42.148353 2032 raft_consensus.cc:383] T 223b0437260545beb12c8aa2235c5d38 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:42.148415 2032 raft_consensus.cc:738] T 223b0437260545beb12c8aa2235c5d38 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:42.148634 2032 consensus_queue.cc:260] T 223b0437260545beb12c8aa2235c5d38 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:42.149034 2037 raft_consensus.cc:491] T a53bd61ca20a4e879c22f22852749324 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:42.149219 2037 raft_consensus.cc:513] T a53bd61ca20a4e879c22f22852749324 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:42.150916 2037 leader_election.cc:290] T a53bd61ca20a4e879c22f22852749324 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:42.160115 1634 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a53bd61ca20a4e879c22f22852749324" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:42.160475 1634 raft_consensus.cc:2466] T a53bd61ca20a4e879c22f22852749324 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 0.
I20250831 19:54:42.161204 1841 leader_election.cc:304] T a53bd61ca20a4e879c22f22852749324 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:54:42.161700 2037 raft_consensus.cc:2802] T a53bd61ca20a4e879c22f22852749324 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:42.161820 2037 raft_consensus.cc:491] T a53bd61ca20a4e879c22f22852749324 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:42.161896 2037 raft_consensus.cc:3058] T a53bd61ca20a4e879c22f22852749324 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:42.164501 2037 raft_consensus.cc:513] T a53bd61ca20a4e879c22f22852749324 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:42.165127 1614 tablet_service.cc:1468] Processing CreateTablet for tablet f56c31854bc94b45879493264daf7ef3 (DEFAULT_TABLE table=default.table_c3535015c99247ec86adfa665b7bc01c [id=ec56be26e67b43bfa7c5cb71edb64c8b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:42.165618 1614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f56c31854bc94b45879493264daf7ef3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:42.165656 1634 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a53bd61ca20a4e879c22f22852749324" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:54:42.165836 1634 raft_consensus.cc:3058] T a53bd61ca20a4e879c22f22852749324 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:42.169261 1634 raft_consensus.cc:2466] T a53bd61ca20a4e879c22f22852749324 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 1.
I20250831 19:54:42.169864 1841 leader_election.cc:304] T a53bd61ca20a4e879c22f22852749324 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:54:42.170171 1751 tablet_service.cc:1468] Processing CreateTablet for tablet f56c31854bc94b45879493264daf7ef3 (DEFAULT_TABLE table=default.table_c3535015c99247ec86adfa665b7bc01c [id=ec56be26e67b43bfa7c5cb71edb64c8b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:42.170296 1885 tablet_service.cc:1468] Processing CreateTablet for tablet f56c31854bc94b45879493264daf7ef3 (DEFAULT_TABLE table=default.table_c3535015c99247ec86adfa665b7bc01c [id=ec56be26e67b43bfa7c5cb71edb64c8b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:42.170593 1751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f56c31854bc94b45879493264daf7ef3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:42.170648 1885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f56c31854bc94b45879493264daf7ef3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:42.176136 2037 leader_election.cc:290] T a53bd61ca20a4e879c22f22852749324 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 election: Requested vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:42.176400 2037 raft_consensus.cc:2802] T a53bd61ca20a4e879c22f22852749324 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:42.176574 2037 raft_consensus.cc:695] T a53bd61ca20a4e879c22f22852749324 P 2441fafe1d62429386f4631ad423567d [term 1 LEADER]: Becoming Leader. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Running, Role: LEADER
I20250831 19:54:42.177007 2037 consensus_queue.cc:237] T a53bd61ca20a4e879c22f22852749324 P 2441fafe1d62429386f4631ad423567d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:42.177392 1772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a53bd61ca20a4e879c22f22852749324" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:42.177928 1772 raft_consensus.cc:2466] T a53bd61ca20a4e879c22f22852749324 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 0.
I20250831 19:54:42.178383 1771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a53bd61ca20a4e879c22f22852749324" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197"
I20250831 19:54:42.178601 1771 raft_consensus.cc:3058] T a53bd61ca20a4e879c22f22852749324 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:42.180974 2022 tablet_bootstrap.cc:492] T f56c31854bc94b45879493264daf7ef3 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:42.181617 1771 raft_consensus.cc:2466] T a53bd61ca20a4e879c22f22852749324 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 1.
I20250831 19:54:42.183095 2022 tablet_bootstrap.cc:654] T f56c31854bc94b45879493264daf7ef3 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:42.187167 1434 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51254:
name: "default.Table_6965b0044d81462a8f1266e855ec1464"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:42.188548 2022 tablet_bootstrap.cc:492] T f56c31854bc94b45879493264daf7ef3 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:42.188753 2022 ts_tablet_manager.cc:1397] T f56c31854bc94b45879493264daf7ef3 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.000s
I20250831 19:54:42.189276 2023 tablet_bootstrap.cc:492] T f56c31854bc94b45879493264daf7ef3 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:42.189668 2022 raft_consensus.cc:357] T f56c31854bc94b45879493264daf7ef3 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:42.189896 2022 raft_consensus.cc:383] T f56c31854bc94b45879493264daf7ef3 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:42.190033 2022 raft_consensus.cc:738] T f56c31854bc94b45879493264daf7ef3 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:42.190308 2022 consensus_queue.cc:260] T f56c31854bc94b45879493264daf7ef3 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:42.190907 2023 tablet_bootstrap.cc:654] T f56c31854bc94b45879493264daf7ef3 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:42.194379 2022 ts_tablet_manager.cc:1428] T f56c31854bc94b45879493264daf7ef3 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20250831 19:54:42.196451 2032 ts_tablet_manager.cc:1428] T 223b0437260545beb12c8aa2235c5d38 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.049s user 0.001s sys 0.006s
I20250831 19:54:42.198956 2032 tablet_bootstrap.cc:492] T f56c31854bc94b45879493264daf7ef3 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:42.200380 2032 tablet_bootstrap.cc:654] T f56c31854bc94b45879493264daf7ef3 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:42.203982 2023 tablet_bootstrap.cc:492] T f56c31854bc94b45879493264daf7ef3 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:42.204128 2023 ts_tablet_manager.cc:1397] T f56c31854bc94b45879493264daf7ef3 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.006s
I20250831 19:54:42.204829 2023 raft_consensus.cc:357] T f56c31854bc94b45879493264daf7ef3 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:42.205025 2023 raft_consensus.cc:383] T f56c31854bc94b45879493264daf7ef3 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:42.205103 2023 raft_consensus.cc:738] T f56c31854bc94b45879493264daf7ef3 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:42.205338 2023 consensus_queue.cc:260] T f56c31854bc94b45879493264daf7ef3 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:42.207095 2023 ts_tablet_manager.cc:1428] T f56c31854bc94b45879493264daf7ef3 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20250831 19:54:42.212007 2032 tablet_bootstrap.cc:492] T f56c31854bc94b45879493264daf7ef3 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:42.212136 2032 ts_tablet_manager.cc:1397] T f56c31854bc94b45879493264daf7ef3 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.013s user 0.004s sys 0.004s
I20250831 19:54:42.212399 2033 raft_consensus.cc:491] T 8262f1d1898840c2822feda5279542bd P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:42.212548 2033 raft_consensus.cc:513] T 8262f1d1898840c2822feda5279542bd P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:42.212765 2032 raft_consensus.cc:357] T f56c31854bc94b45879493264daf7ef3 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:42.212913 2032 raft_consensus.cc:383] T f56c31854bc94b45879493264daf7ef3 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:42.212980 2032 raft_consensus.cc:738] T f56c31854bc94b45879493264daf7ef3 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:42.213182 2032 consensus_queue.cc:260] T f56c31854bc94b45879493264daf7ef3 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:42.213773 2032 ts_tablet_manager.cc:1428] T f56c31854bc94b45879493264daf7ef3 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250831 19:54:42.215431 2033 leader_election.cc:290] T 8262f1d1898840c2822feda5279542bd P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197), 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237)
I20250831 19:54:42.215595 2033 raft_consensus.cc:491] T e6bd41bdbeab4442b2f01f3b074ea0bf P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:42.215730 2033 raft_consensus.cc:513] T e6bd41bdbeab4442b2f01f3b074ea0bf P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:42.216202 2033 leader_election.cc:290] T e6bd41bdbeab4442b2f01f3b074ea0bf P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197), 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237)
I20250831 19:54:42.217429 1435 catalog_manager.cc:2149] created HMS catalog entry for table [id=57a524cac79549ceaebc55dc51fb94ee]
I20250831 19:54:42.223250 1634 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8262f1d1898840c2822feda5279542bd" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:42.223294 1633 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e6bd41bdbeab4442b2f01f3b074ea0bf" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:42.223498 1634 raft_consensus.cc:2466] T 8262f1d1898840c2822feda5279542bd P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 0.
I20250831 19:54:42.223580 1633 raft_consensus.cc:2466] T e6bd41bdbeab4442b2f01f3b074ea0bf P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 0.
I20250831 19:54:42.224000 1706 leader_election.cc:304] T 8262f1d1898840c2822feda5279542bd P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:42.224349 1706 leader_election.cc:304] T e6bd41bdbeab4442b2f01f3b074ea0bf P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:42.224360 2033 raft_consensus.cc:2802] T 8262f1d1898840c2822feda5279542bd P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:42.224512 2033 raft_consensus.cc:491] T 8262f1d1898840c2822feda5279542bd P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:42.224658 2033 raft_consensus.cc:3058] T 8262f1d1898840c2822feda5279542bd P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:42.226912 1435 master_service.cc:948] ReplaceTablet: received request to replace tablet e6bd41bdbeab4442b2f01f3b074ea0bf from {username='slave'} at 127.0.0.1:51254
I20250831 19:54:42.227946 2033 raft_consensus.cc:513] T 8262f1d1898840c2822feda5279542bd P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:42.228583 2033 leader_election.cc:290] T 8262f1d1898840c2822feda5279542bd P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Requested vote from peers 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197), 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237)
I20250831 19:54:42.228778 2033 raft_consensus.cc:2802] T e6bd41bdbeab4442b2f01f3b074ea0bf P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:42.228859 2033 raft_consensus.cc:491] T e6bd41bdbeab4442b2f01f3b074ea0bf P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:42.228931 2033 raft_consensus.cc:3058] T e6bd41bdbeab4442b2f01f3b074ea0bf P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:42.228991 1633 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8262f1d1898840c2822feda5279542bd" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:54:42.229132 1633 raft_consensus.cc:3058] T 8262f1d1898840c2822feda5279542bd P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:42.231419 2033 raft_consensus.cc:513] T e6bd41bdbeab4442b2f01f3b074ea0bf P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:42.231914 2033 leader_election.cc:290] T e6bd41bdbeab4442b2f01f3b074ea0bf P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Requested vote from peers 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197), 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237)
I20250831 19:54:42.232980 1634 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e6bd41bdbeab4442b2f01f3b074ea0bf" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:54:42.233232 1634 raft_consensus.cc:3058] T e6bd41bdbeab4442b2f01f3b074ea0bf P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:42.233814 1633 raft_consensus.cc:2466] T 8262f1d1898840c2822feda5279542bd P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:54:42.234288 1706 leader_election.cc:304] T 8262f1d1898840c2822feda5279542bd P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:42.234606 2033 raft_consensus.cc:2802] T 8262f1d1898840c2822feda5279542bd P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:42.234797 2033 raft_consensus.cc:695] T 8262f1d1898840c2822feda5279542bd P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: Becoming Leader. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Running, Role: LEADER
I20250831 19:54:42.235225 2033 consensus_queue.cc:237] T 8262f1d1898840c2822feda5279542bd P de831f40fa1348a48a1f0260f4130197 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:42.235802 1634 raft_consensus.cc:2466] T e6bd41bdbeab4442b2f01f3b074ea0bf P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:54:42.236501 1706 leader_election.cc:304] T e6bd41bdbeab4442b2f01f3b074ea0bf P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:42.245774 1614 tablet_service.cc:1468] Processing CreateTablet for tablet 1bdb24444f114d12bb4c2b19c6b3eef2 (DEFAULT_TABLE table=default.table_3691be9921f145f4a9495f2d669a5728 [id=57a524cac79549ceaebc55dc51fb94ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:42.245836 1751 tablet_service.cc:1468] Processing CreateTablet for tablet 1bdb24444f114d12bb4c2b19c6b3eef2 (DEFAULT_TABLE table=default.table_3691be9921f145f4a9495f2d669a5728 [id=57a524cac79549ceaebc55dc51fb94ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:42.246206 1751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bdb24444f114d12bb4c2b19c6b3eef2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:42.246208 1614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bdb24444f114d12bb4c2b19c6b3eef2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:42.249789 1885 tablet_service.cc:1468] Processing CreateTablet for tablet 1bdb24444f114d12bb4c2b19c6b3eef2 (DEFAULT_TABLE table=default.table_3691be9921f145f4a9495f2d669a5728 [id=57a524cac79549ceaebc55dc51fb94ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:42.250149 1885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bdb24444f114d12bb4c2b19c6b3eef2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:42.250227 1905 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e6bd41bdbeab4442b2f01f3b074ea0bf" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:42.250614 1905 raft_consensus.cc:2466] T e6bd41bdbeab4442b2f01f3b074ea0bf P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 0.
I20250831 19:54:42.251053 1903 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e6bd41bdbeab4442b2f01f3b074ea0bf" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:54:42.251299 1903 raft_consensus.cc:3058] T e6bd41bdbeab4442b2f01f3b074ea0bf P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:42.251657 2067 raft_consensus.cc:2802] T e6bd41bdbeab4442b2f01f3b074ea0bf P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:42.251793 2067 raft_consensus.cc:695] T e6bd41bdbeab4442b2f01f3b074ea0bf P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: Becoming Leader. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Running, Role: LEADER
I20250831 19:54:42.252045 2067 consensus_queue.cc:237] T e6bd41bdbeab4442b2f01f3b074ea0bf P de831f40fa1348a48a1f0260f4130197 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:42.256273 1906 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8262f1d1898840c2822feda5279542bd" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:42.256551 1906 raft_consensus.cc:2466] T 8262f1d1898840c2822feda5279542bd P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 0.
I20250831 19:54:42.257154 1904 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8262f1d1898840c2822feda5279542bd" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:54:42.257634 1435 catalog_manager.cc:5869] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220: Sending DeleteTablet for 3 replicas of tablet e6bd41bdbeab4442b2f01f3b074ea0bf
I20250831 19:54:42.257732 1904 raft_consensus.cc:3058] T 8262f1d1898840c2822feda5279542bd P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:42.258508 1752 tablet_service.cc:1515] Processing DeleteTablet for tablet e6bd41bdbeab4442b2f01f3b074ea0bf with delete_type TABLET_DATA_DELETED (replaced by tablet f318ccc4400f4830b6a80e27b002b562) from {username='slave'} at 127.0.0.1:50662
I20250831 19:54:42.258767 2028 tablet_replica.cc:331] T e6bd41bdbeab4442b2f01f3b074ea0bf P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:54:42.258952 2028 raft_consensus.cc:2241] T e6bd41bdbeab4442b2f01f3b074ea0bf P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: Raft consensus shutting down.
I20250831 19:54:42.259338 2028 pending_rounds.cc:70] T e6bd41bdbeab4442b2f01f3b074ea0bf P de831f40fa1348a48a1f0260f4130197: Trying to abort 1 pending ops.
I20250831 19:54:42.259447 2028 pending_rounds.cc:77] T e6bd41bdbeab4442b2f01f3b074ea0bf P de831f40fa1348a48a1f0260f4130197: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7195320656906629120 op_type: NO_OP noop_request { }
I20250831 19:54:42.259614 2028 raft_consensus.cc:2887] T e6bd41bdbeab4442b2f01f3b074ea0bf P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250831 19:54:42.259713 2028 raft_consensus.cc:2270] T e6bd41bdbeab4442b2f01f3b074ea0bf P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:42.260618 2061 raft_consensus.cc:491] T 87385809a6b648149025f41da6cc5070 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:42.261227 1613 tablet_service.cc:1515] Processing DeleteTablet for tablet e6bd41bdbeab4442b2f01f3b074ea0bf with delete_type TABLET_DATA_DELETED (replaced by tablet f318ccc4400f4830b6a80e27b002b562) from {username='slave'} at 127.0.0.1:51018
I20250831 19:54:42.261503 1884 tablet_service.cc:1515] Processing DeleteTablet for tablet e6bd41bdbeab4442b2f01f3b074ea0bf with delete_type TABLET_DATA_DELETED (replaced by tablet f318ccc4400f4830b6a80e27b002b562) from {username='slave'} at 127.0.0.1:45900
I20250831 19:54:42.261548 2030 tablet_replica.cc:331] T e6bd41bdbeab4442b2f01f3b074ea0bf P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:54:42.261739 2030 raft_consensus.cc:2241] T e6bd41bdbeab4442b2f01f3b074ea0bf P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:42.261804 2029 tablet_replica.cc:331] T e6bd41bdbeab4442b2f01f3b074ea0bf P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:54:42.261927 2030 raft_consensus.cc:2270] T e6bd41bdbeab4442b2f01f3b074ea0bf P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:42.262043 2061 raft_consensus.cc:513] T 87385809a6b648149025f41da6cc5070 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:42.262699 2061 leader_election.cc:290] T 87385809a6b648149025f41da6cc5070 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:42.263375 2030 ts_tablet_manager.cc:1905] T e6bd41bdbeab4442b2f01f3b074ea0bf P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:42.263792 1634 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "87385809a6b648149025f41da6cc5070" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:42.263950 1634 raft_consensus.cc:2466] T 87385809a6b648149025f41da6cc5070 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 0.
I20250831 19:54:42.264328 1841 leader_election.cc:304] T 87385809a6b648149025f41da6cc5070 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:54:42.264803 1435 catalog_manager.cc:6652] ReplaceTablet: tablet e6bd41bdbeab4442b2f01f3b074ea0bf deleted and replaced by tablet f318ccc4400f4830b6a80e27b002b562
I20250831 19:54:42.265569 2061 raft_consensus.cc:2802] T 87385809a6b648149025f41da6cc5070 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:42.265697 2061 raft_consensus.cc:491] T 87385809a6b648149025f41da6cc5070 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:42.265795 2061 raft_consensus.cc:3058] T 87385809a6b648149025f41da6cc5070 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:42.267413 1752 tablet_service.cc:1468] Processing CreateTablet for tablet f318ccc4400f4830b6a80e27b002b562 (DEFAULT_TABLE table=default.table_5d4cd226dc464a4f9faa6c6e65e4345c [id=1137b2754d104964bbe5bbaa4a0578b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:42.267738 1752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f318ccc4400f4830b6a80e27b002b562. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:42.268716 2061 raft_consensus.cc:513] T 87385809a6b648149025f41da6cc5070 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:42.269336 2061 leader_election.cc:290] T 87385809a6b648149025f41da6cc5070 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 election: Requested vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:42.269976 1884 tablet_service.cc:1468] Processing CreateTablet for tablet f318ccc4400f4830b6a80e27b002b562 (DEFAULT_TABLE table=default.table_5d4cd226dc464a4f9faa6c6e65e4345c [id=1137b2754d104964bbe5bbaa4a0578b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:42.269982 1613 tablet_service.cc:1468] Processing CreateTablet for tablet f318ccc4400f4830b6a80e27b002b562 (DEFAULT_TABLE table=default.table_5d4cd226dc464a4f9faa6c6e65e4345c [id=1137b2754d104964bbe5bbaa4a0578b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:42.270268 1884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f318ccc4400f4830b6a80e27b002b562. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:42.270359 1613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f318ccc4400f4830b6a80e27b002b562. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:42.273605 1634 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "87385809a6b648149025f41da6cc5070" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:54:42.273772 1634 raft_consensus.cc:3058] T 87385809a6b648149025f41da6cc5070 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:42.277056 2022 tablet_bootstrap.cc:492] T f318ccc4400f4830b6a80e27b002b562 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:42.277194 2030 ts_tablet_manager.cc:1918] T e6bd41bdbeab4442b2f01f3b074ea0bf P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250831 19:54:42.277297 2030 log.cc:1199] T e6bd41bdbeab4442b2f01f3b074ea0bf P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/e6bd41bdbeab4442b2f01f3b074ea0bf
I20250831 19:54:42.277508 1904 raft_consensus.cc:2466] T 8262f1d1898840c2822feda5279542bd P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:54:42.277809 1903 raft_consensus.cc:2466] T e6bd41bdbeab4442b2f01f3b074ea0bf P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:54:42.278076 2029 raft_consensus.cc:2241] T e6bd41bdbeab4442b2f01f3b074ea0bf P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:42.278569 2022 tablet_bootstrap.cc:654] T f318ccc4400f4830b6a80e27b002b562 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:42.279018 2029 raft_consensus.cc:2270] T e6bd41bdbeab4442b2f01f3b074ea0bf P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:42.279300 1634 raft_consensus.cc:2466] T 87385809a6b648149025f41da6cc5070 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 1.
I20250831 19:54:42.279570 2032 tablet_bootstrap.cc:492] T f318ccc4400f4830b6a80e27b002b562 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:42.279706 2029 ts_tablet_manager.cc:1905] T e6bd41bdbeab4442b2f01f3b074ea0bf P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:42.284544 2022 tablet_bootstrap.cc:492] T f318ccc4400f4830b6a80e27b002b562 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:42.284730 2022 ts_tablet_manager.cc:1397] T f318ccc4400f4830b6a80e27b002b562 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.000s
I20250831 19:54:42.284670 1435 catalog_manager.cc:5582] T a53bd61ca20a4e879c22f22852749324 P 2441fafe1d62429386f4631ad423567d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2441fafe1d62429386f4631ad423567d (127.1.1.195). New cstate: current_term: 1 leader_uuid: "2441fafe1d62429386f4631ad423567d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: HEALTHY } } }
I20250831 19:54:42.280129 1841 leader_election.cc:304] T 87385809a6b648149025f41da6cc5070 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:54:42.285790 2037 raft_consensus.cc:2802] T 87385809a6b648149025f41da6cc5070 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:42.285578 2022 raft_consensus.cc:357] T f318ccc4400f4830b6a80e27b002b562 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:42.286010 2022 raft_consensus.cc:383] T f318ccc4400f4830b6a80e27b002b562 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:42.286111 2022 raft_consensus.cc:738] T f318ccc4400f4830b6a80e27b002b562 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:42.286370 2022 consensus_queue.cc:260] T f318ccc4400f4830b6a80e27b002b562 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:42.282028 2032 tablet_bootstrap.cc:654] T f318ccc4400f4830b6a80e27b002b562 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:42.286903 2022 ts_tablet_manager.cc:1428] T f318ccc4400f4830b6a80e27b002b562 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250831 19:54:42.287259 2022 tablet_bootstrap.cc:492] T 1bdb24444f114d12bb4c2b19c6b3eef2 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:42.292531 2037 raft_consensus.cc:695] T 87385809a6b648149025f41da6cc5070 P 2441fafe1d62429386f4631ad423567d [term 1 LEADER]: Becoming Leader. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Running, Role: LEADER
I20250831 19:54:42.292814 2037 consensus_queue.cc:237] T 87385809a6b648149025f41da6cc5070 P 2441fafe1d62429386f4631ad423567d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:42.296336 2029 ts_tablet_manager.cc:1918] T e6bd41bdbeab4442b2f01f3b074ea0bf P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250831 19:54:42.296440 2029 log.cc:1199] T e6bd41bdbeab4442b2f01f3b074ea0bf P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/e6bd41bdbeab4442b2f01f3b074ea0bf
I20250831 19:54:42.296736 2029 ts_tablet_manager.cc:1939] T e6bd41bdbeab4442b2f01f3b074ea0bf P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:54:42.297389 2022 tablet_bootstrap.cc:654] T 1bdb24444f114d12bb4c2b19c6b3eef2 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:42.297623 1428 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet e6bd41bdbeab4442b2f01f3b074ea0bf (table default.table_5d4cd226dc464a4f9faa6c6e65e4345c [id=1137b2754d104964bbe5bbaa4a0578b8]) successfully deleted
I20250831 19:54:42.297966 1435 catalog_manager.cc:5582] T 8262f1d1898840c2822feda5279542bd P de831f40fa1348a48a1f0260f4130197 reported cstate change: term changed from 0 to 1, leader changed from <none> to de831f40fa1348a48a1f0260f4130197 (127.1.1.194). New cstate: current_term: 1 leader_uuid: "de831f40fa1348a48a1f0260f4130197" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } }
I20250831 19:54:42.298729 2023 tablet_bootstrap.cc:492] T 1bdb24444f114d12bb4c2b19c6b3eef2 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:42.300283 2023 tablet_bootstrap.cc:654] T 1bdb24444f114d12bb4c2b19c6b3eef2 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:42.303790 2028 ts_tablet_manager.cc:1905] T e6bd41bdbeab4442b2f01f3b074ea0bf P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:42.304523 2030 ts_tablet_manager.cc:1939] T e6bd41bdbeab4442b2f01f3b074ea0bf P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
I20250831 19:54:42.307447 2023 tablet_bootstrap.cc:492] T 1bdb24444f114d12bb4c2b19c6b3eef2 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:42.307629 2023 ts_tablet_manager.cc:1397] T 1bdb24444f114d12bb4c2b19c6b3eef2 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.001s
I20250831 19:54:42.308432 2023 raft_consensus.cc:357] T 1bdb24444f114d12bb4c2b19c6b3eef2 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:42.308638 2023 raft_consensus.cc:383] T 1bdb24444f114d12bb4c2b19c6b3eef2 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:42.308712 2023 raft_consensus.cc:738] T 1bdb24444f114d12bb4c2b19c6b3eef2 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:42.308969 2023 consensus_queue.cc:260] T 1bdb24444f114d12bb4c2b19c6b3eef2 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:42.309650 2023 ts_tablet_manager.cc:1428] T 1bdb24444f114d12bb4c2b19c6b3eef2 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250831 19:54:42.309986 2023 tablet_bootstrap.cc:492] T f318ccc4400f4830b6a80e27b002b562 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:42.309988 1429 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet e6bd41bdbeab4442b2f01f3b074ea0bf (table default.table_5d4cd226dc464a4f9faa6c6e65e4345c [id=1137b2754d104964bbe5bbaa4a0578b8]) successfully deleted
I20250831 19:54:42.311915 2023 tablet_bootstrap.cc:654] T f318ccc4400f4830b6a80e27b002b562 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:42.312464 2028 ts_tablet_manager.cc:1918] T e6bd41bdbeab4442b2f01f3b074ea0bf P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:42.312695 2028 log.cc:1199] T e6bd41bdbeab4442b2f01f3b074ea0bf P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/e6bd41bdbeab4442b2f01f3b074ea0bf
I20250831 19:54:42.313081 2028 ts_tablet_manager.cc:1939] T e6bd41bdbeab4442b2f01f3b074ea0bf P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
I20250831 19:54:42.313747 1430 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet e6bd41bdbeab4442b2f01f3b074ea0bf (table default.table_5d4cd226dc464a4f9faa6c6e65e4345c [id=1137b2754d104964bbe5bbaa4a0578b8]) successfully deleted
I20250831 19:54:42.314901 1751 tablet_service.cc:1515] Processing DeleteTablet for tablet e6bd41bdbeab4442b2f01f3b074ea0bf with delete_type TABLET_DATA_DELETED (replaced by tablet f318ccc4400f4830b6a80e27b002b562) from {username='slave'} at 127.0.0.1:50662
W20250831 19:54:42.315327 1706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.1.193:46197, user_credentials={real_user=slave}} blocked reactor thread for 78820.7us
W20250831 19:54:42.315451 1430 catalog_manager.cc:4895] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): delete failed for tablet e6bd41bdbeab4442b2f01f3b074ea0bf because the tablet was not found. No further retry: Not found: Tablet not found: e6bd41bdbeab4442b2f01f3b074ea0bf
I20250831 19:54:42.315990 1771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "87385809a6b648149025f41da6cc5070" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:42.316193 1771 raft_consensus.cc:2466] T 87385809a6b648149025f41da6cc5070 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 0.
I20250831 19:54:42.316473 1772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "87385809a6b648149025f41da6cc5070" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197"
I20250831 19:54:42.316615 1772 raft_consensus.cc:3058] T 87385809a6b648149025f41da6cc5070 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:42.316751 2032 tablet_bootstrap.cc:492] T f318ccc4400f4830b6a80e27b002b562 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:42.316921 2032 ts_tablet_manager.cc:1397] T f318ccc4400f4830b6a80e27b002b562 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.037s user 0.002s sys 0.006s
I20250831 19:54:42.317631 2032 raft_consensus.cc:357] T f318ccc4400f4830b6a80e27b002b562 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:42.317812 2032 raft_consensus.cc:383] T f318ccc4400f4830b6a80e27b002b562 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:42.317884 2032 raft_consensus.cc:738] T f318ccc4400f4830b6a80e27b002b562 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:42.318094 2032 consensus_queue.cc:260] T f318ccc4400f4830b6a80e27b002b562 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:42.318590 2032 ts_tablet_manager.cc:1428] T f318ccc4400f4830b6a80e27b002b562 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250831 19:54:42.318928 2032 tablet_bootstrap.cc:492] T 1bdb24444f114d12bb4c2b19c6b3eef2 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:42.319151 1772 raft_consensus.cc:2466] T 87385809a6b648149025f41da6cc5070 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 1.
I20250831 19:54:42.320639 2032 tablet_bootstrap.cc:654] T 1bdb24444f114d12bb4c2b19c6b3eef2 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:42.322307 1435 catalog_manager.cc:5582] T 87385809a6b648149025f41da6cc5070 P 2441fafe1d62429386f4631ad423567d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2441fafe1d62429386f4631ad423567d (127.1.1.195). New cstate: current_term: 1 leader_uuid: "2441fafe1d62429386f4631ad423567d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: UNKNOWN } } }
I20250831 19:54:42.322772 2022 tablet_bootstrap.cc:492] T 1bdb24444f114d12bb4c2b19c6b3eef2 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:42.322887 2022 ts_tablet_manager.cc:1397] T 1bdb24444f114d12bb4c2b19c6b3eef2 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.036s user 0.004s sys 0.000s
I20250831 19:54:42.323568 2022 raft_consensus.cc:357] T 1bdb24444f114d12bb4c2b19c6b3eef2 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:42.323734 2022 raft_consensus.cc:383] T 1bdb24444f114d12bb4c2b19c6b3eef2 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:42.323824 2022 raft_consensus.cc:738] T 1bdb24444f114d12bb4c2b19c6b3eef2 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:42.324023 2022 consensus_queue.cc:260] T 1bdb24444f114d12bb4c2b19c6b3eef2 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:42.324489 2022 ts_tablet_manager.cc:1428] T 1bdb24444f114d12bb4c2b19c6b3eef2 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20250831 19:54:42.326781 2023 tablet_bootstrap.cc:492] T f318ccc4400f4830b6a80e27b002b562 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:42.326920 2023 ts_tablet_manager.cc:1397] T f318ccc4400f4830b6a80e27b002b562 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.017s user 0.003s sys 0.000s
I20250831 19:54:42.327654 2023 raft_consensus.cc:357] T f318ccc4400f4830b6a80e27b002b562 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:42.327838 2023 raft_consensus.cc:383] T f318ccc4400f4830b6a80e27b002b562 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:42.327934 2023 raft_consensus.cc:738] T f318ccc4400f4830b6a80e27b002b562 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:42.328150 2023 consensus_queue.cc:260] T f318ccc4400f4830b6a80e27b002b562 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:42.328603 2023 ts_tablet_manager.cc:1428] T f318ccc4400f4830b6a80e27b002b562 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250831 19:54:42.332242 2032 tablet_bootstrap.cc:492] T 1bdb24444f114d12bb4c2b19c6b3eef2 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:42.332562 2032 ts_tablet_manager.cc:1397] T 1bdb24444f114d12bb4c2b19c6b3eef2 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.014s user 0.001s sys 0.003s
I20250831 19:54:42.333376 2032 raft_consensus.cc:357] T 1bdb24444f114d12bb4c2b19c6b3eef2 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:42.333650 2032 raft_consensus.cc:383] T 1bdb24444f114d12bb4c2b19c6b3eef2 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:42.333770 2032 raft_consensus.cc:738] T 1bdb24444f114d12bb4c2b19c6b3eef2 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:42.334028 2032 consensus_queue.cc:260] T 1bdb24444f114d12bb4c2b19c6b3eef2 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:42.335739 2032 ts_tablet_manager.cc:1428] T 1bdb24444f114d12bb4c2b19c6b3eef2 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20250831 19:54:42.345647 1435 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51254:
table { table_name: "default.Table_9f89ae10786e4a2ca85d49ff2a7b7800" } new_table_name: "default.Table_e2ff8984d73f4f05a25d1c132ea949fb" modify_external_catalogs: true
I20250831 19:54:42.360651 2068 raft_consensus.cc:491] T 223b0437260545beb12c8aa2235c5d38 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:42.360833 2068 raft_consensus.cc:513] T 223b0437260545beb12c8aa2235c5d38 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:42.361714 2068 leader_election.cc:290] T 223b0437260545beb12c8aa2235c5d38 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197), 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237)
I20250831 19:54:42.362852 1634 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "223b0437260545beb12c8aa2235c5d38" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:42.363081 1634 raft_consensus.cc:2466] T 223b0437260545beb12c8aa2235c5d38 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 0.
I20250831 19:54:42.363071 1903 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "223b0437260545beb12c8aa2235c5d38" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:42.363356 1903 raft_consensus.cc:2466] T 223b0437260545beb12c8aa2235c5d38 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 0.
I20250831 19:54:42.363657 1706 leader_election.cc:304] T 223b0437260545beb12c8aa2235c5d38 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:42.363986 2068 raft_consensus.cc:2802] T 223b0437260545beb12c8aa2235c5d38 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:42.364095 2068 raft_consensus.cc:491] T 223b0437260545beb12c8aa2235c5d38 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:42.364173 2068 raft_consensus.cc:3058] T 223b0437260545beb12c8aa2235c5d38 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:42.366324 2068 raft_consensus.cc:513] T 223b0437260545beb12c8aa2235c5d38 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:42.367197 1903 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "223b0437260545beb12c8aa2235c5d38" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:54:42.367357 1903 raft_consensus.cc:3058] T 223b0437260545beb12c8aa2235c5d38 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:42.368983 1903 raft_consensus.cc:2466] T 223b0437260545beb12c8aa2235c5d38 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:54:42.369303 1705 leader_election.cc:304] T 223b0437260545beb12c8aa2235c5d38 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:42.369365 1634 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "223b0437260545beb12c8aa2235c5d38" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:54:42.369565 1634 raft_consensus.cc:3058] T 223b0437260545beb12c8aa2235c5d38 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:42.369740 2067 raft_consensus.cc:2802] T 223b0437260545beb12c8aa2235c5d38 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:42.369880 2067 raft_consensus.cc:695] T 223b0437260545beb12c8aa2235c5d38 P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: Becoming Leader. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Running, Role: LEADER
I20250831 19:54:42.370114 2067 consensus_queue.cc:237] T 223b0437260545beb12c8aa2235c5d38 P de831f40fa1348a48a1f0260f4130197 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:42.372035 1634 raft_consensus.cc:2466] T 223b0437260545beb12c8aa2235c5d38 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:54:42.372349 2068 leader_election.cc:290] T 223b0437260545beb12c8aa2235c5d38 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Requested vote from peers 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197), 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237)
I20250831 19:54:42.423854 2067 raft_consensus.cc:491] T 1bdb24444f114d12bb4c2b19c6b3eef2 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:42.424041 2067 raft_consensus.cc:513] T 1bdb24444f114d12bb4c2b19c6b3eef2 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:42.424687 2067 leader_election.cc:290] T 1bdb24444f114d12bb4c2b19c6b3eef2 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:42.426010 1903 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1bdb24444f114d12bb4c2b19c6b3eef2" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:42.426234 1903 raft_consensus.cc:2466] T 1bdb24444f114d12bb4c2b19c6b3eef2 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 0.
I20250831 19:54:42.426602 1634 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1bdb24444f114d12bb4c2b19c6b3eef2" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:42.426792 1634 raft_consensus.cc:2466] T 1bdb24444f114d12bb4c2b19c6b3eef2 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 0.
I20250831 19:54:42.427407 1706 leader_election.cc:304] T 1bdb24444f114d12bb4c2b19c6b3eef2 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:42.428153 2067 raft_consensus.cc:2802] T 1bdb24444f114d12bb4c2b19c6b3eef2 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:42.428258 2067 raft_consensus.cc:491] T 1bdb24444f114d12bb4c2b19c6b3eef2 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:42.428346 2067 raft_consensus.cc:3058] T 1bdb24444f114d12bb4c2b19c6b3eef2 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:42.430775 2067 raft_consensus.cc:513] T 1bdb24444f114d12bb4c2b19c6b3eef2 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:42.431867 1903 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1bdb24444f114d12bb4c2b19c6b3eef2" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:54:42.432056 1903 raft_consensus.cc:3058] T 1bdb24444f114d12bb4c2b19c6b3eef2 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:42.434557 1903 raft_consensus.cc:2466] T 1bdb24444f114d12bb4c2b19c6b3eef2 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:54:42.435092 1705 leader_election.cc:304] T 1bdb24444f114d12bb4c2b19c6b3eef2 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:42.435387 2068 raft_consensus.cc:2802] T 1bdb24444f114d12bb4c2b19c6b3eef2 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:42.435492 2068 raft_consensus.cc:695] T 1bdb24444f114d12bb4c2b19c6b3eef2 P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: Becoming Leader. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Running, Role: LEADER
I20250831 19:54:42.435746 2068 consensus_queue.cc:237] T 1bdb24444f114d12bb4c2b19c6b3eef2 P de831f40fa1348a48a1f0260f4130197 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:42.438596 1634 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1bdb24444f114d12bb4c2b19c6b3eef2" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:54:42.438818 1634 raft_consensus.cc:3058] T 1bdb24444f114d12bb4c2b19c6b3eef2 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:42.441301 1634 raft_consensus.cc:2466] T 1bdb24444f114d12bb4c2b19c6b3eef2 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:54:42.441918 2067 leader_election.cc:290] T 1bdb24444f114d12bb4c2b19c6b3eef2 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Requested vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:42.457567 2031 raft_consensus.cc:491] T f56c31854bc94b45879493264daf7ef3 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:42.457756 2031 raft_consensus.cc:513] T f56c31854bc94b45879493264daf7ef3 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:42.459468 2031 leader_election.cc:290] T f56c31854bc94b45879493264daf7ef3 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237)
W20250831 19:54:42.465615 2042 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20250831 19:54:42.466006 2042 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20250831 19:54:42.466112 2042 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20250831 19:54:42.468211 1772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f56c31854bc94b45879493264daf7ef3" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:42.468446 1772 raft_consensus.cc:2466] T f56c31854bc94b45879493264daf7ef3 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 0.
I20250831 19:54:42.468889 1570 leader_election.cc:304] T f56c31854bc94b45879493264daf7ef3 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:42.469283 2031 raft_consensus.cc:2802] T f56c31854bc94b45879493264daf7ef3 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:42.469390 2031 raft_consensus.cc:491] T f56c31854bc94b45879493264daf7ef3 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:42.469492 2031 raft_consensus.cc:3058] T f56c31854bc94b45879493264daf7ef3 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:42.472406 2031 raft_consensus.cc:513] T f56c31854bc94b45879493264daf7ef3 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:42.473063 2031 leader_election.cc:290] T f56c31854bc94b45879493264daf7ef3 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Requested vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237)
I20250831 19:54:42.473356 1772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f56c31854bc94b45879493264daf7ef3" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197"
I20250831 19:54:42.473645 1772 raft_consensus.cc:3058] T f56c31854bc94b45879493264daf7ef3 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:42.476542 1772 raft_consensus.cc:2466] T f56c31854bc94b45879493264daf7ef3 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1.
I20250831 19:54:42.476939 1570 leader_election.cc:304] T f56c31854bc94b45879493264daf7ef3 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:42.477298 2031 raft_consensus.cc:2802] T f56c31854bc94b45879493264daf7ef3 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election won for term 1
W20250831 19:54:42.477484 2042 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20250831 19:54:42.477583 2042 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20250831 19:54:42.477665 2042 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20250831 19:54:42.477727 2042 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20250831 19:54:42.481318 2031 raft_consensus.cc:695] T f56c31854bc94b45879493264daf7ef3 P 89aa85d59c53436ebdf3074b13d14825 [term 1 LEADER]: Becoming Leader. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Running, Role: LEADER
I20250831 19:54:42.481818 2031 consensus_queue.cc:237] T f56c31854bc94b45879493264daf7ef3 P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:42.491776 1903 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f56c31854bc94b45879493264daf7ef3" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:42.492007 1903 raft_consensus.cc:2466] T f56c31854bc94b45879493264daf7ef3 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 0.
I20250831 19:54:42.492468 2042 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.1.212:44077
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-1/wal
--hive_metastore_uris=thrift://127.0.0.1:46163
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.1.253:45581
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.1.1.253
--webserver_port=43003
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 06466b25e294b4d7d455e6c56263318dc34a80ef
build type FASTDEBUG
built by None at 31 Aug 2025 19:43:25 UTC on 24a791456cd2
build id 7836
ASAN enabled
I20250831 19:54:42.494449 2042 env_posix.cc:2264] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20250831 19:54:42.494907 1903 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f56c31854bc94b45879493264daf7ef3" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:54:42.495086 1903 raft_consensus.cc:3058] T f56c31854bc94b45879493264daf7ef3 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:42.496651 2042 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20250831 19:54:42.497095 1903 raft_consensus.cc:2466] T f56c31854bc94b45879493264daf7ef3 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1.
W20250831 19:54:42.508306 2088 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250831 19:54:42.513908 2089 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
19:54:42.519 [HMS - ERROR - pool-6-thread-1] (RetryingHMSHandler.java:201) AlreadyExistsException(message:Table hive.default.table_8e964bae65cf414eb9661de9e7a89fbf already exists)
at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.create_table_core(HiveMetaStore.java:1839)
at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.create_table_core(HiveMetaStore.java:1786)
at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.create_table_with_environment_context(HiveMetaStore.java:2035)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invokeInternal(RetryingHMSHandler.java:147)
at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:108)
at com.sun.proxy.$Proxy26.create_table_with_environment_context(Unknown Source)
at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$create_table_with_environment_context.getResult(ThriftHiveMetastore.java:14800)
at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$create_table_with_environment_context.getResult(ThriftHiveMetastore.java:14784)
at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
at org.apache.hadoop.hive.metastore.TUGIBasedProcessor.process(TUGIBasedProcessor.java:104)
at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:286)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
W20250831 19:54:42.522394 1438 catalog_manager.cc:2145] Already present: failed to create HMS catalog entry for table [id=4a8f24f90db6496f894c7d356ca555f3]: failed to create Hive MetaStore table: TException - service has thrown: AlreadyExistsException(message=Table hive.default.table_8e964bae65cf414eb9661de9e7a89fbf already exists)
I20250831 19:54:42.523957 1438 catalog_manager.cc:5582] T 223b0437260545beb12c8aa2235c5d38 P de831f40fa1348a48a1f0260f4130197 reported cstate change: term changed from 0 to 1, leader changed from <none> to de831f40fa1348a48a1f0260f4130197 (127.1.1.194). New cstate: current_term: 1 leader_uuid: "de831f40fa1348a48a1f0260f4130197" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } }
I20250831 19:54:42.524397 2037 raft_consensus.cc:491] T a9cf9cf5d78a484087a8369ff5b547aa P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:42.524588 2037 raft_consensus.cc:513] T a9cf9cf5d78a484087a8369ff5b547aa P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:42.525295 2037 leader_election.cc:290] T a9cf9cf5d78a484087a8369ff5b547aa P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
W20250831 19:54:42.525673 2091 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250831 19:54:42.526404 1634 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a9cf9cf5d78a484087a8369ff5b547aa" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:42.526683 1634 raft_consensus.cc:2466] T a9cf9cf5d78a484087a8369ff5b547aa P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 0.
I20250831 19:54:42.526752 1772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a9cf9cf5d78a484087a8369ff5b547aa" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:42.526962 1772 raft_consensus.cc:2466] T a9cf9cf5d78a484087a8369ff5b547aa P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 0.
I20250831 19:54:42.527669 1841 leader_election.cc:304] T a9cf9cf5d78a484087a8369ff5b547aa P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:54:42.528007 2037 raft_consensus.cc:2802] T a9cf9cf5d78a484087a8369ff5b547aa P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:42.528108 2037 raft_consensus.cc:491] T a9cf9cf5d78a484087a8369ff5b547aa P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:42.528185 2037 raft_consensus.cc:3058] T a9cf9cf5d78a484087a8369ff5b547aa P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:42.530740 2037 raft_consensus.cc:513] T a9cf9cf5d78a484087a8369ff5b547aa P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:42.532313 1634 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a9cf9cf5d78a484087a8369ff5b547aa" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:54:42.532372 2042 server_base.cc:1047] running on GCE node
I20250831 19:54:42.532557 1634 raft_consensus.cc:3058] T a9cf9cf5d78a484087a8369ff5b547aa P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:42.532785 1772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a9cf9cf5d78a484087a8369ff5b547aa" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197"
I20250831 19:54:42.532959 1772 raft_consensus.cc:3058] T a9cf9cf5d78a484087a8369ff5b547aa P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:42.533492 2042 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20250831 19:54:42.534919 1634 raft_consensus.cc:2466] T a9cf9cf5d78a484087a8369ff5b547aa P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 1.
I20250831 19:54:42.535420 1772 raft_consensus.cc:2466] T a9cf9cf5d78a484087a8369ff5b547aa P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 1.
I20250831 19:54:42.535619 1841 leader_election.cc:304] T a9cf9cf5d78a484087a8369ff5b547aa P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:54:42.535954 2061 raft_consensus.cc:2802] T a9cf9cf5d78a484087a8369ff5b547aa P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:42.536091 2061 raft_consensus.cc:695] T a9cf9cf5d78a484087a8369ff5b547aa P 2441fafe1d62429386f4631ad423567d [term 1 LEADER]: Becoming Leader. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Running, Role: LEADER
I20250831 19:54:42.536403 2061 consensus_queue.cc:237] T a9cf9cf5d78a484087a8369ff5b547aa P 2441fafe1d62429386f4631ad423567d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:42.538424 2037 leader_election.cc:290] T a9cf9cf5d78a484087a8369ff5b547aa P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 election: Requested vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:42.539381 1438 catalog_manager.cc:5582] T f56c31854bc94b45879493264daf7ef3 P 89aa85d59c53436ebdf3074b13d14825 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193). New cstate: current_term: 1 leader_uuid: "89aa85d59c53436ebdf3074b13d14825" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } }
I20250831 19:54:42.547734 1438 catalog_manager.cc:5582] T 1bdb24444f114d12bb4c2b19c6b3eef2 P de831f40fa1348a48a1f0260f4130197 reported cstate change: term changed from 0 to 1, leader changed from <none> to de831f40fa1348a48a1f0260f4130197 (127.1.1.194). New cstate: current_term: 1 leader_uuid: "de831f40fa1348a48a1f0260f4130197" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: HEALTHY } } }
I20250831 19:54:42.551854 2042 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20250831 19:54:42.558471 1438 catalog_manager.cc:5582] T a9cf9cf5d78a484087a8369ff5b547aa P 2441fafe1d62429386f4631ad423567d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2441fafe1d62429386f4631ad423567d (127.1.1.195). New cstate: current_term: 1 leader_uuid: "2441fafe1d62429386f4631ad423567d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: UNKNOWN } } }
I20250831 19:54:42.567404 2042 hybrid_clock.cc:648] HybridClock initialized: now 1756670082567301 us; error 98 us; skew 500 ppm
I20250831 19:54:42.567912 2042 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250831 19:54:42.567999 1438 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51254:
name: "default.Table_5ca33d92f715421ab04c9570ac2ee4a0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:42.572556 1436 catalog_manager.cc:2149] created HMS catalog entry for table [id=2475332024a84359a43fe486d5488cba]
I20250831 19:54:42.577695 1436 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51254 (request call id 36) took 1015 ms. Trace:
I20250831 19:54:42.577836 1436 rpcz_store.cc:276] 0831 19:54:41.561957 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:41.563114 (+ 1157us) service_pool.cc:225] Handling call
0831 19:54:41.739295 (+176181us) catalog_manager.cc:2076] Acquired catalog manager lock
0831 19:54:41.740934 (+ 1639us) catalog_manager.cc:2122] Created new table and tablet info
0831 19:54:42.572503 (+831569us) catalog_manager.cc:2148] Created new table in HMS catalog
0831 19:54:42.577391 (+ 4888us) catalog_manager.cc:2182] Wrote table and tablets to system table
0831 19:54:42.577536 (+ 145us) catalog_manager.cc:2216] Inserted table and tablets into CatalogManager maps
0831 19:54:42.577655 (+ 119us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:42.573219 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:42.573330 (+ 111us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:42.573335 (+ 5us) write_op.cc:435] Acquired schema lock
0831 19:54:42.573338 (+ 3us) tablet.cc:660] Decoding operations
0831 19:54:42.573423 (+ 85us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:42.573435 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:42.573440 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:42.573546 (+ 106us) tablet.cc:699] Row locks acquired
0831 19:54:42.573548 (+ 2us) write_op.cc:260] PREPARE: finished
0831 19:54:42.573583 (+ 35us) write_op.cc:270] Start()
0831 19:54:42.573610 (+ 27us) write_op.cc:276] Timestamp: P: 1756670082573553 usec, L: 0
0831 19:54:42.573613 (+ 3us) op_driver.cc:348] REPLICATION: starting
0831 19:54:42.573776 (+ 163us) log.cc:844] Serialized 432 byte log entry
0831 19:54:42.576483 (+ 2707us) op_driver.cc:464] REPLICATION: finished
0831 19:54:42.576612 (+ 129us) write_op.cc:301] APPLY: starting
0831 19:54:42.576626 (+ 14us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:42.576664 (+ 38us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:42.576693 (+ 29us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:42.576806 (+ 113us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:42.576835 (+ 29us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0831 19:54:42.576841 (+ 6us) write_op.cc:312] APPLY: finished
0831 19:54:42.576907 (+ 66us) log.cc:844] Serialized 28 byte log entry
0831 19:54:42.576969 (+ 62us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:42.576985 (+ 16us) write_op.cc:454] Released schema lock
0831 19:54:42.576991 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0831 19:54:42.577048 (+ 57us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:42.577052 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":780515,"Hive Metastore.run_cpu_time_us":291,"Hive Metastore.run_wall_time_us":50754,"child_traces":[["op",{"apply.queue_time_us":89,"apply.run_cpu_time_us":430,"apply.run_wall_time_us":429,"num_ops":2,"prepare.queue_time_us":79,"prepare.run_cpu_time_us":652,"prepare.run_wall_time_us":652,"raft.queue_time_us":795,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":202,"replication_time_us":2847}]]}
I20250831 19:54:42.579303 1436 master_service.cc:948] ReplaceTablet: received request to replace tablet a9cf9cf5d78a484087a8369ff5b547aa from {username='slave'} at 127.0.0.1:51254
I20250831 19:54:42.584959 2042 webserver.cc:480] Webserver started at http://127.1.1.253:43003/ using document root <none> and password file <none>
I20250831 19:54:42.586001 2042 fs_manager.cc:362] Metadata directory not provided
I20250831 19:54:42.586141 2042 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250831 19:54:42.587728 1436 catalog_manager.cc:5869] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220: Sending DeleteTablet for 3 replicas of tablet a9cf9cf5d78a484087a8369ff5b547aa
I20250831 19:54:42.587831 1751 tablet_service.cc:1468] Processing CreateTablet for tablet 520b7d1fbd1c4814b42c102aeb250f72 (DEFAULT_TABLE table=default.table_d961171a98f341b5945cfe0300337aec [id=2475332024a84359a43fe486d5488cba]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:42.588151 1436 catalog_manager.cc:6652] ReplaceTablet: tablet a9cf9cf5d78a484087a8369ff5b547aa deleted and replaced by tablet 9cf4a20941f045adb66114df127c84a0
I20250831 19:54:42.588243 1751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 520b7d1fbd1c4814b42c102aeb250f72. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:42.588373 1436 master_service.cc:948] ReplaceTablet: received request to replace tablet a53bd61ca20a4e879c22f22852749324 from {username='slave'} at 127.0.0.1:51254
I20250831 19:54:42.590409 1885 tablet_service.cc:1468] Processing CreateTablet for tablet 520b7d1fbd1c4814b42c102aeb250f72 (DEFAULT_TABLE table=default.table_d961171a98f341b5945cfe0300337aec [id=2475332024a84359a43fe486d5488cba]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:42.590911 1885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 520b7d1fbd1c4814b42c102aeb250f72. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:42.593597 1884 tablet_service.cc:1515] Processing DeleteTablet for tablet a9cf9cf5d78a484087a8369ff5b547aa with delete_type TABLET_DATA_DELETED (replaced by tablet 9cf4a20941f045adb66114df127c84a0) from {username='slave'} at 127.0.0.1:45900
I20250831 19:54:42.593851 2029 tablet_replica.cc:331] T a9cf9cf5d78a484087a8369ff5b547aa P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:54:42.593896 1613 tablet_service.cc:1468] Processing CreateTablet for tablet 520b7d1fbd1c4814b42c102aeb250f72 (DEFAULT_TABLE table=default.table_d961171a98f341b5945cfe0300337aec [id=2475332024a84359a43fe486d5488cba]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:42.594033 2029 raft_consensus.cc:2241] T a9cf9cf5d78a484087a8369ff5b547aa P 2441fafe1d62429386f4631ad423567d [term 1 LEADER]: Raft consensus shutting down.
I20250831 19:54:42.594384 1613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 520b7d1fbd1c4814b42c102aeb250f72. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:42.594411 2029 pending_rounds.cc:70] T a9cf9cf5d78a484087a8369ff5b547aa P 2441fafe1d62429386f4631ad423567d: Trying to abort 1 pending ops.
I20250831 19:54:42.594605 2029 pending_rounds.cc:77] T a9cf9cf5d78a484087a8369ff5b547aa P 2441fafe1d62429386f4631ad423567d: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7195320658072068096 op_type: NO_OP noop_request { }
I20250831 19:54:42.594771 2029 raft_consensus.cc:2887] T a9cf9cf5d78a484087a8369ff5b547aa P 2441fafe1d62429386f4631ad423567d [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250831 19:54:42.594902 2029 raft_consensus.cc:2270] T a9cf9cf5d78a484087a8369ff5b547aa P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:42.596428 2029 ts_tablet_manager.cc:1905] T a9cf9cf5d78a484087a8369ff5b547aa P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:42.597643 1614 tablet_service.cc:1515] Processing DeleteTablet for tablet a9cf9cf5d78a484087a8369ff5b547aa with delete_type TABLET_DATA_DELETED (replaced by tablet 9cf4a20941f045adb66114df127c84a0) from {username='slave'} at 127.0.0.1:51018
I20250831 19:54:42.597939 2030 tablet_replica.cc:331] T a9cf9cf5d78a484087a8369ff5b547aa P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:54:42.598114 2030 raft_consensus.cc:2241] T a9cf9cf5d78a484087a8369ff5b547aa P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:42.598261 2030 raft_consensus.cc:2270] T a9cf9cf5d78a484087a8369ff5b547aa P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:42.598827 2030 ts_tablet_manager.cc:1905] T a9cf9cf5d78a484087a8369ff5b547aa P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:42.599529 2042 fs_manager.cc:714] Time spent opening directory manager: real 0.011s user 0.011s sys 0.001s
I20250831 19:54:42.602380 1752 tablet_service.cc:1515] Processing DeleteTablet for tablet a9cf9cf5d78a484087a8369ff5b547aa with delete_type TABLET_DATA_DELETED (replaced by tablet 9cf4a20941f045adb66114df127c84a0) from {username='slave'} at 127.0.0.1:50662
I20250831 19:54:42.602748 2032 tablet_bootstrap.cc:492] T 520b7d1fbd1c4814b42c102aeb250f72 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:42.604959 2032 tablet_bootstrap.cc:654] T 520b7d1fbd1c4814b42c102aeb250f72 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:42.606156 2028 tablet_replica.cc:331] T a9cf9cf5d78a484087a8369ff5b547aa P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:54:42.606387 2028 raft_consensus.cc:2241] T a9cf9cf5d78a484087a8369ff5b547aa P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:42.606597 2028 raft_consensus.cc:2270] T a9cf9cf5d78a484087a8369ff5b547aa P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:42.607177 2028 ts_tablet_manager.cc:1905] T a9cf9cf5d78a484087a8369ff5b547aa P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:42.609884 2099 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250831 19:54:42.611503 2042 fs_manager.cc:730] Time spent opening block manager: real 0.010s user 0.004s sys 0.004s
I20250831 19:54:42.611711 2042 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-1/data,/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-1/wal
uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5"
format_stamp: "Formatted at 2025-08-31 19:54:38 on dist-test-slave-v4kn"
I20250831 19:54:42.612622 2042 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250831 19:54:42.613109 2028 ts_tablet_manager.cc:1918] T a9cf9cf5d78a484087a8369ff5b547aa P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250831 19:54:42.613221 2028 log.cc:1199] T a9cf9cf5d78a484087a8369ff5b547aa P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/a9cf9cf5d78a484087a8369ff5b547aa
I20250831 19:54:42.616328 2030 ts_tablet_manager.cc:1918] T a9cf9cf5d78a484087a8369ff5b547aa P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250831 19:54:42.616458 2030 log.cc:1199] T a9cf9cf5d78a484087a8369ff5b547aa P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/a9cf9cf5d78a484087a8369ff5b547aa
I20250831 19:54:42.616770 2030 ts_tablet_manager.cc:1939] T a9cf9cf5d78a484087a8369ff5b547aa P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
I20250831 19:54:42.621793 2023 tablet_bootstrap.cc:492] T 520b7d1fbd1c4814b42c102aeb250f72 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:42.623306 2023 tablet_bootstrap.cc:654] T 520b7d1fbd1c4814b42c102aeb250f72 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:42.623476 2029 ts_tablet_manager.cc:1918] T a9cf9cf5d78a484087a8369ff5b547aa P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:42.623638 2029 log.cc:1199] T a9cf9cf5d78a484087a8369ff5b547aa P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/a9cf9cf5d78a484087a8369ff5b547aa
I20250831 19:54:42.624236 2022 tablet_bootstrap.cc:492] T 520b7d1fbd1c4814b42c102aeb250f72 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:42.624490 2029 ts_tablet_manager.cc:1939] T a9cf9cf5d78a484087a8369ff5b547aa P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:54:42.625775 1428 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet a9cf9cf5d78a484087a8369ff5b547aa (table default.table_9f89ae10786e4a2ca85d49ff2a7b7800 [id=b1daf7387b1749019e5377ab08146d20]) successfully deleted
I20250831 19:54:42.626480 1429 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet a9cf9cf5d78a484087a8369ff5b547aa (table default.table_9f89ae10786e4a2ca85d49ff2a7b7800 [id=b1daf7387b1749019e5377ab08146d20]) successfully deleted
I20250831 19:54:42.626750 2032 tablet_bootstrap.cc:492] T 520b7d1fbd1c4814b42c102aeb250f72 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:42.626904 2032 ts_tablet_manager.cc:1397] T 520b7d1fbd1c4814b42c102aeb250f72 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.024s user 0.001s sys 0.003s
I20250831 19:54:42.627635 2032 raft_consensus.cc:357] T 520b7d1fbd1c4814b42c102aeb250f72 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:42.627854 2032 raft_consensus.cc:383] T 520b7d1fbd1c4814b42c102aeb250f72 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:42.627923 2032 raft_consensus.cc:738] T 520b7d1fbd1c4814b42c102aeb250f72 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:42.628358 2032 consensus_queue.cc:260] T 520b7d1fbd1c4814b42c102aeb250f72 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:42.628942 2032 ts_tablet_manager.cc:1428] T 520b7d1fbd1c4814b42c102aeb250f72 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250831 19:54:42.638998 1885 tablet_service.cc:1468] Processing CreateTablet for tablet 9cf4a20941f045adb66114df127c84a0 (DEFAULT_TABLE table=default.table_9f89ae10786e4a2ca85d49ff2a7b7800 [id=b1daf7387b1749019e5377ab08146d20]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:42.639438 1885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cf4a20941f045adb66114df127c84a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:42.643003 1613 tablet_service.cc:1468] Processing CreateTablet for tablet 9cf4a20941f045adb66114df127c84a0 (DEFAULT_TABLE table=default.table_9f89ae10786e4a2ca85d49ff2a7b7800 [id=b1daf7387b1749019e5377ab08146d20]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:42.643360 1613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cf4a20941f045adb66114df127c84a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:42.646303 2032 tablet_bootstrap.cc:492] T 9cf4a20941f045adb66114df127c84a0 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:42.647461 1751 tablet_service.cc:1468] Processing CreateTablet for tablet 9cf4a20941f045adb66114df127c84a0 (DEFAULT_TABLE table=default.table_9f89ae10786e4a2ca85d49ff2a7b7800 [id=b1daf7387b1749019e5377ab08146d20]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:42.647903 2032 tablet_bootstrap.cc:654] T 9cf4a20941f045adb66114df127c84a0 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:42.647912 1751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cf4a20941f045adb66114df127c84a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:42.653860 2022 tablet_bootstrap.cc:654] T 520b7d1fbd1c4814b42c102aeb250f72 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:42.656486 2028 ts_tablet_manager.cc:1939] T a9cf9cf5d78a484087a8369ff5b547aa P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
I20250831 19:54:42.657721 1430 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet a9cf9cf5d78a484087a8369ff5b547aa (table default.table_9f89ae10786e4a2ca85d49ff2a7b7800 [id=b1daf7387b1749019e5377ab08146d20]) successfully deleted
I20250831 19:54:42.659395 1436 catalog_manager.cc:5869] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220: Sending DeleteTablet for 3 replicas of tablet a53bd61ca20a4e879c22f22852749324
I20250831 19:54:42.660027 1436 catalog_manager.cc:6652] ReplaceTablet: tablet a53bd61ca20a4e879c22f22852749324 deleted and replaced by tablet fa69535d223d494db28f4a9444b18e79
I20250831 19:54:42.661590 1613 tablet_service.cc:1515] Processing DeleteTablet for tablet a53bd61ca20a4e879c22f22852749324 with delete_type TABLET_DATA_DELETED (replaced by tablet fa69535d223d494db28f4a9444b18e79) from {username='slave'} at 127.0.0.1:51018
I20250831 19:54:42.661871 2030 tablet_replica.cc:331] T a53bd61ca20a4e879c22f22852749324 P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:54:42.662039 2030 raft_consensus.cc:2241] T a53bd61ca20a4e879c22f22852749324 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:42.662194 1751 tablet_service.cc:1515] Processing DeleteTablet for tablet a53bd61ca20a4e879c22f22852749324 with delete_type TABLET_DATA_DELETED (replaced by tablet fa69535d223d494db28f4a9444b18e79) from {username='slave'} at 127.0.0.1:50662
I20250831 19:54:42.662218 2030 raft_consensus.cc:2270] T a53bd61ca20a4e879c22f22852749324 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:42.662745 2030 ts_tablet_manager.cc:1905] T a53bd61ca20a4e879c22f22852749324 P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:42.662254 2032 tablet_bootstrap.cc:492] T 9cf4a20941f045adb66114df127c84a0 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:42.663672 2032 ts_tablet_manager.cc:1397] T 9cf4a20941f045adb66114df127c84a0 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.017s user 0.005s sys 0.001s
I20250831 19:54:42.664445 2032 raft_consensus.cc:357] T 9cf4a20941f045adb66114df127c84a0 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:42.664641 2032 raft_consensus.cc:383] T 9cf4a20941f045adb66114df127c84a0 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:42.664737 2032 raft_consensus.cc:738] T 9cf4a20941f045adb66114df127c84a0 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:42.664727 1436 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51254:
table { table_name: "default.Table_ae8ede59b2ad492daba0f5e783332e25" } modify_external_catalogs: true
I20250831 19:54:42.664980 2032 consensus_queue.cc:260] T 9cf4a20941f045adb66114df127c84a0 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:42.665091 1436 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51254:
table { table_name: "default.Table_ae8ede59b2ad492daba0f5e783332e25" } modify_external_catalogs: true
I20250831 19:54:42.665473 2032 ts_tablet_manager.cc:1428] T 9cf4a20941f045adb66114df127c84a0 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250831 19:54:42.661226 1885 tablet_service.cc:1515] Processing DeleteTablet for tablet a53bd61ca20a4e879c22f22852749324 with delete_type TABLET_DATA_DELETED (replaced by tablet fa69535d223d494db28f4a9444b18e79) from {username='slave'} at 127.0.0.1:45900
I20250831 19:54:42.665947 2029 tablet_replica.cc:331] T a53bd61ca20a4e879c22f22852749324 P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:54:42.666131 2029 raft_consensus.cc:2241] T a53bd61ca20a4e879c22f22852749324 P 2441fafe1d62429386f4631ad423567d [term 1 LEADER]: Raft consensus shutting down.
I20250831 19:54:42.666339 2029 pending_rounds.cc:70] T a53bd61ca20a4e879c22f22852749324 P 2441fafe1d62429386f4631ad423567d: Trying to abort 1 pending ops.
I20250831 19:54:42.666419 2029 pending_rounds.cc:77] T a53bd61ca20a4e879c22f22852749324 P 2441fafe1d62429386f4631ad423567d: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7195320656602320896 op_type: NO_OP noop_request { }
I20250831 19:54:42.666522 2029 raft_consensus.cc:2887] T a53bd61ca20a4e879c22f22852749324 P 2441fafe1d62429386f4631ad423567d [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250831 19:54:42.666622 2029 raft_consensus.cc:2270] T a53bd61ca20a4e879c22f22852749324 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:42.667316 2029 ts_tablet_manager.cc:1905] T a53bd61ca20a4e879c22f22852749324 P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:42.667331 2028 tablet_replica.cc:331] T a53bd61ca20a4e879c22f22852749324 P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:54:42.667639 2028 raft_consensus.cc:2241] T a53bd61ca20a4e879c22f22852749324 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:42.667915 2061 raft_consensus.cc:491] T f318ccc4400f4830b6a80e27b002b562 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:42.668159 2028 raft_consensus.cc:2270] T a53bd61ca20a4e879c22f22852749324 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:42.668094 2061 raft_consensus.cc:513] T f318ccc4400f4830b6a80e27b002b562 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:42.668706 2061 leader_election.cc:290] T f318ccc4400f4830b6a80e27b002b562 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:42.669318 1634 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f318ccc4400f4830b6a80e27b002b562" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:42.668738 2028 ts_tablet_manager.cc:1905] T a53bd61ca20a4e879c22f22852749324 P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:42.669471 2042 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250831 19:54:42.669544 1634 raft_consensus.cc:2466] T f318ccc4400f4830b6a80e27b002b562 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 0.
I20250831 19:54:42.669977 1841 leader_election.cc:304] T f318ccc4400f4830b6a80e27b002b562 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:54:42.670467 2042 env_posix.cc:2264] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20250831 19:54:42.670639 1772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f318ccc4400f4830b6a80e27b002b562" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:42.670794 2042 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250831 19:54:42.670835 1772 raft_consensus.cc:2466] T f318ccc4400f4830b6a80e27b002b562 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 0.
I20250831 19:54:42.672879 2061 raft_consensus.cc:2802] T f318ccc4400f4830b6a80e27b002b562 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:42.673002 2061 raft_consensus.cc:491] T f318ccc4400f4830b6a80e27b002b562 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:42.673121 2061 raft_consensus.cc:3058] T f318ccc4400f4830b6a80e27b002b562 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:42.676345 2061 raft_consensus.cc:513] T f318ccc4400f4830b6a80e27b002b562 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:42.677067 2061 leader_election.cc:290] T f318ccc4400f4830b6a80e27b002b562 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 election: Requested vote from peers 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:42.677842 1634 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f318ccc4400f4830b6a80e27b002b562" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:54:42.678011 1634 raft_consensus.cc:3058] T f318ccc4400f4830b6a80e27b002b562 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:42.679474 1613 tablet_service.cc:1468] Processing CreateTablet for tablet fa69535d223d494db28f4a9444b18e79 (DEFAULT_TABLE table=default.table_5b498fbba7b34ca49b2d2706a1787053 [id=42fb4ac1f28146339375e6c29735ed44]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:42.679451 1885 tablet_service.cc:1468] Processing CreateTablet for tablet fa69535d223d494db28f4a9444b18e79 (DEFAULT_TABLE table=default.table_5b498fbba7b34ca49b2d2706a1787053 [id=42fb4ac1f28146339375e6c29735ed44]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:42.679934 1885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa69535d223d494db28f4a9444b18e79. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:42.679958 1613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa69535d223d494db28f4a9444b18e79. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:42.680471 1634 raft_consensus.cc:2466] T f318ccc4400f4830b6a80e27b002b562 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 1.
I20250831 19:54:42.681290 1772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f318ccc4400f4830b6a80e27b002b562" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197"
I20250831 19:54:42.681546 1772 raft_consensus.cc:3058] T f318ccc4400f4830b6a80e27b002b562 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:42.683969 1772 raft_consensus.cc:2466] T f318ccc4400f4830b6a80e27b002b562 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 1.
I20250831 19:54:42.684532 1842 leader_election.cc:304] T f318ccc4400f4830b6a80e27b002b562 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:42.685490 2037 raft_consensus.cc:2802] T f318ccc4400f4830b6a80e27b002b562 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:42.685647 2037 raft_consensus.cc:695] T f318ccc4400f4830b6a80e27b002b562 P 2441fafe1d62429386f4631ad423567d [term 1 LEADER]: Becoming Leader. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Running, Role: LEADER
I20250831 19:54:42.686456 2072 raft_consensus.cc:491] T 9cf4a20941f045adb66114df127c84a0 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:42.686570 2037 consensus_queue.cc:237] T f318ccc4400f4830b6a80e27b002b562 P 2441fafe1d62429386f4631ad423567d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:42.686631 2072 raft_consensus.cc:513] T 9cf4a20941f045adb66114df127c84a0 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:42.685536 2032 tablet_bootstrap.cc:492] T fa69535d223d494db28f4a9444b18e79 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:42.687369 2072 leader_election.cc:290] T 9cf4a20941f045adb66114df127c84a0 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:42.688381 1634 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9cf4a20941f045adb66114df127c84a0" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:42.688942 2032 tablet_bootstrap.cc:654] T fa69535d223d494db28f4a9444b18e79 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
W20250831 19:54:42.689114 1841 leader_election.cc:343] T 9cf4a20941f045adb66114df127c84a0 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): Illegal state: must be running to vote when last-logged opid is not known
I20250831 19:54:42.691802 2028 ts_tablet_manager.cc:1918] T a53bd61ca20a4e879c22f22852749324 P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250831 19:54:42.691963 2028 log.cc:1199] T a53bd61ca20a4e879c22f22852749324 P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/a53bd61ca20a4e879c22f22852749324
I20250831 19:54:42.692341 2028 ts_tablet_manager.cc:1939] T a53bd61ca20a4e879c22f22852749324 P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
I20250831 19:54:42.693186 1430 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet a53bd61ca20a4e879c22f22852749324 (table default.table_5b498fbba7b34ca49b2d2706a1787053 [id=42fb4ac1f28146339375e6c29735ed44]) successfully deleted
I20250831 19:54:42.695299 1772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9cf4a20941f045adb66114df127c84a0" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
W20250831 19:54:42.695806 1842 leader_election.cc:343] T 9cf4a20941f045adb66114df127c84a0 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): Illegal state: must be running to vote when last-logged opid is not known
I20250831 19:54:42.695927 1842 leader_election.cc:304] T 9cf4a20941f045adb66114df127c84a0 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2441fafe1d62429386f4631ad423567d; no voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197
I20250831 19:54:42.696377 2072 raft_consensus.cc:2747] T 9cf4a20941f045adb66114df127c84a0 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250831 19:54:42.698009 1751 tablet_service.cc:1468] Processing CreateTablet for tablet fa69535d223d494db28f4a9444b18e79 (DEFAULT_TABLE table=default.table_5b498fbba7b34ca49b2d2706a1787053 [id=42fb4ac1f28146339375e6c29735ed44]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:42.699141 1751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa69535d223d494db28f4a9444b18e79. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:42.699627 2030 ts_tablet_manager.cc:1918] T a53bd61ca20a4e879c22f22852749324 P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250831 19:54:42.699841 2030 log.cc:1199] T a53bd61ca20a4e879c22f22852749324 P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/a53bd61ca20a4e879c22f22852749324
I20250831 19:54:42.700289 2030 ts_tablet_manager.cc:1939] T a53bd61ca20a4e879c22f22852749324 P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
I20250831 19:54:42.701535 1429 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet a53bd61ca20a4e879c22f22852749324 (table default.table_5b498fbba7b34ca49b2d2706a1787053 [id=42fb4ac1f28146339375e6c29735ed44]) successfully deleted
I20250831 19:54:42.700273 2022 tablet_bootstrap.cc:492] T 520b7d1fbd1c4814b42c102aeb250f72 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:42.702144 2022 ts_tablet_manager.cc:1397] T 520b7d1fbd1c4814b42c102aeb250f72 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.078s user 0.001s sys 0.007s
I20250831 19:54:42.703081 2022 raft_consensus.cc:357] T 520b7d1fbd1c4814b42c102aeb250f72 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:42.703330 2022 raft_consensus.cc:383] T 520b7d1fbd1c4814b42c102aeb250f72 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:42.703418 2022 raft_consensus.cc:738] T 520b7d1fbd1c4814b42c102aeb250f72 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:42.704793 2029 ts_tablet_manager.cc:1918] T a53bd61ca20a4e879c22f22852749324 P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:42.705713 2029 log.cc:1199] T a53bd61ca20a4e879c22f22852749324 P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/a53bd61ca20a4e879c22f22852749324
I20250831 19:54:42.706521 2029 ts_tablet_manager.cc:1939] T a53bd61ca20a4e879c22f22852749324 P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:54:42.707930 1428 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet a53bd61ca20a4e879c22f22852749324 (table default.table_5b498fbba7b34ca49b2d2706a1787053 [id=42fb4ac1f28146339375e6c29735ed44]) successfully deleted
I20250831 19:54:42.710498 2023 tablet_bootstrap.cc:492] T 520b7d1fbd1c4814b42c102aeb250f72 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:42.710747 2023 ts_tablet_manager.cc:1397] T 520b7d1fbd1c4814b42c102aeb250f72 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.090s user 0.002s sys 0.007s
I20250831 19:54:42.711671 2023 raft_consensus.cc:357] T 520b7d1fbd1c4814b42c102aeb250f72 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:42.711932 2023 raft_consensus.cc:383] T 520b7d1fbd1c4814b42c102aeb250f72 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:42.712020 2023 raft_consensus.cc:738] T 520b7d1fbd1c4814b42c102aeb250f72 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:42.713181 2022 consensus_queue.cc:260] T 520b7d1fbd1c4814b42c102aeb250f72 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:42.719188 2022 ts_tablet_manager.cc:1428] T 520b7d1fbd1c4814b42c102aeb250f72 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.017s user 0.002s sys 0.000s
I20250831 19:54:42.723985 2022 tablet_bootstrap.cc:492] T 9cf4a20941f045adb66114df127c84a0 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:42.726022 2022 tablet_bootstrap.cc:654] T 9cf4a20941f045adb66114df127c84a0 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:42.727257 2023 consensus_queue.cc:260] T 520b7d1fbd1c4814b42c102aeb250f72 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:42.729164 2023 ts_tablet_manager.cc:1428] T 520b7d1fbd1c4814b42c102aeb250f72 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.018s user 0.001s sys 0.001s
I20250831 19:54:42.729486 2023 tablet_bootstrap.cc:492] T 9cf4a20941f045adb66114df127c84a0 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:42.730734 2032 tablet_bootstrap.cc:492] T fa69535d223d494db28f4a9444b18e79 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:42.730930 2032 ts_tablet_manager.cc:1397] T fa69535d223d494db28f4a9444b18e79 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.045s user 0.017s sys 0.015s
I20250831 19:54:42.731729 2032 raft_consensus.cc:357] T fa69535d223d494db28f4a9444b18e79 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:42.731936 2032 raft_consensus.cc:383] T fa69535d223d494db28f4a9444b18e79 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:42.732012 2032 raft_consensus.cc:738] T fa69535d223d494db28f4a9444b18e79 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:42.733557 2023 tablet_bootstrap.cc:654] T 9cf4a20941f045adb66114df127c84a0 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:42.735059 2032 consensus_queue.cc:260] T fa69535d223d494db28f4a9444b18e79 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:42.735616 2022 tablet_bootstrap.cc:492] T 9cf4a20941f045adb66114df127c84a0 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:42.735757 2022 ts_tablet_manager.cc:1397] T 9cf4a20941f045adb66114df127c84a0 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.000s
I20250831 19:54:42.736828 2032 ts_tablet_manager.cc:1428] T fa69535d223d494db28f4a9444b18e79 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20250831 19:54:42.741547 2022 raft_consensus.cc:357] T 9cf4a20941f045adb66114df127c84a0 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:42.741807 2022 raft_consensus.cc:383] T 9cf4a20941f045adb66114df127c84a0 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:42.741912 2022 raft_consensus.cc:738] T 9cf4a20941f045adb66114df127c84a0 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:42.742199 2022 consensus_queue.cc:260] T 9cf4a20941f045adb66114df127c84a0 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:42.745342 2022 ts_tablet_manager.cc:1428] T 9cf4a20941f045adb66114df127c84a0 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20250831 19:54:42.748250 2022 tablet_bootstrap.cc:492] T fa69535d223d494db28f4a9444b18e79 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:42.750548 2022 tablet_bootstrap.cc:654] T fa69535d223d494db28f4a9444b18e79 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:42.753448 2023 tablet_bootstrap.cc:492] T 9cf4a20941f045adb66114df127c84a0 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:42.753672 2023 ts_tablet_manager.cc:1397] T 9cf4a20941f045adb66114df127c84a0 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.024s user 0.002s sys 0.016s
I20250831 19:54:42.754642 2023 raft_consensus.cc:357] T 9cf4a20941f045adb66114df127c84a0 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:42.754855 2023 raft_consensus.cc:383] T 9cf4a20941f045adb66114df127c84a0 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:42.754940 2023 raft_consensus.cc:738] T 9cf4a20941f045adb66114df127c84a0 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:42.755184 2023 consensus_queue.cc:260] T 9cf4a20941f045adb66114df127c84a0 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:42.755962 2023 ts_tablet_manager.cc:1428] T 9cf4a20941f045adb66114df127c84a0 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250831 19:54:42.756218 2023 tablet_bootstrap.cc:492] T fa69535d223d494db28f4a9444b18e79 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:42.758128 2023 tablet_bootstrap.cc:654] T fa69535d223d494db28f4a9444b18e79 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:42.762471 2022 tablet_bootstrap.cc:492] T fa69535d223d494db28f4a9444b18e79 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:42.762665 2022 ts_tablet_manager.cc:1397] T fa69535d223d494db28f4a9444b18e79 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.014s user 0.005s sys 0.002s
I20250831 19:54:42.763955 2022 raft_consensus.cc:357] T fa69535d223d494db28f4a9444b18e79 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:42.764245 2022 raft_consensus.cc:383] T fa69535d223d494db28f4a9444b18e79 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:42.764350 2022 raft_consensus.cc:738] T fa69535d223d494db28f4a9444b18e79 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:42.764712 2022 consensus_queue.cc:260] T fa69535d223d494db28f4a9444b18e79 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:42.765974 2023 tablet_bootstrap.cc:492] T fa69535d223d494db28f4a9444b18e79 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:42.766127 2023 ts_tablet_manager.cc:1397] T fa69535d223d494db28f4a9444b18e79 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.008s
I20250831 19:54:42.766799 2023 raft_consensus.cc:357] T fa69535d223d494db28f4a9444b18e79 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:42.766984 2023 raft_consensus.cc:383] T fa69535d223d494db28f4a9444b18e79 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:42.767060 2023 raft_consensus.cc:738] T fa69535d223d494db28f4a9444b18e79 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:42.767302 2023 consensus_queue.cc:260] T fa69535d223d494db28f4a9444b18e79 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:42.768330 2022 ts_tablet_manager.cc:1428] T fa69535d223d494db28f4a9444b18e79 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20250831 19:54:42.769085 2023 ts_tablet_manager.cc:1428] T fa69535d223d494db28f4a9444b18e79 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20250831 19:54:42.846977 2160 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.1.253:45581 every 8 connection(s)
I20250831 19:54:42.847047 2042 rpc_server.cc:307] RPC server started. Bound to: 127.1.1.253:45581
I20250831 19:54:42.849298 2042 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-1/data/info.pb
I20250831 19:54:42.852872 1031 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskfwTdIj/build/asan/bin/kudu as pid 2042
I20250831 19:54:42.858697 2161 sys_catalog.cc:263] Verifying existing consensus state
I20250831 19:54:42.864111 2161 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Bootstrap starting.
I20250831 19:54:42.868341 2068 raft_consensus.cc:491] T fa69535d223d494db28f4a9444b18e79 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:42.868513 2068 raft_consensus.cc:513] T fa69535d223d494db28f4a9444b18e79 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:42.869138 2068 leader_election.cc:290] T fa69535d223d494db28f4a9444b18e79 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197), 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237)
I20250831 19:54:42.869720 1903 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "fa69535d223d494db28f4a9444b18e79" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:42.869925 1903 raft_consensus.cc:2466] T fa69535d223d494db28f4a9444b18e79 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 0.
I20250831 19:54:42.870329 1634 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "fa69535d223d494db28f4a9444b18e79" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:42.870517 1634 raft_consensus.cc:2466] T fa69535d223d494db28f4a9444b18e79 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 0.
I20250831 19:54:42.871011 1706 leader_election.cc:304] T fa69535d223d494db28f4a9444b18e79 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:42.871086 1437 catalog_manager.cc:3460] renamed table default.table_9b6f788ff1a344e389223816b5593761 [id=bd456415108d49989ef0bc2af91eb2f0] in HMS: new name default.table_ca86d7dcbfdc477da58b5308247443e7
I20250831 19:54:42.871296 2068 raft_consensus.cc:2802] T fa69535d223d494db28f4a9444b18e79 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:42.871380 2068 raft_consensus.cc:491] T fa69535d223d494db28f4a9444b18e79 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:42.871485 2068 raft_consensus.cc:3058] T fa69535d223d494db28f4a9444b18e79 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:42.874081 2068 raft_consensus.cc:513] T fa69535d223d494db28f4a9444b18e79 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:42.875686 1903 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "fa69535d223d494db28f4a9444b18e79" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:54:42.877044 1634 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "fa69535d223d494db28f4a9444b18e79" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:54:42.877213 1634 raft_consensus.cc:3058] T fa69535d223d494db28f4a9444b18e79 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:42.878240 2161 log.cc:826] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Log is configured to *not* fsync() on all Append() calls
I20250831 19:54:42.880105 1634 raft_consensus.cc:2466] T fa69535d223d494db28f4a9444b18e79 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:54:42.880955 1706 leader_election.cc:304] T fa69535d223d494db28f4a9444b18e79 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:42.881319 2067 raft_consensus.cc:2802] T fa69535d223d494db28f4a9444b18e79 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:42.881450 2067 raft_consensus.cc:695] T fa69535d223d494db28f4a9444b18e79 P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: Becoming Leader. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Running, Role: LEADER
I20250831 19:54:42.881700 2067 consensus_queue.cc:237] T fa69535d223d494db28f4a9444b18e79 P de831f40fa1348a48a1f0260f4130197 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:42.884672 1903 raft_consensus.cc:3058] T fa69535d223d494db28f4a9444b18e79 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:42.888191 1903 raft_consensus.cc:2466] T fa69535d223d494db28f4a9444b18e79 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:54:42.892885 2068 leader_election.cc:290] T fa69535d223d494db28f4a9444b18e79 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Requested vote from peers 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197), 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237)
I20250831 19:54:42.902921 2161 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250831 19:54:42.903529 2161 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Bootstrap complete.
I20250831 19:54:42.911582 2161 raft_consensus.cc:357] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } }
I20250831 19:54:42.912467 2161 raft_consensus.cc:738] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4d46bc3ef5a4fbb8c9e4349c86c54a5, State: Initialized, Role: FOLLOWER
I20250831 19:54:42.913393 2161 consensus_queue.cc:260] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } }
I20250831 19:54:42.923417 2167 sys_catalog.cc:455] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } } }
I20250831 19:54:42.923583 1819 heartbeater.cc:344] Connected to a master server at 127.1.1.253:45581
I20250831 19:54:42.923671 2167 sys_catalog.cc:458] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [sys.catalog]: This master's current role is: FOLLOWER
I20250831 19:54:42.923748 1819 heartbeater.cc:499] Master 127.1.1.253:45581 was elected leader, sending a full tablet report...
I20250831 19:54:42.925231 2161 sys_catalog.cc:564] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [sys.catalog]: configured and running, proceeding with master startup.
I20250831 19:54:42.953536 1441 catalog_manager.cc:3460] renamed table default.table_5b498fbba7b34ca49b2d2706a1787053 [id=42fb4ac1f28146339375e6c29735ed44] in HMS: new name default.table_cc2bfcade74f4778bfa8e873869aba43
W20250831 19:54:42.978436 1499 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fa69535d223d494db28f4a9444b18e79 consensus state has no leader
I20250831 19:54:42.992131 1772 raft_consensus.cc:1273] T 87385809a6b648149025f41da6cc5070 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Refusing update from remote peer 2441fafe1d62429386f4631ad423567d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250831 19:54:42.992131 1634 raft_consensus.cc:1273] T 87385809a6b648149025f41da6cc5070 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Refusing update from remote peer 2441fafe1d62429386f4631ad423567d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250831 19:54:42.992874 2037 consensus_queue.cc:1035] T 87385809a6b648149025f41da6cc5070 P 2441fafe1d62429386f4631ad423567d [LEADER]: Connected to new peer: Peer: permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:42.993844 2037 consensus_queue.cc:1035] T 87385809a6b648149025f41da6cc5070 P 2441fafe1d62429386f4631ad423567d [LEADER]: Connected to new peer: Peer: permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:42.996738 1819 heartbeater.cc:499] Master 127.1.1.253:45581 was elected leader, sending a full tablet report...
I20250831 19:54:43.001027 2136 raft_consensus.cc:3058] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 1 FOLLOWER]: Advancing to term 2
I20250831 19:54:43.005321 1681 heartbeater.cc:344] Connected to a master server at 127.1.1.253:45581
I20250831 19:54:43.019460 2181 mvcc.cc:204] Tried to move back new op lower bound from 7195320659926777856 to 7195320657073610752. Current Snapshot: MvccSnapshot[applied={T|T < 7195320659926777856}]
W20250831 19:54:43.029691 1429 catalog_manager.cc:4726] Async tablet task AlterTable RPC for tablet fa69535d223d494db28f4a9444b18e79 (table default.table_cc2bfcade74f4778bfa8e873869aba43 [id=42fb4ac1f28146339375e6c29735ed44], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet fa69535d223d494db28f4a9444b18e79 consensus state has no leader
I20250831 19:54:43.031448 2184 tablet.cc:1722] T 87385809a6b648149025f41da6cc5070 P 2441fafe1d62429386f4631ad423567d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:43.045560 2185 tablet.cc:1722] T 87385809a6b648149025f41da6cc5070 P 89aa85d59c53436ebdf3074b13d14825: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:43.049504 1953 heartbeater.cc:344] Connected to a master server at 127.1.1.253:45581
I20250831 19:54:43.053609 1953 heartbeater.cc:499] Master 127.1.1.253:45581 was elected leader, sending a full tablet report...
I20250831 19:54:43.054318 2177 mvcc.cc:204] Tried to move back new op lower bound from 7195320659926777856 to 7195320657073610752. Current Snapshot: MvccSnapshot[applied={T|T < 7195320659926777856}]
I20250831 19:54:43.064646 1953 heartbeater.cc:344] Connected to a master server at 127.1.1.253:45581
I20250831 19:54:43.064649 2067 consensus_queue.cc:1035] T 8262f1d1898840c2822feda5279542bd P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:43.064817 1953 heartbeater.cc:499] Master 127.1.1.253:45581 was elected leader, sending a full tablet report...
I20250831 19:54:43.079489 1953 heartbeater.cc:499] Master 127.1.1.253:45581 was elected leader, sending a full tablet report...
I20250831 19:54:43.087985 2033 consensus_queue.cc:1035] T 8262f1d1898840c2822feda5279542bd P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:43.128634 2196 tablet.cc:1722] T 87385809a6b648149025f41da6cc5070 P de831f40fa1348a48a1f0260f4130197: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:43.155179 1443 catalog_manager.cc:3460] renamed table default.table_5d4cd226dc464a4f9faa6c6e65e4345c [id=1137b2754d104964bbe5bbaa4a0578b8] in HMS: new name default.table_9ad6a372f33845d4a9d69bd4b6a04c08
I20250831 19:54:43.156239 2125 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "2441fafe1d62429386f4631ad423567d" instance_seqno: 1756670080785002) as {username='slave'} at 127.1.1.195:39331; Asking this server to re-register.
I20250831 19:54:43.157121 2124 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" instance_seqno: 1756670079933967) as {username='slave'} at 127.1.1.193:58629; Asking this server to re-register.
I20250831 19:54:43.158043 1681 heartbeater.cc:461] Registering TS with master...
I20250831 19:54:43.158982 2197 sys_catalog.cc:455] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "ac75f6e7a0634a89beb9670950e95220" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } } }
I20250831 19:54:43.159125 2167 sys_catalog.cc:455] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ac75f6e7a0634a89beb9670950e95220. Latest consensus state: current_term: 2 leader_uuid: "ac75f6e7a0634a89beb9670950e95220" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } } }
I20250831 19:54:43.159296 2197 sys_catalog.cc:458] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [sys.catalog]: This master's current role is: FOLLOWER
I20250831 19:54:43.159323 2167 sys_catalog.cc:458] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [sys.catalog]: This master's current role is: FOLLOWER
I20250831 19:54:43.159682 1953 heartbeater.cc:461] Registering TS with master...
W20250831 19:54:43.160889 1439 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_f940275fb42644d4935e49d6143fb4ba in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250831 19:54:43.160918 1441 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:51254 (request call id 40) took 1477 ms. Trace:
I20250831 19:54:43.161044 1441 rpcz_store.cc:276] 0831 19:54:41.683243 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:41.683320 (+ 77us) service_pool.cc:225] Handling call
0831 19:54:41.746751 (+ 63431us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:43.160305 (+1413554us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:43.160631 (+ 326us) catalog_manager.cc:3683] Apply alter schema
0831 19:54:43.160876 (+ 245us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":1124046,"Hive Metastore.run_cpu_time_us":681,"Hive Metastore.run_wall_time_us":82491}
I20250831 19:54:43.161392 2033 raft_consensus.cc:491] T 9cf4a20941f045adb66114df127c84a0 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20250831 19:54:43.162212 1434 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_6965b0044d81462a8f1266e855ec1464 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250831 19:54:43.162292 2033 raft_consensus.cc:513] T 9cf4a20941f045adb66114df127c84a0 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:43.163081 2033 leader_election.cc:290] T 9cf4a20941f045adb66114df127c84a0 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197), 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237)
W20250831 19:54:43.163249 1438 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_5ca33d92f715421ab04c9570ac2ee4a0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250831 19:54:43.163838 1903 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9cf4a20941f045adb66114df127c84a0" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:43.164019 1903 raft_consensus.cc:2466] T 9cf4a20941f045adb66114df127c84a0 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 0.
I20250831 19:54:43.164364 1441 master_service.cc:948] ReplaceTablet: received request to replace tablet 87385809a6b648149025f41da6cc5070 from {username='slave'} at 127.0.0.1:51254
I20250831 19:54:43.164456 1437 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:51254 (request call id 39) took 1535 ms. Trace:
I20250831 19:54:43.164527 2126 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "de831f40fa1348a48a1f0260f4130197" instance_seqno: 1756670080362800) as {username='slave'} at 127.1.1.194:38161; Asking this server to re-register.
I20250831 19:54:43.164566 1437 rpcz_store.cc:276] 0831 19:54:41.629168 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:41.629238 (+ 70us) service_pool.cc:225] Handling call
0831 19:54:41.634647 (+ 5409us) spinlock_profiling.cc:243] Waited 4.81 ms on lock 0x616000040f54. stack: 00007f80ca7a17d6 00007f80ca7a1590 00007f80c97943ad 0000000000972d94 0000000000972d5d 00007f80d956c14d 00007f80d956c243 00007f80d622b941 00007f80dddb6a5d 00007f80ddf42126 00007f80d4d7b126 00007f80d4d7ae55 00007f80d154f2ce 00007f80d154e1ae 00007f80d15543e5 00007f80d1554d0f
0831 19:54:41.746498 (+111851us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:43.164030 (+1417532us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:43.164229 (+ 199us) catalog_manager.cc:3683] Apply alter schema
0831 19:54:43.164421 (+ 192us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":825603,"Hive Metastore.run_cpu_time_us":964,"Hive Metastore.run_wall_time_us":298572,"spinlock_wait_cycles":11052800}
I20250831 19:54:43.164876 1437 master_service.cc:948] ReplaceTablet: received request to replace tablet a53bd61ca20a4e879c22f22852749324 from {username='slave'} at 127.0.0.1:51254
I20250831 19:54:43.165174 1437 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:51254 (request call id 58) took 1066 ms. Trace:
I20250831 19:54:43.165248 1437 rpcz_store.cc:276] 0831 19:54:42.098227 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:43.164829 (+1066602us) service_pool.cc:225] Handling call
0831 19:54:43.165128 (+ 299us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250831 19:54:43.165268 1705 leader_election.cc:304] T 9cf4a20941f045adb66114df127c84a0 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:43.165542 2033 raft_consensus.cc:2802] T 9cf4a20941f045adb66114df127c84a0 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:43.165547 1437 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51254:
table { table_name: "default.Table_c3535015c99247ec86adfa665b7bc01c" } modify_external_catalogs: true
I20250831 19:54:43.165634 2033 raft_consensus.cc:491] T 9cf4a20941f045adb66114df127c84a0 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:43.165705 2033 raft_consensus.cc:3058] T 9cf4a20941f045adb66114df127c84a0 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:43.165724 1437 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51254:
table { table_name: "default.Table_c3535015c99247ec86adfa665b7bc01c" } modify_external_catalogs: true
I20250831 19:54:43.166271 2126 ts_manager.cc:194] Registered new tserver with Master: 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237)
I20250831 19:54:43.168056 1819 heartbeater.cc:461] Registering TS with master...
I20250831 19:54:43.168829 2033 raft_consensus.cc:513] T 9cf4a20941f045adb66114df127c84a0 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:43.169670 2033 leader_election.cc:290] T 9cf4a20941f045adb66114df127c84a0 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Requested vote from peers 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197), 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237)
W20250831 19:54:43.170003 1440 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_8adc00cc53274835bfe463ebf3bd3f45 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250831 19:54:43.170249 1903 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9cf4a20941f045adb66114df127c84a0" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:54:43.170430 1903 raft_consensus.cc:3058] T 9cf4a20941f045adb66114df127c84a0 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:43.170794 2126 ts_manager.cc:194] Registered new tserver with Master: de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:43.172811 1903 raft_consensus.cc:2466] T 9cf4a20941f045adb66114df127c84a0 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:54:43.173318 1634 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9cf4a20941f045adb66114df127c84a0" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:43.173540 1634 raft_consensus.cc:2466] T 9cf4a20941f045adb66114df127c84a0 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 0.
I20250831 19:54:43.173635 1633 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9cf4a20941f045adb66114df127c84a0" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:54:43.173815 1633 raft_consensus.cc:3058] T 9cf4a20941f045adb66114df127c84a0 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:43.173974 1705 leader_election.cc:304] T 9cf4a20941f045adb66114df127c84a0 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:43.174229 2033 raft_consensus.cc:2802] T 9cf4a20941f045adb66114df127c84a0 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:43.174736 2033 raft_consensus.cc:695] T 9cf4a20941f045adb66114df127c84a0 P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: Becoming Leader. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Running, Role: LEADER
I20250831 19:54:43.175025 2033 consensus_queue.cc:237] T 9cf4a20941f045adb66114df127c84a0 P de831f40fa1348a48a1f0260f4130197 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:43.176144 1633 raft_consensus.cc:2466] T 9cf4a20941f045adb66114df127c84a0 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:54:43.178015 2123 ts_manager.cc:194] Registered new tserver with Master: 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:43.180114 2188 catalog_manager.cc:1261] Loaded cluster ID: 003a9cb4df1f460dbfc9d2f57d96ced1
I20250831 19:54:43.180188 2188 catalog_manager.cc:1554] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: loading cluster ID for follower catalog manager: success
I20250831 19:54:43.176807 2003 sys_catalog.cc:455] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "ac75f6e7a0634a89beb9670950e95220" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } } }
I20250831 19:54:43.182082 2003 sys_catalog.cc:458] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220 [sys.catalog]: This master's current role is: LEADER
I20250831 19:54:43.188818 1441 catalog_manager.cc:5869] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220: Sending DeleteTablet for 3 replicas of tablet 87385809a6b648149025f41da6cc5070
I20250831 19:54:43.189572 1885 tablet_service.cc:1515] Processing DeleteTablet for tablet 87385809a6b648149025f41da6cc5070 with delete_type TABLET_DATA_DELETED (replaced by tablet e6b57e7935ac4fc5b1b3fff2e9d775b4) from {username='slave'} at 127.0.0.1:45900
I20250831 19:54:43.189564 1751 tablet_service.cc:1515] Processing DeleteTablet for tablet 87385809a6b648149025f41da6cc5070 with delete_type TABLET_DATA_DELETED (replaced by tablet e6b57e7935ac4fc5b1b3fff2e9d775b4) from {username='slave'} at 127.0.0.1:50662
I20250831 19:54:43.189790 2029 tablet_replica.cc:331] T 87385809a6b648149025f41da6cc5070 P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:54:43.189818 2028 tablet_replica.cc:331] T 87385809a6b648149025f41da6cc5070 P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:54:43.189966 2028 raft_consensus.cc:2241] T 87385809a6b648149025f41da6cc5070 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:43.189968 2029 raft_consensus.cc:2241] T 87385809a6b648149025f41da6cc5070 P 2441fafe1d62429386f4631ad423567d [term 1 LEADER]: Raft consensus shutting down.
I20250831 19:54:43.190188 2028 raft_consensus.cc:2270] T 87385809a6b648149025f41da6cc5070 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:43.190282 2029 raft_consensus.cc:2270] T 87385809a6b648149025f41da6cc5070 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:43.191497 2028 ts_tablet_manager.cc:1905] T 87385809a6b648149025f41da6cc5070 P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:43.192353 1441 catalog_manager.cc:6652] ReplaceTablet: tablet 87385809a6b648149025f41da6cc5070 deleted and replaced by tablet e6b57e7935ac4fc5b1b3fff2e9d775b4
I20250831 19:54:43.192552 1441 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:51254 (request call id 57) took 1106 ms. Trace:
I20250831 19:54:43.192775 1441 rpcz_store.cc:276] 0831 19:54:42.085926 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:43.164310 (+1078384us) service_pool.cc:225] Handling call
0831 19:54:43.192502 (+ 28192us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:43.166387 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:43.166494 (+ 107us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:43.166499 (+ 5us) write_op.cc:435] Acquired schema lock
0831 19:54:43.166501 (+ 2us) tablet.cc:660] Decoding operations
0831 19:54:43.166595 (+ 94us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:43.166607 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:43.166612 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:43.166676 (+ 64us) tablet.cc:699] Row locks acquired
0831 19:54:43.166678 (+ 2us) write_op.cc:260] PREPARE: finished
0831 19:54:43.166711 (+ 33us) write_op.cc:270] Start()
0831 19:54:43.166742 (+ 31us) write_op.cc:276] Timestamp: P: 1756670083166676 usec, L: 0
0831 19:54:43.166745 (+ 3us) op_driver.cc:348] REPLICATION: starting
0831 19:54:43.166901 (+ 156us) log.cc:844] Serialized 655 byte log entry
0831 19:54:43.180593 (+ 13692us) op_driver.cc:464] REPLICATION: finished
0831 19:54:43.180709 (+ 116us) write_op.cc:301] APPLY: starting
0831 19:54:43.180724 (+ 15us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:43.180770 (+ 46us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:43.180799 (+ 29us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:43.180898 (+ 99us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:43.180945 (+ 47us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0831 19:54:43.180953 (+ 8us) write_op.cc:312] APPLY: finished
0831 19:54:43.181031 (+ 78us) log.cc:844] Serialized 28 byte log entry
0831 19:54:43.181094 (+ 63us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:43.181114 (+ 20us) write_op.cc:454] Released schema lock
0831 19:54:43.181122 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0831 19:54:43.181185 (+ 63us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:43.181189 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":71,"apply.run_cpu_time_us":469,"apply.run_wall_time_us":468,"num_ops":2,"prepare.queue_time_us":1073,"prepare.run_cpu_time_us":608,"prepare.run_wall_time_us":608,"raft.queue_time_us":842,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":228,"replication_time_us":13820}]]}
I20250831 19:54:43.197953 2068 consensus_queue.cc:1035] T 1bdb24444f114d12bb4c2b19c6b3eef2 P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:43.198493 2029 ts_tablet_manager.cc:1905] T 87385809a6b648149025f41da6cc5070 P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250831 19:54:43.199753 1499 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f318ccc4400f4830b6a80e27b002b562 consensus state has no leader
I20250831 19:54:43.200636 1443 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:51254 (request call id 46) took 1473 ms. Trace:
I20250831 19:54:43.200768 1443 rpcz_store.cc:276] 0831 19:54:41.726639 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:41.873177 (+146538us) service_pool.cc:225] Handling call
0831 19:54:42.979501 (+1106324us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:43.200144 (+220643us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:43.200367 (+ 223us) catalog_manager.cc:3683] Apply alter schema
0831 19:54:43.200579 (+ 212us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":3580,"Hive Metastore.run_cpu_time_us":580,"Hive Metastore.run_wall_time_us":171852}
I20250831 19:54:43.202473 1885 tablet_service.cc:1468] Processing CreateTablet for tablet e6b57e7935ac4fc5b1b3fff2e9d775b4 (DEFAULT_TABLE table=default.table_ca86d7dcbfdc477da58b5308247443e7 [id=bd456415108d49989ef0bc2af91eb2f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:43.202407 1443 catalog_manager.cc:5582] T f318ccc4400f4830b6a80e27b002b562 P 2441fafe1d62429386f4631ad423567d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2441fafe1d62429386f4631ad423567d (127.1.1.195). New cstate: current_term: 1 leader_uuid: "2441fafe1d62429386f4631ad423567d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: HEALTHY } } }
I20250831 19:54:43.202865 1885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6b57e7935ac4fc5b1b3fff2e9d775b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:43.202827 1443 catalog_manager.cc:5674] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237) does not have the latest schema for tablet f318ccc4400f4830b6a80e27b002b562 (table default.table_9ad6a372f33845d4a9d69bd4b6a04c08 [id=1137b2754d104964bbe5bbaa4a0578b8]). Expected version 1 got 0
I20250831 19:54:43.203047 1443 catalog_manager.cc:5674] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237) does not have the latest schema for tablet fa69535d223d494db28f4a9444b18e79 (table default.table_cc2bfcade74f4778bfa8e873869aba43 [id=42fb4ac1f28146339375e6c29735ed44]). Expected version 1 got 0
I20250831 19:54:43.205996 2029 ts_tablet_manager.cc:1918] T 87385809a6b648149025f41da6cc5070 P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250831 19:54:43.206027 1751 tablet_service.cc:1468] Processing CreateTablet for tablet e6b57e7935ac4fc5b1b3fff2e9d775b4 (DEFAULT_TABLE table=default.table_ca86d7dcbfdc477da58b5308247443e7 [id=bd456415108d49989ef0bc2af91eb2f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:43.206179 2029 log.cc:1199] T 87385809a6b648149025f41da6cc5070 P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/87385809a6b648149025f41da6cc5070
I20250831 19:54:43.206378 1751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6b57e7935ac4fc5b1b3fff2e9d775b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:43.206553 2029 ts_tablet_manager.cc:1939] T 87385809a6b648149025f41da6cc5070 P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:54:43.207933 1428 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet 87385809a6b648149025f41da6cc5070 (table default.table_ca86d7dcbfdc477da58b5308247443e7 [id=bd456415108d49989ef0bc2af91eb2f0]) successfully deleted
I20250831 19:54:43.208441 2188 catalog_manager.cc:1576] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: acquiring CA information for follower catalog manager: success
I20250831 19:54:43.211916 2022 tablet_bootstrap.cc:492] T e6b57e7935ac4fc5b1b3fff2e9d775b4 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:43.213537 2022 tablet_bootstrap.cc:654] T e6b57e7935ac4fc5b1b3fff2e9d775b4 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:43.215174 2188 catalog_manager.cc:1604] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20250831 19:54:43.220095 2028 ts_tablet_manager.cc:1918] T 87385809a6b648149025f41da6cc5070 P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250831 19:54:43.220265 1884 tablet_service.cc:1515] Processing DeleteTablet for tablet 87385809a6b648149025f41da6cc5070 with delete_type TABLET_DATA_DELETED (replaced by tablet e6b57e7935ac4fc5b1b3fff2e9d775b4) from {username='slave'} at 127.0.0.1:45900
W20250831 19:54:43.220793 1428 catalog_manager.cc:4895] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): delete failed for tablet 87385809a6b648149025f41da6cc5070 because the tablet was not found. No further retry: Not found: Tablet not found: 87385809a6b648149025f41da6cc5070
I20250831 19:54:43.222061 1443 catalog_manager.cc:5674] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197) does not have the latest schema for tablet fa69535d223d494db28f4a9444b18e79 (table default.table_cc2bfcade74f4778bfa8e873869aba43 [id=42fb4ac1f28146339375e6c29735ed44]). Expected version 1 got 0
I20250831 19:54:43.223243 1443 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51254:
name: "default.Table_9706596e6715417ebc8fb06420b56bde"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:43.224915 2067 consensus_queue.cc:1035] T 1bdb24444f114d12bb4c2b19c6b3eef2 P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:43.226315 1441 catalog_manager.cc:5582] T fa69535d223d494db28f4a9444b18e79 P de831f40fa1348a48a1f0260f4130197 reported cstate change: term changed from 0 to 1, leader changed from <none> to de831f40fa1348a48a1f0260f4130197 (127.1.1.194). New cstate: current_term: 1 leader_uuid: "de831f40fa1348a48a1f0260f4130197" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } }
I20250831 19:54:43.226791 1441 catalog_manager.cc:5674] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475) does not have the latest schema for tablet fa69535d223d494db28f4a9444b18e79 (table default.table_cc2bfcade74f4778bfa8e873869aba43 [id=42fb4ac1f28146339375e6c29735ed44]). Expected version 1 got 0
I20250831 19:54:43.235855 2032 tablet_bootstrap.cc:492] T e6b57e7935ac4fc5b1b3fff2e9d775b4 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:43.237288 2028 log.cc:1199] T 87385809a6b648149025f41da6cc5070 P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/87385809a6b648149025f41da6cc5070
I20250831 19:54:43.237419 2032 tablet_bootstrap.cc:654] T e6b57e7935ac4fc5b1b3fff2e9d775b4 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:43.237721 2028 ts_tablet_manager.cc:1939] T 87385809a6b648149025f41da6cc5070 P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
I20250831 19:54:43.238703 1430 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet 87385809a6b648149025f41da6cc5070 (table default.table_ca86d7dcbfdc477da58b5308247443e7 [id=bd456415108d49989ef0bc2af91eb2f0]) successfully deleted
I20250831 19:54:43.244959 2022 tablet_bootstrap.cc:492] T e6b57e7935ac4fc5b1b3fff2e9d775b4 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:43.245101 2022 ts_tablet_manager.cc:1397] T e6b57e7935ac4fc5b1b3fff2e9d775b4 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.033s user 0.002s sys 0.009s
I20250831 19:54:43.248489 2022 raft_consensus.cc:357] T e6b57e7935ac4fc5b1b3fff2e9d775b4 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:43.248696 2022 raft_consensus.cc:383] T e6b57e7935ac4fc5b1b3fff2e9d775b4 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:43.248791 2022 raft_consensus.cc:738] T e6b57e7935ac4fc5b1b3fff2e9d775b4 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:43.248960 1751 tablet_service.cc:1515] Processing DeleteTablet for tablet 87385809a6b648149025f41da6cc5070 with delete_type TABLET_DATA_DELETED (replaced by tablet e6b57e7935ac4fc5b1b3fff2e9d775b4) from {username='slave'} at 127.0.0.1:50662
W20250831 19:54:43.256258 1430 catalog_manager.cc:4895] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): delete failed for tablet 87385809a6b648149025f41da6cc5070 because the tablet was not found. No further retry: Not found: Tablet not found: 87385809a6b648149025f41da6cc5070
I20250831 19:54:43.257479 1441 catalog_manager.cc:5582] T 9cf4a20941f045adb66114df127c84a0 P de831f40fa1348a48a1f0260f4130197 reported cstate change: term changed from 0 to 1, leader changed from <none> to de831f40fa1348a48a1f0260f4130197 (127.1.1.194). New cstate: current_term: 1 leader_uuid: "de831f40fa1348a48a1f0260f4130197" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } }
I20250831 19:54:43.257923 2022 consensus_queue.cc:260] T e6b57e7935ac4fc5b1b3fff2e9d775b4 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:43.263862 2022 ts_tablet_manager.cc:1428] T e6b57e7935ac4fc5b1b3fff2e9d775b4 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.016s user 0.001s sys 0.001s
I20250831 19:54:43.273576 1441 catalog_manager.cc:5674] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475) does not have the latest schema for tablet e6b57e7935ac4fc5b1b3fff2e9d775b4 (table default.table_ca86d7dcbfdc477da58b5308247443e7 [id=bd456415108d49989ef0bc2af91eb2f0]). Expected version 1 got 0
I20250831 19:54:43.277532 2033 consensus_queue.cc:1035] T 223b0437260545beb12c8aa2235c5d38 P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:43.278494 1613 tablet_service.cc:1515] Processing DeleteTablet for tablet 87385809a6b648149025f41da6cc5070 with delete_type TABLET_DATA_DELETED (replaced by tablet e6b57e7935ac4fc5b1b3fff2e9d775b4) from {username='slave'} at 127.0.0.1:51018
I20250831 19:54:43.279052 1614 tablet_service.cc:1468] Processing CreateTablet for tablet e6b57e7935ac4fc5b1b3fff2e9d775b4 (DEFAULT_TABLE table=default.table_ca86d7dcbfdc477da58b5308247443e7 [id=bd456415108d49989ef0bc2af91eb2f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:43.279417 1614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6b57e7935ac4fc5b1b3fff2e9d775b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:43.279749 2032 tablet_bootstrap.cc:492] T e6b57e7935ac4fc5b1b3fff2e9d775b4 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:43.281608 2032 ts_tablet_manager.cc:1397] T e6b57e7935ac4fc5b1b3fff2e9d775b4 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.046s user 0.002s sys 0.010s
I20250831 19:54:43.282992 2210 tablet_replica.cc:331] T 87385809a6b648149025f41da6cc5070 P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:54:43.283226 2210 raft_consensus.cc:2241] T 87385809a6b648149025f41da6cc5070 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:43.283329 2032 raft_consensus.cc:357] T e6b57e7935ac4fc5b1b3fff2e9d775b4 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:43.283509 2032 raft_consensus.cc:383] T e6b57e7935ac4fc5b1b3fff2e9d775b4 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:43.283596 2032 raft_consensus.cc:738] T e6b57e7935ac4fc5b1b3fff2e9d775b4 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:43.284966 2032 consensus_queue.cc:260] T e6b57e7935ac4fc5b1b3fff2e9d775b4 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:43.285401 2210 raft_consensus.cc:2270] T 87385809a6b648149025f41da6cc5070 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:43.286520 2210 ts_tablet_manager.cc:1905] T 87385809a6b648149025f41da6cc5070 P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:43.286823 1634 raft_consensus.cc:1273] T fa69535d223d494db28f4a9444b18e79 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Refusing update from remote peer de831f40fa1348a48a1f0260f4130197: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250831 19:54:43.288542 2067 consensus_queue.cc:1035] T fa69535d223d494db28f4a9444b18e79 P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:43.289386 2085 consensus_queue.cc:1035] T f56c31854bc94b45879493264daf7ef3 P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:43.289932 1903 raft_consensus.cc:1273] T fa69535d223d494db28f4a9444b18e79 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Refusing update from remote peer de831f40fa1348a48a1f0260f4130197: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250831 19:54:43.290079 2211 tablet_bootstrap.cc:492] T e6b57e7935ac4fc5b1b3fff2e9d775b4 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:43.291000 2067 consensus_queue.cc:1035] T fa69535d223d494db28f4a9444b18e79 P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:43.295886 2210 ts_tablet_manager.cc:1918] T 87385809a6b648149025f41da6cc5070 P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250831 19:54:43.297842 2211 tablet_bootstrap.cc:654] T e6b57e7935ac4fc5b1b3fff2e9d775b4 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:43.300670 2210 log.cc:1199] T 87385809a6b648149025f41da6cc5070 P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/87385809a6b648149025f41da6cc5070
I20250831 19:54:43.301158 2210 ts_tablet_manager.cc:1939] T 87385809a6b648149025f41da6cc5070 P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
I20250831 19:54:43.304023 2068 consensus_queue.cc:1035] T 223b0437260545beb12c8aa2235c5d38 P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:43.304672 2196 tablet.cc:1722] T fa69535d223d494db28f4a9444b18e79 P de831f40fa1348a48a1f0260f4130197: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:43.304920 2180 mvcc.cc:204] Tried to move back new op lower bound from 7195320661135241216 to 7195320659486031872. Current Snapshot: MvccSnapshot[applied={T|T < 7195320661135241216}]
I20250831 19:54:43.308744 2184 tablet.cc:1722] T fa69535d223d494db28f4a9444b18e79 P 2441fafe1d62429386f4631ad423567d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:43.314880 2085 raft_consensus.cc:491] T 520b7d1fbd1c4814b42c102aeb250f72 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:43.315052 2085 raft_consensus.cc:513] T 520b7d1fbd1c4814b42c102aeb250f72 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:43.315724 2085 leader_election.cc:290] T 520b7d1fbd1c4814b42c102aeb250f72 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237)
I20250831 19:54:43.316352 1904 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "520b7d1fbd1c4814b42c102aeb250f72" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:43.316537 2032 ts_tablet_manager.cc:1428] T e6b57e7935ac4fc5b1b3fff2e9d775b4 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.034s user 0.001s sys 0.001s
I20250831 19:54:43.316583 1904 raft_consensus.cc:2466] T 520b7d1fbd1c4814b42c102aeb250f72 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 0.
I20250831 19:54:43.317610 1568 leader_election.cc:304] T 520b7d1fbd1c4814b42c102aeb250f72 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:54:43.304149 1429 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet 87385809a6b648149025f41da6cc5070 (table default.table_ca86d7dcbfdc477da58b5308247443e7 [id=bd456415108d49989ef0bc2af91eb2f0]) successfully deleted
I20250831 19:54:43.318352 2085 raft_consensus.cc:2802] T 520b7d1fbd1c4814b42c102aeb250f72 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:43.318449 2085 raft_consensus.cc:491] T 520b7d1fbd1c4814b42c102aeb250f72 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:43.318547 2085 raft_consensus.cc:3058] T 520b7d1fbd1c4814b42c102aeb250f72 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:43.321601 2185 tablet.cc:1722] T fa69535d223d494db28f4a9444b18e79 P 89aa85d59c53436ebdf3074b13d14825: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:43.323491 1771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "520b7d1fbd1c4814b42c102aeb250f72" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:43.323738 1771 raft_consensus.cc:2466] T 520b7d1fbd1c4814b42c102aeb250f72 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 0.
I20250831 19:54:43.325754 2085 raft_consensus.cc:513] T 520b7d1fbd1c4814b42c102aeb250f72 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:43.327039 1904 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "520b7d1fbd1c4814b42c102aeb250f72" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:54:43.327268 1904 raft_consensus.cc:3058] T 520b7d1fbd1c4814b42c102aeb250f72 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:43.329658 2067 raft_consensus.cc:491] T e6b57e7935ac4fc5b1b3fff2e9d775b4 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:43.329833 2067 raft_consensus.cc:513] T e6b57e7935ac4fc5b1b3fff2e9d775b4 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:43.330406 2067 leader_election.cc:290] T e6b57e7935ac4fc5b1b3fff2e9d775b4 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197), 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237)
I20250831 19:54:43.330912 2085 leader_election.cc:290] T 520b7d1fbd1c4814b42c102aeb250f72 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Requested vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237)
I20250831 19:54:43.331450 1771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "520b7d1fbd1c4814b42c102aeb250f72" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197"
I20250831 19:54:43.331676 1771 raft_consensus.cc:3058] T 520b7d1fbd1c4814b42c102aeb250f72 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:43.334868 1771 raft_consensus.cc:2466] T 520b7d1fbd1c4814b42c102aeb250f72 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1.
I20250831 19:54:43.335536 1906 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e6b57e7935ac4fc5b1b3fff2e9d775b4" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:43.335692 1570 leader_election.cc:304] T 520b7d1fbd1c4814b42c102aeb250f72 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:43.335755 1906 raft_consensus.cc:2466] T e6b57e7935ac4fc5b1b3fff2e9d775b4 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 0.
I20250831 19:54:43.336232 1705 leader_election.cc:304] T e6b57e7935ac4fc5b1b3fff2e9d775b4 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:43.336688 2085 raft_consensus.cc:2802] T 520b7d1fbd1c4814b42c102aeb250f72 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:43.336864 2085 raft_consensus.cc:695] T 520b7d1fbd1c4814b42c102aeb250f72 P 89aa85d59c53436ebdf3074b13d14825 [term 1 LEADER]: Becoming Leader. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Running, Role: LEADER
I20250831 19:54:43.337123 2085 consensus_queue.cc:237] T 520b7d1fbd1c4814b42c102aeb250f72 P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:43.337944 2067 raft_consensus.cc:2802] T e6b57e7935ac4fc5b1b3fff2e9d775b4 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:43.338034 2067 raft_consensus.cc:491] T e6b57e7935ac4fc5b1b3fff2e9d775b4 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:43.338124 2067 raft_consensus.cc:3058] T e6b57e7935ac4fc5b1b3fff2e9d775b4 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:43.340519 2067 raft_consensus.cc:513] T e6b57e7935ac4fc5b1b3fff2e9d775b4 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:43.341069 1904 raft_consensus.cc:2466] T 520b7d1fbd1c4814b42c102aeb250f72 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1.
I20250831 19:54:43.341531 1633 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e6b57e7935ac4fc5b1b3fff2e9d775b4" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:54:43.341670 1634 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e6b57e7935ac4fc5b1b3fff2e9d775b4" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
W20250831 19:54:43.342113 1706 leader_election.cc:343] T e6b57e7935ac4fc5b1b3fff2e9d775b4 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): Illegal state: must be running to vote when last-logged opid is not known
W20250831 19:54:43.342351 1706 leader_election.cc:343] T e6b57e7935ac4fc5b1b3fff2e9d775b4 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): Illegal state: must be running to vote when last-logged opid is not known
I20250831 19:54:43.344880 1904 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e6b57e7935ac4fc5b1b3fff2e9d775b4" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:54:43.345093 1904 raft_consensus.cc:3058] T e6b57e7935ac4fc5b1b3fff2e9d775b4 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
W20250831 19:54:43.345919 1441 catalog_manager.cc:5774] Failed to send AlterTable RPC for tablet e6b57e7935ac4fc5b1b3fff2e9d775b4 (table default.table_ca86d7dcbfdc477da58b5308247443e7 [id=bd456415108d49989ef0bc2af91eb2f0], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet e6b57e7935ac4fc5b1b3fff2e9d775b4 consensus state has no leader
I20250831 19:54:43.348150 1441 catalog_manager.cc:5674] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237) does not have the latest schema for tablet e6b57e7935ac4fc5b1b3fff2e9d775b4 (table default.table_ca86d7dcbfdc477da58b5308247443e7 [id=bd456415108d49989ef0bc2af91eb2f0]). Expected version 1 got 0
I20250831 19:54:43.348407 1904 raft_consensus.cc:2466] T e6b57e7935ac4fc5b1b3fff2e9d775b4 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:54:43.349624 1634 raft_consensus.cc:1273] T f318ccc4400f4830b6a80e27b002b562 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Refusing update from remote peer 2441fafe1d62429386f4631ad423567d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250831 19:54:43.349663 1441 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51254:
table { table_name: "default.Table_3691be9921f145f4a9495f2d669a5728" } modify_external_catalogs: true
I20250831 19:54:43.349843 1441 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51254:
table { table_name: "default.Table_3691be9921f145f4a9495f2d669a5728" } modify_external_catalogs: true
I20250831 19:54:43.345763 2067 leader_election.cc:290] T e6b57e7935ac4fc5b1b3fff2e9d775b4 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Requested vote from peers 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197), 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237)
I20250831 19:54:43.350174 2037 consensus_queue.cc:1035] T f318ccc4400f4830b6a80e27b002b562 P 2441fafe1d62429386f4631ad423567d [LEADER]: Connected to new peer: Peer: permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:43.348922 1705 leader_election.cc:304] T e6b57e7935ac4fc5b1b3fff2e9d775b4 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters: 89aa85d59c53436ebdf3074b13d14825
I20250831 19:54:43.352058 2067 raft_consensus.cc:2802] T e6b57e7935ac4fc5b1b3fff2e9d775b4 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:43.353705 2067 raft_consensus.cc:695] T e6b57e7935ac4fc5b1b3fff2e9d775b4 P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: Becoming Leader. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Running, Role: LEADER
I20250831 19:54:43.354045 2067 consensus_queue.cc:237] T e6b57e7935ac4fc5b1b3fff2e9d775b4 P de831f40fa1348a48a1f0260f4130197 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:43.356993 1771 raft_consensus.cc:1273] T f318ccc4400f4830b6a80e27b002b562 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Refusing update from remote peer 2441fafe1d62429386f4631ad423567d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250831 19:54:43.360433 2037 consensus_queue.cc:1035] T f318ccc4400f4830b6a80e27b002b562 P 2441fafe1d62429386f4631ad423567d [LEADER]: Connected to new peer: Peer: permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:43.367437 2213 consensus_queue.cc:1035] T f56c31854bc94b45879493264daf7ef3 P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250831 19:54:43.380129 2184 tablet.cc:1722] T f318ccc4400f4830b6a80e27b002b562 P 2441fafe1d62429386f4631ad423567d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:43.381541 2185 tablet.cc:1722] T f318ccc4400f4830b6a80e27b002b562 P 89aa85d59c53436ebdf3074b13d14825: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:43.386580 1442 catalog_manager.cc:3460] renamed table default.table_2f4abeeb816647b88ebe1d9e9e09c99f [id=6063834030bb409d8ee666a753351551] in HMS: new name default.table_f2750ddd8ef049ef8bca6b19ca6b68a6
I20250831 19:54:43.400372 2196 tablet.cc:1722] T f318ccc4400f4830b6a80e27b002b562 P de831f40fa1348a48a1f0260f4130197: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:43.401875 2211 tablet_bootstrap.cc:492] T e6b57e7935ac4fc5b1b3fff2e9d775b4 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:43.402081 2211 ts_tablet_manager.cc:1397] T e6b57e7935ac4fc5b1b3fff2e9d775b4 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.113s user 0.007s sys 0.001s
I20250831 19:54:43.402805 2211 raft_consensus.cc:357] T e6b57e7935ac4fc5b1b3fff2e9d775b4 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:43.403050 2211 raft_consensus.cc:383] T e6b57e7935ac4fc5b1b3fff2e9d775b4 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:43.403180 2211 raft_consensus.cc:738] T e6b57e7935ac4fc5b1b3fff2e9d775b4 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:43.403452 2211 consensus_queue.cc:260] T e6b57e7935ac4fc5b1b3fff2e9d775b4 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:43.406839 2211 ts_tablet_manager.cc:1428] T e6b57e7935ac4fc5b1b3fff2e9d775b4 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.005s user 0.000s sys 0.001s
I20250831 19:54:43.412510 2189 mvcc.cc:204] Tried to move back new op lower bound from 7195320659864723456 to 7195320653983125504. Current Snapshot: MvccSnapshot[applied={T|T < 7195320659864723456}]
I20250831 19:54:43.441221 1439 catalog_manager.cc:2149] created HMS catalog entry for table [id=0850f2b0e9324dd0a210fa7b2609c769]
I20250831 19:54:43.450115 1439 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51254 (request call id 48) took 1620 ms. Trace:
I20250831 19:54:43.450242 1439 rpcz_store.cc:276] 0831 19:54:41.829170 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:41.975289 (+146119us) service_pool.cc:225] Handling call
0831 19:54:43.161024 (+1185735us) catalog_manager.cc:2076] Acquired catalog manager lock
0831 19:54:43.161538 (+ 514us) catalog_manager.cc:2122] Created new table and tablet info
0831 19:54:43.441169 (+279631us) catalog_manager.cc:2148] Created new table in HMS catalog
0831 19:54:43.449806 (+ 8637us) catalog_manager.cc:2182] Wrote table and tablets to system table
0831 19:54:43.449940 (+ 134us) catalog_manager.cc:2216] Inserted table and tablets into CatalogManager maps
0831 19:54:43.450053 (+ 113us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:43.442045 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:43.442159 (+ 114us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:43.442165 (+ 6us) write_op.cc:435] Acquired schema lock
0831 19:54:43.442168 (+ 3us) tablet.cc:660] Decoding operations
0831 19:54:43.442269 (+ 101us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:43.442285 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:43.442290 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:43.442397 (+ 107us) tablet.cc:699] Row locks acquired
0831 19:54:43.442399 (+ 2us) write_op.cc:260] PREPARE: finished
0831 19:54:43.442439 (+ 40us) write_op.cc:270] Start()
0831 19:54:43.442475 (+ 36us) write_op.cc:276] Timestamp: P: 1756670083442372 usec, L: 0
0831 19:54:43.442478 (+ 3us) op_driver.cc:348] REPLICATION: starting
0831 19:54:43.442687 (+ 209us) log.cc:844] Serialized 432 byte log entry
0831 19:54:43.448934 (+ 6247us) op_driver.cc:464] REPLICATION: finished
0831 19:54:43.449071 (+ 137us) write_op.cc:301] APPLY: starting
0831 19:54:43.449086 (+ 15us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:43.449130 (+ 44us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:43.449155 (+ 25us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:43.449260 (+ 105us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:43.449292 (+ 32us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0831 19:54:43.449299 (+ 7us) write_op.cc:312] APPLY: finished
0831 19:54:43.449374 (+ 75us) log.cc:844] Serialized 28 byte log entry
0831 19:54:43.449451 (+ 77us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:43.449469 (+ 18us) write_op.cc:454] Released schema lock
0831 19:54:43.449475 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0831 19:54:43.449557 (+ 82us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:43.449560 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":224718,"Hive Metastore.run_cpu_time_us":232,"Hive Metastore.run_wall_time_us":54534,"child_traces":[["op",{"apply.queue_time_us":86,"apply.run_cpu_time_us":479,"apply.run_wall_time_us":479,"num_ops":2,"prepare.queue_time_us":55,"prepare.run_cpu_time_us":762,"prepare.run_wall_time_us":762,"raft.queue_time_us":452,"raft.run_cpu_time_us":497,"raft.run_wall_time_us":495,"replication_time_us":6428}]]}
I20250831 19:54:43.452154 1439 catalog_manager.cc:5582] T 520b7d1fbd1c4814b42c102aeb250f72 P 89aa85d59c53436ebdf3074b13d14825 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193). New cstate: current_term: 1 leader_uuid: "89aa85d59c53436ebdf3074b13d14825" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } }
I20250831 19:54:43.472698 1751 tablet_service.cc:1468] Processing CreateTablet for tablet 79a678e2a5ba495095865769a25ff68a (DEFAULT_TABLE table=default.table_f940275fb42644d4935e49d6143fb4ba [id=0850f2b0e9324dd0a210fa7b2609c769]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:43.472960 1614 tablet_service.cc:1468] Processing CreateTablet for tablet 79a678e2a5ba495095865769a25ff68a (DEFAULT_TABLE table=default.table_f940275fb42644d4935e49d6143fb4ba [id=0850f2b0e9324dd0a210fa7b2609c769]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:43.473192 1751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79a678e2a5ba495095865769a25ff68a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:43.473393 1614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79a678e2a5ba495095865769a25ff68a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:43.474766 1434 catalog_manager.cc:2149] created HMS catalog entry for table [id=8e6395b817aa4efc955cf0ed00f54e14]
I20250831 19:54:43.478211 1885 tablet_service.cc:1468] Processing CreateTablet for tablet 79a678e2a5ba495095865769a25ff68a (DEFAULT_TABLE table=default.table_f940275fb42644d4935e49d6143fb4ba [id=0850f2b0e9324dd0a210fa7b2609c769]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:43.478657 1885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79a678e2a5ba495095865769a25ff68a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:43.479390 2211 tablet_bootstrap.cc:492] T 79a678e2a5ba495095865769a25ff68a P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:43.480904 2211 tablet_bootstrap.cc:654] T 79a678e2a5ba495095865769a25ff68a P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:43.490065 1434 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51254 (request call id 50) took 1562 ms. Trace:
I20250831 19:54:43.490178 1434 rpcz_store.cc:276] 0831 19:54:41.927460 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:42.187006 (+259546us) service_pool.cc:225] Handling call
0831 19:54:43.162287 (+975281us) catalog_manager.cc:2076] Acquired catalog manager lock
0831 19:54:43.162717 (+ 430us) catalog_manager.cc:2122] Created new table and tablet info
0831 19:54:43.474729 (+312012us) catalog_manager.cc:2148] Created new table in HMS catalog
0831 19:54:43.489777 (+ 15048us) catalog_manager.cc:2182] Wrote table and tablets to system table
0831 19:54:43.489907 (+ 130us) catalog_manager.cc:2216] Inserted table and tablets into CatalogManager maps
0831 19:54:43.490004 (+ 97us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:43.483755 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:43.483858 (+ 103us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:43.483864 (+ 6us) write_op.cc:435] Acquired schema lock
0831 19:54:43.483866 (+ 2us) tablet.cc:660] Decoding operations
0831 19:54:43.483957 (+ 91us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:43.483968 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:43.483973 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:43.484050 (+ 77us) tablet.cc:699] Row locks acquired
0831 19:54:43.484052 (+ 2us) write_op.cc:260] PREPARE: finished
0831 19:54:43.484088 (+ 36us) write_op.cc:270] Start()
0831 19:54:43.484119 (+ 31us) write_op.cc:276] Timestamp: P: 1756670083483659 usec, L: 0
0831 19:54:43.484122 (+ 3us) op_driver.cc:348] REPLICATION: starting
0831 19:54:43.484320 (+ 198us) log.cc:844] Serialized 432 byte log entry
0831 19:54:43.488866 (+ 4546us) op_driver.cc:464] REPLICATION: finished
0831 19:54:43.489252 (+ 386us) write_op.cc:301] APPLY: starting
0831 19:54:43.489266 (+ 14us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:43.489305 (+ 39us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:43.489338 (+ 33us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:43.489421 (+ 83us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:43.489472 (+ 51us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0831 19:54:43.489479 (+ 7us) write_op.cc:312] APPLY: finished
0831 19:54:43.489544 (+ 65us) log.cc:844] Serialized 28 byte log entry
0831 19:54:43.489595 (+ 51us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:43.489611 (+ 16us) write_op.cc:454] Released schema lock
0831 19:54:43.489616 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0831 19:54:43.489685 (+ 69us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:43.489689 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":278132,"Hive Metastore.run_cpu_time_us":223,"Hive Metastore.run_wall_time_us":33617,"spinlock_wait_cycles":768,"child_traces":[["op",{"apply.queue_time_us":335,"apply.run_cpu_time_us":429,"apply.run_wall_time_us":428,"num_ops":2,"prepare.queue_time_us":8524,"prepare.run_cpu_time_us":685,"prepare.run_wall_time_us":686,"raft.queue_time_us":481,"raft.run_cpu_time_us":275,"raft.run_wall_time_us":274,"replication_time_us":4718}]]}
I20250831 19:54:43.505949 2032 tablet_bootstrap.cc:492] T 79a678e2a5ba495095865769a25ff68a P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:43.507596 2032 tablet_bootstrap.cc:654] T 79a678e2a5ba495095865769a25ff68a P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:43.509222 1614 tablet_service.cc:1468] Processing CreateTablet for tablet 9eea7f86bbcd40e88907dea27deba8de (DEFAULT_TABLE table=default.table_6965b0044d81462a8f1266e855ec1464 [id=8e6395b817aa4efc955cf0ed00f54e14]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:43.509706 1614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9eea7f86bbcd40e88907dea27deba8de. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:43.509769 1752 tablet_service.cc:1468] Processing CreateTablet for tablet 9eea7f86bbcd40e88907dea27deba8de (DEFAULT_TABLE table=default.table_6965b0044d81462a8f1266e855ec1464 [id=8e6395b817aa4efc955cf0ed00f54e14]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:43.510295 1752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9eea7f86bbcd40e88907dea27deba8de. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:43.514729 1884 tablet_service.cc:1468] Processing CreateTablet for tablet 9eea7f86bbcd40e88907dea27deba8de (DEFAULT_TABLE table=default.table_6965b0044d81462a8f1266e855ec1464 [id=8e6395b817aa4efc955cf0ed00f54e14]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:43.515125 1884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9eea7f86bbcd40e88907dea27deba8de. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:43.524633 2022 tablet_bootstrap.cc:492] T 9eea7f86bbcd40e88907dea27deba8de P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:43.526249 2022 tablet_bootstrap.cc:654] T 9eea7f86bbcd40e88907dea27deba8de P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:43.527895 2022 tablet_bootstrap.cc:492] T 9eea7f86bbcd40e88907dea27deba8de P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:43.528084 2022 ts_tablet_manager.cc:1397] T 9eea7f86bbcd40e88907dea27deba8de P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20250831 19:54:43.529919 2022 raft_consensus.cc:357] T 9eea7f86bbcd40e88907dea27deba8de P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:43.530110 2022 raft_consensus.cc:383] T 9eea7f86bbcd40e88907dea27deba8de P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:43.530169 2022 raft_consensus.cc:738] T 9eea7f86bbcd40e88907dea27deba8de P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:43.530411 2022 consensus_queue.cc:260] T 9eea7f86bbcd40e88907dea27deba8de P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:43.534588 2022 ts_tablet_manager.cc:1428] T 9eea7f86bbcd40e88907dea27deba8de P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.006s user 0.002s sys 0.001s
I20250831 19:54:43.539225 1439 catalog_manager.cc:6127] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220: default.table_cc2bfcade74f4778bfa8e873869aba43 [id=42fb4ac1f28146339375e6c29735ed44] alter complete (version 1)
I20250831 19:54:43.544834 1434 catalog_manager.cc:5674] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197) does not have the latest schema for tablet e6b57e7935ac4fc5b1b3fff2e9d775b4 (table default.table_ca86d7dcbfdc477da58b5308247443e7 [id=bd456415108d49989ef0bc2af91eb2f0]). Expected version 1 got 0
I20250831 19:54:43.554214 2022 tablet_bootstrap.cc:492] T 79a678e2a5ba495095865769a25ff68a P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:43.555838 2022 tablet_bootstrap.cc:654] T 79a678e2a5ba495095865769a25ff68a P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:43.564677 1439 catalog_manager.cc:5674] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237) does not have the latest schema for tablet e6b57e7935ac4fc5b1b3fff2e9d775b4 (table default.table_ca86d7dcbfdc477da58b5308247443e7 [id=bd456415108d49989ef0bc2af91eb2f0]). Expected version 1 got 0
I20250831 19:54:43.565265 1434 catalog_manager.cc:6127] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220: default.table_9ad6a372f33845d4a9d69bd4b6a04c08 [id=1137b2754d104964bbe5bbaa4a0578b8] alter complete (version 1)
I20250831 19:54:43.568935 1434 catalog_manager.cc:5582] T e6b57e7935ac4fc5b1b3fff2e9d775b4 P de831f40fa1348a48a1f0260f4130197 reported cstate change: term changed from 0 to 1, leader changed from <none> to de831f40fa1348a48a1f0260f4130197 (127.1.1.194). New cstate: current_term: 1 leader_uuid: "de831f40fa1348a48a1f0260f4130197" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } }
I20250831 19:54:43.572386 1434 catalog_manager.cc:5674] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475) does not have the latest schema for tablet e6b57e7935ac4fc5b1b3fff2e9d775b4 (table default.table_ca86d7dcbfdc477da58b5308247443e7 [id=bd456415108d49989ef0bc2af91eb2f0]). Expected version 1 got 0
I20250831 19:54:43.586359 1439 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51254:
name: "default.Table_544f7d804f564e83be8fb83049aa8dea"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:43.588886 1434 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51254:
name: "default.Table_486ee0377a714038aaf8f3f5b1ad7f79"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:43.593883 2022 tablet_bootstrap.cc:492] T 79a678e2a5ba495095865769a25ff68a P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:43.594087 2022 ts_tablet_manager.cc:1397] T 79a678e2a5ba495095865769a25ff68a P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.040s user 0.004s sys 0.005s
I20250831 19:54:43.595043 2032 tablet_bootstrap.cc:492] T 79a678e2a5ba495095865769a25ff68a P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:43.595049 2211 tablet_bootstrap.cc:492] T 79a678e2a5ba495095865769a25ff68a P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:43.595197 2211 ts_tablet_manager.cc:1397] T 79a678e2a5ba495095865769a25ff68a P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.116s user 0.020s sys 0.025s
I20250831 19:54:43.595260 2032 ts_tablet_manager.cc:1397] T 79a678e2a5ba495095865769a25ff68a P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.089s user 0.032s sys 0.020s
I20250831 19:54:43.595435 2022 raft_consensus.cc:357] T 79a678e2a5ba495095865769a25ff68a P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:43.595609 2022 raft_consensus.cc:383] T 79a678e2a5ba495095865769a25ff68a P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:43.595718 2022 raft_consensus.cc:738] T 79a678e2a5ba495095865769a25ff68a P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:43.595929 2032 raft_consensus.cc:357] T 79a678e2a5ba495095865769a25ff68a P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:43.595942 2022 consensus_queue.cc:260] T 79a678e2a5ba495095865769a25ff68a P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:43.596117 2032 raft_consensus.cc:383] T 79a678e2a5ba495095865769a25ff68a P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:43.596190 2032 raft_consensus.cc:738] T 79a678e2a5ba495095865769a25ff68a P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:43.596395 2211 raft_consensus.cc:357] T 79a678e2a5ba495095865769a25ff68a P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:43.596441 2032 consensus_queue.cc:260] T 79a678e2a5ba495095865769a25ff68a P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:43.597671 2032 ts_tablet_manager.cc:1428] T 79a678e2a5ba495095865769a25ff68a P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250831 19:54:43.597956 2032 tablet_bootstrap.cc:492] T 9eea7f86bbcd40e88907dea27deba8de P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:43.599479 2032 tablet_bootstrap.cc:654] T 9eea7f86bbcd40e88907dea27deba8de P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:43.599534 2022 ts_tablet_manager.cc:1428] T 79a678e2a5ba495095865769a25ff68a P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20250831 19:54:43.596664 2211 raft_consensus.cc:383] T 79a678e2a5ba495095865769a25ff68a P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:43.600225 2211 raft_consensus.cc:738] T 79a678e2a5ba495095865769a25ff68a P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:43.602345 2211 consensus_queue.cc:260] T 79a678e2a5ba495095865769a25ff68a P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:43.604272 1435 catalog_manager.cc:3460] renamed table default.table_9f89ae10786e4a2ca85d49ff2a7b7800 [id=b1daf7387b1749019e5377ab08146d20] in HMS: new name default.table_e2ff8984d73f4f05a25d1c132ea949fb
I20250831 19:54:43.607559 2211 ts_tablet_manager.cc:1428] T 79a678e2a5ba495095865769a25ff68a P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
I20250831 19:54:43.611414 2211 tablet_bootstrap.cc:492] T 9eea7f86bbcd40e88907dea27deba8de P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:43.613008 2211 tablet_bootstrap.cc:654] T 9eea7f86bbcd40e88907dea27deba8de P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:43.635459 1438 catalog_manager.cc:2149] created HMS catalog entry for table [id=2ee6bb3de6424a89b5adf289bbb2f9ef]
I20250831 19:54:43.643872 1438 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51254 (request call id 53) took 1625 ms. Trace:
I20250831 19:54:43.643985 1438 rpcz_store.cc:276] 0831 19:54:42.018737 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:42.567824 (+549087us) service_pool.cc:225] Handling call
0831 19:54:43.163334 (+595510us) catalog_manager.cc:2076] Acquired catalog manager lock
0831 19:54:43.163707 (+ 373us) catalog_manager.cc:2122] Created new table and tablet info
0831 19:54:43.635421 (+471714us) catalog_manager.cc:2148] Created new table in HMS catalog
0831 19:54:43.643599 (+ 8178us) catalog_manager.cc:2182] Wrote table and tablets to system table
0831 19:54:43.643706 (+ 107us) catalog_manager.cc:2216] Inserted table and tablets into CatalogManager maps
0831 19:54:43.643804 (+ 98us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:43.636390 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:43.636561 (+ 171us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:43.636569 (+ 8us) write_op.cc:435] Acquired schema lock
0831 19:54:43.636574 (+ 5us) tablet.cc:660] Decoding operations
0831 19:54:43.636705 (+ 131us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:43.636723 (+ 18us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:43.636731 (+ 8us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:43.636865 (+ 134us) tablet.cc:699] Row locks acquired
0831 19:54:43.636869 (+ 4us) write_op.cc:260] PREPARE: finished
0831 19:54:43.636912 (+ 43us) write_op.cc:270] Start()
0831 19:54:43.636957 (+ 45us) write_op.cc:276] Timestamp: P: 1756670083636466 usec, L: 0
0831 19:54:43.636962 (+ 5us) op_driver.cc:348] REPLICATION: starting
0831 19:54:43.637188 (+ 226us) log.cc:844] Serialized 432 byte log entry
0831 19:54:43.642727 (+ 5539us) op_driver.cc:464] REPLICATION: finished
0831 19:54:43.643158 (+ 431us) write_op.cc:301] APPLY: starting
0831 19:54:43.643174 (+ 16us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:43.643218 (+ 44us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:43.643240 (+ 22us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:43.643334 (+ 94us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:43.643369 (+ 35us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0831 19:54:43.643376 (+ 7us) write_op.cc:312] APPLY: finished
0831 19:54:43.643446 (+ 70us) log.cc:844] Serialized 28 byte log entry
0831 19:54:43.643504 (+ 58us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:43.643521 (+ 17us) write_op.cc:454] Released schema lock
0831 19:54:43.643527 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0831 19:54:43.643597 (+ 70us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:43.643600 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":440432,"Hive Metastore.run_cpu_time_us":256,"Hive Metastore.run_wall_time_us":31100,"child_traces":[["op",{"apply.queue_time_us":362,"apply.run_cpu_time_us":439,"apply.run_wall_time_us":439,"num_ops":2,"prepare.queue_time_us":63,"prepare.run_cpu_time_us":929,"prepare.run_wall_time_us":930,"raft.queue_time_us":1734,"raft.run_cpu_time_us":635,"raft.run_wall_time_us":635,"replication_time_us":5738}]]}
I20250831 19:54:43.647614 2032 tablet_bootstrap.cc:492] T 9eea7f86bbcd40e88907dea27deba8de P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:43.647776 2032 ts_tablet_manager.cc:1397] T 9eea7f86bbcd40e88907dea27deba8de P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.050s user 0.004s sys 0.005s
I20250831 19:54:43.648119 1438 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51254:
name: "default.Table_5660fc6b1a9846a6bd36b56e553a8f35"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:43.648523 2032 raft_consensus.cc:357] T 9eea7f86bbcd40e88907dea27deba8de P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:43.648694 2032 raft_consensus.cc:383] T 9eea7f86bbcd40e88907dea27deba8de P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:43.648808 2032 raft_consensus.cc:738] T 9eea7f86bbcd40e88907dea27deba8de P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:43.649051 2032 consensus_queue.cc:260] T 9eea7f86bbcd40e88907dea27deba8de P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:43.650292 2032 ts_tablet_manager.cc:1428] T 9eea7f86bbcd40e88907dea27deba8de P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250831 19:54:43.660581 1885 tablet_service.cc:1468] Processing CreateTablet for tablet 15fd6c30770b4c1599a812d4722b2bad (DEFAULT_TABLE table=default.table_5ca33d92f715421ab04c9570ac2ee4a0 [id=2ee6bb3de6424a89b5adf289bbb2f9ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:43.660759 1614 tablet_service.cc:1468] Processing CreateTablet for tablet 15fd6c30770b4c1599a812d4722b2bad (DEFAULT_TABLE table=default.table_5ca33d92f715421ab04c9570ac2ee4a0 [id=2ee6bb3de6424a89b5adf289bbb2f9ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:43.661010 1885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15fd6c30770b4c1599a812d4722b2bad. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:43.661144 1614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15fd6c30770b4c1599a812d4722b2bad. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:43.666101 1751 tablet_service.cc:1468] Processing CreateTablet for tablet 15fd6c30770b4c1599a812d4722b2bad (DEFAULT_TABLE table=default.table_5ca33d92f715421ab04c9570ac2ee4a0 [id=2ee6bb3de6424a89b5adf289bbb2f9ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:43.666554 1751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15fd6c30770b4c1599a812d4722b2bad. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:43.672327 1634 raft_consensus.cc:3058] T e6b57e7935ac4fc5b1b3fff2e9d775b4 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:43.672451 1903 raft_consensus.cc:1273] T e6b57e7935ac4fc5b1b3fff2e9d775b4 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Refusing update from remote peer de831f40fa1348a48a1f0260f4130197: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250831 19:54:43.673023 2068 consensus_queue.cc:1035] T e6b57e7935ac4fc5b1b3fff2e9d775b4 P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:43.675822 1634 raft_consensus.cc:1273] T e6b57e7935ac4fc5b1b3fff2e9d775b4 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Refusing update from remote peer de831f40fa1348a48a1f0260f4130197: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250831 19:54:43.676384 2068 consensus_queue.cc:1035] T e6b57e7935ac4fc5b1b3fff2e9d775b4 P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:43.680748 2196 tablet.cc:1722] T e6b57e7935ac4fc5b1b3fff2e9d775b4 P de831f40fa1348a48a1f0260f4130197: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:43.685197 2184 tablet.cc:1722] T e6b57e7935ac4fc5b1b3fff2e9d775b4 P 2441fafe1d62429386f4631ad423567d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:43.693465 2185 tablet.cc:1722] T e6b57e7935ac4fc5b1b3fff2e9d775b4 P 89aa85d59c53436ebdf3074b13d14825: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:43.706691 2032 tablet_bootstrap.cc:492] T 15fd6c30770b4c1599a812d4722b2bad P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:43.708351 2032 tablet_bootstrap.cc:654] T 15fd6c30770b4c1599a812d4722b2bad P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:43.710198 2022 tablet_bootstrap.cc:492] T 15fd6c30770b4c1599a812d4722b2bad P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:43.710844 2032 tablet_bootstrap.cc:492] T 15fd6c30770b4c1599a812d4722b2bad P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:43.710984 2032 ts_tablet_manager.cc:1397] T 15fd6c30770b4c1599a812d4722b2bad P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.001s
I20250831 19:54:43.711818 2022 tablet_bootstrap.cc:654] T 15fd6c30770b4c1599a812d4722b2bad P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:43.711731 2032 raft_consensus.cc:357] T 15fd6c30770b4c1599a812d4722b2bad P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:43.711963 2032 raft_consensus.cc:383] T 15fd6c30770b4c1599a812d4722b2bad P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:43.712042 2032 raft_consensus.cc:738] T 15fd6c30770b4c1599a812d4722b2bad P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:43.712273 2032 consensus_queue.cc:260] T 15fd6c30770b4c1599a812d4722b2bad P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:43.713510 2032 ts_tablet_manager.cc:1428] T 15fd6c30770b4c1599a812d4722b2bad P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250831 19:54:43.714627 2022 tablet_bootstrap.cc:492] T 15fd6c30770b4c1599a812d4722b2bad P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:43.714861 2022 ts_tablet_manager.cc:1397] T 15fd6c30770b4c1599a812d4722b2bad P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20250831 19:54:43.715770 2022 raft_consensus.cc:357] T 15fd6c30770b4c1599a812d4722b2bad P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:43.716032 2022 raft_consensus.cc:383] T 15fd6c30770b4c1599a812d4722b2bad P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:43.716154 2022 raft_consensus.cc:738] T 15fd6c30770b4c1599a812d4722b2bad P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:43.716501 2022 consensus_queue.cc:260] T 15fd6c30770b4c1599a812d4722b2bad P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:43.718577 2022 ts_tablet_manager.cc:1428] T 15fd6c30770b4c1599a812d4722b2bad P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20250831 19:54:43.721043 2211 tablet_bootstrap.cc:492] T 9eea7f86bbcd40e88907dea27deba8de P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:43.721190 2211 ts_tablet_manager.cc:1397] T 9eea7f86bbcd40e88907dea27deba8de P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.110s user 0.015s sys 0.011s
I20250831 19:54:43.722002 2211 raft_consensus.cc:357] T 9eea7f86bbcd40e88907dea27deba8de P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:43.722172 2211 raft_consensus.cc:383] T 9eea7f86bbcd40e88907dea27deba8de P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:43.722249 2211 raft_consensus.cc:738] T 9eea7f86bbcd40e88907dea27deba8de P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:43.722438 2211 consensus_queue.cc:260] T 9eea7f86bbcd40e88907dea27deba8de P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:43.722980 2211 ts_tablet_manager.cc:1428] T 9eea7f86bbcd40e88907dea27deba8de P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250831 19:54:43.723275 2211 tablet_bootstrap.cc:492] T 15fd6c30770b4c1599a812d4722b2bad P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:43.724629 2211 tablet_bootstrap.cc:654] T 15fd6c30770b4c1599a812d4722b2bad P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:43.730197 2211 tablet_bootstrap.cc:492] T 15fd6c30770b4c1599a812d4722b2bad P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:43.730398 2211 ts_tablet_manager.cc:1397] T 15fd6c30770b4c1599a812d4722b2bad P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20250831 19:54:43.731204 2211 raft_consensus.cc:357] T 15fd6c30770b4c1599a812d4722b2bad P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:43.731459 2211 raft_consensus.cc:383] T 15fd6c30770b4c1599a812d4722b2bad P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:43.731602 2211 raft_consensus.cc:738] T 15fd6c30770b4c1599a812d4722b2bad P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:43.731986 2211 consensus_queue.cc:260] T 15fd6c30770b4c1599a812d4722b2bad P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:43.736958 2211 ts_tablet_manager.cc:1428] T 15fd6c30770b4c1599a812d4722b2bad P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20250831 19:54:43.744732 2085 raft_consensus.cc:491] T 9eea7f86bbcd40e88907dea27deba8de P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:43.744869 2085 raft_consensus.cc:513] T 9eea7f86bbcd40e88907dea27deba8de P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:43.745404 2085 leader_election.cc:290] T 9eea7f86bbcd40e88907dea27deba8de P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237)
I20250831 19:54:43.746148 1903 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9eea7f86bbcd40e88907dea27deba8de" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:43.746335 1903 raft_consensus.cc:2466] T 9eea7f86bbcd40e88907dea27deba8de P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 0.
I20250831 19:54:43.747212 1771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9eea7f86bbcd40e88907dea27deba8de" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:43.747437 1771 raft_consensus.cc:2466] T 9eea7f86bbcd40e88907dea27deba8de P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 0.
I20250831 19:54:43.748136 1568 leader_election.cc:304] T 9eea7f86bbcd40e88907dea27deba8de P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:54:43.748811 2085 raft_consensus.cc:2802] T 9eea7f86bbcd40e88907dea27deba8de P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:43.748914 2085 raft_consensus.cc:491] T 9eea7f86bbcd40e88907dea27deba8de P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:43.748983 2085 raft_consensus.cc:3058] T 9eea7f86bbcd40e88907dea27deba8de P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:43.751628 2085 raft_consensus.cc:513] T 9eea7f86bbcd40e88907dea27deba8de P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:43.752622 1771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9eea7f86bbcd40e88907dea27deba8de" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197"
I20250831 19:54:43.752799 1771 raft_consensus.cc:3058] T 9eea7f86bbcd40e88907dea27deba8de P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:43.755257 1771 raft_consensus.cc:2466] T 9eea7f86bbcd40e88907dea27deba8de P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1.
I20250831 19:54:43.755717 1570 leader_election.cc:304] T 9eea7f86bbcd40e88907dea27deba8de P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:43.755985 2221 raft_consensus.cc:2802] T 9eea7f86bbcd40e88907dea27deba8de P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:43.756109 2221 raft_consensus.cc:695] T 9eea7f86bbcd40e88907dea27deba8de P 89aa85d59c53436ebdf3074b13d14825 [term 1 LEADER]: Becoming Leader. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Running, Role: LEADER
I20250831 19:54:43.756381 2221 consensus_queue.cc:237] T 9eea7f86bbcd40e88907dea27deba8de P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:43.758622 1903 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9eea7f86bbcd40e88907dea27deba8de" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:54:43.758816 1903 raft_consensus.cc:3058] T 9eea7f86bbcd40e88907dea27deba8de P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:43.761690 1903 raft_consensus.cc:2466] T 9eea7f86bbcd40e88907dea27deba8de P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1.
I20250831 19:54:43.762209 2085 leader_election.cc:290] T 9eea7f86bbcd40e88907dea27deba8de P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Requested vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237)
I20250831 19:54:43.933694 2037 raft_consensus.cc:491] T 79a678e2a5ba495095865769a25ff68a P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:43.933892 2037 raft_consensus.cc:513] T 79a678e2a5ba495095865769a25ff68a P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:43.934473 2037 leader_election.cc:290] T 79a678e2a5ba495095865769a25ff68a P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:43.935264 1771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "79a678e2a5ba495095865769a25ff68a" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:43.935478 1771 raft_consensus.cc:2466] T 79a678e2a5ba495095865769a25ff68a P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 0.
I20250831 19:54:43.936152 1633 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "79a678e2a5ba495095865769a25ff68a" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:43.936369 1633 raft_consensus.cc:2466] T 79a678e2a5ba495095865769a25ff68a P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 0.
I20250831 19:54:43.938102 1842 leader_election.cc:304] T 79a678e2a5ba495095865769a25ff68a P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:43.938796 2037 raft_consensus.cc:2802] T 79a678e2a5ba495095865769a25ff68a P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:43.938894 2037 raft_consensus.cc:491] T 79a678e2a5ba495095865769a25ff68a P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:43.938984 2037 raft_consensus.cc:3058] T 79a678e2a5ba495095865769a25ff68a P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:43.941608 2037 raft_consensus.cc:513] T 79a678e2a5ba495095865769a25ff68a P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:43.942615 1633 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "79a678e2a5ba495095865769a25ff68a" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:54:43.942852 1633 raft_consensus.cc:3058] T 79a678e2a5ba495095865769a25ff68a P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:43.945024 1633 raft_consensus.cc:2466] T 79a678e2a5ba495095865769a25ff68a P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 1.
I20250831 19:54:43.949645 1841 leader_election.cc:304] T 79a678e2a5ba495095865769a25ff68a P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:54:43.951910 2239 raft_consensus.cc:2802] T 79a678e2a5ba495095865769a25ff68a P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:43.954208 1771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "79a678e2a5ba495095865769a25ff68a" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197"
I20250831 19:54:43.954397 1771 raft_consensus.cc:3058] T 79a678e2a5ba495095865769a25ff68a P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:43.956902 1771 raft_consensus.cc:2466] T 79a678e2a5ba495095865769a25ff68a P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 1.
I20250831 19:54:43.957401 2037 leader_election.cc:290] T 79a678e2a5ba495095865769a25ff68a P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 election: Requested vote from peers 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:43.962239 2239 raft_consensus.cc:695] T 79a678e2a5ba495095865769a25ff68a P 2441fafe1d62429386f4631ad423567d [term 1 LEADER]: Becoming Leader. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Running, Role: LEADER
I20250831 19:54:43.962594 2239 consensus_queue.cc:237] T 79a678e2a5ba495095865769a25ff68a P 2441fafe1d62429386f4631ad423567d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:44.105647 2033 raft_consensus.cc:491] T 15fd6c30770b4c1599a812d4722b2bad P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:44.105826 2033 raft_consensus.cc:513] T 15fd6c30770b4c1599a812d4722b2bad P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:44.106415 2033 leader_election.cc:290] T 15fd6c30770b4c1599a812d4722b2bad P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197), 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237)
I20250831 19:54:44.107230 1903 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "15fd6c30770b4c1599a812d4722b2bad" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:44.107440 1903 raft_consensus.cc:2466] T 15fd6c30770b4c1599a812d4722b2bad P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 0.
I20250831 19:54:44.108127 1705 leader_election.cc:304] T 15fd6c30770b4c1599a812d4722b2bad P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:44.108873 1633 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "15fd6c30770b4c1599a812d4722b2bad" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:44.109048 1633 raft_consensus.cc:2466] T 15fd6c30770b4c1599a812d4722b2bad P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 0.
I20250831 19:54:44.109644 2033 raft_consensus.cc:2802] T 15fd6c30770b4c1599a812d4722b2bad P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:44.109741 2033 raft_consensus.cc:491] T 15fd6c30770b4c1599a812d4722b2bad P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:44.109805 2033 raft_consensus.cc:3058] T 15fd6c30770b4c1599a812d4722b2bad P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:44.116778 2033 raft_consensus.cc:513] T 15fd6c30770b4c1599a812d4722b2bad P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:44.117885 1903 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "15fd6c30770b4c1599a812d4722b2bad" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:54:44.117905 1633 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "15fd6c30770b4c1599a812d4722b2bad" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:54:44.118062 1633 raft_consensus.cc:3058] T 15fd6c30770b4c1599a812d4722b2bad P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:44.118093 1903 raft_consensus.cc:3058] T 15fd6c30770b4c1599a812d4722b2bad P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:44.119939 1903 raft_consensus.cc:2466] T 15fd6c30770b4c1599a812d4722b2bad P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:54:44.120306 1705 leader_election.cc:304] T 15fd6c30770b4c1599a812d4722b2bad P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:44.120570 2067 raft_consensus.cc:2802] T 15fd6c30770b4c1599a812d4722b2bad P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:44.120680 2067 raft_consensus.cc:695] T 15fd6c30770b4c1599a812d4722b2bad P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: Becoming Leader. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Running, Role: LEADER
I20250831 19:54:44.120965 2067 consensus_queue.cc:237] T 15fd6c30770b4c1599a812d4722b2bad P de831f40fa1348a48a1f0260f4130197 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:44.120456 1633 raft_consensus.cc:2466] T 15fd6c30770b4c1599a812d4722b2bad P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:54:44.123036 2033 leader_election.cc:290] T 15fd6c30770b4c1599a812d4722b2bad P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Requested vote from peers 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197), 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237)
I20250831 19:54:44.149581 1436 catalog_manager.cc:2706] deleted HMS catalog entry for table default.table_ae8ede59b2ad492daba0f5e783332e25 [id=a8017c2a018f4bd28637a2b8c5677286]
I20250831 19:54:44.160095 2243 raft_consensus.cc:491] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ac75f6e7a0634a89beb9670950e95220)
I20250831 19:54:44.160346 2243 raft_consensus.cc:513] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } }
I20250831 19:54:44.162467 2243 leader_election.cc:290] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259), ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943)
I20250831 19:54:44.163110 1452 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 59 } } ignore_live_leader: false dest_uuid: "ac75f6e7a0634a89beb9670950e95220" is_pre_election: true
I20250831 19:54:44.163300 1312 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 59 } } ignore_live_leader: false dest_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" is_pre_election: true
I20250831 19:54:44.163522 1312 raft_consensus.cc:2466] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4d46bc3ef5a4fbb8c9e4349c86c54a5 in term 2.
I20250831 19:54:44.164345 2105 leader_election.cc:304] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c830f6055d64a3b8a9f78b405ad8aa3, a4d46bc3ef5a4fbb8c9e4349c86c54a5; no voters: ac75f6e7a0634a89beb9670950e95220
I20250831 19:54:44.164574 2244 raft_consensus.cc:491] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ac75f6e7a0634a89beb9670950e95220)
I20250831 19:54:44.164780 2244 raft_consensus.cc:513] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } }
I20250831 19:54:44.164947 2243 raft_consensus.cc:2802] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20250831 19:54:44.165053 2243 raft_consensus.cc:491] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ac75f6e7a0634a89beb9670950e95220)
I20250831 19:54:44.165146 2243 raft_consensus.cc:3058] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 2 FOLLOWER]: Advancing to term 3
I20250831 19:54:44.167743 2243 raft_consensus.cc:513] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } }
I20250831 19:54:44.168669 1312 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 59 } } ignore_live_leader: false dest_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3"
I20250831 19:54:44.168850 1312 raft_consensus.cc:3058] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [term 2 FOLLOWER]: Advancing to term 3
I20250831 19:54:44.171535 1312 raft_consensus.cc:2466] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4d46bc3ef5a4fbb8c9e4349c86c54a5 in term 3.
I20250831 19:54:44.171968 2105 leader_election.cc:304] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c830f6055d64a3b8a9f78b405ad8aa3, a4d46bc3ef5a4fbb8c9e4349c86c54a5; no voters:
I20250831 19:54:44.178284 1440 catalog_manager.cc:2149] created HMS catalog entry for table [id=4098ece72dac48dfa9027440ad814225]
I20250831 19:54:44.179507 1452 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 59 } } ignore_live_leader: false dest_uuid: "ac75f6e7a0634a89beb9670950e95220"
I20250831 19:54:44.180241 2243 leader_election.cc:290] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 3 election: Requested vote from peers 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259), ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943)
I20250831 19:54:44.180590 2243 raft_consensus.cc:2802] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 3 FOLLOWER]: Leader election won for term 3
I20250831 19:54:44.180953 2243 raft_consensus.cc:695] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 3 LEADER]: Becoming Leader. State: Replica: a4d46bc3ef5a4fbb8c9e4349c86c54a5, State: Running, Role: LEADER
I20250831 19:54:44.181335 2243 consensus_queue.cc:237] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 59, Committed index: 59, Last appended: 2.59, Last appended by leader: 59, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } }
I20250831 19:54:44.183396 2243 sys_catalog.cc:455] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a4d46bc3ef5a4fbb8c9e4349c86c54a5. Latest consensus state: current_term: 3 leader_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } } }
I20250831 19:54:44.183782 2243 sys_catalog.cc:458] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [sys.catalog]: This master's current role is: LEADER
I20250831 19:54:44.187837 2221 consensus_queue.cc:1035] T 520b7d1fbd1c4814b42c102aeb250f72 P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:44.195230 2244 leader_election.cc:290] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a4d46bc3ef5a4fbb8c9e4349c86c54a5 (127.1.1.253:45581), ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943)
I20250831 19:54:44.195202 2223 consensus_queue.cc:1035] T 520b7d1fbd1c4814b42c102aeb250f72 P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:44.214586 2136 raft_consensus.cc:1238] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 3 LEADER]: Rejecting Update request from peer ac75f6e7a0634a89beb9670950e95220 for earlier term 2. Current term is 3. Ops: []
I20250831 19:54:44.215696 2254 consensus_queue.cc:1046] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 }, Status: INVALID_TERM, Last received: 2.59, Next index: 60, Last known committed idx: 59, Time since last communication: 0.000s
I20250831 19:54:44.216074 2254 consensus_queue.cc:1230] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220 [LEADER]: Peer a4d46bc3ef5a4fbb8c9e4349c86c54a5 log is divergent from this leader: its last log entry 3.60 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 59
I20250831 19:54:44.216679 2254 raft_consensus.cc:3053] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220 [term 2 LEADER]: Stepping down as leader of term 2
I20250831 19:54:44.216843 2254 raft_consensus.cc:738] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ac75f6e7a0634a89beb9670950e95220, State: Running, Role: LEADER
I20250831 19:54:44.217298 2254 consensus_queue.cc:260] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 59, Committed index: 59, Last appended: 2.61, Last appended by leader: 61, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } }
I20250831 19:54:44.217849 2254 raft_consensus.cc:3058] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220 [term 2 FOLLOWER]: Advancing to term 3
I20250831 19:54:44.220175 1452 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" candidate_term: 3 candidate_status { last_received { term: 2 index: 59 } } ignore_live_leader: false dest_uuid: "ac75f6e7a0634a89beb9670950e95220" is_pre_election: true
I20250831 19:54:44.222077 1452 raft_consensus.cc:2408] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c830f6055d64a3b8a9f78b405ad8aa3 for term 3 because replica has last-logged OpId of term: 2 index: 61, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 59.
I20250831 19:54:44.223819 2249 catalog_manager.cc:1477] Loading table and tablet metadata into memory...
I20250831 19:54:44.225514 1312 raft_consensus.cc:1238] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [term 3 FOLLOWER]: Rejecting Update request from peer ac75f6e7a0634a89beb9670950e95220 for earlier term 2. Current term is 3. Ops: []
I20250831 19:54:44.231624 2249 catalog_manager.cc:671] Loaded metadata for table default.table_f940275fb42644d4935e49d6143fb4ba [id=0850f2b0e9324dd0a210fa7b2609c769]
I20250831 19:54:44.232239 2249 catalog_manager.cc:671] Loaded metadata for table default.table_9ad6a372f33845d4a9d69bd4b6a04c08 [id=1137b2754d104964bbe5bbaa4a0578b8]
I20250831 19:54:44.233247 2249 catalog_manager.cc:671] Loaded metadata for table default.table_d961171a98f341b5945cfe0300337aec [id=2475332024a84359a43fe486d5488cba]
I20250831 19:54:44.233743 2249 catalog_manager.cc:671] Loaded metadata for table default.table_5ca33d92f715421ab04c9570ac2ee4a0 [id=2ee6bb3de6424a89b5adf289bbb2f9ef]
I20250831 19:54:44.234066 2249 catalog_manager.cc:671] Loaded metadata for table default.table_cc2bfcade74f4778bfa8e873869aba43 [id=42fb4ac1f28146339375e6c29735ed44]
I20250831 19:54:44.234354 2249 catalog_manager.cc:671] Loaded metadata for table default.table_3691be9921f145f4a9495f2d669a5728 [id=57a524cac79549ceaebc55dc51fb94ee]
I20250831 19:54:44.234714 2249 catalog_manager.cc:671] Loaded metadata for table default.table_2f4abeeb816647b88ebe1d9e9e09c99f [id=6063834030bb409d8ee666a753351551]
I20250831 19:54:44.235105 2249 catalog_manager.cc:671] Loaded metadata for table default.table_6965b0044d81462a8f1266e855ec1464 [id=8e6395b817aa4efc955cf0ed00f54e14]
I20250831 19:54:44.235469 2249 catalog_manager.cc:671] Loaded metadata for table default.table_ae8ede59b2ad492daba0f5e783332e25 [id=a8017c2a018f4bd28637a2b8c5677286]
I20250831 19:54:44.236395 2249 catalog_manager.cc:671] Loaded metadata for table default.table_9f89ae10786e4a2ca85d49ff2a7b7800 [id=b1daf7387b1749019e5377ab08146d20]
I20250831 19:54:44.236783 2249 catalog_manager.cc:671] Loaded metadata for table default.table_ca86d7dcbfdc477da58b5308247443e7 [id=bd456415108d49989ef0bc2af91eb2f0]
I20250831 19:54:44.237136 2249 catalog_manager.cc:671] Loaded metadata for table default.table_c3535015c99247ec86adfa665b7bc01c [id=ec56be26e67b43bfa7c5cb71edb64c8b]
I20250831 19:54:44.239274 2249 tablet_loader.cc:96] loaded metadata for tablet 15fd6c30770b4c1599a812d4722b2bad (table default.table_5ca33d92f715421ab04c9570ac2ee4a0 [id=2ee6bb3de6424a89b5adf289bbb2f9ef])
I20250831 19:54:44.239665 2249 tablet_loader.cc:96] loaded metadata for tablet 1bdb24444f114d12bb4c2b19c6b3eef2 (table default.table_3691be9921f145f4a9495f2d669a5728 [id=57a524cac79549ceaebc55dc51fb94ee])
I20250831 19:54:44.240007 2249 tablet_loader.cc:96] loaded metadata for tablet 223b0437260545beb12c8aa2235c5d38 (table default.table_ae8ede59b2ad492daba0f5e783332e25 [id=a8017c2a018f4bd28637a2b8c5677286])
I20250831 19:54:44.240322 2249 tablet_loader.cc:96] loaded metadata for tablet 520b7d1fbd1c4814b42c102aeb250f72 (table default.table_d961171a98f341b5945cfe0300337aec [id=2475332024a84359a43fe486d5488cba])
I20250831 19:54:44.240856 2249 tablet_loader.cc:96] loaded metadata for tablet 79a678e2a5ba495095865769a25ff68a (table default.table_f940275fb42644d4935e49d6143fb4ba [id=0850f2b0e9324dd0a210fa7b2609c769])
I20250831 19:54:44.241459 2249 tablet_loader.cc:96] loaded metadata for tablet 8262f1d1898840c2822feda5279542bd (table default.table_2f4abeeb816647b88ebe1d9e9e09c99f [id=6063834030bb409d8ee666a753351551])
I20250831 19:54:44.242058 2249 tablet_loader.cc:96] loaded metadata for tablet 9cf4a20941f045adb66114df127c84a0 (table default.table_9f89ae10786e4a2ca85d49ff2a7b7800 [id=b1daf7387b1749019e5377ab08146d20])
I20250831 19:54:44.242390 2249 tablet_loader.cc:96] loaded metadata for tablet 9eea7f86bbcd40e88907dea27deba8de (table default.table_6965b0044d81462a8f1266e855ec1464 [id=8e6395b817aa4efc955cf0ed00f54e14])
I20250831 19:54:44.243110 2249 tablet_loader.cc:96] loaded metadata for tablet e6b57e7935ac4fc5b1b3fff2e9d775b4 (table default.table_ca86d7dcbfdc477da58b5308247443e7 [id=bd456415108d49989ef0bc2af91eb2f0])
I20250831 19:54:44.243666 2249 tablet_loader.cc:96] loaded metadata for tablet f318ccc4400f4830b6a80e27b002b562 (table default.table_9ad6a372f33845d4a9d69bd4b6a04c08 [id=1137b2754d104964bbe5bbaa4a0578b8])
I20250831 19:54:44.243994 2249 tablet_loader.cc:96] loaded metadata for tablet f56c31854bc94b45879493264daf7ef3 (table default.table_c3535015c99247ec86adfa665b7bc01c [id=ec56be26e67b43bfa7c5cb71edb64c8b])
I20250831 19:54:44.244344 2249 tablet_loader.cc:96] loaded metadata for tablet fa69535d223d494db28f4a9444b18e79 (table default.table_cc2bfcade74f4778bfa8e873869aba43 [id=42fb4ac1f28146339375e6c29735ed44])
I20250831 19:54:44.244594 2249 catalog_manager.cc:1486] Initializing Kudu cluster ID...
I20250831 19:54:44.244670 2136 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" candidate_term: 3 candidate_status { last_received { term: 2 index: 59 } } ignore_live_leader: false dest_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" is_pre_election: true
I20250831 19:54:44.245318 1287 leader_election.cc:304] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c830f6055d64a3b8a9f78b405ad8aa3; no voters: a4d46bc3ef5a4fbb8c9e4349c86c54a5, ac75f6e7a0634a89beb9670950e95220
I20250831 19:54:44.245644 2244 raft_consensus.cc:2747] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20250831 19:54:44.245919 2249 catalog_manager.cc:1261] Loaded cluster ID: 003a9cb4df1f460dbfc9d2f57d96ced1
I20250831 19:54:44.245980 2249 catalog_manager.cc:1497] Initializing Kudu internal certificate authority...
I20250831 19:54:44.247112 2249 catalog_manager.cc:1506] Loading token signing keys...
I20250831 19:54:44.248039 2249 catalog_manager.cc:5966] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Loaded TSK: 0
I20250831 19:54:44.248831 2249 catalog_manager.cc:1516] Initializing in-progress tserver states...
I20250831 19:54:44.249773 2249 catalog_manager.cc:1529] Loading latest processed Hive Metastore notification log event ID...
I20250831 19:54:44.250767 2249 catalog_manager.cc:5804] Last processed Hive Metastore notification event ID: 13
I20250831 19:54:44.268412 2067 consensus_queue.cc:1035] T 9cf4a20941f045adb66114df127c84a0 P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:44.274771 1681 heartbeater.cc:499] Master 127.1.1.253:45581 was elected leader, sending a full tablet report...
I20250831 19:54:44.276619 2068 consensus_queue.cc:1035] T 9cf4a20941f045adb66114df127c84a0 P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:44.278693 2123 catalog_manager.cc:5582] T 9eea7f86bbcd40e88907dea27deba8de P 89aa85d59c53436ebdf3074b13d14825 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193). New cstate: current_term: 1 leader_uuid: "89aa85d59c53436ebdf3074b13d14825" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } }
I20250831 19:54:44.285869 1312 raft_consensus.cc:1273] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [term 3 FOLLOWER]: Refusing update from remote peer a4d46bc3ef5a4fbb8c9e4349c86c54a5: Log matching property violated. Preceding OpId in replica: term: 2 index: 59. Preceding OpId from leader: term: 3 index: 61. (index mismatch)
I20250831 19:54:44.285912 1452 raft_consensus.cc:1273] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220 [term 3 FOLLOWER]: Refusing update from remote peer a4d46bc3ef5a4fbb8c9e4349c86c54a5: Log matching property violated. Preceding OpId in replica: term: 2 index: 61. Preceding OpId from leader: term: 3 index: 61. (term mismatch)
I20250831 19:54:44.286016 1452 pending_rounds.cc:85] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220: Aborting all ops after (but not including) 60
I20250831 19:54:44.286135 1452 pending_rounds.cc:107] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220: Aborting uncommitted WRITE_OP operation due to leader change: 2.61
I20250831 19:54:44.286402 2247 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 60, Last known committed idx: 59, Time since last communication: 0.000s
W20250831 19:54:44.286504 1499 catalog_manager.cc:3897] Aborted: an error occurred while updating the sys-catalog: Op aborted by new leader
W20250831 19:54:44.286793 1499 hms_notification_log_listener.cc:330] Failed to handle Hive Metastore notification: 14 ALTER_TABLE default.table_f2750ddd8ef049ef8bca6b19ca6b68a6: Aborted: an error occurred while updating the sys-catalog: Op aborted by new leader
W20250831 19:54:44.286953 1499 hms_notification_log_listener.cc:143] Hive Metastore notification log listener poll failed: Service unavailable: lost leadership while handling Hive Metastore notification log events: an error occurred while updating the sys-catalog: Op aborted by new leader
I20250831 19:54:44.286989 2247 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 60, Last known committed idx: 59, Time since last communication: 0.000s
I20250831 19:54:44.287158 2247 consensus_queue.cc:1230] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [LEADER]: Peer ac75f6e7a0634a89beb9670950e95220 log is divergent from this leader: its last log entry 2.60 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 59
I20250831 19:54:44.287253 1437 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:51254 (request call id 59) took 2144 ms. Trace:
I20250831 19:54:44.287364 1437 rpcz_store.cc:276] 0831 19:54:42.143025 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:43.165383 (+1022358us) service_pool.cc:225] Handling call
0831 19:54:44.287198 (+1121815us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20250831 19:54:44.287691 1443 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_9706596e6715417ebc8fb06420b56bde in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250831 19:54:44.288048 1452 pending_rounds.cc:85] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220: Aborting all ops after (but not including) 59
I20250831 19:54:44.288120 1452 pending_rounds.cc:107] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220: Aborting uncommitted WRITE_OP operation due to leader change: 2.60
W20250831 19:54:44.289220 1440 catalog_manager.cc:2177] Aborted: an error occurred while writing to the sys-catalog: Op aborted by new leader
I20250831 19:54:44.289460 1442 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:51254 (request call id 47) took 2470 ms. Trace:
I20250831 19:54:44.289605 1442 rpcz_store.cc:276] 0831 19:54:41.818471 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:41.893903 (+ 75432us) service_pool.cc:225] Handling call
0831 19:54:43.160329 (+1266426us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:44.288851 (+1128522us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:44.289118 (+ 267us) catalog_manager.cc:3683] Apply alter schema
0831 19:54:44.289397 (+ 279us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":23951,"Hive Metastore.run_cpu_time_us":572,"Hive Metastore.run_wall_time_us":201850}
I20250831 19:54:44.290103 2252 sys_catalog.cc:455] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a4d46bc3ef5a4fbb8c9e4349c86c54a5. Latest consensus state: current_term: 3 leader_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } } }
I20250831 19:54:44.290278 2252 sys_catalog.cc:458] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220 [sys.catalog]: This master's current role is: FOLLOWER
I20250831 19:54:44.290474 1437 master_service.cc:948] ReplaceTablet: received request to replace tablet 223b0437260545beb12c8aa2235c5d38 from {username='slave'} at 127.0.0.1:51254
I20250831 19:54:44.290867 1437 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:51254 (request call id 65) took 1820 ms. Trace:
I20250831 19:54:44.290983 1437 rpcz_store.cc:276] 0831 19:54:42.470210 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:44.290394 (+1820184us) service_pool.cc:225] Handling call
0831 19:54:44.290828 (+ 434us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250831 19:54:44.291188 1442 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51254 (request call id 66) took 1766 ms. Trace:
I20250831 19:54:44.291327 1442 rpcz_store.cc:276] 0831 19:54:42.524828 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:44.290773 (+1765945us) service_pool.cc:225] Handling call
0831 19:54:44.291133 (+ 360us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250831 19:54:44.292105 2252 sys_catalog.cc:455] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } } }
W20250831 19:54:44.296183 1958 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.1.1.252:35943)
W20250831 19:54:44.296758 1958 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.1.1.252:35943)
W20250831 19:54:44.297071 1958 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.1.1.252:35943)
W20250831 19:54:44.298787 1439 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_544f7d804f564e83be8fb83049aa8dea in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250831 19:54:44.299401 2252 sys_catalog.cc:458] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220 [sys.catalog]: This master's current role is: FOLLOWER
I20250831 19:54:44.301540 1436 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:51254 (request call id 56) took 2211 ms. Trace:
I20250831 19:54:44.301681 1436 rpcz_store.cc:276] 0831 19:54:42.080721 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:42.664360 (+583639us) service_pool.cc:225] Handling call
0831 19:54:43.163829 (+499469us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:44.292566 (+1128737us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":471401,"Hive Metastore.run_cpu_time_us":331,"Hive Metastore.run_wall_time_us":514125}
I20250831 19:54:44.305981 1435 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:51254 (request call id 52) took 2345 ms. Trace:
I20250831 19:54:44.307293 1442 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51254 (request call id 68) took 1511 ms. Trace:
I20250831 19:54:44.307472 1435 rpcz_store.cc:276] 0831 19:54:41.960837 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:42.345501 (+384664us) service_pool.cc:225] Handling call
0831 19:54:43.162866 (+817365us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:44.292243 (+1129377us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:44.305659 (+ 13416us) catalog_manager.cc:3683] Apply alter schema
0831 19:54:44.305944 (+ 285us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":311622,"Hive Metastore.run_cpu_time_us":558,"Hive Metastore.run_wall_time_us":129576}
I20250831 19:54:44.307919 1435 master_service.cc:948] ReplaceTablet: received request to replace tablet 9cf4a20941f045adb66114df127c84a0 from {username='slave'} at 127.0.0.1:51254
I20250831 19:54:44.308532 1435 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:51254 (request call id 70) took 1440 ms. Trace:
I20250831 19:54:44.308655 1435 rpcz_store.cc:276] 0831 19:54:42.868180 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:44.307857 (+1439677us) service_pool.cc:225] Handling call
0831 19:54:44.308231 (+ 374us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250831 19:54:44.309158 1437 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:51254 (request call id 67) took 1719 ms. Trace:
W20250831 19:54:44.306404 1438 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_5660fc6b1a9846a6bd36b56e553a8f35 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250831 19:54:44.309417 1434 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_486ee0377a714038aaf8f3f5b1ad7f79 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250831 19:54:44.309923 1435 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:51254 (request call id 71) took 1131 ms. Trace:
I20250831 19:54:44.310104 1437 rpcz_store.cc:276] 0831 19:54:42.582091 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:44.291202 (+1709111us) service_pool.cc:225] Handling call
0831 19:54:44.301079 (+ 9877us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1633152}
I20250831 19:54:44.311124 1437 master_service.cc:948] ReplaceTablet: received request to replace tablet 1bdb24444f114d12bb4c2b19c6b3eef2 from {username='slave'} at 127.0.0.1:51254
I20250831 19:54:44.312359 1437 master_service.cc:948] ReplaceTablet: received request to replace tablet 9cf4a20941f045adb66114df127c84a0 from {username='slave'} at 127.0.0.1:51254
I20250831 19:54:44.313896 1819 heartbeater.cc:499] Master 127.1.1.253:45581 was elected leader, sending a full tablet report...
I20250831 19:54:44.316434 2042 master_runner.cc:232] Existing masters have differing terms: 2 vs 3
I20250831 19:54:44.316660 2042 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20250831 19:54:44.317047 1410 master_runner.cc:263] No leader master found from master ac75f6e7a0634a89beb9670950e95220
I20250831 19:54:44.317133 1410 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20250831 19:54:44.319597 1958 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.1.1.252:35943)
I20250831 19:54:44.321384 1442 rpcz_store.cc:276] 0831 19:54:42.781374 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:44.291474 (+1510100us) service_pool.cc:225] Handling call
0831 19:54:44.292372 (+ 898us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1519872}
I20250831 19:54:44.322588 1436 master_service.cc:948] ReplaceTablet: received request to replace tablet f56c31854bc94b45879493264daf7ef3 from {username='slave'} at 127.0.0.1:51254
I20250831 19:54:44.323171 1436 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:51254 (request call id 69) took 1516 ms. Trace:
I20250831 19:54:44.324573 1436 rpcz_store.cc:276] 0831 19:54:42.806831 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:44.305408 (+1498577us) service_pool.cc:225] Handling call
0831 19:54:44.323140 (+ 17732us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250831 19:54:44.324939 1435 rpcz_store.cc:276] 0831 19:54:43.177299 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:44.308854 (+1131555us) service_pool.cc:225] Handling call
0831 19:54:44.309120 (+ 266us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250831 19:54:44.329289 2243 sys_catalog.cc:455] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } } }
I20250831 19:54:44.329593 2243 sys_catalog.cc:458] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [sys.catalog]: This master's current role is: LEADER
I20250831 19:54:44.330466 1953 heartbeater.cc:499] Master 127.1.1.253:45581 was elected leader, sending a full tablet report...
I20250831 19:54:44.335283 2121 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36958:
name: "default.Table_041b766e57be48328a32ed288f99216a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:44.335614 2118 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_9ad6a372f33845d4a9d69bd4b6a04c08" } new_table_name: "default.Table_d0245eccd867474e98fe08e8ef86df18" modify_external_catalogs: true
I20250831 19:54:44.336012 2125 master_service.cc:948] ReplaceTablet: received request to replace tablet 223b0437260545beb12c8aa2235c5d38 from {username='slave'} at 127.0.0.1:36958
I20250831 19:54:44.336272 2119 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_d961171a98f341b5945cfe0300337aec" } modify_external_catalogs: true
I20250831 19:54:44.336464 2119 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_d961171a98f341b5945cfe0300337aec" } modify_external_catalogs: true
I20250831 19:54:44.336618 2124 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_c3535015c99247ec86adfa665b7bc01c" } modify_external_catalogs: true
I20250831 19:54:44.336822 2124 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_c3535015c99247ec86adfa665b7bc01c" } modify_external_catalogs: true
I20250831 19:54:44.336917 2117 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_ca86d7dcbfdc477da58b5308247443e7" } new_table_name: "default.Table_179225213b4a45978264479432550f67" modify_external_catalogs: true
I20250831 19:54:44.337370 2120 master_service.cc:948] ReplaceTablet: received request to replace tablet 9cf4a20941f045adb66114df127c84a0 from {username='slave'} at 127.0.0.1:36958
I20250831 19:54:44.342129 2122 catalog_manager.cc:5582] T 15fd6c30770b4c1599a812d4722b2bad P de831f40fa1348a48a1f0260f4130197 reported cstate change: term changed from 0 to 1, leader changed from <none> to de831f40fa1348a48a1f0260f4130197 (127.1.1.194). New cstate: current_term: 1 leader_uuid: "de831f40fa1348a48a1f0260f4130197" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: HEALTHY } } }
I20250831 19:54:44.349886 1443 catalog_manager.cc:2149] created HMS catalog entry for table [id=e2ce658df3e14cd28c444b4a0526333b]
W20250831 19:54:44.350636 1443 catalog_manager.cc:2177] Illegal state: an error occurred while writing to the sys-catalog: replica ac75f6e7a0634a89beb9670950e95220 is not leader of this config: current role FOLLOWER
I20250831 19:54:44.352691 2244 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a4d46bc3ef5a4fbb8c9e4349c86c54a5. Latest consensus state: current_term: 3 leader_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } } }
I20250831 19:54:44.352946 2244 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [sys.catalog]: This master's current role is: FOLLOWER
I20250831 19:54:44.396948 1441 catalog_manager.cc:2706] deleted HMS catalog entry for table default.table_3691be9921f145f4a9495f2d669a5728 [id=57a524cac79549ceaebc55dc51fb94ee]
I20250831 19:54:44.397643 1441 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:51254 (request call id 61) took 2166 ms. Trace:
I20250831 19:54:44.397770 1441 rpcz_store.cc:276] 0831 19:54:42.230665 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:43.349520 (+1118855us) service_pool.cc:225] Handling call
0831 19:54:44.288616 (+939096us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:44.397597 (+108981us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":61071,"Hive Metastore.run_cpu_time_us":228,"Hive Metastore.run_wall_time_us":47016}
I20250831 19:54:44.398557 2247 sys_catalog.cc:455] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } } }
I20250831 19:54:44.398874 2247 sys_catalog.cc:458] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [sys.catalog]: This master's current role is: LEADER
I20250831 19:54:44.424176 2120 catalog_manager.cc:5869] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Sending DeleteTablet for 3 replicas of tablet 9cf4a20941f045adb66114df127c84a0
I20250831 19:54:44.424628 2125 catalog_manager.cc:5869] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Sending DeleteTablet for 3 replicas of tablet 223b0437260545beb12c8aa2235c5d38
I20250831 19:54:44.426391 2120 catalog_manager.cc:6652] ReplaceTablet: tablet 9cf4a20941f045adb66114df127c84a0 deleted and replaced by tablet 1033d94413c34db7bbf540330df23b7c
I20250831 19:54:44.428561 2126 catalog_manager.cc:5582] T 79a678e2a5ba495095865769a25ff68a P 2441fafe1d62429386f4631ad423567d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2441fafe1d62429386f4631ad423567d (127.1.1.195). New cstate: current_term: 1 leader_uuid: "2441fafe1d62429386f4631ad423567d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: HEALTHY } } }
I20250831 19:54:44.426780 2120 master_service.cc:948] ReplaceTablet: received request to replace tablet 1bdb24444f114d12bb4c2b19c6b3eef2 from {username='slave'} at 127.0.0.1:36958
I20250831 19:54:44.437455 2123 catalog_manager.cc:6127] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: default.table_ca86d7dcbfdc477da58b5308247443e7 [id=bd456415108d49989ef0bc2af91eb2f0] alter complete (version 1)
I20250831 19:54:44.438467 2123 master_service.cc:948] ReplaceTablet: received request to replace tablet 9cf4a20941f045adb66114df127c84a0 from {username='slave'} at 127.0.0.1:36958
I20250831 19:54:44.450856 2125 catalog_manager.cc:6652] ReplaceTablet: tablet 223b0437260545beb12c8aa2235c5d38 deleted and replaced by tablet 7d0e87ebdeb94dae90d8f2274d18e3ae
I20250831 19:54:44.457841 2122 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_f940275fb42644d4935e49d6143fb4ba" } new_table_name: "default.Table_609f839fcd04455fb64b8a7674b0f57b" modify_external_catalogs: true
I20250831 19:54:44.461236 2125 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36958:
name: "default.Table_21109c51ccde402faea41968420775a5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:44.464401 1614 tablet_service.cc:1515] Processing DeleteTablet for tablet 9cf4a20941f045adb66114df127c84a0 with delete_type TABLET_DATA_DELETED (replaced by tablet 1033d94413c34db7bbf540330df23b7c) from {username='slave'} at 127.0.0.1:51022
I20250831 19:54:44.464977 2277 tablet_replica.cc:331] T 9cf4a20941f045adb66114df127c84a0 P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:54:44.466301 1614 tablet_service.cc:1515] Processing DeleteTablet for tablet 223b0437260545beb12c8aa2235c5d38 with delete_type TABLET_DATA_DELETED (replaced by tablet 7d0e87ebdeb94dae90d8f2274d18e3ae) from {username='slave'} at 127.0.0.1:51022
I20250831 19:54:44.468327 2277 raft_consensus.cc:2241] T 9cf4a20941f045adb66114df127c84a0 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:44.468595 2277 raft_consensus.cc:2270] T 9cf4a20941f045adb66114df127c84a0 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:44.469302 2244 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } } }
I20250831 19:54:44.469564 2244 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [sys.catalog]: This master's current role is: FOLLOWER
I20250831 19:54:44.470438 2277 ts_tablet_manager.cc:1905] T 9cf4a20941f045adb66114df127c84a0 P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:44.471050 1751 tablet_service.cc:1515] Processing DeleteTablet for tablet 9cf4a20941f045adb66114df127c84a0 with delete_type TABLET_DATA_DELETED (replaced by tablet 1033d94413c34db7bbf540330df23b7c) from {username='slave'} at 127.0.0.1:50674
I20250831 19:54:44.472381 1752 tablet_service.cc:1515] Processing DeleteTablet for tablet 223b0437260545beb12c8aa2235c5d38 with delete_type TABLET_DATA_DELETED (replaced by tablet 7d0e87ebdeb94dae90d8f2274d18e3ae) from {username='slave'} at 127.0.0.1:50674
I20250831 19:54:44.475644 1885 tablet_service.cc:1515] Processing DeleteTablet for tablet 9cf4a20941f045adb66114df127c84a0 with delete_type TABLET_DATA_DELETED (replaced by tablet 1033d94413c34db7bbf540330df23b7c) from {username='slave'} at 127.0.0.1:45906
I20250831 19:54:44.475744 1884 tablet_service.cc:1515] Processing DeleteTablet for tablet 223b0437260545beb12c8aa2235c5d38 with delete_type TABLET_DATA_DELETED (replaced by tablet 7d0e87ebdeb94dae90d8f2274d18e3ae) from {username='slave'} at 127.0.0.1:45906
W20250831 19:54:44.478240 2186 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1033d94413c34db7bbf540330df23b7c has no consensus state
I20250831 19:54:44.479246 2186 catalog_manager.cc:2747] Deleting table default.table_ae8ede59b2ad492daba0f5e783332e25 [id=a8017c2a018f4bd28637a2b8c5677286] in response to Hive Metastore notification log event 19
I20250831 19:54:44.483477 2126 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36958:
name: "default.Table_87e103a1db824462bc7d586a4682352e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:44.484906 2123 catalog_manager.cc:5674] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475) does not have the latest schema for tablet 8262f1d1898840c2822feda5279542bd (table default.table_f2750ddd8ef049ef8bca6b19ca6b68a6 [id=6063834030bb409d8ee666a753351551]). Expected version 1 got 0
I20250831 19:54:44.485750 2123 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36958:
name: "default.Table_f8db9b89d5e148b5ba271e3a17ff89b4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:44.486373 2120 catalog_manager.cc:5869] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Sending DeleteTablet for 3 replicas of tablet 1bdb24444f114d12bb4c2b19c6b3eef2
I20250831 19:54:44.486930 2120 catalog_manager.cc:6652] ReplaceTablet: tablet 1bdb24444f114d12bb4c2b19c6b3eef2 deleted and replaced by tablet a22b1e71ca344973808ad05fa1af7eb9
I20250831 19:54:44.487255 2120 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36958:
name: "default.Table_40da3badb9e84e4990e6171bd0dbe8ac"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:44.487392 1752 tablet_service.cc:1515] Processing DeleteTablet for tablet 1bdb24444f114d12bb4c2b19c6b3eef2 with delete_type TABLET_DATA_DELETED (replaced by tablet a22b1e71ca344973808ad05fa1af7eb9) from {username='slave'} at 127.0.0.1:50674
I20250831 19:54:44.488917 1884 tablet_service.cc:1515] Processing DeleteTablet for tablet 1bdb24444f114d12bb4c2b19c6b3eef2 with delete_type TABLET_DATA_DELETED (replaced by tablet a22b1e71ca344973808ad05fa1af7eb9) from {username='slave'} at 127.0.0.1:45906
I20250831 19:54:44.491658 2280 tablet_replica.cc:331] T 9cf4a20941f045adb66114df127c84a0 P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:54:44.492307 2280 raft_consensus.cc:2241] T 9cf4a20941f045adb66114df127c84a0 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:44.492825 2280 raft_consensus.cc:2270] T 9cf4a20941f045adb66114df127c84a0 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:44.496171 2186 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 7d0e87ebdeb94dae90d8f2274d18e3ae
I20250831 19:54:44.488638 1614 tablet_service.cc:1515] Processing DeleteTablet for tablet 1bdb24444f114d12bb4c2b19c6b3eef2 with delete_type TABLET_DATA_DELETED (replaced by tablet a22b1e71ca344973808ad05fa1af7eb9) from {username='slave'} at 127.0.0.1:51022
I20250831 19:54:44.499433 2280 ts_tablet_manager.cc:1905] T 9cf4a20941f045adb66114df127c84a0 P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:44.506460 1752 tablet_service.cc:1468] Processing CreateTablet for tablet 1033d94413c34db7bbf540330df23b7c (DEFAULT_TABLE table=default.table_e2ff8984d73f4f05a25d1c132ea949fb [id=b1daf7387b1749019e5377ab08146d20]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:44.507004 1752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1033d94413c34db7bbf540330df23b7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:44.509827 1614 tablet_service.cc:1468] Processing CreateTablet for tablet 1033d94413c34db7bbf540330df23b7c (DEFAULT_TABLE table=default.table_e2ff8984d73f4f05a25d1c132ea949fb [id=b1daf7387b1749019e5377ab08146d20]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:44.510341 1614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1033d94413c34db7bbf540330df23b7c. 1 dirs total, 0 dirs full, 0 dirs failed
W20250831 19:54:44.511888 2101 catalog_manager.cc:4726] Async tablet task AlterTable RPC for tablet 1033d94413c34db7bbf540330df23b7c (table default.table_e2ff8984d73f4f05a25d1c132ea949fb [id=b1daf7387b1749019e5377ab08146d20], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 1033d94413c34db7bbf540330df23b7c consensus state has no leader
I20250831 19:54:44.513917 1885 tablet_service.cc:1468] Processing CreateTablet for tablet 1033d94413c34db7bbf540330df23b7c (DEFAULT_TABLE table=default.table_e2ff8984d73f4f05a25d1c132ea949fb [id=b1daf7387b1749019e5377ab08146d20]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:44.514376 1885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1033d94413c34db7bbf540330df23b7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:44.517154 1440 catalog_manager.cc:2159] deleted orphaned HMS catalog entry for table [id=4098ece72dac48dfa9027440ad814225]
I20250831 19:54:44.517439 1440 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51254 (request call id 49) took 2631 ms. Trace:
I20250831 19:54:44.517884 1613 tablet_service.cc:1468] Processing CreateTablet for tablet a22b1e71ca344973808ad05fa1af7eb9 (DEFAULT_TABLE table=default.table_3691be9921f145f4a9495f2d669a5728 [id=57a524cac79549ceaebc55dc51fb94ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:44.517594 1440 rpcz_store.cc:276] 0831 19:54:41.885797 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:42.074287 (+188490us) service_pool.cc:225] Handling call
0831 19:54:43.170097 (+1095810us) catalog_manager.cc:2076] Acquired catalog manager lock
0831 19:54:43.170506 (+ 409us) catalog_manager.cc:2122] Created new table and tablet info
0831 19:54:44.178230 (+1007724us) catalog_manager.cc:2148] Created new table in HMS catalog
0831 19:54:44.289291 (+111061us) catalog_manager.cc:2156] Rolling back HMS table creation
0831 19:54:44.517387 (+228096us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:44.213767 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:44.214072 (+ 305us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:44.214077 (+ 5us) write_op.cc:435] Acquired schema lock
0831 19:54:44.214080 (+ 3us) tablet.cc:660] Decoding operations
0831 19:54:44.214173 (+ 93us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:44.214187 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:44.214191 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:44.214279 (+ 88us) tablet.cc:699] Row locks acquired
0831 19:54:44.214282 (+ 3us) write_op.cc:260] PREPARE: finished
0831 19:54:44.214313 (+ 31us) write_op.cc:270] Start()
0831 19:54:44.214348 (+ 35us) write_op.cc:276] Timestamp: P: 1756670084214274 usec, L: 0
0831 19:54:44.214351 (+ 3us) op_driver.cc:348] REPLICATION: starting
0831 19:54:44.214545 (+ 194us) log.cc:844] Serialized 432 byte log entry
0831 19:54:44.288215 (+ 73670us) op_driver.cc:464] REPLICATION: finished
0831 19:54:44.288223 (+ 8us) op_driver.cc:389] HandleFailure(Aborted: Op aborted by new leader)
0831 19:54:44.288228 (+ 5us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:44.288265 (+ 37us) write_op.cc:454] Released schema lock
0831 19:54:44.288271 (+ 6us) write_op.cc:335] FINISH: Op aborted
Metrics: {"Hive Metastore.queue_time_us":1086513,"Hive Metastore.run_cpu_time_us":474,"Hive Metastore.run_wall_time_us":148600,"child_traces":[["op",{"num_ops":2,"prepare.queue_time_us":34674,"prepare.run_cpu_time_us":705,"prepare.run_wall_time_us":1207,"replication_time_us":73808,"thread_start_us":40384,"threads_started":1}]]}
I20250831 19:54:44.518344 1613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a22b1e71ca344973808ad05fa1af7eb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:44.523183 1750 tablet_service.cc:1468] Processing CreateTablet for tablet a22b1e71ca344973808ad05fa1af7eb9 (DEFAULT_TABLE table=default.table_3691be9921f145f4a9495f2d669a5728 [id=57a524cac79549ceaebc55dc51fb94ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:44.523610 1750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a22b1e71ca344973808ad05fa1af7eb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:44.524349 2280 ts_tablet_manager.cc:1918] T 9cf4a20941f045adb66114df127c84a0 P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:44.524446 2280 log.cc:1199] T 9cf4a20941f045adb66114df127c84a0 P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/9cf4a20941f045adb66114df127c84a0
I20250831 19:54:44.524828 2280 ts_tablet_manager.cc:1939] T 9cf4a20941f045adb66114df127c84a0 P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:54:44.525976 1884 tablet_service.cc:1468] Processing CreateTablet for tablet a22b1e71ca344973808ad05fa1af7eb9 (DEFAULT_TABLE table=default.table_3691be9921f145f4a9495f2d669a5728 [id=57a524cac79549ceaebc55dc51fb94ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:44.526320 1884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a22b1e71ca344973808ad05fa1af7eb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:44.528128 2280 tablet_replica.cc:331] T 223b0437260545beb12c8aa2235c5d38 P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:54:44.528200 2101 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet 9cf4a20941f045adb66114df127c84a0 (table default.table_e2ff8984d73f4f05a25d1c132ea949fb [id=b1daf7387b1749019e5377ab08146d20]) successfully deleted
I20250831 19:54:44.528412 2280 raft_consensus.cc:2241] T 223b0437260545beb12c8aa2235c5d38 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:44.528625 2280 raft_consensus.cc:2270] T 223b0437260545beb12c8aa2235c5d38 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:44.529163 2280 ts_tablet_manager.cc:1905] T 223b0437260545beb12c8aa2235c5d38 P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:44.532802 2282 tablet_bootstrap.cc:492] T a22b1e71ca344973808ad05fa1af7eb9 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:44.537014 2280 ts_tablet_manager.cc:1918] T 223b0437260545beb12c8aa2235c5d38 P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:44.537200 2280 log.cc:1199] T 223b0437260545beb12c8aa2235c5d38 P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/223b0437260545beb12c8aa2235c5d38
I20250831 19:54:44.537629 2280 ts_tablet_manager.cc:1939] T 223b0437260545beb12c8aa2235c5d38 P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:54:44.538707 2280 tablet_replica.cc:331] T 1bdb24444f114d12bb4c2b19c6b3eef2 P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:54:44.538913 2280 raft_consensus.cc:2241] T 1bdb24444f114d12bb4c2b19c6b3eef2 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:44.539146 2280 raft_consensus.cc:2270] T 1bdb24444f114d12bb4c2b19c6b3eef2 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:44.539705 2280 ts_tablet_manager.cc:1905] T 1bdb24444f114d12bb4c2b19c6b3eef2 P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:44.544113 2283 tablet_bootstrap.cc:492] T a22b1e71ca344973808ad05fa1af7eb9 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:44.545394 2280 ts_tablet_manager.cc:1918] T 1bdb24444f114d12bb4c2b19c6b3eef2 P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:44.545609 2280 log.cc:1199] T 1bdb24444f114d12bb4c2b19c6b3eef2 P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/1bdb24444f114d12bb4c2b19c6b3eef2
I20250831 19:54:44.546096 2280 ts_tablet_manager.cc:1939] T 1bdb24444f114d12bb4c2b19c6b3eef2 P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:54:44.546262 2283 tablet_bootstrap.cc:654] T a22b1e71ca344973808ad05fa1af7eb9 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:44.549798 2101 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet 1bdb24444f114d12bb4c2b19c6b3eef2 (table default.table_3691be9921f145f4a9495f2d669a5728 [id=57a524cac79549ceaebc55dc51fb94ee]) successfully deleted
I20250831 19:54:44.535956 2277 ts_tablet_manager.cc:1918] T 9cf4a20941f045adb66114df127c84a0 P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:44.557920 2277 log.cc:1199] T 9cf4a20941f045adb66114df127c84a0 P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/9cf4a20941f045adb66114df127c84a0
I20250831 19:54:44.558542 2277 ts_tablet_manager.cc:1939] T 9cf4a20941f045adb66114df127c84a0 P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
I20250831 19:54:44.559157 2282 tablet_bootstrap.cc:654] T a22b1e71ca344973808ad05fa1af7eb9 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:44.560009 2104 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet 9cf4a20941f045adb66114df127c84a0 (table default.table_e2ff8984d73f4f05a25d1c132ea949fb [id=b1daf7387b1749019e5377ab08146d20]) successfully deleted
I20250831 19:54:44.583607 1439 catalog_manager.cc:2149] created HMS catalog entry for table [id=171e825e5eab4a558091a9444acf5092]
W20250831 19:54:44.584448 1439 catalog_manager.cc:2177] Illegal state: an error occurred while writing to the sys-catalog: replica ac75f6e7a0634a89beb9670950e95220 is not leader of this config: current role FOLLOWER
I20250831 19:54:44.559924 2277 tablet_replica.cc:331] T 223b0437260545beb12c8aa2235c5d38 P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:54:44.589781 2277 raft_consensus.cc:2241] T 223b0437260545beb12c8aa2235c5d38 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:44.589993 2277 raft_consensus.cc:2270] T 223b0437260545beb12c8aa2235c5d38 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:44.590633 2277 ts_tablet_manager.cc:1905] T 223b0437260545beb12c8aa2235c5d38 P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:44.598996 2284 tablet_bootstrap.cc:492] T a22b1e71ca344973808ad05fa1af7eb9 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:44.601359 2284 tablet_bootstrap.cc:654] T a22b1e71ca344973808ad05fa1af7eb9 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:44.583992 2288 tablet.cc:1722] T 8262f1d1898840c2822feda5279542bd P 89aa85d59c53436ebdf3074b13d14825: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:44.605252 2277 ts_tablet_manager.cc:1918] T 223b0437260545beb12c8aa2235c5d38 P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:44.605379 2277 log.cc:1199] T 223b0437260545beb12c8aa2235c5d38 P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/223b0437260545beb12c8aa2235c5d38
I20250831 19:54:44.605767 2277 ts_tablet_manager.cc:1939] T 223b0437260545beb12c8aa2235c5d38 P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
I20250831 19:54:44.607506 2277 tablet_replica.cc:331] T 1bdb24444f114d12bb4c2b19c6b3eef2 P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:54:44.607782 2277 raft_consensus.cc:2241] T 1bdb24444f114d12bb4c2b19c6b3eef2 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:44.608978 2278 tablet_replica.cc:331] T 9cf4a20941f045adb66114df127c84a0 P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:54:44.609711 2277 raft_consensus.cc:2270] T 1bdb24444f114d12bb4c2b19c6b3eef2 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:44.609839 2278 raft_consensus.cc:2241] T 9cf4a20941f045adb66114df127c84a0 P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: Raft consensus shutting down.
I20250831 19:54:44.610670 2278 raft_consensus.cc:2270] T 9cf4a20941f045adb66114df127c84a0 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:44.612262 2278 ts_tablet_manager.cc:1905] T 9cf4a20941f045adb66114df127c84a0 P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:44.613919 2277 ts_tablet_manager.cc:1905] T 1bdb24444f114d12bb4c2b19c6b3eef2 P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:44.619037 2282 tablet_bootstrap.cc:492] T a22b1e71ca344973808ad05fa1af7eb9 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:44.619297 2282 ts_tablet_manager.cc:1397] T a22b1e71ca344973808ad05fa1af7eb9 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.087s user 0.004s sys 0.000s
I20250831 19:54:44.620497 2282 raft_consensus.cc:357] T a22b1e71ca344973808ad05fa1af7eb9 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:44.621063 2282 raft_consensus.cc:383] T a22b1e71ca344973808ad05fa1af7eb9 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:44.621209 2282 raft_consensus.cc:738] T a22b1e71ca344973808ad05fa1af7eb9 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:44.621546 2282 consensus_queue.cc:260] T a22b1e71ca344973808ad05fa1af7eb9 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:44.622745 1438 catalog_manager.cc:2149] created HMS catalog entry for table [id=833646a3553b46beb5bee93d170df67c]
W20250831 19:54:44.623507 1438 catalog_manager.cc:2177] Illegal state: an error occurred while writing to the sys-catalog: replica ac75f6e7a0634a89beb9670950e95220 is not leader of this config: current role FOLLOWER
I20250831 19:54:44.624238 2282 ts_tablet_manager.cc:1428] T a22b1e71ca344973808ad05fa1af7eb9 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20250831 19:54:44.624513 2282 tablet_bootstrap.cc:492] T 1033d94413c34db7bbf540330df23b7c P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:44.628520 2282 tablet_bootstrap.cc:654] T 1033d94413c34db7bbf540330df23b7c P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:44.631925 2277 ts_tablet_manager.cc:1918] T 1bdb24444f114d12bb4c2b19c6b3eef2 P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:44.632194 2277 log.cc:1199] T 1bdb24444f114d12bb4c2b19c6b3eef2 P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/1bdb24444f114d12bb4c2b19c6b3eef2
I20250831 19:54:44.632755 2277 ts_tablet_manager.cc:1939] T 1bdb24444f114d12bb4c2b19c6b3eef2 P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
I20250831 19:54:44.633294 2283 tablet_bootstrap.cc:492] T a22b1e71ca344973808ad05fa1af7eb9 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:44.634357 2104 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet 1bdb24444f114d12bb4c2b19c6b3eef2 (table default.table_3691be9921f145f4a9495f2d669a5728 [id=57a524cac79549ceaebc55dc51fb94ee]) successfully deleted
I20250831 19:54:44.636643 2283 ts_tablet_manager.cc:1397] T a22b1e71ca344973808ad05fa1af7eb9 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.093s user 0.005s sys 0.010s
I20250831 19:54:44.637439 2282 tablet_bootstrap.cc:492] T 1033d94413c34db7bbf540330df23b7c P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:44.637674 2282 ts_tablet_manager.cc:1397] T 1033d94413c34db7bbf540330df23b7c P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.004s
I20250831 19:54:44.637573 2283 raft_consensus.cc:357] T a22b1e71ca344973808ad05fa1af7eb9 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:44.637750 2283 raft_consensus.cc:383] T a22b1e71ca344973808ad05fa1af7eb9 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:44.638536 2282 raft_consensus.cc:357] T 1033d94413c34db7bbf540330df23b7c P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:44.638792 2282 raft_consensus.cc:383] T 1033d94413c34db7bbf540330df23b7c P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:44.638911 2282 raft_consensus.cc:738] T 1033d94413c34db7bbf540330df23b7c P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:44.639258 2282 consensus_queue.cc:260] T 1033d94413c34db7bbf540330df23b7c P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:44.641973 2282 ts_tablet_manager.cc:1428] T 1033d94413c34db7bbf540330df23b7c P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20250831 19:54:44.643870 2283 raft_consensus.cc:738] T a22b1e71ca344973808ad05fa1af7eb9 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:44.644044 2118 catalog_manager.cc:3460] renamed table default.table_9ad6a372f33845d4a9d69bd4b6a04c08 [id=1137b2754d104964bbe5bbaa4a0578b8] in HMS: new name default.table_d0245eccd867474e98fe08e8ef86df18
I20250831 19:54:44.644269 2283 consensus_queue.cc:260] T a22b1e71ca344973808ad05fa1af7eb9 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:44.644428 2221 consensus_queue.cc:1035] T 9eea7f86bbcd40e88907dea27deba8de P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:44.648451 2283 ts_tablet_manager.cc:1428] T a22b1e71ca344973808ad05fa1af7eb9 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
I20250831 19:54:44.652293 2283 tablet_bootstrap.cc:492] T 1033d94413c34db7bbf540330df23b7c P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:44.652920 2186 catalog_manager.cc:2747] Deleting table default.table_3691be9921f145f4a9495f2d669a5728 [id=57a524cac79549ceaebc55dc51fb94ee] in response to Hive Metastore notification log event 22
I20250831 19:54:44.654613 2283 tablet_bootstrap.cc:654] T 1033d94413c34db7bbf540330df23b7c P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:44.657521 2290 tablet.cc:1722] T 8262f1d1898840c2822feda5279542bd P de831f40fa1348a48a1f0260f4130197: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:44.659842 2284 tablet_bootstrap.cc:492] T a22b1e71ca344973808ad05fa1af7eb9 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:44.661405 2186 catalog_manager.cc:5869] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Sending DeleteTablet for 3 replicas of tablet a22b1e71ca344973808ad05fa1af7eb9
I20250831 19:54:44.661670 2284 ts_tablet_manager.cc:1397] T a22b1e71ca344973808ad05fa1af7eb9 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.063s user 0.008s sys 0.004s
I20250831 19:54:44.662817 2186 catalog_manager.cc:2747] Deleting table default.table_8adc00cc53274835bfe463ebf3bd3f45 [id=4098ece72dac48dfa9027440ad814225] in response to Hive Metastore notification log event 23
W20250831 19:54:44.663129 2186 hms_notification_log_listener.cc:330] Failed to handle Hive Metastore notification: 23 DROP_TABLE default.table_8adc00cc53274835bfe463ebf3bd3f45: Not found: the table does not exist: table_id: "4098ece72dac48dfa9027440ad814225" table_name: "default.table_8adc00cc53274835bfe463ebf3bd3f45"
I20250831 19:54:44.663923 2284 raft_consensus.cc:357] T a22b1e71ca344973808ad05fa1af7eb9 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:44.666316 1614 tablet_service.cc:1515] Processing DeleteTablet for tablet a22b1e71ca344973808ad05fa1af7eb9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:44 UTC) from {username='slave'} at 127.0.0.1:51022
I20250831 19:54:44.666702 2284 raft_consensus.cc:383] T a22b1e71ca344973808ad05fa1af7eb9 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:44.667064 2277 tablet_replica.cc:331] T a22b1e71ca344973808ad05fa1af7eb9 P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:54:44.661099 2278 ts_tablet_manager.cc:1918] T 9cf4a20941f045adb66114df127c84a0 P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:44.667454 2278 log.cc:1199] T 9cf4a20941f045adb66114df127c84a0 P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/9cf4a20941f045adb66114df127c84a0
I20250831 19:54:44.667261 2277 raft_consensus.cc:2241] T a22b1e71ca344973808ad05fa1af7eb9 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:44.667973 2277 raft_consensus.cc:2270] T a22b1e71ca344973808ad05fa1af7eb9 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:44.668020 2278 ts_tablet_manager.cc:1939] T 9cf4a20941f045adb66114df127c84a0 P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
I20250831 19:54:44.668649 2105 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet 9cf4a20941f045adb66114df127c84a0 (table default.table_e2ff8984d73f4f05a25d1c132ea949fb [id=b1daf7387b1749019e5377ab08146d20]) successfully deleted
I20250831 19:54:44.666911 2284 raft_consensus.cc:738] T a22b1e71ca344973808ad05fa1af7eb9 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:44.669668 2284 consensus_queue.cc:260] T a22b1e71ca344973808ad05fa1af7eb9 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:44.669750 2277 ts_tablet_manager.cc:1905] T a22b1e71ca344973808ad05fa1af7eb9 P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:44.670723 2284 ts_tablet_manager.cc:1428] T a22b1e71ca344973808ad05fa1af7eb9 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20250831 19:54:44.656028 2292 tablet.cc:1722] T 8262f1d1898840c2822feda5279542bd P 2441fafe1d62429386f4631ad423567d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:44.665930 1884 tablet_service.cc:1515] Processing DeleteTablet for tablet a22b1e71ca344973808ad05fa1af7eb9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:44 UTC) from {username='slave'} at 127.0.0.1:45906
I20250831 19:54:44.673592 2280 tablet_replica.cc:331] T a22b1e71ca344973808ad05fa1af7eb9 P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:54:44.673831 2280 raft_consensus.cc:2241] T a22b1e71ca344973808ad05fa1af7eb9 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:44.674019 2280 raft_consensus.cc:2270] T a22b1e71ca344973808ad05fa1af7eb9 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:44.674885 2280 ts_tablet_manager.cc:1905] T a22b1e71ca344973808ad05fa1af7eb9 P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:44.675552 2277 ts_tablet_manager.cc:1918] T a22b1e71ca344973808ad05fa1af7eb9 P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250831 19:54:44.675678 2277 log.cc:1199] T a22b1e71ca344973808ad05fa1af7eb9 P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/a22b1e71ca344973808ad05fa1af7eb9
I20250831 19:54:44.676002 2277 ts_tablet_manager.cc:1939] T a22b1e71ca344973808ad05fa1af7eb9 P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
I20250831 19:54:44.677063 2104 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet a22b1e71ca344973808ad05fa1af7eb9 (table default.table_3691be9921f145f4a9495f2d669a5728 [id=57a524cac79549ceaebc55dc51fb94ee]) successfully deleted
I20250831 19:54:44.677944 2284 tablet_bootstrap.cc:492] T 1033d94413c34db7bbf540330df23b7c P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:44.678539 1751 tablet_service.cc:1515] Processing DeleteTablet for tablet a22b1e71ca344973808ad05fa1af7eb9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:44 UTC) from {username='slave'} at 127.0.0.1:50674
I20250831 19:54:44.670258 2278 tablet_replica.cc:331] T 223b0437260545beb12c8aa2235c5d38 P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:54:44.679577 2278 raft_consensus.cc:2241] T 223b0437260545beb12c8aa2235c5d38 P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: Raft consensus shutting down.
W20250831 19:54:44.679620 2121 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_041b766e57be48328a32ed288f99216a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250831 19:54:44.679986 2278 raft_consensus.cc:2270] T 223b0437260545beb12c8aa2235c5d38 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:44.680583 2278 ts_tablet_manager.cc:1905] T 223b0437260545beb12c8aa2235c5d38 P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250831 19:54:44.681540 2125 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_21109c51ccde402faea41968420775a5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250831 19:54:44.682606 2126 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_87e103a1db824462bc7d586a4682352e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250831 19:54:44.687453 2123 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_f8db9b89d5e148b5ba271e3a17ff89b4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250831 19:54:44.682607 2120 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_40da3badb9e84e4990e6171bd0dbe8ac in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250831 19:54:44.689620 2223 consensus_queue.cc:1035] T 9eea7f86bbcd40e88907dea27deba8de P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:44.690200 2280 ts_tablet_manager.cc:1918] T a22b1e71ca344973808ad05fa1af7eb9 P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250831 19:54:44.690347 2280 log.cc:1199] T a22b1e71ca344973808ad05fa1af7eb9 P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/a22b1e71ca344973808ad05fa1af7eb9
I20250831 19:54:44.690716 2280 ts_tablet_manager.cc:1939] T a22b1e71ca344973808ad05fa1af7eb9 P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:54:44.694325 2101 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet a22b1e71ca344973808ad05fa1af7eb9 (table default.table_3691be9921f145f4a9495f2d669a5728 [id=57a524cac79549ceaebc55dc51fb94ee]) successfully deleted
I20250831 19:54:44.704310 2284 tablet_bootstrap.cc:654] T 1033d94413c34db7bbf540330df23b7c P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:44.716188 2284 tablet_bootstrap.cc:492] T 1033d94413c34db7bbf540330df23b7c P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:44.716441 2284 ts_tablet_manager.cc:1397] T 1033d94413c34db7bbf540330df23b7c P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.039s user 0.003s sys 0.001s
I20250831 19:54:44.717178 2284 raft_consensus.cc:357] T 1033d94413c34db7bbf540330df23b7c P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:44.717516 2284 raft_consensus.cc:383] T 1033d94413c34db7bbf540330df23b7c P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:44.717602 2278 ts_tablet_manager.cc:1918] T 223b0437260545beb12c8aa2235c5d38 P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:44.717662 2284 raft_consensus.cc:738] T 1033d94413c34db7bbf540330df23b7c P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:44.718098 2284 consensus_queue.cc:260] T 1033d94413c34db7bbf540330df23b7c P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:44.721236 2284 ts_tablet_manager.cc:1428] T 1033d94413c34db7bbf540330df23b7c P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20250831 19:54:44.724112 2278 log.cc:1199] T 223b0437260545beb12c8aa2235c5d38 P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/223b0437260545beb12c8aa2235c5d38
I20250831 19:54:44.725849 2278 ts_tablet_manager.cc:1939] T 223b0437260545beb12c8aa2235c5d38 P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
I20250831 19:54:44.728770 1434 catalog_manager.cc:2149] created HMS catalog entry for table [id=1ace025b68c34372b346c712a1d27cab]
W20250831 19:54:44.729509 1434 catalog_manager.cc:2177] Illegal state: an error occurred while writing to the sys-catalog: replica ac75f6e7a0634a89beb9670950e95220 is not leader of this config: current role FOLLOWER
I20250831 19:54:44.731917 2278 tablet_replica.cc:331] T 1bdb24444f114d12bb4c2b19c6b3eef2 P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:54:44.732470 2278 raft_consensus.cc:2241] T 1bdb24444f114d12bb4c2b19c6b3eef2 P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: Raft consensus shutting down.
I20250831 19:54:44.733166 2278 raft_consensus.cc:2270] T 1bdb24444f114d12bb4c2b19c6b3eef2 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:44.734757 2278 ts_tablet_manager.cc:1905] T 1bdb24444f114d12bb4c2b19c6b3eef2 P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:44.744429 2288 tablet.cc:1722] T f318ccc4400f4830b6a80e27b002b562 P 89aa85d59c53436ebdf3074b13d14825: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250831 19:54:44.744956 2292 tablet.cc:1722] T f318ccc4400f4830b6a80e27b002b562 P 2441fafe1d62429386f4631ad423567d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250831 19:54:44.747867 2278 ts_tablet_manager.cc:1918] T 1bdb24444f114d12bb4c2b19c6b3eef2 P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:44.752668 2239 consensus_queue.cc:1035] T 79a678e2a5ba495095865769a25ff68a P 2441fafe1d62429386f4631ad423567d [LEADER]: Connected to new peer: Peer: permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:44.759649 2278 log.cc:1199] T 1bdb24444f114d12bb4c2b19c6b3eef2 P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/1bdb24444f114d12bb4c2b19c6b3eef2
I20250831 19:54:44.760376 2278 ts_tablet_manager.cc:1939] T 1bdb24444f114d12bb4c2b19c6b3eef2 P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
I20250831 19:54:44.762549 2278 tablet_replica.cc:331] T a22b1e71ca344973808ad05fa1af7eb9 P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:54:44.763080 2278 raft_consensus.cc:2241] T a22b1e71ca344973808ad05fa1af7eb9 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:44.763576 2278 raft_consensus.cc:2270] T a22b1e71ca344973808ad05fa1af7eb9 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:44.764281 2278 ts_tablet_manager.cc:1905] T a22b1e71ca344973808ad05fa1af7eb9 P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:44.766079 2290 tablet.cc:1722] T f318ccc4400f4830b6a80e27b002b562 P de831f40fa1348a48a1f0260f4130197: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250831 19:54:44.769874 2283 tablet_bootstrap.cc:492] T 1033d94413c34db7bbf540330df23b7c P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:44.770092 2283 ts_tablet_manager.cc:1397] T 1033d94413c34db7bbf540330df23b7c P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.118s user 0.008s sys 0.013s
I20250831 19:54:44.771162 2283 raft_consensus.cc:357] T 1033d94413c34db7bbf540330df23b7c P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:44.771328 2283 raft_consensus.cc:383] T 1033d94413c34db7bbf540330df23b7c P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:44.771409 2283 raft_consensus.cc:738] T 1033d94413c34db7bbf540330df23b7c P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:44.771723 2283 consensus_queue.cc:260] T 1033d94413c34db7bbf540330df23b7c P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:44.772161 2283 ts_tablet_manager.cc:1428] T 1033d94413c34db7bbf540330df23b7c P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250831 19:54:44.779326 2239 consensus_queue.cc:1035] T 79a678e2a5ba495095865769a25ff68a P 2441fafe1d62429386f4631ad423567d [LEADER]: Connected to new peer: Peer: permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:44.780706 2278 ts_tablet_manager.cc:1918] T a22b1e71ca344973808ad05fa1af7eb9 P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250831 19:54:44.780901 2278 log.cc:1199] T a22b1e71ca344973808ad05fa1af7eb9 P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/a22b1e71ca344973808ad05fa1af7eb9
I20250831 19:54:44.781242 2278 ts_tablet_manager.cc:1939] T a22b1e71ca344973808ad05fa1af7eb9 P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
I20250831 19:54:44.782145 2105 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet a22b1e71ca344973808ad05fa1af7eb9 (table default.table_3691be9921f145f4a9495f2d669a5728 [id=57a524cac79549ceaebc55dc51fb94ee]) successfully deleted
I20250831 19:54:44.797811 2119 catalog_manager.cc:2706] deleted HMS catalog entry for table default.table_d961171a98f341b5945cfe0300337aec [id=2475332024a84359a43fe486d5488cba]
I20250831 19:54:44.811736 1443 catalog_manager.cc:2159] deleted orphaned HMS catalog entry for table [id=e2ce658df3e14cd28c444b4a0526333b]
I20250831 19:54:44.812120 1443 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51254 (request call id 60) took 2650 ms. Trace:
I20250831 19:54:44.812201 1443 rpcz_store.cc:276] 0831 19:54:42.161250 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:43.223064 (+1061814us) service_pool.cc:225] Handling call
0831 19:54:44.287796 (+1064732us) catalog_manager.cc:2076] Acquired catalog manager lock
0831 19:54:44.288402 (+ 606us) catalog_manager.cc:2122] Created new table and tablet info
0831 19:54:44.349853 (+ 61451us) catalog_manager.cc:2148] Created new table in HMS catalog
0831 19:54:44.350478 (+ 625us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:44.350481 (+ 3us) write_op.cc:454] Released schema lock
0831 19:54:44.350739 (+ 258us) catalog_manager.cc:2156] Rolling back HMS table creation
0831 19:54:44.812074 (+461335us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:44.350405 (+ 0us) op_driver.cc:389] HandleFailure(Illegal state: replica ac75f6e7a0634a89beb9670950e95220 is not leader of this config: current role FOLLOWER)
0831 19:54:44.350416 (+ 11us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:44.350422 (+ 6us) write_op.cc:454] Released schema lock
0831 19:54:44.350426 (+ 4us) write_op.cc:335] FINISH: Op aborted
Metrics: {"Hive Metastore.queue_time_us":381793,"Hive Metastore.run_cpu_time_us":530,"Hive Metastore.run_wall_time_us":140121,"child_traces":[["op",{}]]}
I20250831 19:54:44.835927 2124 catalog_manager.cc:2706] deleted HMS catalog entry for table default.table_c3535015c99247ec86adfa665b7bc01c [id=ec56be26e67b43bfa7c5cb71edb64c8b]
I20250831 19:54:44.846772 1439 catalog_manager.cc:2159] deleted orphaned HMS catalog entry for table [id=171e825e5eab4a558091a9444acf5092]
I20250831 19:54:44.847167 1439 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51254 (request call id 62) took 2570 ms. Trace:
I20250831 19:54:44.847249 1439 rpcz_store.cc:276] 0831 19:54:42.276625 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:43.586157 (+1309532us) service_pool.cc:225] Handling call
0831 19:54:44.298902 (+712745us) catalog_manager.cc:2076] Acquired catalog manager lock
0831 19:54:44.299335 (+ 433us) catalog_manager.cc:2122] Created new table and tablet info
0831 19:54:44.583575 (+284240us) catalog_manager.cc:2148] Created new table in HMS catalog
0831 19:54:44.584302 (+ 727us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:44.584305 (+ 3us) write_op.cc:454] Released schema lock
0831 19:54:44.584535 (+ 230us) catalog_manager.cc:2156] Rolling back HMS table creation
0831 19:54:44.847065 (+262530us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:44.584230 (+ 0us) op_driver.cc:389] HandleFailure(Illegal state: replica ac75f6e7a0634a89beb9670950e95220 is not leader of this config: current role FOLLOWER)
0831 19:54:44.584242 (+ 12us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:44.584249 (+ 7us) write_op.cc:454] Released schema lock
0831 19:54:44.584253 (+ 4us) write_op.cc:335] FINISH: Op aborted
Metrics: {"Hive Metastore.queue_time_us":444455,"Hive Metastore.run_cpu_time_us":433,"Hive Metastore.run_wall_time_us":101363,"child_traces":[["op",{}]]}
I20250831 19:54:44.870464 2068 raft_consensus.cc:491] T 1033d94413c34db7bbf540330df23b7c P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:44.870710 2068 raft_consensus.cc:513] T 1033d94413c34db7bbf540330df23b7c P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:44.871475 2068 leader_election.cc:290] T 1033d94413c34db7bbf540330df23b7c P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:44.872815 1904 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1033d94413c34db7bbf540330df23b7c" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:44.873078 1904 raft_consensus.cc:2466] T 1033d94413c34db7bbf540330df23b7c P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 0.
I20250831 19:54:44.873531 1634 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1033d94413c34db7bbf540330df23b7c" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:44.873759 1634 raft_consensus.cc:2466] T 1033d94413c34db7bbf540330df23b7c P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 0.
I20250831 19:54:44.874485 1706 leader_election.cc:304] T 1033d94413c34db7bbf540330df23b7c P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:44.874877 2033 raft_consensus.cc:2802] T 1033d94413c34db7bbf540330df23b7c P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:44.874962 2033 raft_consensus.cc:491] T 1033d94413c34db7bbf540330df23b7c P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:44.875609 2033 raft_consensus.cc:3058] T 1033d94413c34db7bbf540330df23b7c P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:44.878113 2033 raft_consensus.cc:513] T 1033d94413c34db7bbf540330df23b7c P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:44.879513 1904 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1033d94413c34db7bbf540330df23b7c" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:54:44.879551 1634 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1033d94413c34db7bbf540330df23b7c" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:54:44.879689 1904 raft_consensus.cc:3058] T 1033d94413c34db7bbf540330df23b7c P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:44.879755 1634 raft_consensus.cc:3058] T 1033d94413c34db7bbf540330df23b7c P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:44.882278 1904 raft_consensus.cc:2466] T 1033d94413c34db7bbf540330df23b7c P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:54:44.882457 1634 raft_consensus.cc:2466] T 1033d94413c34db7bbf540330df23b7c P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:54:44.882866 1705 leader_election.cc:304] T 1033d94413c34db7bbf540330df23b7c P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:44.883446 2306 raft_consensus.cc:2802] T 1033d94413c34db7bbf540330df23b7c P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:44.883641 2306 raft_consensus.cc:695] T 1033d94413c34db7bbf540330df23b7c P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: Becoming Leader. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Running, Role: LEADER
I20250831 19:54:44.883939 2306 consensus_queue.cc:237] T 1033d94413c34db7bbf540330df23b7c P de831f40fa1348a48a1f0260f4130197 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:44.885540 2033 leader_election.cc:290] T 1033d94413c34db7bbf540330df23b7c P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Requested vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:44.890856 1438 catalog_manager.cc:2159] deleted orphaned HMS catalog entry for table [id=833646a3553b46beb5bee93d170df67c]
I20250831 19:54:44.891160 1438 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51254 (request call id 64) took 2460 ms. Trace:
I20250831 19:54:44.891281 1438 rpcz_store.cc:276] 0831 19:54:42.430359 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:43.647954 (+1217595us) service_pool.cc:225] Handling call
0831 19:54:44.309306 (+661352us) catalog_manager.cc:2076] Acquired catalog manager lock
0831 19:54:44.314953 (+ 5647us) catalog_manager.cc:2122] Created new table and tablet info
0831 19:54:44.622701 (+307748us) catalog_manager.cc:2148] Created new table in HMS catalog
0831 19:54:44.623393 (+ 692us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:44.623396 (+ 3us) write_op.cc:454] Released schema lock
0831 19:54:44.623603 (+ 207us) catalog_manager.cc:2156] Rolling back HMS table creation
0831 19:54:44.891124 (+267521us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:44.623313 (+ 0us) op_driver.cc:389] HandleFailure(Illegal state: replica ac75f6e7a0634a89beb9670950e95220 is not leader of this config: current role FOLLOWER)
0831 19:54:44.623325 (+ 12us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:44.623332 (+ 7us) write_op.cc:454] Released schema lock
0831 19:54:44.623337 (+ 5us) write_op.cc:335] FINISH: Op aborted
Metrics: {"Hive Metastore.queue_time_us":491217,"Hive Metastore.run_cpu_time_us":444,"Hive Metastore.run_wall_time_us":83187,"child_traces":[["op",{}]]}
I20250831 19:54:44.894691 2117 catalog_manager.cc:3460] renamed table default.table_ca86d7dcbfdc477da58b5308247443e7 [id=bd456415108d49989ef0bc2af91eb2f0] in HMS: new name default.table_179225213b4a45978264479432550f67
I20250831 19:54:44.913134 2121 catalog_manager.cc:2149] created HMS catalog entry for table [id=c52f5ff0a57742749597f0406f63c8d8]
I20250831 19:54:44.924805 1434 catalog_manager.cc:2159] deleted orphaned HMS catalog entry for table [id=1ace025b68c34372b346c712a1d27cab]
I20250831 19:54:44.925110 1434 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51254 (request call id 63) took 2581 ms. Trace:
I20250831 19:54:44.925233 1434 rpcz_store.cc:276] 0831 19:54:42.343386 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:43.588263 (+1244877us) service_pool.cc:225] Handling call
0831 19:54:44.309525 (+721262us) catalog_manager.cc:2076] Acquired catalog manager lock
0831 19:54:44.315645 (+ 6120us) catalog_manager.cc:2122] Created new table and tablet info
0831 19:54:44.728724 (+413079us) catalog_manager.cc:2148] Created new table in HMS catalog
0831 19:54:44.729376 (+ 652us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:44.729380 (+ 4us) write_op.cc:454] Released schema lock
0831 19:54:44.729609 (+ 229us) catalog_manager.cc:2156] Rolling back HMS table creation
0831 19:54:44.925069 (+195460us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:44.729307 (+ 0us) op_driver.cc:389] HandleFailure(Illegal state: replica ac75f6e7a0634a89beb9670950e95220 is not leader of this config: current role FOLLOWER)
0831 19:54:44.729319 (+ 12us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:44.729324 (+ 5us) write_op.cc:454] Released schema lock
0831 19:54:44.729329 (+ 5us) write_op.cc:335] FINISH: Op aborted
Metrics: {"Hive Metastore.queue_time_us":467828,"Hive Metastore.run_cpu_time_us":865,"Hive Metastore.run_wall_time_us":139942,"child_traces":[["op",{}]]}
I20250831 19:54:44.932751 2121 catalog_manager.cc:6127] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: default.table_f2750ddd8ef049ef8bca6b19ca6b68a6 [id=6063834030bb409d8ee666a753351551] alter complete (version 1)
I20250831 19:54:44.933590 1614 tablet_service.cc:1515] Processing DeleteTablet for tablet a22b1e71ca344973808ad05fa1af7eb9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:44 UTC) from {username='slave'} at 127.0.0.1:51022
I20250831 19:54:44.934863 1884 tablet_service.cc:1468] Processing CreateTablet for tablet b4cc124dc284464f8e78562b4d0881c8 (DEFAULT_TABLE table=default.table_041b766e57be48328a32ed288f99216a [id=c52f5ff0a57742749597f0406f63c8d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:44.935272 1884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4cc124dc284464f8e78562b4d0881c8. 1 dirs total, 0 dirs full, 0 dirs failed
W20250831 19:54:44.937947 2104 catalog_manager.cc:4895] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): delete failed for tablet a22b1e71ca344973808ad05fa1af7eb9 because the tablet was not found. No further retry: Not found: Tablet not found: a22b1e71ca344973808ad05fa1af7eb9
I20250831 19:54:44.938803 1614 tablet_service.cc:1468] Processing CreateTablet for tablet b4cc124dc284464f8e78562b4d0881c8 (DEFAULT_TABLE table=default.table_041b766e57be48328a32ed288f99216a [id=c52f5ff0a57742749597f0406f63c8d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:44.939188 1614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4cc124dc284464f8e78562b4d0881c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:44.939664 1751 tablet_service.cc:1468] Processing CreateTablet for tablet b4cc124dc284464f8e78562b4d0881c8 (DEFAULT_TABLE table=default.table_041b766e57be48328a32ed288f99216a [id=c52f5ff0a57742749597f0406f63c8d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:44.940062 1751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4cc124dc284464f8e78562b4d0881c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:44.941888 2283 tablet_bootstrap.cc:492] T b4cc124dc284464f8e78562b4d0881c8 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:44.943336 2283 tablet_bootstrap.cc:654] T b4cc124dc284464f8e78562b4d0881c8 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:44.947686 2284 tablet_bootstrap.cc:492] T b4cc124dc284464f8e78562b4d0881c8 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:44.949182 2284 tablet_bootstrap.cc:654] T b4cc124dc284464f8e78562b4d0881c8 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:44.959374 2282 tablet_bootstrap.cc:492] T b4cc124dc284464f8e78562b4d0881c8 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:44.961395 2282 tablet_bootstrap.cc:654] T b4cc124dc284464f8e78562b4d0881c8 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:44.968703 2283 tablet_bootstrap.cc:492] T b4cc124dc284464f8e78562b4d0881c8 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:44.968848 2284 tablet_bootstrap.cc:492] T b4cc124dc284464f8e78562b4d0881c8 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:44.968963 2283 ts_tablet_manager.cc:1397] T b4cc124dc284464f8e78562b4d0881c8 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.028s user 0.006s sys 0.006s
I20250831 19:54:44.968990 2284 ts_tablet_manager.cc:1397] T b4cc124dc284464f8e78562b4d0881c8 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.021s user 0.003s sys 0.008s
I20250831 19:54:44.969913 2283 raft_consensus.cc:357] T b4cc124dc284464f8e78562b4d0881c8 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:44.970257 2283 raft_consensus.cc:383] T b4cc124dc284464f8e78562b4d0881c8 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:44.970391 2283 raft_consensus.cc:738] T b4cc124dc284464f8e78562b4d0881c8 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:44.970769 2283 consensus_queue.cc:260] T b4cc124dc284464f8e78562b4d0881c8 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:44.971226 2284 raft_consensus.cc:357] T b4cc124dc284464f8e78562b4d0881c8 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:44.971412 2284 raft_consensus.cc:383] T b4cc124dc284464f8e78562b4d0881c8 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:44.971478 2284 raft_consensus.cc:738] T b4cc124dc284464f8e78562b4d0881c8 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:44.972349 2284 consensus_queue.cc:260] T b4cc124dc284464f8e78562b4d0881c8 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:44.973819 2284 ts_tablet_manager.cc:1428] T b4cc124dc284464f8e78562b4d0881c8 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20250831 19:54:44.979481 2283 ts_tablet_manager.cc:1428] T b4cc124dc284464f8e78562b4d0881c8 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20250831 19:54:44.980361 2282 tablet_bootstrap.cc:492] T b4cc124dc284464f8e78562b4d0881c8 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:44.980592 2282 ts_tablet_manager.cc:1397] T b4cc124dc284464f8e78562b4d0881c8 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.021s user 0.004s sys 0.009s
I20250831 19:54:44.981421 2282 raft_consensus.cc:357] T b4cc124dc284464f8e78562b4d0881c8 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:44.981703 2282 raft_consensus.cc:383] T b4cc124dc284464f8e78562b4d0881c8 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:44.981846 2282 raft_consensus.cc:738] T b4cc124dc284464f8e78562b4d0881c8 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:44.982156 2282 consensus_queue.cc:260] T b4cc124dc284464f8e78562b4d0881c8 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:44.984737 2282 ts_tablet_manager.cc:1428] T b4cc124dc284464f8e78562b4d0881c8 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20250831 19:54:44.997700 2121 catalog_manager.cc:5674] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197) does not have the latest schema for tablet 1033d94413c34db7bbf540330df23b7c (table default.table_e2ff8984d73f4f05a25d1c132ea949fb [id=b1daf7387b1749019e5377ab08146d20]). Expected version 1 got 0
I20250831 19:54:44.998876 1884 tablet_service.cc:1515] Processing DeleteTablet for tablet a22b1e71ca344973808ad05fa1af7eb9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:44 UTC) from {username='slave'} at 127.0.0.1:45906
W20250831 19:54:44.999583 2101 catalog_manager.cc:4895] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): delete failed for tablet a22b1e71ca344973808ad05fa1af7eb9 because the tablet was not found. No further retry: Not found: Tablet not found: a22b1e71ca344973808ad05fa1af7eb9
I20250831 19:54:45.006587 2121 catalog_manager.cc:6127] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: default.table_d0245eccd867474e98fe08e8ef86df18 [id=1137b2754d104964bbe5bbaa4a0578b8] alter complete (version 2)
I20250831 19:54:45.008466 2121 catalog_manager.cc:5674] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237) does not have the latest schema for tablet 1033d94413c34db7bbf540330df23b7c (table default.table_e2ff8984d73f4f05a25d1c132ea949fb [id=b1daf7387b1749019e5377ab08146d20]). Expected version 1 got 0
I20250831 19:54:45.011884 2303 raft_consensus.cc:491] T b4cc124dc284464f8e78562b4d0881c8 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:45.012056 2303 raft_consensus.cc:513] T b4cc124dc284464f8e78562b4d0881c8 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:45.012343 2121 catalog_manager.cc:5582] T 1033d94413c34db7bbf540330df23b7c P de831f40fa1348a48a1f0260f4130197 reported cstate change: term changed from 0 to 1, leader changed from <none> to de831f40fa1348a48a1f0260f4130197 (127.1.1.194). New cstate: current_term: 1 leader_uuid: "de831f40fa1348a48a1f0260f4130197" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: UNKNOWN } } }
I20250831 19:54:45.012678 2303 leader_election.cc:290] T b4cc124dc284464f8e78562b4d0881c8 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:45.012799 2121 catalog_manager.cc:5674] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475) does not have the latest schema for tablet 1033d94413c34db7bbf540330df23b7c (table default.table_e2ff8984d73f4f05a25d1c132ea949fb [id=b1daf7387b1749019e5377ab08146d20]). Expected version 1 got 0
I20250831 19:54:45.013257 1771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b4cc124dc284464f8e78562b4d0881c8" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:45.013314 1634 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b4cc124dc284464f8e78562b4d0881c8" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:45.013504 1771 raft_consensus.cc:2466] T b4cc124dc284464f8e78562b4d0881c8 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 0.
I20250831 19:54:45.013518 1634 raft_consensus.cc:2466] T b4cc124dc284464f8e78562b4d0881c8 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 0.
I20250831 19:54:45.013914 1841 leader_election.cc:304] T b4cc124dc284464f8e78562b4d0881c8 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:54:45.014269 2303 raft_consensus.cc:2802] T b4cc124dc284464f8e78562b4d0881c8 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:45.014354 2303 raft_consensus.cc:491] T b4cc124dc284464f8e78562b4d0881c8 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:45.014415 2303 raft_consensus.cc:3058] T b4cc124dc284464f8e78562b4d0881c8 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:45.016839 2303 raft_consensus.cc:513] T b4cc124dc284464f8e78562b4d0881c8 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:45.017625 1771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b4cc124dc284464f8e78562b4d0881c8" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197"
I20250831 19:54:45.017807 1771 raft_consensus.cc:3058] T b4cc124dc284464f8e78562b4d0881c8 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:45.020712 1771 raft_consensus.cc:2466] T b4cc124dc284464f8e78562b4d0881c8 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 1.
I20250831 19:54:45.021670 1842 leader_election.cc:304] T b4cc124dc284464f8e78562b4d0881c8 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:45.021982 2239 raft_consensus.cc:2802] T b4cc124dc284464f8e78562b4d0881c8 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:45.022140 2239 raft_consensus.cc:695] T b4cc124dc284464f8e78562b4d0881c8 P 2441fafe1d62429386f4631ad423567d [term 1 LEADER]: Becoming Leader. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Running, Role: LEADER
I20250831 19:54:45.022378 2239 consensus_queue.cc:237] T b4cc124dc284464f8e78562b4d0881c8 P 2441fafe1d62429386f4631ad423567d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:45.024176 2122 catalog_manager.cc:3460] renamed table default.table_f940275fb42644d4935e49d6143fb4ba [id=0850f2b0e9324dd0a210fa7b2609c769] in HMS: new name default.table_609f839fcd04455fb64b8a7674b0f57b
I20250831 19:54:45.025013 1634 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b4cc124dc284464f8e78562b4d0881c8" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:54:45.025182 1634 raft_consensus.cc:3058] T b4cc124dc284464f8e78562b4d0881c8 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:45.027782 1634 raft_consensus.cc:2466] T b4cc124dc284464f8e78562b4d0881c8 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 1.
I20250831 19:54:45.028331 2303 leader_election.cc:290] T b4cc124dc284464f8e78562b4d0881c8 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 election: Requested vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:45.048905 2121 catalog_manager.cc:5582] T b4cc124dc284464f8e78562b4d0881c8 P 2441fafe1d62429386f4631ad423567d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2441fafe1d62429386f4631ad423567d (127.1.1.195). New cstate: current_term: 1 leader_uuid: "2441fafe1d62429386f4631ad423567d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: UNKNOWN } } }
I20250831 19:54:45.053272 2125 catalog_manager.cc:2149] created HMS catalog entry for table [id=d1d8c4304331413794b75cf39b81ad3a]
I20250831 19:54:45.058992 2125 master_service.cc:948] ReplaceTablet: received request to replace tablet f56c31854bc94b45879493264daf7ef3 from {username='slave'} at 127.0.0.1:36958
I20250831 19:54:45.061169 2186 catalog_manager.cc:2747] Deleting table default.table_d961171a98f341b5945cfe0300337aec [id=2475332024a84359a43fe486d5488cba] in response to Hive Metastore notification log event 28
I20250831 19:54:45.066531 2125 catalog_manager.cc:5869] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Sending DeleteTablet for 3 replicas of tablet f56c31854bc94b45879493264daf7ef3
I20250831 19:54:45.066972 2125 catalog_manager.cc:6652] ReplaceTablet: tablet f56c31854bc94b45879493264daf7ef3 deleted and replaced by tablet cfc065bfa931449c9901c8089cae14c3
I20250831 19:54:45.067240 2125 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_cc2bfcade74f4778bfa8e873869aba43" } modify_external_catalogs: true
I20250831 19:54:45.067430 2125 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_cc2bfcade74f4778bfa8e873869aba43" } modify_external_catalogs: true
I20250831 19:54:45.067421 1884 tablet_service.cc:1515] Processing DeleteTablet for tablet f56c31854bc94b45879493264daf7ef3 with delete_type TABLET_DATA_DELETED (replaced by tablet cfc065bfa931449c9901c8089cae14c3) from {username='slave'} at 127.0.0.1:45906
I20250831 19:54:45.067757 2280 tablet_replica.cc:331] T f56c31854bc94b45879493264daf7ef3 P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:54:45.067957 2280 raft_consensus.cc:2241] T f56c31854bc94b45879493264daf7ef3 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:45.068009 1614 tablet_service.cc:1515] Processing DeleteTablet for tablet f56c31854bc94b45879493264daf7ef3 with delete_type TABLET_DATA_DELETED (replaced by tablet cfc065bfa931449c9901c8089cae14c3) from {username='slave'} at 127.0.0.1:51022
I20250831 19:54:45.068168 2280 raft_consensus.cc:2270] T f56c31854bc94b45879493264daf7ef3 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:45.068277 2277 tablet_replica.cc:331] T f56c31854bc94b45879493264daf7ef3 P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:54:45.068475 2277 raft_consensus.cc:2241] T f56c31854bc94b45879493264daf7ef3 P 89aa85d59c53436ebdf3074b13d14825 [term 1 LEADER]: Raft consensus shutting down.
I20250831 19:54:45.068727 2280 ts_tablet_manager.cc:1905] T f56c31854bc94b45879493264daf7ef3 P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:45.069016 2277 raft_consensus.cc:2270] T f56c31854bc94b45879493264daf7ef3 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:45.070314 2277 ts_tablet_manager.cc:1905] T f56c31854bc94b45879493264daf7ef3 P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:45.073650 1751 tablet_service.cc:1515] Processing DeleteTablet for tablet f56c31854bc94b45879493264daf7ef3 with delete_type TABLET_DATA_DELETED (replaced by tablet cfc065bfa931449c9901c8089cae14c3) from {username='slave'} at 127.0.0.1:50674
I20250831 19:54:45.073928 2278 tablet_replica.cc:331] T f56c31854bc94b45879493264daf7ef3 P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:54:45.074100 2278 raft_consensus.cc:2241] T f56c31854bc94b45879493264daf7ef3 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:45.074285 2278 raft_consensus.cc:2270] T f56c31854bc94b45879493264daf7ef3 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:45.074790 2278 ts_tablet_manager.cc:1905] T f56c31854bc94b45879493264daf7ef3 P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:45.075016 2277 ts_tablet_manager.cc:1918] T f56c31854bc94b45879493264daf7ef3 P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:45.075121 2277 log.cc:1199] T f56c31854bc94b45879493264daf7ef3 P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/f56c31854bc94b45879493264daf7ef3
I20250831 19:54:45.075505 2277 ts_tablet_manager.cc:1939] T f56c31854bc94b45879493264daf7ef3 P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
I20250831 19:54:45.077419 2104 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet f56c31854bc94b45879493264daf7ef3 (table default.table_c3535015c99247ec86adfa665b7bc01c [id=ec56be26e67b43bfa7c5cb71edb64c8b]) successfully deleted
I20250831 19:54:45.078284 2121 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_e2ff8984d73f4f05a25d1c132ea949fb" } new_table_name: "default.Table_cba30e3477524a4fb902655e070bfce2" modify_external_catalogs: true
I20250831 19:54:45.080019 2186 catalog_manager.cc:5869] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Sending DeleteTablet for 3 replicas of tablet 520b7d1fbd1c4814b42c102aeb250f72
I20250831 19:54:45.081303 2186 catalog_manager.cc:2747] Deleting table default.table_9706596e6715417ebc8fb06420b56bde [id=e2ce658df3e14cd28c444b4a0526333b] in response to Hive Metastore notification log event 29
W20250831 19:54:45.081591 2186 hms_notification_log_listener.cc:330] Failed to handle Hive Metastore notification: 29 DROP_TABLE default.table_9706596e6715417ebc8fb06420b56bde: Not found: the table does not exist: table_id: "e2ce658df3e14cd28c444b4a0526333b" table_name: "default.table_9706596e6715417ebc8fb06420b56bde"
I20250831 19:54:45.082238 1885 tablet_service.cc:1515] Processing DeleteTablet for tablet 520b7d1fbd1c4814b42c102aeb250f72 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:45 UTC) from {username='slave'} at 127.0.0.1:45906
I20250831 19:54:45.082305 2186 catalog_manager.cc:2747] Deleting table default.table_c3535015c99247ec86adfa665b7bc01c [id=ec56be26e67b43bfa7c5cb71edb64c8b] in response to Hive Metastore notification log event 30
I20250831 19:54:45.082262 1884 tablet_service.cc:1468] Processing CreateTablet for tablet 52329de858ab4af18b3639df57972eb5 (DEFAULT_TABLE table=default.table_21109c51ccde402faea41968420775a5 [id=d1d8c4304331413794b75cf39b81ad3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:45.082692 1884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52329de858ab4af18b3639df57972eb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:45.085755 1750 tablet_service.cc:1468] Processing CreateTablet for tablet 52329de858ab4af18b3639df57972eb5 (DEFAULT_TABLE table=default.table_21109c51ccde402faea41968420775a5 [id=d1d8c4304331413794b75cf39b81ad3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:45.086105 1750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52329de858ab4af18b3639df57972eb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:45.089661 1751 tablet_service.cc:1515] Processing DeleteTablet for tablet 520b7d1fbd1c4814b42c102aeb250f72 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:45 UTC) from {username='slave'} at 127.0.0.1:50674
I20250831 19:54:45.090576 1613 tablet_service.cc:1468] Processing CreateTablet for tablet 52329de858ab4af18b3639df57972eb5 (DEFAULT_TABLE table=default.table_21109c51ccde402faea41968420775a5 [id=d1d8c4304331413794b75cf39b81ad3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:45.091053 1613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52329de858ab4af18b3639df57972eb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:45.093698 1614 tablet_service.cc:1515] Processing DeleteTablet for tablet 520b7d1fbd1c4814b42c102aeb250f72 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:45 UTC) from {username='slave'} at 127.0.0.1:51022
I20250831 19:54:45.094892 2126 catalog_manager.cc:2149] created HMS catalog entry for table [id=f63d391a9c824314bf6789cc7bbb5ffb]
I20250831 19:54:45.094975 1885 tablet_service.cc:1468] Processing CreateTablet for tablet cfc065bfa931449c9901c8089cae14c3 (DEFAULT_TABLE table=default.table_c3535015c99247ec86adfa665b7bc01c [id=ec56be26e67b43bfa7c5cb71edb64c8b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:45.095557 1885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfc065bfa931449c9901c8089cae14c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:45.098647 2283 tablet_bootstrap.cc:492] T 52329de858ab4af18b3639df57972eb5 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:45.100147 2283 tablet_bootstrap.cc:654] T 52329de858ab4af18b3639df57972eb5 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:45.101505 2284 tablet_bootstrap.cc:492] T 52329de858ab4af18b3639df57972eb5 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:45.103051 2284 tablet_bootstrap.cc:654] T 52329de858ab4af18b3639df57972eb5 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:45.104935 2278 ts_tablet_manager.cc:1918] T f56c31854bc94b45879493264daf7ef3 P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:45.105785 1614 tablet_service.cc:1468] Processing CreateTablet for tablet cfc065bfa931449c9901c8089cae14c3 (DEFAULT_TABLE table=default.table_c3535015c99247ec86adfa665b7bc01c [id=ec56be26e67b43bfa7c5cb71edb64c8b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:45.106003 2278 log.cc:1199] T f56c31854bc94b45879493264daf7ef3 P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/f56c31854bc94b45879493264daf7ef3
I20250831 19:54:45.106220 1614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfc065bfa931449c9901c8089cae14c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:45.106480 2278 ts_tablet_manager.cc:1939] T f56c31854bc94b45879493264daf7ef3 P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
I20250831 19:54:45.107846 2278 tablet_replica.cc:331] T 520b7d1fbd1c4814b42c102aeb250f72 P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:54:45.108013 2278 raft_consensus.cc:2241] T 520b7d1fbd1c4814b42c102aeb250f72 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:45.108148 2278 raft_consensus.cc:2270] T 520b7d1fbd1c4814b42c102aeb250f72 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:45.108949 2278 ts_tablet_manager.cc:1905] T 520b7d1fbd1c4814b42c102aeb250f72 P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:45.105810 2282 tablet_bootstrap.cc:492] T 52329de858ab4af18b3639df57972eb5 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:45.111086 2282 tablet_bootstrap.cc:654] T 52329de858ab4af18b3639df57972eb5 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:45.112387 2105 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet f56c31854bc94b45879493264daf7ef3 (table default.table_c3535015c99247ec86adfa665b7bc01c [id=ec56be26e67b43bfa7c5cb71edb64c8b]) successfully deleted
I20250831 19:54:45.113076 1750 tablet_service.cc:1468] Processing CreateTablet for tablet cfc065bfa931449c9901c8089cae14c3 (DEFAULT_TABLE table=default.table_c3535015c99247ec86adfa665b7bc01c [id=ec56be26e67b43bfa7c5cb71edb64c8b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:45.113412 1750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfc065bfa931449c9901c8089cae14c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:45.113907 2278 ts_tablet_manager.cc:1918] T 520b7d1fbd1c4814b42c102aeb250f72 P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:45.114025 2278 log.cc:1199] T 520b7d1fbd1c4814b42c102aeb250f72 P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/520b7d1fbd1c4814b42c102aeb250f72
I20250831 19:54:45.114363 2278 ts_tablet_manager.cc:1939] T 520b7d1fbd1c4814b42c102aeb250f72 P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
I20250831 19:54:45.117719 2126 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_f2750ddd8ef049ef8bca6b19ca6b68a6" } modify_external_catalogs: true
I20250831 19:54:45.117967 2126 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_f2750ddd8ef049ef8bca6b19ca6b68a6" } modify_external_catalogs: true
I20250831 19:54:45.119082 2280 ts_tablet_manager.cc:1918] T f56c31854bc94b45879493264daf7ef3 P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:45.119256 2280 log.cc:1199] T f56c31854bc94b45879493264daf7ef3 P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/f56c31854bc94b45879493264daf7ef3
I20250831 19:54:45.119853 2280 ts_tablet_manager.cc:1939] T f56c31854bc94b45879493264daf7ef3 P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:54:45.120762 2280 tablet_replica.cc:331] T 520b7d1fbd1c4814b42c102aeb250f72 P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:54:45.120899 2101 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet f56c31854bc94b45879493264daf7ef3 (table default.table_c3535015c99247ec86adfa665b7bc01c [id=ec56be26e67b43bfa7c5cb71edb64c8b]) successfully deleted
I20250831 19:54:45.121014 2280 raft_consensus.cc:2241] T 520b7d1fbd1c4814b42c102aeb250f72 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:45.121212 2280 raft_consensus.cc:2270] T 520b7d1fbd1c4814b42c102aeb250f72 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:45.122215 2280 ts_tablet_manager.cc:1905] T 520b7d1fbd1c4814b42c102aeb250f72 P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:45.123013 2105 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet 520b7d1fbd1c4814b42c102aeb250f72 (table default.table_d961171a98f341b5945cfe0300337aec [id=2475332024a84359a43fe486d5488cba]) successfully deleted
I20250831 19:54:45.124887 2123 catalog_manager.cc:2149] created HMS catalog entry for table [id=ad7bb166843e423ea7e50a1d18710fa1]
I20250831 19:54:45.130007 2277 tablet_replica.cc:331] T 520b7d1fbd1c4814b42c102aeb250f72 P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:54:45.130219 2277 raft_consensus.cc:2241] T 520b7d1fbd1c4814b42c102aeb250f72 P 89aa85d59c53436ebdf3074b13d14825 [term 1 LEADER]: Raft consensus shutting down.
I20250831 19:54:45.130550 2277 raft_consensus.cc:2270] T 520b7d1fbd1c4814b42c102aeb250f72 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:45.131901 2123 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_6965b0044d81462a8f1266e855ec1464" } new_table_name: "default.Table_87fbe752a7a54c9eaa7536ba0e611919" modify_external_catalogs: true
I20250831 19:54:45.135094 1751 tablet_service.cc:1468] Processing CreateTablet for tablet 9ad8ad70eab04e7abd29597603a1ce33 (DEFAULT_TABLE table=default.table_87e103a1db824462bc7d586a4682352e [id=f63d391a9c824314bf6789cc7bbb5ffb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:45.135493 1751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ad8ad70eab04e7abd29597603a1ce33. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:45.139014 1885 tablet_service.cc:1468] Processing CreateTablet for tablet 9ad8ad70eab04e7abd29597603a1ce33 (DEFAULT_TABLE table=default.table_87e103a1db824462bc7d586a4682352e [id=f63d391a9c824314bf6789cc7bbb5ffb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:45.140472 1885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ad8ad70eab04e7abd29597603a1ce33. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:45.142678 1614 tablet_service.cc:1468] Processing CreateTablet for tablet 9ad8ad70eab04e7abd29597603a1ce33 (DEFAULT_TABLE table=default.table_87e103a1db824462bc7d586a4682352e [id=f63d391a9c824314bf6789cc7bbb5ffb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:45.143723 2186 catalog_manager.cc:5869] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Sending DeleteTablet for 3 replicas of tablet cfc065bfa931449c9901c8089cae14c3
I20250831 19:54:45.144335 1884 tablet_service.cc:1515] Processing DeleteTablet for tablet cfc065bfa931449c9901c8089cae14c3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:45 UTC) from {username='slave'} at 127.0.0.1:45906
I20250831 19:54:45.144379 2306 consensus_queue.cc:1035] T 15fd6c30770b4c1599a812d4722b2bad P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:45.146095 2120 catalog_manager.cc:2149] created HMS catalog entry for table [id=115e02286266464593ead506a011b5a0]
I20250831 19:54:45.146600 1752 tablet_service.cc:1515] Processing DeleteTablet for tablet cfc065bfa931449c9901c8089cae14c3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:45 UTC) from {username='slave'} at 127.0.0.1:50674
I20250831 19:54:45.147013 2283 tablet_bootstrap.cc:492] T 52329de858ab4af18b3639df57972eb5 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:45.147156 2283 ts_tablet_manager.cc:1397] T 52329de858ab4af18b3639df57972eb5 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.049s user 0.003s sys 0.006s
W20250831 19:54:45.147181 2105 catalog_manager.cc:4895] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): delete failed for tablet cfc065bfa931449c9901c8089cae14c3 because the tablet was not found. No further retry: Not found: Tablet not found: cfc065bfa931449c9901c8089cae14c3
I20250831 19:54:45.147671 2186 catalog_manager.cc:2747] Deleting table default.table_544f7d804f564e83be8fb83049aa8dea [id=171e825e5eab4a558091a9444acf5092] in response to Hive Metastore notification log event 31
W20250831 19:54:45.147854 2186 hms_notification_log_listener.cc:330] Failed to handle Hive Metastore notification: 31 DROP_TABLE default.table_544f7d804f564e83be8fb83049aa8dea: Not found: the table does not exist: table_id: "171e825e5eab4a558091a9444acf5092" table_name: "default.table_544f7d804f564e83be8fb83049aa8dea"
I20250831 19:54:45.147877 2283 raft_consensus.cc:357] T 52329de858ab4af18b3639df57972eb5 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:45.148036 2283 raft_consensus.cc:383] T 52329de858ab4af18b3639df57972eb5 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:45.148106 2283 raft_consensus.cc:738] T 52329de858ab4af18b3639df57972eb5 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:45.148313 2283 consensus_queue.cc:260] T 52329de858ab4af18b3639df57972eb5 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:45.148785 2283 ts_tablet_manager.cc:1428] T 52329de858ab4af18b3639df57972eb5 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20250831 19:54:45.149195 2283 tablet_bootstrap.cc:492] T cfc065bfa931449c9901c8089cae14c3 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:45.149569 1614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ad8ad70eab04e7abd29597603a1ce33. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:45.150781 2283 tablet_bootstrap.cc:654] T cfc065bfa931449c9901c8089cae14c3 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:45.151068 1613 tablet_service.cc:1515] Processing DeleteTablet for tablet cfc065bfa931449c9901c8089cae14c3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:45 UTC) from {username='slave'} at 127.0.0.1:51022
I20250831 19:54:45.160454 1633 raft_consensus.cc:1273] T 1033d94413c34db7bbf540330df23b7c P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Refusing update from remote peer de831f40fa1348a48a1f0260f4130197: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250831 19:54:45.148470 2186 catalog_manager.cc:2747] Deleting table default.table_5660fc6b1a9846a6bd36b56e553a8f35 [id=833646a3553b46beb5bee93d170df67c] in response to Hive Metastore notification log event 32
I20250831 19:54:45.161213 1904 raft_consensus.cc:1273] T 1033d94413c34db7bbf540330df23b7c P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Refusing update from remote peer de831f40fa1348a48a1f0260f4130197: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20250831 19:54:45.161589 2186 hms_notification_log_listener.cc:330] Failed to handle Hive Metastore notification: 32 DROP_TABLE default.table_5660fc6b1a9846a6bd36b56e553a8f35: Not found: the table does not exist: table_id: "833646a3553b46beb5bee93d170df67c" table_name: "default.table_5660fc6b1a9846a6bd36b56e553a8f35"
I20250831 19:54:45.161896 2306 consensus_queue.cc:1035] T 1033d94413c34db7bbf540330df23b7c P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:45.164004 2306 consensus_queue.cc:1035] T 1033d94413c34db7bbf540330df23b7c P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:45.165632 2282 tablet_bootstrap.cc:492] T 52329de858ab4af18b3639df57972eb5 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:45.165812 2282 ts_tablet_manager.cc:1397] T 52329de858ab4af18b3639df57972eb5 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.060s user 0.003s sys 0.000s
I20250831 19:54:45.166764 2282 raft_consensus.cc:357] T 52329de858ab4af18b3639df57972eb5 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:45.167006 2282 raft_consensus.cc:383] T 52329de858ab4af18b3639df57972eb5 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:45.167080 2282 raft_consensus.cc:738] T 52329de858ab4af18b3639df57972eb5 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:45.167378 2282 consensus_queue.cc:260] T 52329de858ab4af18b3639df57972eb5 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:45.168151 2282 ts_tablet_manager.cc:1428] T 52329de858ab4af18b3639df57972eb5 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250831 19:54:45.168488 2282 tablet_bootstrap.cc:492] T cfc065bfa931449c9901c8089cae14c3 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:45.170588 2282 tablet_bootstrap.cc:654] T cfc065bfa931449c9901c8089cae14c3 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:45.178696 2120 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_5ca33d92f715421ab04c9570ac2ee4a0" } modify_external_catalogs: true
I20250831 19:54:45.178943 2120 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_5ca33d92f715421ab04c9570ac2ee4a0" } modify_external_catalogs: true
I20250831 19:54:45.186312 1884 tablet_service.cc:1468] Processing CreateTablet for tablet 07a9cd92870045a7a3e5a8b007bf7f47 (DEFAULT_TABLE table=default.table_f8db9b89d5e148b5ba271e3a17ff89b4 [id=ad7bb166843e423ea7e50a1d18710fa1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:45.186847 1884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07a9cd92870045a7a3e5a8b007bf7f47. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:45.194350 1751 tablet_service.cc:1468] Processing CreateTablet for tablet 07a9cd92870045a7a3e5a8b007bf7f47 (DEFAULT_TABLE table=default.table_f8db9b89d5e148b5ba271e3a17ff89b4 [id=ad7bb166843e423ea7e50a1d18710fa1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:45.194659 1613 tablet_service.cc:1468] Processing CreateTablet for tablet 07a9cd92870045a7a3e5a8b007bf7f47 (DEFAULT_TABLE table=default.table_f8db9b89d5e148b5ba271e3a17ff89b4 [id=ad7bb166843e423ea7e50a1d18710fa1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:45.194798 1751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07a9cd92870045a7a3e5a8b007bf7f47. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:45.195008 1613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07a9cd92870045a7a3e5a8b007bf7f47. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:45.206493 1886 tablet_service.cc:1468] Processing CreateTablet for tablet 2c2c52514c444ae382cd20d03c7ed456 (DEFAULT_TABLE table=default.table_40da3badb9e84e4990e6171bd0dbe8ac [id=115e02286266464593ead506a011b5a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:45.206988 1886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c2c52514c444ae382cd20d03c7ed456. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:45.210340 2277 ts_tablet_manager.cc:1905] T 520b7d1fbd1c4814b42c102aeb250f72 P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:45.216746 2288 tablet.cc:1722] T 1033d94413c34db7bbf540330df23b7c P 89aa85d59c53436ebdf3074b13d14825: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:45.216817 1752 tablet_service.cc:1468] Processing CreateTablet for tablet 2c2c52514c444ae382cd20d03c7ed456 (DEFAULT_TABLE table=default.table_40da3badb9e84e4990e6171bd0dbe8ac [id=115e02286266464593ead506a011b5a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:45.217245 1752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c2c52514c444ae382cd20d03c7ed456. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:45.217360 2280 ts_tablet_manager.cc:1918] T 520b7d1fbd1c4814b42c102aeb250f72 P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:45.217504 2280 log.cc:1199] T 520b7d1fbd1c4814b42c102aeb250f72 P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/520b7d1fbd1c4814b42c102aeb250f72
I20250831 19:54:45.217881 2280 ts_tablet_manager.cc:1939] T 520b7d1fbd1c4814b42c102aeb250f72 P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:54:45.222353 2101 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet 520b7d1fbd1c4814b42c102aeb250f72 (table default.table_d961171a98f341b5945cfe0300337aec [id=2475332024a84359a43fe486d5488cba]) successfully deleted
W20250831 19:54:45.222644 2101 catalog_manager.cc:4908] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): delete failed for tablet cfc065bfa931449c9901c8089cae14c3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cfc065bfa931449c9901c8089cae14c3 already in progress: creating tablet
I20250831 19:54:45.224754 2292 tablet.cc:1722] T 1033d94413c34db7bbf540330df23b7c P 2441fafe1d62429386f4631ad423567d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:45.226269 2284 tablet_bootstrap.cc:492] T 52329de858ab4af18b3639df57972eb5 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:45.227409 2284 ts_tablet_manager.cc:1397] T 52329de858ab4af18b3639df57972eb5 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.126s user 0.005s sys 0.005s
I20250831 19:54:45.228320 2284 raft_consensus.cc:357] T 52329de858ab4af18b3639df57972eb5 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:45.229158 2223 raft_consensus.cc:491] T 52329de858ab4af18b3639df57972eb5 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:45.229354 2223 raft_consensus.cc:513] T 52329de858ab4af18b3639df57972eb5 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:45.230314 2284 raft_consensus.cc:383] T 52329de858ab4af18b3639df57972eb5 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:45.230392 2284 raft_consensus.cc:738] T 52329de858ab4af18b3639df57972eb5 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:45.230582 2284 consensus_queue.cc:260] T 52329de858ab4af18b3639df57972eb5 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:45.231029 2284 ts_tablet_manager.cc:1428] T 52329de858ab4af18b3639df57972eb5 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.003s user 0.000s sys 0.000s
I20250831 19:54:45.233585 2290 tablet.cc:1722] T 1033d94413c34db7bbf540330df23b7c P de831f40fa1348a48a1f0260f4130197: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:45.235411 2223 leader_election.cc:290] T 52329de858ab4af18b3639df57972eb5 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:45.237124 2277 ts_tablet_manager.cc:1918] T 520b7d1fbd1c4814b42c102aeb250f72 P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:45.237262 2277 log.cc:1199] T 520b7d1fbd1c4814b42c102aeb250f72 P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/520b7d1fbd1c4814b42c102aeb250f72
I20250831 19:54:45.237731 2277 ts_tablet_manager.cc:1939] T 520b7d1fbd1c4814b42c102aeb250f72 P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
I20250831 19:54:45.239320 2104 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet 520b7d1fbd1c4814b42c102aeb250f72 (table default.table_d961171a98f341b5945cfe0300337aec [id=2475332024a84359a43fe486d5488cba]) successfully deleted
W20250831 19:54:45.239586 2104 catalog_manager.cc:4908] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): delete failed for tablet cfc065bfa931449c9901c8089cae14c3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cfc065bfa931449c9901c8089cae14c3 already in progress: creating tablet
I20250831 19:54:45.239861 1771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "52329de858ab4af18b3639df57972eb5" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:45.240021 1771 raft_consensus.cc:2466] T 52329de858ab4af18b3639df57972eb5 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 0.
I20250831 19:54:45.240397 1570 leader_election.cc:304] T 52329de858ab4af18b3639df57972eb5 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:45.241540 2223 raft_consensus.cc:2802] T 52329de858ab4af18b3639df57972eb5 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:45.241636 2223 raft_consensus.cc:491] T 52329de858ab4af18b3639df57972eb5 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:45.241693 2223 raft_consensus.cc:3058] T 52329de858ab4af18b3639df57972eb5 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:45.243726 2223 raft_consensus.cc:513] T 52329de858ab4af18b3639df57972eb5 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:45.244139 2223 leader_election.cc:290] T 52329de858ab4af18b3639df57972eb5 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Requested vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:45.244702 1771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "52329de858ab4af18b3639df57972eb5" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197"
I20250831 19:54:45.244856 1771 raft_consensus.cc:3058] T 52329de858ab4af18b3639df57972eb5 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:45.247097 1771 raft_consensus.cc:2466] T 52329de858ab4af18b3639df57972eb5 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1.
I20250831 19:54:45.248626 1903 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "52329de858ab4af18b3639df57972eb5" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:54:45.248826 1903 raft_consensus.cc:3058] T 52329de858ab4af18b3639df57972eb5 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:45.252648 1903 raft_consensus.cc:2466] T 52329de858ab4af18b3639df57972eb5 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1.
I20250831 19:54:45.253059 1568 leader_election.cc:304] T 52329de858ab4af18b3639df57972eb5 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:54:45.255039 2186 catalog_manager.cc:2747] Deleting table default.table_486ee0377a714038aaf8f3f5b1ad7f79 [id=1ace025b68c34372b346c712a1d27cab] in response to Hive Metastore notification log event 35
I20250831 19:54:45.256357 1614 tablet_service.cc:1468] Processing CreateTablet for tablet 2c2c52514c444ae382cd20d03c7ed456 (DEFAULT_TABLE table=default.table_40da3badb9e84e4990e6171bd0dbe8ac [id=115e02286266464593ead506a011b5a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:45.256804 1614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c2c52514c444ae382cd20d03c7ed456. 1 dirs total, 0 dirs full, 0 dirs failed
W20250831 19:54:45.255335 2186 hms_notification_log_listener.cc:330] Failed to handle Hive Metastore notification: 35 DROP_TABLE default.table_486ee0377a714038aaf8f3f5b1ad7f79: Not found: the table does not exist: table_id: "1ace025b68c34372b346c712a1d27cab" table_name: "default.table_486ee0377a714038aaf8f3f5b1ad7f79"
I20250831 19:54:45.268225 2033 consensus_queue.cc:1035] T 15fd6c30770b4c1599a812d4722b2bad P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:45.268342 2282 tablet_bootstrap.cc:492] T cfc065bfa931449c9901c8089cae14c3 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:45.268494 2282 ts_tablet_manager.cc:1397] T cfc065bfa931449c9901c8089cae14c3 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.100s user 0.001s sys 0.009s
I20250831 19:54:45.269428 2282 raft_consensus.cc:357] T cfc065bfa931449c9901c8089cae14c3 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:45.269682 2282 raft_consensus.cc:383] T cfc065bfa931449c9901c8089cae14c3 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:45.269770 2282 raft_consensus.cc:738] T cfc065bfa931449c9901c8089cae14c3 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:45.274801 2282 consensus_queue.cc:260] T cfc065bfa931449c9901c8089cae14c3 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:45.280043 2282 ts_tablet_manager.cc:1428] T cfc065bfa931449c9901c8089cae14c3 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.011s user 0.004s sys 0.000s
I20250831 19:54:45.280074 2283 tablet_bootstrap.cc:492] T cfc065bfa931449c9901c8089cae14c3 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:45.280187 2283 ts_tablet_manager.cc:1397] T cfc065bfa931449c9901c8089cae14c3 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.131s user 0.053s sys 0.073s
I20250831 19:54:45.280956 2283 raft_consensus.cc:357] T cfc065bfa931449c9901c8089cae14c3 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:45.281153 2283 raft_consensus.cc:383] T cfc065bfa931449c9901c8089cae14c3 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:45.281257 2283 raft_consensus.cc:738] T cfc065bfa931449c9901c8089cae14c3 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:45.281487 2283 consensus_queue.cc:260] T cfc065bfa931449c9901c8089cae14c3 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:45.281977 2283 ts_tablet_manager.cc:1428] T cfc065bfa931449c9901c8089cae14c3 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250831 19:54:45.282255 2283 tablet_bootstrap.cc:492] T 2c2c52514c444ae382cd20d03c7ed456 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:45.283725 2283 tablet_bootstrap.cc:654] T 2c2c52514c444ae382cd20d03c7ed456 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:45.284502 2330 raft_consensus.cc:2802] T 52329de858ab4af18b3639df57972eb5 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:45.284780 2330 raft_consensus.cc:695] T 52329de858ab4af18b3639df57972eb5 P 89aa85d59c53436ebdf3074b13d14825 [term 1 LEADER]: Becoming Leader. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Running, Role: LEADER
I20250831 19:54:45.285040 2330 consensus_queue.cc:237] T 52329de858ab4af18b3639df57972eb5 P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:45.285895 1904 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "52329de858ab4af18b3639df57972eb5" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:45.286127 2282 tablet_bootstrap.cc:492] T 07a9cd92870045a7a3e5a8b007bf7f47 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:45.286239 1904 raft_consensus.cc:2374] T 52329de858ab4af18b3639df57972eb5 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1. Re-sending same reply.
I20250831 19:54:45.289036 2284 tablet_bootstrap.cc:492] T 9ad8ad70eab04e7abd29597603a1ce33 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:45.291464 2284 tablet_bootstrap.cc:654] T 9ad8ad70eab04e7abd29597603a1ce33 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:45.294198 2288 tablet.cc:1722] T 79a678e2a5ba495095865769a25ff68a P 89aa85d59c53436ebdf3074b13d14825: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:45.297799 2292 tablet.cc:1722] T 79a678e2a5ba495095865769a25ff68a P 2441fafe1d62429386f4631ad423567d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:45.309666 2118 catalog_manager.cc:5674] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237) does not have the latest schema for tablet 1033d94413c34db7bbf540330df23b7c (table default.table_e2ff8984d73f4f05a25d1c132ea949fb [id=b1daf7387b1749019e5377ab08146d20]). Expected version 1 got 0
I20250831 19:54:45.321100 2282 tablet_bootstrap.cc:654] T 07a9cd92870045a7a3e5a8b007bf7f47 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:45.323880 2283 tablet_bootstrap.cc:492] T 2c2c52514c444ae382cd20d03c7ed456 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:45.324046 2283 ts_tablet_manager.cc:1397] T 2c2c52514c444ae382cd20d03c7ed456 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.042s user 0.019s sys 0.013s
I20250831 19:54:45.324607 2282 tablet_bootstrap.cc:492] T 07a9cd92870045a7a3e5a8b007bf7f47 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:45.324797 2282 ts_tablet_manager.cc:1397] T 07a9cd92870045a7a3e5a8b007bf7f47 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.039s user 0.001s sys 0.003s
I20250831 19:54:45.324761 2283 raft_consensus.cc:357] T 2c2c52514c444ae382cd20d03c7ed456 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:45.324960 2283 raft_consensus.cc:383] T 2c2c52514c444ae382cd20d03c7ed456 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:45.325030 2283 raft_consensus.cc:738] T 2c2c52514c444ae382cd20d03c7ed456 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:45.325274 2283 consensus_queue.cc:260] T 2c2c52514c444ae382cd20d03c7ed456 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:45.325769 2282 raft_consensus.cc:357] T 07a9cd92870045a7a3e5a8b007bf7f47 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:45.325987 2282 raft_consensus.cc:383] T 07a9cd92870045a7a3e5a8b007bf7f47 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:45.326087 2282 raft_consensus.cc:738] T 07a9cd92870045a7a3e5a8b007bf7f47 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:45.326344 2282 consensus_queue.cc:260] T 07a9cd92870045a7a3e5a8b007bf7f47 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:45.327943 2283 ts_tablet_manager.cc:1428] T 2c2c52514c444ae382cd20d03c7ed456 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20250831 19:54:45.329226 2282 ts_tablet_manager.cc:1428] T 07a9cd92870045a7a3e5a8b007bf7f47 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20250831 19:54:45.330052 2283 tablet_bootstrap.cc:492] T 07a9cd92870045a7a3e5a8b007bf7f47 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:45.331779 2282 tablet_bootstrap.cc:492] T 9ad8ad70eab04e7abd29597603a1ce33 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:45.332605 2283 tablet_bootstrap.cc:654] T 07a9cd92870045a7a3e5a8b007bf7f47 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:45.333437 2282 tablet_bootstrap.cc:654] T 9ad8ad70eab04e7abd29597603a1ce33 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:45.335611 2118 catalog_manager.cc:6127] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: default.table_e2ff8984d73f4f05a25d1c132ea949fb [id=b1daf7387b1749019e5377ab08146d20] alter complete (version 1)
I20250831 19:54:45.339470 2282 tablet_bootstrap.cc:492] T 9ad8ad70eab04e7abd29597603a1ce33 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:45.339716 2282 ts_tablet_manager.cc:1397] T 9ad8ad70eab04e7abd29597603a1ce33 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.003s
I20250831 19:54:45.342427 2282 raft_consensus.cc:357] T 9ad8ad70eab04e7abd29597603a1ce33 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:45.342710 2282 raft_consensus.cc:383] T 9ad8ad70eab04e7abd29597603a1ce33 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:45.342832 2282 raft_consensus.cc:738] T 9ad8ad70eab04e7abd29597603a1ce33 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:45.343080 2282 consensus_queue.cc:260] T 9ad8ad70eab04e7abd29597603a1ce33 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:45.351053 2282 ts_tablet_manager.cc:1428] T 9ad8ad70eab04e7abd29597603a1ce33 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.011s user 0.001s sys 0.001s
I20250831 19:54:45.352912 2290 tablet.cc:1722] T 79a678e2a5ba495095865769a25ff68a P de831f40fa1348a48a1f0260f4130197: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:45.354212 2282 tablet_bootstrap.cc:492] T 2c2c52514c444ae382cd20d03c7ed456 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:45.358539 2282 tablet_bootstrap.cc:654] T 2c2c52514c444ae382cd20d03c7ed456 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:45.360112 2283 tablet_bootstrap.cc:492] T 07a9cd92870045a7a3e5a8b007bf7f47 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:45.360296 2283 ts_tablet_manager.cc:1397] T 07a9cd92870045a7a3e5a8b007bf7f47 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.030s user 0.005s sys 0.022s
I20250831 19:54:45.361193 2283 raft_consensus.cc:357] T 07a9cd92870045a7a3e5a8b007bf7f47 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:45.361387 2283 raft_consensus.cc:383] T 07a9cd92870045a7a3e5a8b007bf7f47 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:45.361503 2283 raft_consensus.cc:738] T 07a9cd92870045a7a3e5a8b007bf7f47 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:45.361743 2283 consensus_queue.cc:260] T 07a9cd92870045a7a3e5a8b007bf7f47 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:45.366315 2283 ts_tablet_manager.cc:1428] T 07a9cd92870045a7a3e5a8b007bf7f47 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.006s user 0.000s sys 0.002s
I20250831 19:54:45.368449 2282 tablet_bootstrap.cc:492] T 2c2c52514c444ae382cd20d03c7ed456 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:45.368619 2282 ts_tablet_manager.cc:1397] T 2c2c52514c444ae382cd20d03c7ed456 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.014s user 0.000s sys 0.010s
I20250831 19:54:45.369024 2283 tablet_bootstrap.cc:492] T 9ad8ad70eab04e7abd29597603a1ce33 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:45.369295 2282 raft_consensus.cc:357] T 2c2c52514c444ae382cd20d03c7ed456 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:45.369488 2282 raft_consensus.cc:383] T 2c2c52514c444ae382cd20d03c7ed456 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:45.369556 2282 raft_consensus.cc:738] T 2c2c52514c444ae382cd20d03c7ed456 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:45.369750 2282 consensus_queue.cc:260] T 2c2c52514c444ae382cd20d03c7ed456 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:45.370715 2283 tablet_bootstrap.cc:654] T 9ad8ad70eab04e7abd29597603a1ce33 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:45.373176 2282 ts_tablet_manager.cc:1428] T 2c2c52514c444ae382cd20d03c7ed456 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20250831 19:54:45.376595 2283 tablet_bootstrap.cc:492] T 9ad8ad70eab04e7abd29597603a1ce33 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:45.376784 2283 ts_tablet_manager.cc:1397] T 9ad8ad70eab04e7abd29597603a1ce33 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.001s
I20250831 19:54:45.377481 2283 raft_consensus.cc:357] T 9ad8ad70eab04e7abd29597603a1ce33 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:45.378085 2283 raft_consensus.cc:383] T 9ad8ad70eab04e7abd29597603a1ce33 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:45.378181 2283 raft_consensus.cc:738] T 9ad8ad70eab04e7abd29597603a1ce33 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:45.378371 2283 consensus_queue.cc:260] T 9ad8ad70eab04e7abd29597603a1ce33 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:45.378847 2283 ts_tablet_manager.cc:1428] T 9ad8ad70eab04e7abd29597603a1ce33 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250831 19:54:45.380463 2284 tablet_bootstrap.cc:492] T 9ad8ad70eab04e7abd29597603a1ce33 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:45.381110 2284 ts_tablet_manager.cc:1397] T 9ad8ad70eab04e7abd29597603a1ce33 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.092s user 0.010s sys 0.024s
I20250831 19:54:45.381914 2284 raft_consensus.cc:357] T 9ad8ad70eab04e7abd29597603a1ce33 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:45.382172 2284 raft_consensus.cc:383] T 9ad8ad70eab04e7abd29597603a1ce33 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:45.382274 2284 raft_consensus.cc:738] T 9ad8ad70eab04e7abd29597603a1ce33 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:45.382478 2284 consensus_queue.cc:260] T 9ad8ad70eab04e7abd29597603a1ce33 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:45.383162 2284 ts_tablet_manager.cc:1428] T 9ad8ad70eab04e7abd29597603a1ce33 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20250831 19:54:45.383410 2284 tablet_bootstrap.cc:492] T cfc065bfa931449c9901c8089cae14c3 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:45.384982 2284 tablet_bootstrap.cc:654] T cfc065bfa931449c9901c8089cae14c3 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:45.389117 2292 tablet.cc:1722] T e6b57e7935ac4fc5b1b3fff2e9d775b4 P 2441fafe1d62429386f4631ad423567d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250831 19:54:45.389858 2290 tablet.cc:1722] T e6b57e7935ac4fc5b1b3fff2e9d775b4 P de831f40fa1348a48a1f0260f4130197: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250831 19:54:45.395087 2118 catalog_manager.cc:6127] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: default.table_609f839fcd04455fb64b8a7674b0f57b [id=0850f2b0e9324dd0a210fa7b2609c769] alter complete (version 1)
I20250831 19:54:45.397521 2118 catalog_manager.cc:5582] T 52329de858ab4af18b3639df57972eb5 P 89aa85d59c53436ebdf3074b13d14825 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193). New cstate: current_term: 1 leader_uuid: "89aa85d59c53436ebdf3074b13d14825" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: HEALTHY } } }
I20250831 19:54:45.398075 1885 tablet_service.cc:1515] Processing DeleteTablet for tablet cfc065bfa931449c9901c8089cae14c3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:45 UTC) from {username='slave'} at 127.0.0.1:45906
I20250831 19:54:45.398139 2284 tablet_bootstrap.cc:492] T cfc065bfa931449c9901c8089cae14c3 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:45.398285 2284 ts_tablet_manager.cc:1397] T cfc065bfa931449c9901c8089cae14c3 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.015s user 0.010s sys 0.004s
I20250831 19:54:45.398330 2280 tablet_replica.cc:331] T cfc065bfa931449c9901c8089cae14c3 P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:54:45.398516 2280 raft_consensus.cc:2241] T cfc065bfa931449c9901c8089cae14c3 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:45.398692 2280 raft_consensus.cc:2270] T cfc065bfa931449c9901c8089cae14c3 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:45.398929 2284 raft_consensus.cc:357] T cfc065bfa931449c9901c8089cae14c3 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:45.399108 2284 raft_consensus.cc:383] T cfc065bfa931449c9901c8089cae14c3 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:45.399178 2284 raft_consensus.cc:738] T cfc065bfa931449c9901c8089cae14c3 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:45.399345 2280 ts_tablet_manager.cc:1905] T cfc065bfa931449c9901c8089cae14c3 P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:45.399386 2284 consensus_queue.cc:260] T cfc065bfa931449c9901c8089cae14c3 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:45.399817 2284 ts_tablet_manager.cc:1428] T cfc065bfa931449c9901c8089cae14c3 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250831 19:54:45.400609 2284 tablet_bootstrap.cc:492] T 07a9cd92870045a7a3e5a8b007bf7f47 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:45.402113 2284 tablet_bootstrap.cc:654] T 07a9cd92870045a7a3e5a8b007bf7f47 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:45.403335 2288 tablet.cc:1722] T e6b57e7935ac4fc5b1b3fff2e9d775b4 P 89aa85d59c53436ebdf3074b13d14825: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250831 19:54:45.404736 2280 ts_tablet_manager.cc:1918] T cfc065bfa931449c9901c8089cae14c3 P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250831 19:54:45.404842 2280 log.cc:1199] T cfc065bfa931449c9901c8089cae14c3 P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/cfc065bfa931449c9901c8089cae14c3
I20250831 19:54:45.411293 2280 ts_tablet_manager.cc:1939] T cfc065bfa931449c9901c8089cae14c3 P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:54:45.412286 2101 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet cfc065bfa931449c9901c8089cae14c3 (table default.table_c3535015c99247ec86adfa665b7bc01c [id=ec56be26e67b43bfa7c5cb71edb64c8b]) successfully deleted
I20250831 19:54:45.416074 2124 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:36958 (request call id 1) took 1081 ms. Trace:
I20250831 19:54:45.416271 2119 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:36958 (request call id 5) took 1081 ms. Trace:
I20250831 19:54:45.417028 2117 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:36958 (request call id 7) took 1081 ms. Trace:
I20250831 19:54:45.417124 2117 rpcz_store.cc:276] 0831 19:54:44.335188 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:44.336689 (+ 1501us) service_pool.cc:225] Handling call
0831 19:54:44.678182 (+341493us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:45.416367 (+738185us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:45.416674 (+ 307us) catalog_manager.cc:3683] Apply alter schema
0831 19:54:45.416971 (+ 297us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":157410,"Hive Metastore.run_cpu_time_us":589,"Hive Metastore.run_wall_time_us":58575}
I20250831 19:54:45.416420 2119 rpcz_store.cc:276] 0831 19:54:44.335019 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:44.335970 (+ 951us) service_pool.cc:225] Handling call
0831 19:54:44.517671 (+181701us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:45.416225 (+898554us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":134110,"Hive Metastore.run_cpu_time_us":290,"Hive Metastore.run_wall_time_us":145479,"spinlock_wait_cycles":38144}
I20250831 19:54:45.419878 2119 master_service.cc:948] ReplaceTablet: received request to replace tablet a22b1e71ca344973808ad05fa1af7eb9 from {username='slave'} at 127.0.0.1:36958
I20250831 19:54:45.424058 2284 tablet_bootstrap.cc:492] T 07a9cd92870045a7a3e5a8b007bf7f47 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:45.424233 2284 ts_tablet_manager.cc:1397] T 07a9cd92870045a7a3e5a8b007bf7f47 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.024s user 0.006s sys 0.006s
I20250831 19:54:45.416270 2124 rpcz_store.cc:276] 0831 19:54:44.334485 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:44.336448 (+ 1963us) service_pool.cc:225] Handling call
0831 19:54:44.677993 (+341545us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:45.415992 (+737999us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":119496,"Hive Metastore.run_cpu_time_us":196,"Hive Metastore.run_wall_time_us":38110}
I20250831 19:54:45.425001 2284 raft_consensus.cc:357] T 07a9cd92870045a7a3e5a8b007bf7f47 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:45.425184 2284 raft_consensus.cc:383] T 07a9cd92870045a7a3e5a8b007bf7f47 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:45.425273 2284 raft_consensus.cc:738] T 07a9cd92870045a7a3e5a8b007bf7f47 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:45.425325 2122 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:36958 (request call id 10) took 1089 ms. Trace:
I20250831 19:54:45.425545 2284 consensus_queue.cc:260] T 07a9cd92870045a7a3e5a8b007bf7f47 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:45.425634 2122 rpcz_store.cc:276] 0831 19:54:44.335659 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:44.439779 (+104120us) service_pool.cc:225] Handling call
0831 19:54:44.457783 (+ 18004us) spinlock_profiling.cc:243] Waited 17.7 ms on lock 0x616000040c54. stack: 00007f1e3b0dc7d6 00007f1e3b0dc590 00007f1e3a0cf3ad 0000000000972d94 0000000000972d5d 00007f1e49ea714d 00007f1e49ea7243 00007f1e46b66941 00007f1e4e6f1a5d 00007f1e4e87d126 00007f1e456b6126 00007f1e456b5e55 00007f1e41e8a2ce 00007f1e41e891ae 00007f1e41e8f3e5 00007f1e41e8fd0f
0831 19:54:44.681056 (+223273us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:45.418800 (+737744us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:45.425059 (+ 6259us) catalog_manager.cc:3683] Apply alter schema
0831 19:54:45.425294 (+ 235us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":231730,"Hive Metastore.run_cpu_time_us":610,"Hive Metastore.run_wall_time_us":110480,"spinlock_wait_cycles":40654720}
I20250831 19:54:45.426432 2124 master_service.cc:948] ReplaceTablet: received request to replace tablet 223b0437260545beb12c8aa2235c5d38 from {username='slave'} at 127.0.0.1:36958
I20250831 19:54:45.426846 2124 master_service.cc:948] ReplaceTablet: received request to replace tablet 1033d94413c34db7bbf540330df23b7c from {username='slave'} at 127.0.0.1:36958
I20250831 19:54:45.427984 2284 ts_tablet_manager.cc:1428] T 07a9cd92870045a7a3e5a8b007bf7f47 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20250831 19:54:45.428918 2119 master_service.cc:948] ReplaceTablet: received request to replace tablet 15fd6c30770b4c1599a812d4722b2bad from {username='slave'} at 127.0.0.1:36958
I20250831 19:54:45.431715 2284 tablet_bootstrap.cc:492] T 2c2c52514c444ae382cd20d03c7ed456 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:45.433815 2284 tablet_bootstrap.cc:654] T 2c2c52514c444ae382cd20d03c7ed456 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:45.438171 2124 catalog_manager.cc:5869] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Sending DeleteTablet for 3 replicas of tablet 1033d94413c34db7bbf540330df23b7c
I20250831 19:54:45.438539 2124 catalog_manager.cc:6652] ReplaceTablet: tablet 1033d94413c34db7bbf540330df23b7c deleted and replaced by tablet 1a617be966d0410d9c273d6b25e383c4
I20250831 19:54:45.438836 2124 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36958:
name: "default.Table_6b2346554c4543e684ad6275a7946831"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:45.439623 1614 tablet_service.cc:1515] Processing DeleteTablet for tablet 1033d94413c34db7bbf540330df23b7c with delete_type TABLET_DATA_DELETED (replaced by tablet 1a617be966d0410d9c273d6b25e383c4) from {username='slave'} at 127.0.0.1:51022
I20250831 19:54:45.439970 2277 tablet_replica.cc:331] T 1033d94413c34db7bbf540330df23b7c P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:54:45.440218 1885 tablet_service.cc:1515] Processing DeleteTablet for tablet 1033d94413c34db7bbf540330df23b7c with delete_type TABLET_DATA_DELETED (replaced by tablet 1a617be966d0410d9c273d6b25e383c4) from {username='slave'} at 127.0.0.1:45906
I20250831 19:54:45.440235 2277 raft_consensus.cc:2241] T 1033d94413c34db7bbf540330df23b7c P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:45.440450 2280 tablet_replica.cc:331] T 1033d94413c34db7bbf540330df23b7c P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:54:45.440490 2277 raft_consensus.cc:2270] T 1033d94413c34db7bbf540330df23b7c P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:45.440630 2280 raft_consensus.cc:2241] T 1033d94413c34db7bbf540330df23b7c P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:45.440798 2280 raft_consensus.cc:2270] T 1033d94413c34db7bbf540330df23b7c P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:45.442250 2280 ts_tablet_manager.cc:1905] T 1033d94413c34db7bbf540330df23b7c P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:45.442893 1750 tablet_service.cc:1515] Processing DeleteTablet for tablet 1033d94413c34db7bbf540330df23b7c with delete_type TABLET_DATA_DELETED (replaced by tablet 1a617be966d0410d9c273d6b25e383c4) from {username='slave'} at 127.0.0.1:50674
I20250831 19:54:45.443109 2278 tablet_replica.cc:331] T 1033d94413c34db7bbf540330df23b7c P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:54:45.443256 2278 raft_consensus.cc:2241] T 1033d94413c34db7bbf540330df23b7c P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: Raft consensus shutting down.
I20250831 19:54:45.443542 2278 raft_consensus.cc:2270] T 1033d94413c34db7bbf540330df23b7c P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:45.443668 2328 raft_consensus.cc:491] T 9ad8ad70eab04e7abd29597603a1ce33 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:45.443797 2328 raft_consensus.cc:513] T 9ad8ad70eab04e7abd29597603a1ce33 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:45.444528 2328 leader_election.cc:290] T 9ad8ad70eab04e7abd29597603a1ce33 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:45.444698 2278 ts_tablet_manager.cc:1905] T 1033d94413c34db7bbf540330df23b7c P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:45.445153 1903 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9ad8ad70eab04e7abd29597603a1ce33" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:45.445363 1903 raft_consensus.cc:2466] T 9ad8ad70eab04e7abd29597603a1ce33 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 0.
I20250831 19:54:45.445819 1705 leader_election.cc:304] T 9ad8ad70eab04e7abd29597603a1ce33 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:45.446069 2328 raft_consensus.cc:2802] T 9ad8ad70eab04e7abd29597603a1ce33 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:45.446152 2277 ts_tablet_manager.cc:1905] T 1033d94413c34db7bbf540330df23b7c P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:45.446179 2328 raft_consensus.cc:491] T 9ad8ad70eab04e7abd29597603a1ce33 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:45.446271 2328 raft_consensus.cc:3058] T 9ad8ad70eab04e7abd29597603a1ce33 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:45.448047 1634 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9ad8ad70eab04e7abd29597603a1ce33" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:45.448240 1634 raft_consensus.cc:2466] T 9ad8ad70eab04e7abd29597603a1ce33 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 0.
I20250831 19:54:45.449980 2328 raft_consensus.cc:513] T 9ad8ad70eab04e7abd29597603a1ce33 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:45.451136 1903 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9ad8ad70eab04e7abd29597603a1ce33" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:54:45.451329 1903 raft_consensus.cc:3058] T 9ad8ad70eab04e7abd29597603a1ce33 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:45.453873 1903 raft_consensus.cc:2466] T 9ad8ad70eab04e7abd29597603a1ce33 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:54:45.454118 2328 leader_election.cc:290] T 9ad8ad70eab04e7abd29597603a1ce33 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Requested vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:45.454391 1705 leader_election.cc:304] T 9ad8ad70eab04e7abd29597603a1ce33 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:45.454499 1634 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9ad8ad70eab04e7abd29597603a1ce33" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:54:45.454665 1634 raft_consensus.cc:3058] T 9ad8ad70eab04e7abd29597603a1ce33 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:45.454783 2328 raft_consensus.cc:2802] T 9ad8ad70eab04e7abd29597603a1ce33 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:45.455572 2328 raft_consensus.cc:695] T 9ad8ad70eab04e7abd29597603a1ce33 P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: Becoming Leader. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Running, Role: LEADER
I20250831 19:54:45.455945 2328 consensus_queue.cc:237] T 9ad8ad70eab04e7abd29597603a1ce33 P de831f40fa1348a48a1f0260f4130197 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:45.457114 1634 raft_consensus.cc:2466] T 9ad8ad70eab04e7abd29597603a1ce33 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:54:45.461153 2277 ts_tablet_manager.cc:1918] T 1033d94413c34db7bbf540330df23b7c P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250831 19:54:45.461336 2277 log.cc:1199] T 1033d94413c34db7bbf540330df23b7c P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/1033d94413c34db7bbf540330df23b7c
I20250831 19:54:45.453850 2280 ts_tablet_manager.cc:1918] T 1033d94413c34db7bbf540330df23b7c P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250831 19:54:45.464978 2280 log.cc:1199] T 1033d94413c34db7bbf540330df23b7c P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/1033d94413c34db7bbf540330df23b7c
I20250831 19:54:45.465426 2280 ts_tablet_manager.cc:1939] T 1033d94413c34db7bbf540330df23b7c P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:54:45.465881 2119 catalog_manager.cc:5869] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Sending DeleteTablet for 3 replicas of tablet 15fd6c30770b4c1599a812d4722b2bad
I20250831 19:54:45.466308 2119 catalog_manager.cc:6652] ReplaceTablet: tablet 15fd6c30770b4c1599a812d4722b2bad deleted and replaced by tablet b3144f3db9234ed98c59c82c91257390
I20250831 19:54:45.466656 2119 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36958:
name: "default.Table_8adc00cc53274835bfe463ebf3bd3f45"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:45.467738 2101 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet 1033d94413c34db7bbf540330df23b7c (table default.table_e2ff8984d73f4f05a25d1c132ea949fb [id=b1daf7387b1749019e5377ab08146d20]) successfully deleted
I20250831 19:54:45.467976 1885 tablet_service.cc:1515] Processing DeleteTablet for tablet 15fd6c30770b4c1599a812d4722b2bad with delete_type TABLET_DATA_DELETED (replaced by tablet b3144f3db9234ed98c59c82c91257390) from {username='slave'} at 127.0.0.1:45906
I20250831 19:54:45.468377 1614 tablet_service.cc:1515] Processing DeleteTablet for tablet 15fd6c30770b4c1599a812d4722b2bad with delete_type TABLET_DATA_DELETED (replaced by tablet b3144f3db9234ed98c59c82c91257390) from {username='slave'} at 127.0.0.1:51022
I20250831 19:54:45.468704 2277 ts_tablet_manager.cc:1939] T 1033d94413c34db7bbf540330df23b7c P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
I20250831 19:54:45.469522 1750 tablet_service.cc:1515] Processing DeleteTablet for tablet 15fd6c30770b4c1599a812d4722b2bad with delete_type TABLET_DATA_DELETED (replaced by tablet b3144f3db9234ed98c59c82c91257390) from {username='slave'} at 127.0.0.1:50674
I20250831 19:54:45.473587 2104 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet 1033d94413c34db7bbf540330df23b7c (table default.table_e2ff8984d73f4f05a25d1c132ea949fb [id=b1daf7387b1749019e5377ab08146d20]) successfully deleted
I20250831 19:54:45.474289 2277 tablet_replica.cc:331] T 15fd6c30770b4c1599a812d4722b2bad P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:54:45.477008 1885 tablet_service.cc:1468] Processing CreateTablet for tablet 1a617be966d0410d9c273d6b25e383c4 (DEFAULT_TABLE table=default.table_e2ff8984d73f4f05a25d1c132ea949fb [id=b1daf7387b1749019e5377ab08146d20]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:45.477360 1885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a617be966d0410d9c273d6b25e383c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:45.477372 1614 tablet_service.cc:1468] Processing CreateTablet for tablet 1a617be966d0410d9c273d6b25e383c4 (DEFAULT_TABLE table=default.table_e2ff8984d73f4f05a25d1c132ea949fb [id=b1daf7387b1749019e5377ab08146d20]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:45.479568 1614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a617be966d0410d9c273d6b25e383c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:45.480232 1750 tablet_service.cc:1468] Processing CreateTablet for tablet 1a617be966d0410d9c273d6b25e383c4 (DEFAULT_TABLE table=default.table_e2ff8984d73f4f05a25d1c132ea949fb [id=b1daf7387b1749019e5377ab08146d20]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:45.480544 1750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a617be966d0410d9c273d6b25e383c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:45.481271 1613 tablet_service.cc:1515] Processing DeleteTablet for tablet cfc065bfa931449c9901c8089cae14c3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:45 UTC) from {username='slave'} at 127.0.0.1:51022
I20250831 19:54:45.483454 2118 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36958:
name: "default.Table_9706596e6715417ebc8fb06420b56bde"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:45.483830 2280 tablet_replica.cc:331] T 15fd6c30770b4c1599a812d4722b2bad P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:54:45.483999 2280 raft_consensus.cc:2241] T 15fd6c30770b4c1599a812d4722b2bad P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:45.484189 2280 raft_consensus.cc:2270] T 15fd6c30770b4c1599a812d4722b2bad P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:45.488955 2282 tablet_bootstrap.cc:492] T 1a617be966d0410d9c273d6b25e383c4 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:45.490458 2117 catalog_manager.cc:6127] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: default.table_179225213b4a45978264479432550f67 [id=bd456415108d49989ef0bc2af91eb2f0] alter complete (version 2)
I20250831 19:54:45.490844 2282 tablet_bootstrap.cc:654] T 1a617be966d0410d9c273d6b25e383c4 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:45.491088 2117 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36958:
name: "default.Table_544f7d804f564e83be8fb83049aa8dea"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:45.492376 1613 tablet_service.cc:1468] Processing CreateTablet for tablet b3144f3db9234ed98c59c82c91257390 (DEFAULT_TABLE table=default.table_5ca33d92f715421ab04c9570ac2ee4a0 [id=2ee6bb3de6424a89b5adf289bbb2f9ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:45.492820 1613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3144f3db9234ed98c59c82c91257390. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:45.493621 2278 ts_tablet_manager.cc:1918] T 1033d94413c34db7bbf540330df23b7c P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250831 19:54:45.493754 2278 log.cc:1199] T 1033d94413c34db7bbf540330df23b7c P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/1033d94413c34db7bbf540330df23b7c
I20250831 19:54:45.494174 2278 ts_tablet_manager.cc:1939] T 1033d94413c34db7bbf540330df23b7c P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
I20250831 19:54:45.494153 2122 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36958:
name: "default.Table_5660fc6b1a9846a6bd36b56e553a8f35"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:45.494432 1752 tablet_service.cc:1468] Processing CreateTablet for tablet b3144f3db9234ed98c59c82c91257390 (DEFAULT_TABLE table=default.table_5ca33d92f715421ab04c9570ac2ee4a0 [id=2ee6bb3de6424a89b5adf289bbb2f9ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:45.494798 1752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3144f3db9234ed98c59c82c91257390. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:45.494977 2278 tablet_replica.cc:331] T 15fd6c30770b4c1599a812d4722b2bad P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:54:45.495172 2278 raft_consensus.cc:2241] T 15fd6c30770b4c1599a812d4722b2bad P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: Raft consensus shutting down.
I20250831 19:54:45.495476 2278 raft_consensus.cc:2270] T 15fd6c30770b4c1599a812d4722b2bad P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:45.495793 2283 tablet_bootstrap.cc:492] T 1a617be966d0410d9c273d6b25e383c4 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:45.497794 2283 tablet_bootstrap.cc:654] T 1a617be966d0410d9c273d6b25e383c4 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:45.497983 2105 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet 1033d94413c34db7bbf540330df23b7c (table default.table_e2ff8984d73f4f05a25d1c132ea949fb [id=b1daf7387b1749019e5377ab08146d20]) successfully deleted
I20250831 19:54:45.498637 2278 ts_tablet_manager.cc:1905] T 15fd6c30770b4c1599a812d4722b2bad P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:45.502246 2282 tablet_bootstrap.cc:492] T 1a617be966d0410d9c273d6b25e383c4 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:45.502383 2282 ts_tablet_manager.cc:1397] T 1a617be966d0410d9c273d6b25e383c4 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.000s
I20250831 19:54:45.502575 1885 tablet_service.cc:1468] Processing CreateTablet for tablet b3144f3db9234ed98c59c82c91257390 (DEFAULT_TABLE table=default.table_5ca33d92f715421ab04c9570ac2ee4a0 [id=2ee6bb3de6424a89b5adf289bbb2f9ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:45.503012 1885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3144f3db9234ed98c59c82c91257390. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:45.503120 2282 raft_consensus.cc:357] T 1a617be966d0410d9c273d6b25e383c4 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:45.503321 2282 raft_consensus.cc:383] T 1a617be966d0410d9c273d6b25e383c4 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:45.503414 2282 raft_consensus.cc:738] T 1a617be966d0410d9c273d6b25e383c4 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:45.503715 2280 ts_tablet_manager.cc:1905] T 15fd6c30770b4c1599a812d4722b2bad P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:45.503660 2282 consensus_queue.cc:260] T 1a617be966d0410d9c273d6b25e383c4 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:45.504284 2282 ts_tablet_manager.cc:1428] T 1a617be966d0410d9c273d6b25e383c4 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250831 19:54:45.505630 2278 ts_tablet_manager.cc:1918] T 15fd6c30770b4c1599a812d4722b2bad P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:45.506014 2277 raft_consensus.cc:2241] T 15fd6c30770b4c1599a812d4722b2bad P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:45.506628 2278 log.cc:1199] T 15fd6c30770b4c1599a812d4722b2bad P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/15fd6c30770b4c1599a812d4722b2bad
I20250831 19:54:45.507166 2278 ts_tablet_manager.cc:1939] T 15fd6c30770b4c1599a812d4722b2bad P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
I20250831 19:54:45.503239 1750 tablet_service.cc:1515] Processing DeleteTablet for tablet cfc065bfa931449c9901c8089cae14c3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:45 UTC) from {username='slave'} at 127.0.0.1:50674
I20250831 19:54:45.508479 2105 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet 15fd6c30770b4c1599a812d4722b2bad (table default.table_5ca33d92f715421ab04c9570ac2ee4a0 [id=2ee6bb3de6424a89b5adf289bbb2f9ef]) successfully deleted
I20250831 19:54:45.509686 2278 tablet_replica.cc:331] T cfc065bfa931449c9901c8089cae14c3 P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:54:45.509876 2278 raft_consensus.cc:2241] T cfc065bfa931449c9901c8089cae14c3 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:45.507532 2282 tablet_bootstrap.cc:492] T b3144f3db9234ed98c59c82c91257390 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:45.510051 2278 raft_consensus.cc:2270] T cfc065bfa931449c9901c8089cae14c3 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:45.511598 2278 ts_tablet_manager.cc:1905] T cfc065bfa931449c9901c8089cae14c3 P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:45.510046 2277 raft_consensus.cc:2270] T 15fd6c30770b4c1599a812d4722b2bad P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:45.512042 2282 tablet_bootstrap.cc:654] T b3144f3db9234ed98c59c82c91257390 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:45.512928 2277 ts_tablet_manager.cc:1905] T 15fd6c30770b4c1599a812d4722b2bad P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:45.515533 1031 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-taskfwTdIj/build/asan/bin/kudu pid 1272
I20250831 19:54:45.516530 1333 generic_service.cc:196] Checking for leaks (request via RPC)
I20250831 19:54:45.516680 2278 ts_tablet_manager.cc:1918] T cfc065bfa931449c9901c8089cae14c3 P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250831 19:54:45.517643 2283 tablet_bootstrap.cc:492] T 1a617be966d0410d9c273d6b25e383c4 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:45.517863 2283 ts_tablet_manager.cc:1397] T 1a617be966d0410d9c273d6b25e383c4 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.022s user 0.006s sys 0.000s
I20250831 19:54:45.518085 2330 raft_consensus.cc:491] T 2c2c52514c444ae382cd20d03c7ed456 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:45.518251 2330 raft_consensus.cc:513] T 2c2c52514c444ae382cd20d03c7ed456 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:45.518462 2283 raft_consensus.cc:357] T 1a617be966d0410d9c273d6b25e383c4 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:45.518581 2283 raft_consensus.cc:383] T 1a617be966d0410d9c273d6b25e383c4 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:45.518635 2283 raft_consensus.cc:738] T 1a617be966d0410d9c273d6b25e383c4 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:45.518829 2330 leader_election.cc:290] T 2c2c52514c444ae382cd20d03c7ed456 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:45.518867 2283 consensus_queue.cc:260] T 1a617be966d0410d9c273d6b25e383c4 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:45.519454 1903 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2c2c52514c444ae382cd20d03c7ed456" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:45.519671 1903 raft_consensus.cc:2466] T 2c2c52514c444ae382cd20d03c7ed456 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 0.
I20250831 19:54:45.520514 1568 leader_election.cc:304] T 2c2c52514c444ae382cd20d03c7ed456 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:54:45.520823 2330 raft_consensus.cc:2802] T 2c2c52514c444ae382cd20d03c7ed456 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:45.520926 2330 raft_consensus.cc:491] T 2c2c52514c444ae382cd20d03c7ed456 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:45.521026 2330 raft_consensus.cc:3058] T 2c2c52514c444ae382cd20d03c7ed456 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:45.522926 2283 ts_tablet_manager.cc:1428] T 1a617be966d0410d9c273d6b25e383c4 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20250831 19:54:45.523347 2330 raft_consensus.cc:513] T 2c2c52514c444ae382cd20d03c7ed456 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:45.524421 1906 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2c2c52514c444ae382cd20d03c7ed456" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:54:45.524510 2330 leader_election.cc:290] T 2c2c52514c444ae382cd20d03c7ed456 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Requested vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:45.524598 1906 raft_consensus.cc:3058] T 2c2c52514c444ae382cd20d03c7ed456 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:45.525540 2283 tablet_bootstrap.cc:492] T b3144f3db9234ed98c59c82c91257390 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:45.526782 2283 tablet_bootstrap.cc:654] T b3144f3db9234ed98c59c82c91257390 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:45.526930 1906 raft_consensus.cc:2466] T 2c2c52514c444ae382cd20d03c7ed456 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1.
I20250831 19:54:45.527772 1772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2c2c52514c444ae382cd20d03c7ed456" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197"
I20250831 19:54:45.527849 1568 leader_election.cc:304] T 2c2c52514c444ae382cd20d03c7ed456 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:54:45.527971 2278 log.cc:1199] T cfc065bfa931449c9901c8089cae14c3 P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/cfc065bfa931449c9901c8089cae14c3
I20250831 19:54:45.521288 1771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2c2c52514c444ae382cd20d03c7ed456" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:45.528115 2330 raft_consensus.cc:2802] T 2c2c52514c444ae382cd20d03c7ed456 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:45.528342 2278 ts_tablet_manager.cc:1939] T cfc065bfa931449c9901c8089cae14c3 P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
W20250831 19:54:45.528708 1570 leader_election.cc:343] T 2c2c52514c444ae382cd20d03c7ed456 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): Illegal state: must be running to vote when last-logged opid is not known
I20250831 19:54:45.528829 2330 raft_consensus.cc:695] T 2c2c52514c444ae382cd20d03c7ed456 P 89aa85d59c53436ebdf3074b13d14825 [term 1 LEADER]: Becoming Leader. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Running, Role: LEADER
W20250831 19:54:45.529188 1570 leader_election.cc:343] T 2c2c52514c444ae382cd20d03c7ed456 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): Illegal state: must be running to vote when last-logged opid is not known
I20250831 19:54:45.529184 2330 consensus_queue.cc:237] T 2c2c52514c444ae382cd20d03c7ed456 P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:45.529839 2105 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet cfc065bfa931449c9901c8089cae14c3 (table default.table_c3535015c99247ec86adfa665b7bc01c [id=ec56be26e67b43bfa7c5cb71edb64c8b]) successfully deleted
I20250831 19:54:45.533877 2282 tablet_bootstrap.cc:492] T b3144f3db9234ed98c59c82c91257390 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:45.534063 2282 ts_tablet_manager.cc:1397] T b3144f3db9234ed98c59c82c91257390 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.027s user 0.005s sys 0.004s
I20250831 19:54:45.534797 2282 raft_consensus.cc:357] T b3144f3db9234ed98c59c82c91257390 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:45.537240 2282 raft_consensus.cc:383] T b3144f3db9234ed98c59c82c91257390 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:45.537362 2282 raft_consensus.cc:738] T b3144f3db9234ed98c59c82c91257390 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:45.537657 2282 consensus_queue.cc:260] T b3144f3db9234ed98c59c82c91257390 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:45.538225 2282 ts_tablet_manager.cc:1428] T b3144f3db9234ed98c59c82c91257390 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20250831 19:54:45.539273 2277 ts_tablet_manager.cc:1918] T 15fd6c30770b4c1599a812d4722b2bad P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:45.540361 2277 log.cc:1199] T 15fd6c30770b4c1599a812d4722b2bad P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/15fd6c30770b4c1599a812d4722b2bad
I20250831 19:54:45.540949 2277 ts_tablet_manager.cc:1939] T 15fd6c30770b4c1599a812d4722b2bad P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
I20250831 19:54:45.542279 2277 tablet_replica.cc:331] T cfc065bfa931449c9901c8089cae14c3 P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:54:45.542678 2104 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet 15fd6c30770b4c1599a812d4722b2bad (table default.table_5ca33d92f715421ab04c9570ac2ee4a0 [id=2ee6bb3de6424a89b5adf289bbb2f9ef]) successfully deleted
I20250831 19:54:45.543409 2277 raft_consensus.cc:2241] T cfc065bfa931449c9901c8089cae14c3 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:45.543814 2277 raft_consensus.cc:2270] T cfc065bfa931449c9901c8089cae14c3 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:45.544667 2277 ts_tablet_manager.cc:1905] T cfc065bfa931449c9901c8089cae14c3 P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:45.552382 2277 ts_tablet_manager.cc:1918] T cfc065bfa931449c9901c8089cae14c3 P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250831 19:54:45.556915 2277 log.cc:1199] T cfc065bfa931449c9901c8089cae14c3 P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/cfc065bfa931449c9901c8089cae14c3
I20250831 19:54:45.557533 2277 ts_tablet_manager.cc:1939] T cfc065bfa931449c9901c8089cae14c3 P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
I20250831 19:54:45.559067 2104 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet cfc065bfa931449c9901c8089cae14c3 (table default.table_c3535015c99247ec86adfa665b7bc01c [id=ec56be26e67b43bfa7c5cb71edb64c8b]) successfully deleted
I20250831 19:54:45.559628 2280 ts_tablet_manager.cc:1918] T 15fd6c30770b4c1599a812d4722b2bad P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:45.559855 2280 log.cc:1199] T 15fd6c30770b4c1599a812d4722b2bad P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/15fd6c30770b4c1599a812d4722b2bad
I20250831 19:54:45.560410 2280 ts_tablet_manager.cc:1939] T 15fd6c30770b4c1599a812d4722b2bad P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:54:45.561868 2101 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet 15fd6c30770b4c1599a812d4722b2bad (table default.table_5ca33d92f715421ab04c9570ac2ee4a0 [id=2ee6bb3de6424a89b5adf289bbb2f9ef]) successfully deleted
I20250831 19:54:45.574013 2283 tablet_bootstrap.cc:492] T b3144f3db9234ed98c59c82c91257390 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:45.574314 2283 ts_tablet_manager.cc:1397] T b3144f3db9234ed98c59c82c91257390 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.049s user 0.022s sys 0.024s
I20250831 19:54:45.575414 2283 raft_consensus.cc:357] T b3144f3db9234ed98c59c82c91257390 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:45.575783 2283 raft_consensus.cc:383] T b3144f3db9234ed98c59c82c91257390 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:45.575911 2283 raft_consensus.cc:738] T b3144f3db9234ed98c59c82c91257390 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:45.576275 2283 consensus_queue.cc:260] T b3144f3db9234ed98c59c82c91257390 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:45.578080 2283 ts_tablet_manager.cc:1428] T b3144f3db9234ed98c59c82c91257390 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20250831 19:54:45.579530 2284 tablet_bootstrap.cc:492] T 2c2c52514c444ae382cd20d03c7ed456 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:45.579743 2284 ts_tablet_manager.cc:1397] T 2c2c52514c444ae382cd20d03c7ed456 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.148s user 0.032s sys 0.059s
I20250831 19:54:45.581125 2284 raft_consensus.cc:357] T 2c2c52514c444ae382cd20d03c7ed456 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:45.581323 2284 raft_consensus.cc:383] T 2c2c52514c444ae382cd20d03c7ed456 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:45.581400 2284 raft_consensus.cc:738] T 2c2c52514c444ae382cd20d03c7ed456 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:45.581790 2284 consensus_queue.cc:260] T 2c2c52514c444ae382cd20d03c7ed456 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:45.583173 2284 ts_tablet_manager.cc:1428] T 2c2c52514c444ae382cd20d03c7ed456 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20250831 19:54:45.584230 2284 tablet_bootstrap.cc:492] T 1a617be966d0410d9c273d6b25e383c4 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:45.586489 2284 tablet_bootstrap.cc:654] T 1a617be966d0410d9c273d6b25e383c4 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:45.588142 2284 tablet_bootstrap.cc:492] T 1a617be966d0410d9c273d6b25e383c4 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:45.588315 2284 ts_tablet_manager.cc:1397] T 1a617be966d0410d9c273d6b25e383c4 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.003s
I20250831 19:54:45.588956 2284 raft_consensus.cc:357] T 1a617be966d0410d9c273d6b25e383c4 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:45.589193 2284 raft_consensus.cc:383] T 1a617be966d0410d9c273d6b25e383c4 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:45.589303 2284 raft_consensus.cc:738] T 1a617be966d0410d9c273d6b25e383c4 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:45.589608 2284 consensus_queue.cc:260] T 1a617be966d0410d9c273d6b25e383c4 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:45.590229 2284 ts_tablet_manager.cc:1428] T 1a617be966d0410d9c273d6b25e383c4 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250831 19:54:45.590564 2284 tablet_bootstrap.cc:492] T b3144f3db9234ed98c59c82c91257390 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:45.592193 2284 tablet_bootstrap.cc:654] T b3144f3db9234ed98c59c82c91257390 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:45.594244 2284 tablet_bootstrap.cc:492] T b3144f3db9234ed98c59c82c91257390 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:45.594416 2284 ts_tablet_manager.cc:1397] T b3144f3db9234ed98c59c82c91257390 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.002s
I20250831 19:54:45.595089 2284 raft_consensus.cc:357] T b3144f3db9234ed98c59c82c91257390 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:45.595292 2284 raft_consensus.cc:383] T b3144f3db9234ed98c59c82c91257390 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:45.595372 2284 raft_consensus.cc:738] T b3144f3db9234ed98c59c82c91257390 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:45.595569 2284 consensus_queue.cc:260] T b3144f3db9234ed98c59c82c91257390 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:45.595997 2284 ts_tablet_manager.cc:1428] T b3144f3db9234ed98c59c82c91257390 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250831 19:54:45.611663 2125 catalog_manager.cc:2706] deleted HMS catalog entry for table default.table_cc2bfcade74f4778bfa8e873869aba43 [id=42fb4ac1f28146339375e6c29735ed44]
I20250831 19:54:45.645088 2126 catalog_manager.cc:2706] deleted HMS catalog entry for table default.table_f2750ddd8ef049ef8bca6b19ca6b68a6 [id=6063834030bb409d8ee666a753351551]
I20250831 19:54:45.664623 2302 raft_consensus.cc:491] T 07a9cd92870045a7a3e5a8b007bf7f47 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:45.664826 2302 raft_consensus.cc:513] T 07a9cd92870045a7a3e5a8b007bf7f47 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:45.665630 2302 leader_election.cc:290] T 07a9cd92870045a7a3e5a8b007bf7f47 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:45.666914 1771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "07a9cd92870045a7a3e5a8b007bf7f47" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:45.667131 1771 raft_consensus.cc:2466] T 07a9cd92870045a7a3e5a8b007bf7f47 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 0.
I20250831 19:54:45.667505 1634 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "07a9cd92870045a7a3e5a8b007bf7f47" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:45.667714 1634 raft_consensus.cc:2466] T 07a9cd92870045a7a3e5a8b007bf7f47 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 0.
I20250831 19:54:45.668298 1841 leader_election.cc:304] T 07a9cd92870045a7a3e5a8b007bf7f47 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:54:45.669006 2302 raft_consensus.cc:2802] T 07a9cd92870045a7a3e5a8b007bf7f47 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:45.669111 2302 raft_consensus.cc:491] T 07a9cd92870045a7a3e5a8b007bf7f47 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:45.669184 2302 raft_consensus.cc:3058] T 07a9cd92870045a7a3e5a8b007bf7f47 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:45.671764 2302 raft_consensus.cc:513] T 07a9cd92870045a7a3e5a8b007bf7f47 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:45.672782 1771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "07a9cd92870045a7a3e5a8b007bf7f47" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197"
I20250831 19:54:45.672942 1771 raft_consensus.cc:3058] T 07a9cd92870045a7a3e5a8b007bf7f47 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:45.675309 1771 raft_consensus.cc:2466] T 07a9cd92870045a7a3e5a8b007bf7f47 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 1.
I20250831 19:54:45.675765 1842 leader_election.cc:304] T 07a9cd92870045a7a3e5a8b007bf7f47 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:45.676048 2239 raft_consensus.cc:2802] T 07a9cd92870045a7a3e5a8b007bf7f47 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:45.676205 2239 raft_consensus.cc:695] T 07a9cd92870045a7a3e5a8b007bf7f47 P 2441fafe1d62429386f4631ad423567d [term 1 LEADER]: Becoming Leader. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Running, Role: LEADER
I20250831 19:54:45.676441 2239 consensus_queue.cc:237] T 07a9cd92870045a7a3e5a8b007bf7f47 P 2441fafe1d62429386f4631ad423567d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:45.676625 1634 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "07a9cd92870045a7a3e5a8b007bf7f47" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:54:45.676793 1634 raft_consensus.cc:3058] T 07a9cd92870045a7a3e5a8b007bf7f47 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:45.679196 1634 raft_consensus.cc:2466] T 07a9cd92870045a7a3e5a8b007bf7f47 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 1.
I20250831 19:54:45.679713 2302 leader_election.cc:290] T 07a9cd92870045a7a3e5a8b007bf7f47 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 election: Requested vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:45.693035 2120 catalog_manager.cc:2706] deleted HMS catalog entry for table default.table_5ca33d92f715421ab04c9570ac2ee4a0 [id=2ee6bb3de6424a89b5adf289bbb2f9ef]
I20250831 19:54:45.725087 2223 raft_consensus.cc:491] T 1a617be966d0410d9c273d6b25e383c4 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:45.725258 2223 raft_consensus.cc:513] T 1a617be966d0410d9c273d6b25e383c4 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:45.726112 2223 leader_election.cc:290] T 1a617be966d0410d9c273d6b25e383c4 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:45.726723 1771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1a617be966d0410d9c273d6b25e383c4" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:45.726955 1771 raft_consensus.cc:2466] T 1a617be966d0410d9c273d6b25e383c4 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 0.
I20250831 19:54:45.727635 1906 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1a617be966d0410d9c273d6b25e383c4" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:45.727862 1906 raft_consensus.cc:2466] T 1a617be966d0410d9c273d6b25e383c4 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 0.
I20250831 19:54:45.728374 1568 leader_election.cc:304] T 1a617be966d0410d9c273d6b25e383c4 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:54:45.729017 2223 raft_consensus.cc:2802] T 1a617be966d0410d9c273d6b25e383c4 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:45.729120 2223 raft_consensus.cc:491] T 1a617be966d0410d9c273d6b25e383c4 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:45.729187 2223 raft_consensus.cc:3058] T 1a617be966d0410d9c273d6b25e383c4 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:45.731745 2223 raft_consensus.cc:513] T 1a617be966d0410d9c273d6b25e383c4 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:45.732681 1906 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1a617be966d0410d9c273d6b25e383c4" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:54:45.732875 1906 raft_consensus.cc:3058] T 1a617be966d0410d9c273d6b25e383c4 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:45.735105 1906 raft_consensus.cc:2466] T 1a617be966d0410d9c273d6b25e383c4 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1.
I20250831 19:54:45.735469 2121 catalog_manager.cc:3460] renamed table default.table_e2ff8984d73f4f05a25d1c132ea949fb [id=b1daf7387b1749019e5377ab08146d20] in HMS: new name default.table_cba30e3477524a4fb902655e070bfce2
I20250831 19:54:45.735584 1568 leader_election.cc:304] T 1a617be966d0410d9c273d6b25e383c4 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:54:45.735847 2330 raft_consensus.cc:2802] T 1a617be966d0410d9c273d6b25e383c4 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:45.737818 1771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1a617be966d0410d9c273d6b25e383c4" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197"
I20250831 19:54:45.738011 1771 raft_consensus.cc:3058] T 1a617be966d0410d9c273d6b25e383c4 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:45.740433 1771 raft_consensus.cc:2466] T 1a617be966d0410d9c273d6b25e383c4 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1.
I20250831 19:54:45.741498 2223 leader_election.cc:290] T 1a617be966d0410d9c273d6b25e383c4 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Requested vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:45.748790 2302 raft_consensus.cc:491] T b3144f3db9234ed98c59c82c91257390 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:45.748920 2302 raft_consensus.cc:513] T b3144f3db9234ed98c59c82c91257390 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:45.749537 2302 leader_election.cc:290] T b3144f3db9234ed98c59c82c91257390 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:45.750525 1634 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b3144f3db9234ed98c59c82c91257390" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:45.750612 1771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b3144f3db9234ed98c59c82c91257390" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:45.750742 1634 raft_consensus.cc:2466] T b3144f3db9234ed98c59c82c91257390 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 0.
I20250831 19:54:45.750794 1771 raft_consensus.cc:2466] T b3144f3db9234ed98c59c82c91257390 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 0.
I20250831 19:54:45.751330 1842 leader_election.cc:304] T b3144f3db9234ed98c59c82c91257390 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:45.751950 2302 raft_consensus.cc:2802] T b3144f3db9234ed98c59c82c91257390 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:45.752071 2302 raft_consensus.cc:491] T b3144f3db9234ed98c59c82c91257390 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:45.752161 2302 raft_consensus.cc:3058] T b3144f3db9234ed98c59c82c91257390 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:45.754928 2302 raft_consensus.cc:513] T b3144f3db9234ed98c59c82c91257390 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:45.755585 2302 leader_election.cc:290] T b3144f3db9234ed98c59c82c91257390 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 election: Requested vote from peers 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:45.755975 1634 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b3144f3db9234ed98c59c82c91257390" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:54:45.756160 1634 raft_consensus.cc:3058] T b3144f3db9234ed98c59c82c91257390 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:45.756121 1771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b3144f3db9234ed98c59c82c91257390" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197"
I20250831 19:54:45.756279 1771 raft_consensus.cc:3058] T b3144f3db9234ed98c59c82c91257390 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:45.758359 1771 raft_consensus.cc:2466] T b3144f3db9234ed98c59c82c91257390 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 1.
I20250831 19:54:45.759024 2330 raft_consensus.cc:695] T 1a617be966d0410d9c273d6b25e383c4 P 89aa85d59c53436ebdf3074b13d14825 [term 1 LEADER]: Becoming Leader. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Running, Role: LEADER
I20250831 19:54:45.759253 1634 raft_consensus.cc:2466] T b3144f3db9234ed98c59c82c91257390 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 1.
I20250831 19:54:45.759729 2330 consensus_queue.cc:237] T 1a617be966d0410d9c273d6b25e383c4 P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:45.759630 1841 leader_election.cc:304] T b3144f3db9234ed98c59c82c91257390 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:54:45.761332 1031 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskfwTdIj/build/asan/bin/kudu with pid 1272
I20250831 19:54:45.765054 2302 raft_consensus.cc:2802] T b3144f3db9234ed98c59c82c91257390 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:45.765563 2302 raft_consensus.cc:695] T b3144f3db9234ed98c59c82c91257390 P 2441fafe1d62429386f4631ad423567d [term 1 LEADER]: Becoming Leader. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Running, Role: LEADER
I20250831 19:54:45.765901 2302 consensus_queue.cc:237] T b3144f3db9234ed98c59c82c91257390 P 2441fafe1d62429386f4631ad423567d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:45.779568 2123 catalog_manager.cc:3460] renamed table default.table_6965b0044d81462a8f1266e855ec1464 [id=8e6395b817aa4efc955cf0ed00f54e14] in HMS: new name default.table_87fbe752a7a54c9eaa7536ba0e611919
I20250831 19:54:45.783494 2186 catalog_manager.cc:2747] Deleting table default.table_cc2bfcade74f4778bfa8e873869aba43 [id=42fb4ac1f28146339375e6c29735ed44] in response to Hive Metastore notification log event 41
I20250831 19:54:45.791435 2186 catalog_manager.cc:5869] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Sending DeleteTablet for 3 replicas of tablet fa69535d223d494db28f4a9444b18e79
I20250831 19:54:45.792171 1614 tablet_service.cc:1515] Processing DeleteTablet for tablet fa69535d223d494db28f4a9444b18e79 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:45 UTC) from {username='slave'} at 127.0.0.1:51022
I20250831 19:54:45.792415 2277 tablet_replica.cc:331] T fa69535d223d494db28f4a9444b18e79 P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:54:45.792613 2277 raft_consensus.cc:2241] T fa69535d223d494db28f4a9444b18e79 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:45.792781 2277 raft_consensus.cc:2270] T fa69535d223d494db28f4a9444b18e79 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:45.792990 2186 catalog_manager.cc:2747] Deleting table default.table_f2750ddd8ef049ef8bca6b19ca6b68a6 [id=6063834030bb409d8ee666a753351551] in response to Hive Metastore notification log event 42
I20250831 19:54:45.793284 2277 ts_tablet_manager.cc:1905] T fa69535d223d494db28f4a9444b18e79 P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:45.794523 1885 tablet_service.cc:1515] Processing DeleteTablet for tablet fa69535d223d494db28f4a9444b18e79 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:45 UTC) from {username='slave'} at 127.0.0.1:45906
I20250831 19:54:45.795080 1750 tablet_service.cc:1515] Processing DeleteTablet for tablet fa69535d223d494db28f4a9444b18e79 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:45 UTC) from {username='slave'} at 127.0.0.1:50674
I20250831 19:54:45.795310 2278 tablet_replica.cc:331] T fa69535d223d494db28f4a9444b18e79 P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:54:45.795513 2278 raft_consensus.cc:2241] T fa69535d223d494db28f4a9444b18e79 P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: Raft consensus shutting down.
I20250831 19:54:45.795819 2278 raft_consensus.cc:2270] T fa69535d223d494db28f4a9444b18e79 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:45.796355 2278 ts_tablet_manager.cc:1905] T fa69535d223d494db28f4a9444b18e79 P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:45.797578 2280 tablet_replica.cc:331] T fa69535d223d494db28f4a9444b18e79 P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
W20250831 19:54:45.797662 1707 connection.cc:537] client connection to 127.1.1.254:34259 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20250831 19:54:45.797780 2280 raft_consensus.cc:2241] T fa69535d223d494db28f4a9444b18e79 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:45.797938 2280 raft_consensus.cc:2270] T fa69535d223d494db28f4a9444b18e79 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:45.798372 2280 ts_tablet_manager.cc:1905] T fa69535d223d494db28f4a9444b18e79 P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:45.798621 2277 ts_tablet_manager.cc:1918] T fa69535d223d494db28f4a9444b18e79 P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250831 19:54:45.798738 2277 log.cc:1199] T fa69535d223d494db28f4a9444b18e79 P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/fa69535d223d494db28f4a9444b18e79
I20250831 19:54:45.799059 2277 ts_tablet_manager.cc:1939] T fa69535d223d494db28f4a9444b18e79 P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
W20250831 19:54:45.799897 1842 connection.cc:537] client connection to 127.1.1.254:34259 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20250831 19:54:45.801970 1570 connection.cc:537] client connection to 127.1.1.254:34259 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20250831 19:54:45.802314 2104 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet fa69535d223d494db28f4a9444b18e79 (table default.table_cc2bfcade74f4778bfa8e873869aba43 [id=42fb4ac1f28146339375e6c29735ed44]) successfully deleted
W20250831 19:54:45.803001 2105 connection.cc:537] client connection to 127.1.1.254:34259 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20250831 19:54:45.803195 2105 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20250831 19:54:45.806223 2278 ts_tablet_manager.cc:1918] T fa69535d223d494db28f4a9444b18e79 P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250831 19:54:45.806913 2278 log.cc:1199] T fa69535d223d494db28f4a9444b18e79 P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/fa69535d223d494db28f4a9444b18e79
I20250831 19:54:45.807319 2278 ts_tablet_manager.cc:1939] T fa69535d223d494db28f4a9444b18e79 P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
I20250831 19:54:45.808820 2280 ts_tablet_manager.cc:1918] T fa69535d223d494db28f4a9444b18e79 P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250831 19:54:45.812279 2280 log.cc:1199] T fa69535d223d494db28f4a9444b18e79 P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/fa69535d223d494db28f4a9444b18e79
I20250831 19:54:45.812719 2280 ts_tablet_manager.cc:1939] T fa69535d223d494db28f4a9444b18e79 P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:54:45.813632 2101 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet fa69535d223d494db28f4a9444b18e79 (table default.table_cc2bfcade74f4778bfa8e873869aba43 [id=42fb4ac1f28146339375e6c29735ed44]) successfully deleted
I20250831 19:54:45.815160 2186 catalog_manager.cc:5869] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Sending DeleteTablet for 3 replicas of tablet 8262f1d1898840c2822feda5279542bd
I20250831 19:54:45.815964 1614 tablet_service.cc:1515] Processing DeleteTablet for tablet 8262f1d1898840c2822feda5279542bd with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:45 UTC) from {username='slave'} at 127.0.0.1:51022
I20250831 19:54:45.816263 2277 tablet_replica.cc:331] T 8262f1d1898840c2822feda5279542bd P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:54:45.816812 1885 tablet_service.cc:1515] Processing DeleteTablet for tablet 8262f1d1898840c2822feda5279542bd with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:45 UTC) from {username='slave'} at 127.0.0.1:45906
I20250831 19:54:45.816848 2277 raft_consensus.cc:2241] T 8262f1d1898840c2822feda5279542bd P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:45.817147 2277 raft_consensus.cc:2270] T 8262f1d1898840c2822feda5279542bd P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:45.817727 2277 ts_tablet_manager.cc:1905] T 8262f1d1898840c2822feda5279542bd P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:45.817816 2186 catalog_manager.cc:2747] Deleting table default.table_5ca33d92f715421ab04c9570ac2ee4a0 [id=2ee6bb3de6424a89b5adf289bbb2f9ef] in response to Hive Metastore notification log event 43
I20250831 19:54:45.822427 2280 tablet_replica.cc:331] T 8262f1d1898840c2822feda5279542bd P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:54:45.822640 2280 raft_consensus.cc:2241] T 8262f1d1898840c2822feda5279542bd P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:45.822743 2105 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet fa69535d223d494db28f4a9444b18e79 (table default.table_cc2bfcade74f4778bfa8e873869aba43 [id=42fb4ac1f28146339375e6c29735ed44]) successfully deleted
I20250831 19:54:45.822922 2280 raft_consensus.cc:2270] T 8262f1d1898840c2822feda5279542bd P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:45.822958 1750 tablet_service.cc:1515] Processing DeleteTablet for tablet 8262f1d1898840c2822feda5279542bd with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:45 UTC) from {username='slave'} at 127.0.0.1:50674
W20250831 19:54:45.822968 2105 consensus_peers.cc:489] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 -> Peer 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259): Couldn't send request to peer 6c830f6055d64a3b8a9f78b405ad8aa3. Status: Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250831 19:54:45.823262 2278 tablet_replica.cc:331] T 8262f1d1898840c2822feda5279542bd P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:54:45.823581 2280 ts_tablet_manager.cc:1905] T 8262f1d1898840c2822feda5279542bd P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:45.823488 2278 raft_consensus.cc:2241] T 8262f1d1898840c2822feda5279542bd P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: Raft consensus shutting down.
I20250831 19:54:45.824213 2278 raft_consensus.cc:2270] T 8262f1d1898840c2822feda5279542bd P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:45.824726 2278 ts_tablet_manager.cc:1905] T 8262f1d1898840c2822feda5279542bd P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:45.829685 2186 catalog_manager.cc:5869] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Sending DeleteTablet for 3 replicas of tablet b3144f3db9234ed98c59c82c91257390
I20250831 19:54:45.830341 1885 tablet_service.cc:1515] Processing DeleteTablet for tablet b3144f3db9234ed98c59c82c91257390 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:45 UTC) from {username='slave'} at 127.0.0.1:45906
I20250831 19:54:45.830353 1614 tablet_service.cc:1515] Processing DeleteTablet for tablet b3144f3db9234ed98c59c82c91257390 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:45 UTC) from {username='slave'} at 127.0.0.1:51022
I20250831 19:54:45.831401 1750 tablet_service.cc:1515] Processing DeleteTablet for tablet b3144f3db9234ed98c59c82c91257390 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:45 UTC) from {username='slave'} at 127.0.0.1:50674
I20250831 19:54:45.831550 2278 ts_tablet_manager.cc:1918] T 8262f1d1898840c2822feda5279542bd P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250831 19:54:45.831686 2278 log.cc:1199] T 8262f1d1898840c2822feda5279542bd P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/8262f1d1898840c2822feda5279542bd
I20250831 19:54:45.831912 2277 ts_tablet_manager.cc:1918] T 8262f1d1898840c2822feda5279542bd P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250831 19:54:45.832047 2277 log.cc:1199] T 8262f1d1898840c2822feda5279542bd P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/8262f1d1898840c2822feda5279542bd
I20250831 19:54:45.832195 2278 ts_tablet_manager.cc:1939] T 8262f1d1898840c2822feda5279542bd P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
I20250831 19:54:45.832448 2277 ts_tablet_manager.cc:1939] T 8262f1d1898840c2822feda5279542bd P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
I20250831 19:54:45.833199 2277 tablet_replica.cc:331] T b3144f3db9234ed98c59c82c91257390 P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:54:45.833305 2104 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet 8262f1d1898840c2822feda5279542bd (table default.table_f2750ddd8ef049ef8bca6b19ca6b68a6 [id=6063834030bb409d8ee666a753351551]) successfully deleted
I20250831 19:54:45.833621 2278 tablet_replica.cc:331] T b3144f3db9234ed98c59c82c91257390 P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:54:45.833758 2105 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet 8262f1d1898840c2822feda5279542bd (table default.table_f2750ddd8ef049ef8bca6b19ca6b68a6 [id=6063834030bb409d8ee666a753351551]) successfully deleted
I20250831 19:54:45.833885 2278 raft_consensus.cc:2241] T b3144f3db9234ed98c59c82c91257390 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:45.834035 2278 raft_consensus.cc:2270] T b3144f3db9234ed98c59c82c91257390 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:45.834337 2277 raft_consensus.cc:2241] T b3144f3db9234ed98c59c82c91257390 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:45.834509 2277 raft_consensus.cc:2270] T b3144f3db9234ed98c59c82c91257390 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:45.835702 2278 ts_tablet_manager.cc:1905] T b3144f3db9234ed98c59c82c91257390 P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:45.836619 2280 ts_tablet_manager.cc:1918] T 8262f1d1898840c2822feda5279542bd P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250831 19:54:45.836722 2280 log.cc:1199] T 8262f1d1898840c2822feda5279542bd P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/8262f1d1898840c2822feda5279542bd
I20250831 19:54:45.837111 2280 ts_tablet_manager.cc:1939] T 8262f1d1898840c2822feda5279542bd P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:54:45.837836 2280 tablet_replica.cc:331] T b3144f3db9234ed98c59c82c91257390 P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:54:45.837985 2101 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet 8262f1d1898840c2822feda5279542bd (table default.table_f2750ddd8ef049ef8bca6b19ca6b68a6 [id=6063834030bb409d8ee666a753351551]) successfully deleted
I20250831 19:54:45.838306 2277 ts_tablet_manager.cc:1905] T b3144f3db9234ed98c59c82c91257390 P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250831 19:54:45.841301 2186 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1a617be966d0410d9c273d6b25e383c4 consensus state has no leader
I20250831 19:54:45.842108 2280 raft_consensus.cc:2241] T b3144f3db9234ed98c59c82c91257390 P 2441fafe1d62429386f4631ad423567d [term 1 LEADER]: Raft consensus shutting down.
I20250831 19:54:45.844393 2277 ts_tablet_manager.cc:1918] T b3144f3db9234ed98c59c82c91257390 P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250831 19:54:45.844771 2280 pending_rounds.cc:70] T b3144f3db9234ed98c59c82c91257390 P 2441fafe1d62429386f4631ad423567d: Trying to abort 1 pending ops.
I20250831 19:54:45.844894 2280 pending_rounds.cc:77] T b3144f3db9234ed98c59c82c91257390 P 2441fafe1d62429386f4631ad423567d: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7195320671299530752 op_type: NO_OP noop_request { }
I20250831 19:54:45.845057 2280 raft_consensus.cc:2887] T b3144f3db9234ed98c59c82c91257390 P 2441fafe1d62429386f4631ad423567d [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250831 19:54:45.845214 2280 raft_consensus.cc:2270] T b3144f3db9234ed98c59c82c91257390 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:45.846400 2280 ts_tablet_manager.cc:1905] T b3144f3db9234ed98c59c82c91257390 P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:45.849584 2277 log.cc:1199] T b3144f3db9234ed98c59c82c91257390 P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/b3144f3db9234ed98c59c82c91257390
I20250831 19:54:45.850003 2277 ts_tablet_manager.cc:1939] T b3144f3db9234ed98c59c82c91257390 P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
W20250831 19:54:45.850945 2124 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_6b2346554c4543e684ad6275a7946831 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250831 19:54:45.851064 2104 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet b3144f3db9234ed98c59c82c91257390 (table default.table_5ca33d92f715421ab04c9570ac2ee4a0 [id=2ee6bb3de6424a89b5adf289bbb2f9ef]) successfully deleted
I20250831 19:54:45.861506 2280 ts_tablet_manager.cc:1918] T b3144f3db9234ed98c59c82c91257390 P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:45.861742 2280 log.cc:1199] T b3144f3db9234ed98c59c82c91257390 P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/b3144f3db9234ed98c59c82c91257390
I20250831 19:54:45.862191 2280 ts_tablet_manager.cc:1939] T b3144f3db9234ed98c59c82c91257390 P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:54:45.846225 2278 ts_tablet_manager.cc:1918] T b3144f3db9234ed98c59c82c91257390 P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250831 19:54:45.866302 2278 log.cc:1199] T b3144f3db9234ed98c59c82c91257390 P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/b3144f3db9234ed98c59c82c91257390
I20250831 19:54:45.866816 2278 ts_tablet_manager.cc:1939] T b3144f3db9234ed98c59c82c91257390 P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
I20250831 19:54:45.870008 2105 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet b3144f3db9234ed98c59c82c91257390 (table default.table_5ca33d92f715421ab04c9570ac2ee4a0 [id=2ee6bb3de6424a89b5adf289bbb2f9ef]) successfully deleted
I20250831 19:54:45.872292 2101 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet b3144f3db9234ed98c59c82c91257390 (table default.table_5ca33d92f715421ab04c9570ac2ee4a0 [id=2ee6bb3de6424a89b5adf289bbb2f9ef]) successfully deleted
I20250831 19:54:45.879248 2124 catalog_manager.cc:2149] created HMS catalog entry for table [id=8b308db3bde240de873d138c0eec73a9]
W20250831 19:54:45.879397 2104 catalog_manager.cc:4726] Async tablet task AlterTable RPC for tablet 1a617be966d0410d9c273d6b25e383c4 (table default.table_cba30e3477524a4fb902655e070bfce2 [id=b1daf7387b1749019e5377ab08146d20], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 1a617be966d0410d9c273d6b25e383c4 consensus state has no leader
I20250831 19:54:45.890045 1614 tablet_service.cc:1515] Processing DeleteTablet for tablet 15fd6c30770b4c1599a812d4722b2bad with delete_type TABLET_DATA_DELETED (replaced by tablet b3144f3db9234ed98c59c82c91257390) from {username='slave'} at 127.0.0.1:51022
W20250831 19:54:45.893167 2104 catalog_manager.cc:4895] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): delete failed for tablet 15fd6c30770b4c1599a812d4722b2bad because the tablet was not found. No further retry: Not found: Tablet not found: 15fd6c30770b4c1599a812d4722b2bad
I20250831 19:54:45.899850 1885 tablet_service.cc:1468] Processing CreateTablet for tablet 529eddf7703e4ddc87e974720404fdf3 (DEFAULT_TABLE table=default.table_6b2346554c4543e684ad6275a7946831 [id=8b308db3bde240de873d138c0eec73a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:45.900341 1885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 529eddf7703e4ddc87e974720404fdf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:45.903019 2288 tablet.cc:1722] T 9eea7f86bbcd40e88907dea27deba8de P 89aa85d59c53436ebdf3074b13d14825: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:45.906580 1750 tablet_service.cc:1468] Processing CreateTablet for tablet 529eddf7703e4ddc87e974720404fdf3 (DEFAULT_TABLE table=default.table_6b2346554c4543e684ad6275a7946831 [id=8b308db3bde240de873d138c0eec73a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:45.906941 1750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 529eddf7703e4ddc87e974720404fdf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:45.911237 2124 catalog_manager.cc:5674] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237) does not have the latest schema for tablet 1a617be966d0410d9c273d6b25e383c4 (table default.table_cba30e3477524a4fb902655e070bfce2 [id=b1daf7387b1749019e5377ab08146d20]). Expected version 2 got 0
I20250831 19:54:45.913794 2284 tablet_bootstrap.cc:492] T 529eddf7703e4ddc87e974720404fdf3 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:45.915720 2284 tablet_bootstrap.cc:654] T 529eddf7703e4ddc87e974720404fdf3 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:45.917225 2367 tablet.cc:1722] T 9eea7f86bbcd40e88907dea27deba8de P 2441fafe1d62429386f4631ad423567d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:45.918109 2302 consensus_queue.cc:1035] T b4cc124dc284464f8e78562b4d0881c8 P 2441fafe1d62429386f4631ad423567d [LEADER]: Connected to new peer: Peer: permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:45.915372 2124 catalog_manager.cc:5582] T 9ad8ad70eab04e7abd29597603a1ce33 P de831f40fa1348a48a1f0260f4130197 reported cstate change: term changed from 0 to 1, leader changed from <none> to de831f40fa1348a48a1f0260f4130197 (127.1.1.194). New cstate: current_term: 1 leader_uuid: "de831f40fa1348a48a1f0260f4130197" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: UNKNOWN } } }
I20250831 19:54:45.922392 2283 tablet_bootstrap.cc:492] T 529eddf7703e4ddc87e974720404fdf3 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:45.923787 2283 tablet_bootstrap.cc:654] T 529eddf7703e4ddc87e974720404fdf3 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:45.927001 2125 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:36958 (request call id 16) took 1586 ms. Trace:
W20250831 19:54:45.927258 2118 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_9706596e6715417ebc8fb06420b56bde in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250831 19:54:45.927143 2125 rpcz_store.cc:276] 0831 19:54:44.340376 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:45.067103 (+726727us) service_pool.cc:225] Handling call
0831 19:54:45.418878 (+351775us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:45.926956 (+508078us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":557,"Hive Metastore.run_cpu_time_us":204,"Hive Metastore.run_wall_time_us":191943}
W20250831 19:54:45.927600 2117 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_544f7d804f564e83be8fb83049aa8dea in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250831 19:54:45.928480 2122 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_5660fc6b1a9846a6bd36b56e553a8f35 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250831 19:54:45.928625 2125 catalog_manager.cc:5582] T 2c2c52514c444ae382cd20d03c7ed456 P 89aa85d59c53436ebdf3074b13d14825 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193). New cstate: current_term: 1 leader_uuid: "89aa85d59c53436ebdf3074b13d14825" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: HEALTHY } } }
W20250831 19:54:45.927261 2119 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_8adc00cc53274835bfe463ebf3bd3f45 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250831 19:54:45.929548 2126 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:36958 (request call id 18) took 1403 ms. Trace:
I20250831 19:54:45.929731 2121 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:36958 (request call id 17) took 1430 ms. Trace:
I20250831 19:54:45.929646 2126 rpcz_store.cc:276] 0831 19:54:44.525741 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:45.117565 (+591824us) service_pool.cc:225] Handling call
0831 19:54:45.419080 (+301515us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:45.929493 (+510413us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":192422,"Hive Metastore.run_cpu_time_us":214,"Hive Metastore.run_wall_time_us":33291}
I20250831 19:54:45.929800 2121 rpcz_store.cc:276] 0831 19:54:44.498996 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:45.078112 (+579116us) service_pool.cc:225] Handling call
0831 19:54:45.420106 (+341994us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:45.929166 (+509060us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:45.929410 (+ 244us) catalog_manager.cc:3683] Apply alter schema
0831 19:54:45.929666 (+ 256us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":272736,"Hive Metastore.run_cpu_time_us":646,"Hive Metastore.run_wall_time_us":42269}
I20250831 19:54:45.930130 2121 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36958:
name: "default.Table_486ee0377a714038aaf8f3f5b1ad7f79"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:45.930629 2120 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:36958 (request call id 21) took 1328 ms. Trace:
I20250831 19:54:45.930711 2120 rpcz_store.cc:276] 0831 19:54:44.601700 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:45.178561 (+576861us) service_pool.cc:225] Handling call
0831 19:54:45.419221 (+240660us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:45.930578 (+511357us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":225624,"Hive Metastore.run_cpu_time_us":189,"Hive Metastore.run_wall_time_us":47999}
I20250831 19:54:45.930960 2123 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:36958 (request call id 19) took 1405 ms. Trace:
I20250831 19:54:45.931038 2123 rpcz_store.cc:276] 0831 19:54:44.525860 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:45.131701 (+605841us) service_pool.cc:225] Handling call
0831 19:54:45.423773 (+292072us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:45.930416 (+506643us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:45.930629 (+ 213us) catalog_manager.cc:3683] Apply alter schema
0831 19:54:45.930903 (+ 274us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":311382,"Hive Metastore.run_cpu_time_us":662,"Hive Metastore.run_wall_time_us":44076}
I20250831 19:54:45.931141 2120 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36958:
name: "default.Table_1ca0a7f3c33945bd902a63ca09aa62ad"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:45.931322 2123 master_service.cc:948] ReplaceTablet: received request to replace tablet 9eea7f86bbcd40e88907dea27deba8de from {username='slave'} at 127.0.0.1:36958
I20250831 19:54:45.932457 2303 consensus_queue.cc:1035] T b4cc124dc284464f8e78562b4d0881c8 P 2441fafe1d62429386f4631ad423567d [LEADER]: Connected to new peer: Peer: permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:45.929265 2125 catalog_manager.cc:5582] T 1a617be966d0410d9c273d6b25e383c4 P 89aa85d59c53436ebdf3074b13d14825 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193). New cstate: current_term: 1 leader_uuid: "89aa85d59c53436ebdf3074b13d14825" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: HEALTHY } } }
I20250831 19:54:45.933343 2125 catalog_manager.cc:5674] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197) does not have the latest schema for tablet 1a617be966d0410d9c273d6b25e383c4 (table default.table_cba30e3477524a4fb902655e070bfce2 [id=b1daf7387b1749019e5377ab08146d20]). Expected version 2 got 0
I20250831 19:54:45.934762 1614 tablet_service.cc:1468] Processing CreateTablet for tablet 529eddf7703e4ddc87e974720404fdf3 (DEFAULT_TABLE table=default.table_6b2346554c4543e684ad6275a7946831 [id=8b308db3bde240de873d138c0eec73a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:45.935120 1614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 529eddf7703e4ddc87e974720404fdf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:45.947870 2282 tablet_bootstrap.cc:492] T 529eddf7703e4ddc87e974720404fdf3 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:45.949633 2282 tablet_bootstrap.cc:654] T 529eddf7703e4ddc87e974720404fdf3 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:45.949870 2126 catalog_manager.cc:5674] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237) does not have the latest schema for tablet 1a617be966d0410d9c273d6b25e383c4 (table default.table_cba30e3477524a4fb902655e070bfce2 [id=b1daf7387b1749019e5377ab08146d20]). Expected version 2 got 0
I20250831 19:54:45.950114 2126 catalog_manager.cc:5582] T 07a9cd92870045a7a3e5a8b007bf7f47 P 2441fafe1d62429386f4631ad423567d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2441fafe1d62429386f4631ad423567d (127.1.1.195). New cstate: current_term: 1 leader_uuid: "2441fafe1d62429386f4631ad423567d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: UNKNOWN } } }
I20250831 19:54:45.959635 2118 catalog_manager.cc:2149] created HMS catalog entry for table [id=aabaa79336954b3ab0450dcff3afa7bf]
I20250831 19:54:45.964054 2283 tablet_bootstrap.cc:492] T 529eddf7703e4ddc87e974720404fdf3 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:45.964202 2283 ts_tablet_manager.cc:1397] T 529eddf7703e4ddc87e974720404fdf3 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.042s user 0.008s sys 0.004s
I20250831 19:54:45.965857 2283 raft_consensus.cc:357] T 529eddf7703e4ddc87e974720404fdf3 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:45.966033 2283 raft_consensus.cc:383] T 529eddf7703e4ddc87e974720404fdf3 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:45.966122 2283 raft_consensus.cc:738] T 529eddf7703e4ddc87e974720404fdf3 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:45.966344 2283 consensus_queue.cc:260] T 529eddf7703e4ddc87e974720404fdf3 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:45.966903 2283 ts_tablet_manager.cc:1428] T 529eddf7703e4ddc87e974720404fdf3 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20250831 19:54:45.981604 2125 catalog_manager.cc:6127] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: default.table_87fbe752a7a54c9eaa7536ba0e611919 [id=8e6395b817aa4efc955cf0ed00f54e14] alter complete (version 1)
I20250831 19:54:45.982285 2125 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36958:
name: "default.Table_bced462d6a2a4c929f51cfe29e54fe75"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:45.985869 2123 catalog_manager.cc:5869] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Sending DeleteTablet for 3 replicas of tablet 9eea7f86bbcd40e88907dea27deba8de
I20250831 19:54:45.986289 2123 catalog_manager.cc:6652] ReplaceTablet: tablet 9eea7f86bbcd40e88907dea27deba8de deleted and replaced by tablet a50607b15c144326bcc2d40f5d3ff4ff
I20250831 19:54:45.987449 2284 tablet_bootstrap.cc:492] T 529eddf7703e4ddc87e974720404fdf3 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:45.987716 2284 ts_tablet_manager.cc:1397] T 529eddf7703e4ddc87e974720404fdf3 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.074s user 0.001s sys 0.005s
I20250831 19:54:45.988850 2284 raft_consensus.cc:357] T 529eddf7703e4ddc87e974720404fdf3 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:45.989164 2284 raft_consensus.cc:383] T 529eddf7703e4ddc87e974720404fdf3 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:45.989308 2284 raft_consensus.cc:738] T 529eddf7703e4ddc87e974720404fdf3 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:45.989545 2126 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36958:
name: "default.Table_2cfa6cbcf8244da6b6468895fd9e31cc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:45.989857 2284 consensus_queue.cc:260] T 529eddf7703e4ddc87e974720404fdf3 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:45.990247 2124 catalog_manager.cc:5674] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475) does not have the latest schema for tablet 1a617be966d0410d9c273d6b25e383c4 (table default.table_cba30e3477524a4fb902655e070bfce2 [id=b1daf7387b1749019e5377ab08146d20]). Expected version 2 got 0
I20250831 19:54:45.991094 2124 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36958:
name: "default.Table_696724b65868432da5cd0914cbbf40a3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:45.992606 2284 ts_tablet_manager.cc:1428] T 529eddf7703e4ddc87e974720404fdf3 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20250831 19:54:45.992951 1750 tablet_service.cc:1515] Processing DeleteTablet for tablet 9eea7f86bbcd40e88907dea27deba8de with delete_type TABLET_DATA_DELETED (replaced by tablet a50607b15c144326bcc2d40f5d3ff4ff) from {username='slave'} at 127.0.0.1:50674
I20250831 19:54:45.993999 2278 tablet_replica.cc:331] T 9eea7f86bbcd40e88907dea27deba8de P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:54:45.994947 2123 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_f8db9b89d5e148b5ba271e3a17ff89b4" } new_table_name: "default.Table_26f70c27ca284c39a6201e33337404a9" modify_external_catalogs: true
I20250831 19:54:45.995647 1885 tablet_service.cc:1515] Processing DeleteTablet for tablet 9eea7f86bbcd40e88907dea27deba8de with delete_type TABLET_DATA_DELETED (replaced by tablet a50607b15c144326bcc2d40f5d3ff4ff) from {username='slave'} at 127.0.0.1:45906
I20250831 19:54:45.996791 2280 tablet_replica.cc:331] T 9eea7f86bbcd40e88907dea27deba8de P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:54:45.997045 2280 raft_consensus.cc:2241] T 9eea7f86bbcd40e88907dea27deba8de P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:45.997267 2280 raft_consensus.cc:2270] T 9eea7f86bbcd40e88907dea27deba8de P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:45.998210 2280 ts_tablet_manager.cc:1905] T 9eea7f86bbcd40e88907dea27deba8de P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:45.999573 2376 tablet.cc:1722] T 9eea7f86bbcd40e88907dea27deba8de P de831f40fa1348a48a1f0260f4130197: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:46.003718 1885 tablet_service.cc:1468] Processing CreateTablet for tablet a50607b15c144326bcc2d40f5d3ff4ff (DEFAULT_TABLE table=default.table_87fbe752a7a54c9eaa7536ba0e611919 [id=8e6395b817aa4efc955cf0ed00f54e14]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:46.004029 2280 ts_tablet_manager.cc:1918] T 9eea7f86bbcd40e88907dea27deba8de P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250831 19:54:46.004088 1885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a50607b15c144326bcc2d40f5d3ff4ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:46.004148 2280 log.cc:1199] T 9eea7f86bbcd40e88907dea27deba8de P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/9eea7f86bbcd40e88907dea27deba8de
I20250831 19:54:46.004541 2280 ts_tablet_manager.cc:1939] T 9eea7f86bbcd40e88907dea27deba8de P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:54:46.005415 2101 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet 9eea7f86bbcd40e88907dea27deba8de (table default.table_87fbe752a7a54c9eaa7536ba0e611919 [id=8e6395b817aa4efc955cf0ed00f54e14]) successfully deleted
I20250831 19:54:46.006541 2282 tablet_bootstrap.cc:492] T 529eddf7703e4ddc87e974720404fdf3 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:46.006670 2282 ts_tablet_manager.cc:1397] T 529eddf7703e4ddc87e974720404fdf3 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.059s user 0.002s sys 0.009s
I20250831 19:54:46.007346 2282 raft_consensus.cc:357] T 529eddf7703e4ddc87e974720404fdf3 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:46.007519 2282 raft_consensus.cc:383] T 529eddf7703e4ddc87e974720404fdf3 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:46.007635 2282 raft_consensus.cc:738] T 529eddf7703e4ddc87e974720404fdf3 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:45.999863 2278 raft_consensus.cc:2241] T 9eea7f86bbcd40e88907dea27deba8de P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:46.008244 2278 raft_consensus.cc:2270] T 9eea7f86bbcd40e88907dea27deba8de P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:46.009057 2282 consensus_queue.cc:260] T 529eddf7703e4ddc87e974720404fdf3 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:46.010025 1750 tablet_service.cc:1468] Processing CreateTablet for tablet a50607b15c144326bcc2d40f5d3ff4ff (DEFAULT_TABLE table=default.table_87fbe752a7a54c9eaa7536ba0e611919 [id=8e6395b817aa4efc955cf0ed00f54e14]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:46.010401 1750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a50607b15c144326bcc2d40f5d3ff4ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:46.013527 2283 tablet_bootstrap.cc:492] T a50607b15c144326bcc2d40f5d3ff4ff P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:46.014223 2278 ts_tablet_manager.cc:1905] T 9eea7f86bbcd40e88907dea27deba8de P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:46.014938 2283 tablet_bootstrap.cc:654] T a50607b15c144326bcc2d40f5d3ff4ff P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:46.015297 1614 tablet_service.cc:1515] Processing DeleteTablet for tablet 9eea7f86bbcd40e88907dea27deba8de with delete_type TABLET_DATA_DELETED (replaced by tablet a50607b15c144326bcc2d40f5d3ff4ff) from {username='slave'} at 127.0.0.1:51022
I20250831 19:54:46.015933 1613 tablet_service.cc:1468] Processing CreateTablet for tablet a50607b15c144326bcc2d40f5d3ff4ff (DEFAULT_TABLE table=default.table_87fbe752a7a54c9eaa7536ba0e611919 [id=8e6395b817aa4efc955cf0ed00f54e14]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:46.016268 1613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a50607b15c144326bcc2d40f5d3ff4ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:46.018262 2277 tablet_replica.cc:331] T 9eea7f86bbcd40e88907dea27deba8de P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:54:46.018410 2277 raft_consensus.cc:2241] T 9eea7f86bbcd40e88907dea27deba8de P 89aa85d59c53436ebdf3074b13d14825 [term 1 LEADER]: Raft consensus shutting down.
I20250831 19:54:46.018679 2277 raft_consensus.cc:2270] T 9eea7f86bbcd40e88907dea27deba8de P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:46.018718 2282 ts_tablet_manager.cc:1428] T 529eddf7703e4ddc87e974720404fdf3 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
I20250831 19:54:46.019459 2277 ts_tablet_manager.cc:1905] T 9eea7f86bbcd40e88907dea27deba8de P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:46.025082 2277 ts_tablet_manager.cc:1918] T 9eea7f86bbcd40e88907dea27deba8de P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250831 19:54:46.025187 2277 log.cc:1199] T 9eea7f86bbcd40e88907dea27deba8de P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/9eea7f86bbcd40e88907dea27deba8de
I20250831 19:54:46.025287 1884 tablet_service.cc:1468] Processing CreateTablet for tablet 011ffff51cf94c76968725fca7721182 (DEFAULT_TABLE table=default.table_9706596e6715417ebc8fb06420b56bde [id=aabaa79336954b3ab0450dcff3afa7bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:46.025646 1884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 011ffff51cf94c76968725fca7721182. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:46.026942 2278 ts_tablet_manager.cc:1918] T 9eea7f86bbcd40e88907dea27deba8de P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250831 19:54:46.027029 2278 log.cc:1199] T 9eea7f86bbcd40e88907dea27deba8de P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/9eea7f86bbcd40e88907dea27deba8de
I20250831 19:54:46.027413 2278 ts_tablet_manager.cc:1939] T 9eea7f86bbcd40e88907dea27deba8de P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
I20250831 19:54:46.028268 2105 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet 9eea7f86bbcd40e88907dea27deba8de (table default.table_87fbe752a7a54c9eaa7536ba0e611919 [id=8e6395b817aa4efc955cf0ed00f54e14]) successfully deleted
I20250831 19:54:46.029726 2277 ts_tablet_manager.cc:1939] T 9eea7f86bbcd40e88907dea27deba8de P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
I20250831 19:54:46.030529 2284 tablet_bootstrap.cc:492] T a50607b15c144326bcc2d40f5d3ff4ff P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:46.030790 1614 tablet_service.cc:1468] Processing CreateTablet for tablet 011ffff51cf94c76968725fca7721182 (DEFAULT_TABLE table=default.table_9706596e6715417ebc8fb06420b56bde [id=aabaa79336954b3ab0450dcff3afa7bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:46.031117 1614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 011ffff51cf94c76968725fca7721182. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:46.031963 2284 tablet_bootstrap.cc:654] T a50607b15c144326bcc2d40f5d3ff4ff P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:46.033627 2104 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet 9eea7f86bbcd40e88907dea27deba8de (table default.table_87fbe752a7a54c9eaa7536ba0e611919 [id=8e6395b817aa4efc955cf0ed00f54e14]) successfully deleted
I20250831 19:54:46.035358 2117 catalog_manager.cc:2149] created HMS catalog entry for table [id=2cd4af6b415c4e3a92a3732fa145aa42]
I20250831 19:54:46.036981 1886 tablet_service.cc:1515] Processing DeleteTablet for tablet 9eea7f86bbcd40e88907dea27deba8de with delete_type TABLET_DATA_DELETED (replaced by tablet a50607b15c144326bcc2d40f5d3ff4ff) from {username='slave'} at 127.0.0.1:45906
W20250831 19:54:46.037612 2101 catalog_manager.cc:4895] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): delete failed for tablet 9eea7f86bbcd40e88907dea27deba8de because the tablet was not found. No further retry: Not found: Tablet not found: 9eea7f86bbcd40e88907dea27deba8de
I20250831 19:54:46.039721 1750 tablet_service.cc:1468] Processing CreateTablet for tablet 011ffff51cf94c76968725fca7721182 (DEFAULT_TABLE table=default.table_9706596e6715417ebc8fb06420b56bde [id=aabaa79336954b3ab0450dcff3afa7bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:46.040071 1750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 011ffff51cf94c76968725fca7721182. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:46.046149 1903 raft_consensus.cc:1273] T 1a617be966d0410d9c273d6b25e383c4 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Refusing update from remote peer 89aa85d59c53436ebdf3074b13d14825: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250831 19:54:46.046638 2330 consensus_queue.cc:1035] T 1a617be966d0410d9c273d6b25e383c4 P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:46.052582 1772 raft_consensus.cc:1273] T 1a617be966d0410d9c273d6b25e383c4 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Refusing update from remote peer 89aa85d59c53436ebdf3074b13d14825: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250831 19:54:46.054224 2330 consensus_queue.cc:1035] T 1a617be966d0410d9c273d6b25e383c4 P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:46.055446 2117 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_179225213b4a45978264479432550f67" } new_table_name: "default.Table_c8611581e59f4d8a94cd6f4da06917a4" modify_external_catalogs: true
I20250831 19:54:46.056270 2288 tablet.cc:1722] T 1a617be966d0410d9c273d6b25e383c4 P 89aa85d59c53436ebdf3074b13d14825: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250831 19:54:46.061908 2118 catalog_manager.cc:5674] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237) does not have the latest schema for tablet 1a617be966d0410d9c273d6b25e383c4 (table default.table_cba30e3477524a4fb902655e070bfce2 [id=b1daf7387b1749019e5377ab08146d20]). Expected version 2 got 0
I20250831 19:54:46.064872 2367 tablet.cc:1722] T 1a617be966d0410d9c273d6b25e383c4 P 2441fafe1d62429386f4631ad423567d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250831 19:54:46.065791 2282 tablet_bootstrap.cc:492] T 011ffff51cf94c76968725fca7721182 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:46.067478 2282 tablet_bootstrap.cc:654] T 011ffff51cf94c76968725fca7721182 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:46.070448 2376 tablet.cc:1722] T 1a617be966d0410d9c273d6b25e383c4 P de831f40fa1348a48a1f0260f4130197: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250831 19:54:46.071990 2283 tablet_bootstrap.cc:492] T a50607b15c144326bcc2d40f5d3ff4ff P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:46.072175 2283 ts_tablet_manager.cc:1397] T a50607b15c144326bcc2d40f5d3ff4ff P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.059s user 0.004s sys 0.000s
I20250831 19:54:46.072906 2283 raft_consensus.cc:357] T a50607b15c144326bcc2d40f5d3ff4ff P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:46.073084 2283 raft_consensus.cc:383] T a50607b15c144326bcc2d40f5d3ff4ff P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:46.073151 2283 raft_consensus.cc:738] T a50607b15c144326bcc2d40f5d3ff4ff P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:46.073357 2283 consensus_queue.cc:260] T a50607b15c144326bcc2d40f5d3ff4ff P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:46.073935 2283 ts_tablet_manager.cc:1428] T a50607b15c144326bcc2d40f5d3ff4ff P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250831 19:54:46.074226 2283 tablet_bootstrap.cc:492] T 011ffff51cf94c76968725fca7721182 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:46.075768 2283 tablet_bootstrap.cc:654] T 011ffff51cf94c76968725fca7721182 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:46.079433 2118 catalog_manager.cc:6127] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: default.table_cba30e3477524a4fb902655e070bfce2 [id=b1daf7387b1749019e5377ab08146d20] alter complete (version 2)
I20250831 19:54:46.082033 2118 catalog_manager.cc:5674] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475) does not have the latest schema for tablet 1a617be966d0410d9c273d6b25e383c4 (table default.table_cba30e3477524a4fb902655e070bfce2 [id=b1daf7387b1749019e5377ab08146d20]). Expected version 2 got 0
I20250831 19:54:46.090631 1613 tablet_service.cc:1468] Processing CreateTablet for tablet 5aa2af1f691a4fa0945d81ba94e03052 (DEFAULT_TABLE table=default.table_544f7d804f564e83be8fb83049aa8dea [id=2cd4af6b415c4e3a92a3732fa145aa42]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:46.091046 1613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5aa2af1f691a4fa0945d81ba94e03052. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:46.091570 2284 tablet_bootstrap.cc:492] T a50607b15c144326bcc2d40f5d3ff4ff P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:46.091740 2284 ts_tablet_manager.cc:1397] T a50607b15c144326bcc2d40f5d3ff4ff P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.061s user 0.009s sys 0.000s
I20250831 19:54:46.092070 2118 catalog_manager.cc:5674] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237) does not have the latest schema for tablet a50607b15c144326bcc2d40f5d3ff4ff (table default.table_87fbe752a7a54c9eaa7536ba0e611919 [id=8e6395b817aa4efc955cf0ed00f54e14]). Expected version 1 got 0
I20250831 19:54:46.092425 2284 raft_consensus.cc:357] T a50607b15c144326bcc2d40f5d3ff4ff P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:46.092597 2284 raft_consensus.cc:383] T a50607b15c144326bcc2d40f5d3ff4ff P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:46.092665 2284 raft_consensus.cc:738] T a50607b15c144326bcc2d40f5d3ff4ff P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:46.093021 1750 tablet_service.cc:1468] Processing CreateTablet for tablet 5aa2af1f691a4fa0945d81ba94e03052 (DEFAULT_TABLE table=default.table_544f7d804f564e83be8fb83049aa8dea [id=2cd4af6b415c4e3a92a3732fa145aa42]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:46.093344 1750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5aa2af1f691a4fa0945d81ba94e03052. 1 dirs total, 0 dirs full, 0 dirs failed
W20250831 19:54:46.093482 2118 catalog_manager.cc:5774] Failed to send AlterTable RPC for tablet a50607b15c144326bcc2d40f5d3ff4ff (table default.table_87fbe752a7a54c9eaa7536ba0e611919 [id=8e6395b817aa4efc955cf0ed00f54e14], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet a50607b15c144326bcc2d40f5d3ff4ff consensus state has no leader
I20250831 19:54:46.094267 2284 consensus_queue.cc:260] T a50607b15c144326bcc2d40f5d3ff4ff P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:46.095448 2284 ts_tablet_manager.cc:1428] T a50607b15c144326bcc2d40f5d3ff4ff P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20250831 19:54:46.095743 2284 tablet_bootstrap.cc:492] T 011ffff51cf94c76968725fca7721182 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:46.097651 1884 tablet_service.cc:1468] Processing CreateTablet for tablet 5aa2af1f691a4fa0945d81ba94e03052 (DEFAULT_TABLE table=default.table_544f7d804f564e83be8fb83049aa8dea [id=2cd4af6b415c4e3a92a3732fa145aa42]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:46.098008 1884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5aa2af1f691a4fa0945d81ba94e03052. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:46.101475 2118 catalog_manager.cc:5674] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475) does not have the latest schema for tablet a50607b15c144326bcc2d40f5d3ff4ff (table default.table_87fbe752a7a54c9eaa7536ba0e611919 [id=8e6395b817aa4efc955cf0ed00f54e14]). Expected version 1 got 0
I20250831 19:54:46.103678 2118 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_041b766e57be48328a32ed288f99216a" } modify_external_catalogs: true
I20250831 19:54:46.103888 2118 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_041b766e57be48328a32ed288f99216a" } modify_external_catalogs: true
I20250831 19:54:46.109705 2284 tablet_bootstrap.cc:654] T 011ffff51cf94c76968725fca7721182 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:46.109794 2282 tablet_bootstrap.cc:492] T 011ffff51cf94c76968725fca7721182 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:46.109999 2282 ts_tablet_manager.cc:1397] T 011ffff51cf94c76968725fca7721182 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.044s user 0.003s sys 0.010s
I20250831 19:54:46.110963 2282 raft_consensus.cc:357] T 011ffff51cf94c76968725fca7721182 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:46.111222 2282 raft_consensus.cc:383] T 011ffff51cf94c76968725fca7721182 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:46.111308 2282 raft_consensus.cc:738] T 011ffff51cf94c76968725fca7721182 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:46.111625 2282 consensus_queue.cc:260] T 011ffff51cf94c76968725fca7721182 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:46.114506 2282 ts_tablet_manager.cc:1428] T 011ffff51cf94c76968725fca7721182 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20250831 19:54:46.115254 2282 tablet_bootstrap.cc:492] T a50607b15c144326bcc2d40f5d3ff4ff P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:46.117756 2282 tablet_bootstrap.cc:654] T a50607b15c144326bcc2d40f5d3ff4ff P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:46.123346 2284 tablet_bootstrap.cc:492] T 011ffff51cf94c76968725fca7721182 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:46.123543 2284 ts_tablet_manager.cc:1397] T 011ffff51cf94c76968725fca7721182 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.028s user 0.001s sys 0.002s
I20250831 19:54:46.124310 2284 raft_consensus.cc:357] T 011ffff51cf94c76968725fca7721182 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:46.124481 2283 tablet_bootstrap.cc:492] T 011ffff51cf94c76968725fca7721182 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:46.124573 2284 raft_consensus.cc:383] T 011ffff51cf94c76968725fca7721182 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:46.124625 2283 ts_tablet_manager.cc:1397] T 011ffff51cf94c76968725fca7721182 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.051s user 0.008s sys 0.026s
I20250831 19:54:46.124747 2284 raft_consensus.cc:738] T 011ffff51cf94c76968725fca7721182 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:46.125018 2284 consensus_queue.cc:260] T 011ffff51cf94c76968725fca7721182 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:46.125350 2283 raft_consensus.cc:357] T 011ffff51cf94c76968725fca7721182 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:46.125557 2283 raft_consensus.cc:383] T 011ffff51cf94c76968725fca7721182 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:46.125645 2283 raft_consensus.cc:738] T 011ffff51cf94c76968725fca7721182 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:46.125890 2283 consensus_queue.cc:260] T 011ffff51cf94c76968725fca7721182 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:46.127441 2284 ts_tablet_manager.cc:1428] T 011ffff51cf94c76968725fca7721182 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20250831 19:54:46.127728 2283 ts_tablet_manager.cc:1428] T 011ffff51cf94c76968725fca7721182 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20250831 19:54:46.128018 2283 tablet_bootstrap.cc:492] T 5aa2af1f691a4fa0945d81ba94e03052 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:46.128643 2284 tablet_bootstrap.cc:492] T 5aa2af1f691a4fa0945d81ba94e03052 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:46.130292 2284 tablet_bootstrap.cc:654] T 5aa2af1f691a4fa0945d81ba94e03052 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:46.130375 2283 tablet_bootstrap.cc:654] T 5aa2af1f691a4fa0945d81ba94e03052 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:46.133266 2282 tablet_bootstrap.cc:492] T a50607b15c144326bcc2d40f5d3ff4ff P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:46.133471 2282 ts_tablet_manager.cc:1397] T a50607b15c144326bcc2d40f5d3ff4ff P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.002s
I20250831 19:54:46.134519 2282 raft_consensus.cc:357] T a50607b15c144326bcc2d40f5d3ff4ff P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:46.134754 2282 raft_consensus.cc:383] T a50607b15c144326bcc2d40f5d3ff4ff P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:46.134866 2282 raft_consensus.cc:738] T a50607b15c144326bcc2d40f5d3ff4ff P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:46.139245 2284 tablet_bootstrap.cc:492] T 5aa2af1f691a4fa0945d81ba94e03052 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:46.139395 2284 ts_tablet_manager.cc:1397] T 5aa2af1f691a4fa0945d81ba94e03052 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.002s
I20250831 19:54:46.140020 2284 raft_consensus.cc:357] T 5aa2af1f691a4fa0945d81ba94e03052 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:46.140180 2284 raft_consensus.cc:383] T 5aa2af1f691a4fa0945d81ba94e03052 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:46.140244 2284 raft_consensus.cc:738] T 5aa2af1f691a4fa0945d81ba94e03052 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:46.140460 2284 consensus_queue.cc:260] T 5aa2af1f691a4fa0945d81ba94e03052 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:46.141146 2283 tablet_bootstrap.cc:492] T 5aa2af1f691a4fa0945d81ba94e03052 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:46.141286 2283 ts_tablet_manager.cc:1397] T 5aa2af1f691a4fa0945d81ba94e03052 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.013s user 0.007s sys 0.002s
I20250831 19:54:46.142050 2283 raft_consensus.cc:357] T 5aa2af1f691a4fa0945d81ba94e03052 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:46.142225 2283 raft_consensus.cc:383] T 5aa2af1f691a4fa0945d81ba94e03052 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:46.142290 2283 raft_consensus.cc:738] T 5aa2af1f691a4fa0945d81ba94e03052 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:46.142258 2282 consensus_queue.cc:260] T a50607b15c144326bcc2d40f5d3ff4ff P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:46.144088 2284 ts_tablet_manager.cc:1428] T 5aa2af1f691a4fa0945d81ba94e03052 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20250831 19:54:46.144403 2282 ts_tablet_manager.cc:1428] T a50607b15c144326bcc2d40f5d3ff4ff P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.011s user 0.001s sys 0.001s
I20250831 19:54:46.144680 2282 tablet_bootstrap.cc:492] T 5aa2af1f691a4fa0945d81ba94e03052 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:46.147289 2283 consensus_queue.cc:260] T 5aa2af1f691a4fa0945d81ba94e03052 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:46.147780 2283 ts_tablet_manager.cc:1428] T 5aa2af1f691a4fa0945d81ba94e03052 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.006s user 0.000s sys 0.002s
I20250831 19:54:46.149039 2122 catalog_manager.cc:2149] created HMS catalog entry for table [id=5ce6c4d5dcd34d73af61fd2c4bf28799]
I20250831 19:54:46.152493 2282 tablet_bootstrap.cc:654] T 5aa2af1f691a4fa0945d81ba94e03052 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:46.163316 2282 tablet_bootstrap.cc:492] T 5aa2af1f691a4fa0945d81ba94e03052 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:46.163482 2282 ts_tablet_manager.cc:1397] T 5aa2af1f691a4fa0945d81ba94e03052 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.019s user 0.001s sys 0.002s
I20250831 19:54:46.164242 2282 raft_consensus.cc:357] T 5aa2af1f691a4fa0945d81ba94e03052 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:46.164485 2282 raft_consensus.cc:383] T 5aa2af1f691a4fa0945d81ba94e03052 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:46.164565 2282 raft_consensus.cc:738] T 5aa2af1f691a4fa0945d81ba94e03052 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:46.164808 2282 consensus_queue.cc:260] T 5aa2af1f691a4fa0945d81ba94e03052 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:46.165400 2282 ts_tablet_manager.cc:1428] T 5aa2af1f691a4fa0945d81ba94e03052 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20250831 19:54:46.170998 1750 tablet_service.cc:1468] Processing CreateTablet for tablet 6eda2f28ef194cba81661fbf080c5883 (DEFAULT_TABLE table=default.table_5660fc6b1a9846a6bd36b56e553a8f35 [id=5ce6c4d5dcd34d73af61fd2c4bf28799]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:46.171370 1750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6eda2f28ef194cba81661fbf080c5883. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:46.173781 1884 tablet_service.cc:1468] Processing CreateTablet for tablet 6eda2f28ef194cba81661fbf080c5883 (DEFAULT_TABLE table=default.table_5660fc6b1a9846a6bd36b56e553a8f35 [id=5ce6c4d5dcd34d73af61fd2c4bf28799]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:46.174201 1884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6eda2f28ef194cba81661fbf080c5883. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:46.175662 2284 tablet_bootstrap.cc:492] T 6eda2f28ef194cba81661fbf080c5883 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:46.176781 2284 tablet_bootstrap.cc:654] T 6eda2f28ef194cba81661fbf080c5883 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:46.177685 1613 tablet_service.cc:1468] Processing CreateTablet for tablet 6eda2f28ef194cba81661fbf080c5883 (DEFAULT_TABLE table=default.table_5660fc6b1a9846a6bd36b56e553a8f35 [id=5ce6c4d5dcd34d73af61fd2c4bf28799]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:46.178069 1613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6eda2f28ef194cba81661fbf080c5883. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:46.178256 2284 tablet_bootstrap.cc:492] T 6eda2f28ef194cba81661fbf080c5883 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:46.178369 2284 ts_tablet_manager.cc:1397] T 6eda2f28ef194cba81661fbf080c5883 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20250831 19:54:46.178856 2284 raft_consensus.cc:357] T 6eda2f28ef194cba81661fbf080c5883 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:46.178979 2284 raft_consensus.cc:383] T 6eda2f28ef194cba81661fbf080c5883 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:46.179057 2284 raft_consensus.cc:738] T 6eda2f28ef194cba81661fbf080c5883 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:46.179262 2284 consensus_queue.cc:260] T 6eda2f28ef194cba81661fbf080c5883 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:46.181411 2284 ts_tablet_manager.cc:1428] T 6eda2f28ef194cba81661fbf080c5883 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20250831 19:54:46.186628 2283 tablet_bootstrap.cc:492] T 6eda2f28ef194cba81661fbf080c5883 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:46.188174 2283 tablet_bootstrap.cc:654] T 6eda2f28ef194cba81661fbf080c5883 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:46.190057 2282 tablet_bootstrap.cc:492] T 6eda2f28ef194cba81661fbf080c5883 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:46.191570 2122 catalog_manager.cc:5674] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197) does not have the latest schema for tablet a50607b15c144326bcc2d40f5d3ff4ff (table default.table_87fbe752a7a54c9eaa7536ba0e611919 [id=8e6395b817aa4efc955cf0ed00f54e14]). Expected version 1 got 0
I20250831 19:54:46.192957 2282 tablet_bootstrap.cc:654] T 6eda2f28ef194cba81661fbf080c5883 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:46.193434 2330 consensus_queue.cc:1035] T 52329de858ab4af18b3639df57972eb5 P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:46.195381 2122 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_21109c51ccde402faea41968420775a5" } modify_external_catalogs: true
I20250831 19:54:46.203727 2122 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_21109c51ccde402faea41968420775a5" } modify_external_catalogs: true
I20250831 19:54:46.212301 2328 consensus_queue.cc:1035] T 9ad8ad70eab04e7abd29597603a1ce33 P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:46.216660 2119 catalog_manager.cc:2149] created HMS catalog entry for table [id=0fc929ad819b48a9af984f8c301bad2b]
I20250831 19:54:46.223390 2119 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:36958 (request call id 27) took 1041 ms. Trace:
I20250831 19:54:46.223517 2119 rpcz_store.cc:276] 0831 19:54:45.181661 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:45.466487 (+284826us) service_pool.cc:225] Handling call
0831 19:54:45.929297 (+462810us) catalog_manager.cc:2076] Acquired catalog manager lock
0831 19:54:45.929707 (+ 410us) catalog_manager.cc:2122] Created new table and tablet info
0831 19:54:46.216615 (+286908us) catalog_manager.cc:2148] Created new table in HMS catalog
0831 19:54:46.223076 (+ 6461us) catalog_manager.cc:2182] Wrote table and tablets to system table
0831 19:54:46.223204 (+ 128us) catalog_manager.cc:2216] Inserted table and tablets into CatalogManager maps
0831 19:54:46.223320 (+ 116us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:46.217464 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:46.217601 (+ 137us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:46.217610 (+ 9us) write_op.cc:435] Acquired schema lock
0831 19:54:46.217613 (+ 3us) tablet.cc:660] Decoding operations
0831 19:54:46.217730 (+ 117us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:46.217747 (+ 17us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:46.217753 (+ 6us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:46.217862 (+ 109us) tablet.cc:699] Row locks acquired
0831 19:54:46.217865 (+ 3us) write_op.cc:260] PREPARE: finished
0831 19:54:46.217905 (+ 40us) write_op.cc:270] Start()
0831 19:54:46.217945 (+ 40us) write_op.cc:276] Timestamp: P: 1756670086217878 usec, L: 0
0831 19:54:46.217951 (+ 6us) op_driver.cc:348] REPLICATION: starting
0831 19:54:46.218146 (+ 195us) log.cc:844] Serialized 432 byte log entry
0831 19:54:46.221666 (+ 3520us) op_driver.cc:464] REPLICATION: finished
0831 19:54:46.221853 (+ 187us) write_op.cc:301] APPLY: starting
0831 19:54:46.221872 (+ 19us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:46.221931 (+ 59us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:46.221974 (+ 43us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:46.222100 (+ 126us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:46.222144 (+ 44us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0831 19:54:46.222155 (+ 11us) write_op.cc:312] APPLY: finished
0831 19:54:46.222240 (+ 85us) log.cc:844] Serialized 28 byte log entry
0831 19:54:46.222314 (+ 74us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:46.222337 (+ 23us) write_op.cc:454] Released schema lock
0831 19:54:46.222345 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0831 19:54:46.222428 (+ 83us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:46.222433 (+ 5us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":219024,"Hive Metastore.run_cpu_time_us":651,"Hive Metastore.run_wall_time_us":67602,"spinlock_wait_cycles":9088,"child_traces":[["op",{"apply.queue_time_us":130,"apply.run_cpu_time_us":567,"apply.run_wall_time_us":566,"num_ops":2,"prepare.queue_time_us":58,"prepare.run_cpu_time_us":834,"prepare.run_wall_time_us":834,"raft.queue_time_us":1301,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":250,"replication_time_us":3680}]]}
I20250831 19:54:46.226157 2119 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_609f839fcd04455fb64b8a7674b0f57b" } new_table_name: "default.Table_0ab569c1a9dc4f91af81c84392bc5748" modify_external_catalogs: true
I20250831 19:54:46.235167 2330 consensus_queue.cc:1035] T 52329de858ab4af18b3639df57972eb5 P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:46.236296 1750 tablet_service.cc:1468] Processing CreateTablet for tablet f94f30794d6143b1877dd45e589cfe76 (DEFAULT_TABLE table=default.table_8adc00cc53274835bfe463ebf3bd3f45 [id=0fc929ad819b48a9af984f8c301bad2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:46.236716 1750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f94f30794d6143b1877dd45e589cfe76. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:46.238269 2283 tablet_bootstrap.cc:492] T 6eda2f28ef194cba81661fbf080c5883 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:46.238404 2283 ts_tablet_manager.cc:1397] T 6eda2f28ef194cba81661fbf080c5883 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.052s user 0.013s sys 0.014s
I20250831 19:54:46.239075 2283 raft_consensus.cc:357] T 6eda2f28ef194cba81661fbf080c5883 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:46.239229 2283 raft_consensus.cc:383] T 6eda2f28ef194cba81661fbf080c5883 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:46.239310 2283 raft_consensus.cc:738] T 6eda2f28ef194cba81661fbf080c5883 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:46.239527 2283 consensus_queue.cc:260] T 6eda2f28ef194cba81661fbf080c5883 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:46.240023 2283 ts_tablet_manager.cc:1428] T 6eda2f28ef194cba81661fbf080c5883 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20250831 19:54:46.241590 1613 tablet_service.cc:1468] Processing CreateTablet for tablet f94f30794d6143b1877dd45e589cfe76 (DEFAULT_TABLE table=default.table_8adc00cc53274835bfe463ebf3bd3f45 [id=0fc929ad819b48a9af984f8c301bad2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:46.242084 1613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f94f30794d6143b1877dd45e589cfe76. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:46.243255 2374 sys_catalog.cc:455] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } } }
I20250831 19:54:46.243513 2374 sys_catalog.cc:458] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [sys.catalog]: This master's current role is: LEADER
I20250831 19:54:46.256021 1884 tablet_service.cc:1468] Processing CreateTablet for tablet f94f30794d6143b1877dd45e589cfe76 (DEFAULT_TABLE table=default.table_8adc00cc53274835bfe463ebf3bd3f45 [id=0fc929ad819b48a9af984f8c301bad2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:46.257254 1884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f94f30794d6143b1877dd45e589cfe76. 1 dirs total, 0 dirs full, 0 dirs failed
W20250831 19:54:46.257561 2121 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_486ee0377a714038aaf8f3f5b1ad7f79 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250831 19:54:46.258816 2120 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_1ca0a7f3c33945bd902a63ca09aa62ad in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250831 19:54:46.260064 2284 tablet_bootstrap.cc:492] T f94f30794d6143b1877dd45e589cfe76 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:46.262199 2284 tablet_bootstrap.cc:654] T f94f30794d6143b1877dd45e589cfe76 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:46.274049 2396 raft_consensus.cc:491] T 6eda2f28ef194cba81661fbf080c5883 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:46.274219 2396 raft_consensus.cc:513] T 6eda2f28ef194cba81661fbf080c5883 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:46.275393 1634 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6eda2f28ef194cba81661fbf080c5883" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
W20250831 19:54:46.276042 1706 leader_election.cc:343] T 6eda2f28ef194cba81661fbf080c5883 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): Illegal state: must be running to vote when last-logged opid is not known
I20250831 19:54:46.279213 2398 consensus_queue.cc:1035] T 9ad8ad70eab04e7abd29597603a1ce33 P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:46.288744 1906 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6eda2f28ef194cba81661fbf080c5883" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:46.289032 1906 raft_consensus.cc:2466] T 6eda2f28ef194cba81661fbf080c5883 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 0.
I20250831 19:54:46.289481 1705 leader_election.cc:304] T 6eda2f28ef194cba81661fbf080c5883 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters: 89aa85d59c53436ebdf3074b13d14825
I20250831 19:54:46.290167 2396 leader_election.cc:290] T 6eda2f28ef194cba81661fbf080c5883 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197), 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237)
I20250831 19:54:46.290617 2398 raft_consensus.cc:2802] T 6eda2f28ef194cba81661fbf080c5883 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:46.291262 2398 raft_consensus.cc:491] T 6eda2f28ef194cba81661fbf080c5883 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:46.291702 2398 raft_consensus.cc:3058] T 6eda2f28ef194cba81661fbf080c5883 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:46.293306 2284 tablet_bootstrap.cc:492] T f94f30794d6143b1877dd45e589cfe76 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:46.294165 2284 ts_tablet_manager.cc:1397] T f94f30794d6143b1877dd45e589cfe76 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.034s user 0.007s sys 0.005s
I20250831 19:54:46.295110 2284 raft_consensus.cc:357] T f94f30794d6143b1877dd45e589cfe76 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:46.295351 2284 raft_consensus.cc:383] T f94f30794d6143b1877dd45e589cfe76 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:46.295433 2284 raft_consensus.cc:738] T f94f30794d6143b1877dd45e589cfe76 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:46.295742 2284 consensus_queue.cc:260] T f94f30794d6143b1877dd45e589cfe76 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:46.296330 2284 ts_tablet_manager.cc:1428] T f94f30794d6143b1877dd45e589cfe76 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250831 19:54:46.300274 2283 tablet_bootstrap.cc:492] T f94f30794d6143b1877dd45e589cfe76 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:46.302102 2283 tablet_bootstrap.cc:654] T f94f30794d6143b1877dd45e589cfe76 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:46.303793 2398 raft_consensus.cc:513] T 6eda2f28ef194cba81661fbf080c5883 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:46.304705 1634 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6eda2f28ef194cba81661fbf080c5883" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
W20250831 19:54:46.305169 1706 leader_election.cc:343] T 6eda2f28ef194cba81661fbf080c5883 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): Illegal state: must be running to vote when last-logged opid is not known
I20250831 19:54:46.305884 2398 leader_election.cc:290] T 6eda2f28ef194cba81661fbf080c5883 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Requested vote from peers 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197), 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237)
I20250831 19:54:46.305968 1904 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6eda2f28ef194cba81661fbf080c5883" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:54:46.306152 1904 raft_consensus.cc:3058] T 6eda2f28ef194cba81661fbf080c5883 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:46.308614 1904 raft_consensus.cc:2466] T 6eda2f28ef194cba81661fbf080c5883 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:54:46.308969 1705 leader_election.cc:304] T 6eda2f28ef194cba81661fbf080c5883 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters: 89aa85d59c53436ebdf3074b13d14825
I20250831 19:54:46.309546 2328 raft_consensus.cc:2802] T 6eda2f28ef194cba81661fbf080c5883 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:46.310473 2328 raft_consensus.cc:695] T 6eda2f28ef194cba81661fbf080c5883 P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: Becoming Leader. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Running, Role: LEADER
I20250831 19:54:46.312544 2328 consensus_queue.cc:237] T 6eda2f28ef194cba81661fbf080c5883 P de831f40fa1348a48a1f0260f4130197 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:46.331880 2282 tablet_bootstrap.cc:492] T 6eda2f28ef194cba81661fbf080c5883 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:46.332069 2282 ts_tablet_manager.cc:1397] T 6eda2f28ef194cba81661fbf080c5883 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.142s user 0.030s sys 0.043s
I20250831 19:54:46.332463 2283 tablet_bootstrap.cc:492] T f94f30794d6143b1877dd45e589cfe76 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:46.332633 2283 ts_tablet_manager.cc:1397] T f94f30794d6143b1877dd45e589cfe76 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.032s user 0.004s sys 0.008s
I20250831 19:54:46.332947 2282 raft_consensus.cc:357] T 6eda2f28ef194cba81661fbf080c5883 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:46.333143 2282 raft_consensus.cc:383] T 6eda2f28ef194cba81661fbf080c5883 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:46.333225 2282 raft_consensus.cc:738] T 6eda2f28ef194cba81661fbf080c5883 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:46.333487 2283 raft_consensus.cc:357] T f94f30794d6143b1877dd45e589cfe76 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:46.333678 2283 raft_consensus.cc:383] T f94f30794d6143b1877dd45e589cfe76 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:46.333742 2283 raft_consensus.cc:738] T f94f30794d6143b1877dd45e589cfe76 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:46.333945 2283 consensus_queue.cc:260] T f94f30794d6143b1877dd45e589cfe76 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:46.334125 2282 consensus_queue.cc:260] T 6eda2f28ef194cba81661fbf080c5883 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:46.337702 2283 ts_tablet_manager.cc:1428] T f94f30794d6143b1877dd45e589cfe76 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20250831 19:54:46.339097 2282 ts_tablet_manager.cc:1428] T 6eda2f28ef194cba81661fbf080c5883 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20250831 19:54:46.339461 2330 raft_consensus.cc:491] T 011ffff51cf94c76968725fca7721182 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:46.339476 2121 catalog_manager.cc:2149] created HMS catalog entry for table [id=028e873d141c4006aca7d45be88d9ae3]
I20250831 19:54:46.339887 2330 raft_consensus.cc:513] T 011ffff51cf94c76968725fca7721182 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:46.340837 1903 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "011ffff51cf94c76968725fca7721182" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:46.341068 1903 raft_consensus.cc:2466] T 011ffff51cf94c76968725fca7721182 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 0.
I20250831 19:54:46.341697 1568 leader_election.cc:304] T 011ffff51cf94c76968725fca7721182 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:54:46.342016 2354 raft_consensus.cc:2802] T 011ffff51cf94c76968725fca7721182 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:46.342123 2354 raft_consensus.cc:491] T 011ffff51cf94c76968725fca7721182 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:46.342232 2354 raft_consensus.cc:3058] T 011ffff51cf94c76968725fca7721182 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:46.344992 2121 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:36958 (request call id 31) took 1162 ms. Trace:
I20250831 19:54:46.345147 2354 raft_consensus.cc:513] T 011ffff51cf94c76968725fca7721182 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:46.345119 2121 rpcz_store.cc:276] 0831 19:54:45.182260 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:45.929968 (+747708us) service_pool.cc:225] Handling call
0831 19:54:46.257677 (+327709us) catalog_manager.cc:2076] Acquired catalog manager lock
0831 19:54:46.258366 (+ 689us) catalog_manager.cc:2122] Created new table and tablet info
0831 19:54:46.339426 (+ 81060us) catalog_manager.cc:2148] Created new table in HMS catalog
0831 19:54:46.344741 (+ 5315us) catalog_manager.cc:2182] Wrote table and tablets to system table
0831 19:54:46.344854 (+ 113us) catalog_manager.cc:2216] Inserted table and tablets into CatalogManager maps
0831 19:54:46.344947 (+ 93us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:46.340148 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:46.340291 (+ 143us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:46.340298 (+ 7us) write_op.cc:435] Acquired schema lock
0831 19:54:46.340300 (+ 2us) tablet.cc:660] Decoding operations
0831 19:54:46.340398 (+ 98us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:46.340412 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:46.340419 (+ 7us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:46.340502 (+ 83us) tablet.cc:699] Row locks acquired
0831 19:54:46.340504 (+ 2us) write_op.cc:260] PREPARE: finished
0831 19:54:46.340540 (+ 36us) write_op.cc:270] Start()
0831 19:54:46.340573 (+ 33us) write_op.cc:276] Timestamp: P: 1756670086340504 usec, L: 0
0831 19:54:46.340576 (+ 3us) op_driver.cc:348] REPLICATION: starting
0831 19:54:46.340742 (+ 166us) log.cc:844] Serialized 433 byte log entry
0831 19:54:46.343585 (+ 2843us) op_driver.cc:464] REPLICATION: finished
0831 19:54:46.343703 (+ 118us) write_op.cc:301] APPLY: starting
0831 19:54:46.343717 (+ 14us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:46.343765 (+ 48us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:46.343804 (+ 39us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:46.343933 (+ 129us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:46.343964 (+ 31us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0831 19:54:46.343974 (+ 10us) write_op.cc:312] APPLY: finished
0831 19:54:46.344051 (+ 77us) log.cc:844] Serialized 29 byte log entry
0831 19:54:46.344109 (+ 58us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:46.344126 (+ 17us) write_op.cc:454] Released schema lock
0831 19:54:46.344131 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0831 19:54:46.344212 (+ 81us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:46.344216 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":11851,"Hive Metastore.run_cpu_time_us":275,"Hive Metastore.run_wall_time_us":68822,"child_traces":[["op",{"apply.queue_time_us":73,"apply.run_cpu_time_us":483,"apply.run_wall_time_us":481,"num_ops":2,"prepare.queue_time_us":51,"prepare.run_cpu_time_us":709,"prepare.run_wall_time_us":710,"raft.queue_time_us":1067,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":226,"replication_time_us":2985}]]}
I20250831 19:54:46.347020 1903 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "011ffff51cf94c76968725fca7721182" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:54:46.347234 1903 raft_consensus.cc:3058] T 011ffff51cf94c76968725fca7721182 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:46.348968 2354 leader_election.cc:290] T 011ffff51cf94c76968725fca7721182 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Requested vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:46.352499 1903 raft_consensus.cc:2466] T 011ffff51cf94c76968725fca7721182 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1.
I20250831 19:54:46.352947 1568 leader_election.cc:304] T 011ffff51cf94c76968725fca7721182 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:54:46.353250 2354 raft_consensus.cc:2802] T 011ffff51cf94c76968725fca7721182 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:46.353624 2354 raft_consensus.cc:695] T 011ffff51cf94c76968725fca7721182 P 89aa85d59c53436ebdf3074b13d14825 [term 1 LEADER]: Becoming Leader. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Running, Role: LEADER
I20250831 19:54:46.354660 2354 consensus_queue.cc:237] T 011ffff51cf94c76968725fca7721182 P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:46.356325 1771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "011ffff51cf94c76968725fca7721182" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:46.356583 1771 raft_consensus.cc:2466] T 011ffff51cf94c76968725fca7721182 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 0.
I20250831 19:54:46.357057 2330 leader_election.cc:290] T 011ffff51cf94c76968725fca7721182 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:46.357518 1772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "011ffff51cf94c76968725fca7721182" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197"
I20250831 19:54:46.357708 1772 raft_consensus.cc:3058] T 011ffff51cf94c76968725fca7721182 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:46.360199 1750 tablet_service.cc:1468] Processing CreateTablet for tablet 73e83ccb99b643428aef635b8ea90f03 (DEFAULT_TABLE table=default.table_486ee0377a714038aaf8f3f5b1ad7f79 [id=028e873d141c4006aca7d45be88d9ae3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:46.360601 1750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73e83ccb99b643428aef635b8ea90f03. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:46.360890 1772 raft_consensus.cc:2466] T 011ffff51cf94c76968725fca7721182 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1.
I20250831 19:54:46.362639 2282 tablet_bootstrap.cc:492] T f94f30794d6143b1877dd45e589cfe76 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:46.365103 2303 raft_consensus.cc:491] T a50607b15c144326bcc2d40f5d3ff4ff P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:46.365273 2303 raft_consensus.cc:513] T a50607b15c144326bcc2d40f5d3ff4ff P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:46.366200 2303 leader_election.cc:290] T a50607b15c144326bcc2d40f5d3ff4ff P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:46.366729 1771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a50607b15c144326bcc2d40f5d3ff4ff" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:46.366871 2282 tablet_bootstrap.cc:654] T f94f30794d6143b1877dd45e589cfe76 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:46.366937 1771 raft_consensus.cc:2466] T a50607b15c144326bcc2d40f5d3ff4ff P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 0.
I20250831 19:54:46.367583 1634 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a50607b15c144326bcc2d40f5d3ff4ff" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:46.367762 1634 raft_consensus.cc:2466] T a50607b15c144326bcc2d40f5d3ff4ff P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 0.
I20250831 19:54:46.368170 1842 leader_election.cc:304] T a50607b15c144326bcc2d40f5d3ff4ff P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:46.368994 2303 raft_consensus.cc:2802] T a50607b15c144326bcc2d40f5d3ff4ff P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:46.369082 2303 raft_consensus.cc:491] T a50607b15c144326bcc2d40f5d3ff4ff P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:46.369172 2303 raft_consensus.cc:3058] T a50607b15c144326bcc2d40f5d3ff4ff P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:46.371670 2303 raft_consensus.cc:513] T a50607b15c144326bcc2d40f5d3ff4ff P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:46.373760 1613 tablet_service.cc:1468] Processing CreateTablet for tablet 73e83ccb99b643428aef635b8ea90f03 (DEFAULT_TABLE table=default.table_486ee0377a714038aaf8f3f5b1ad7f79 [id=028e873d141c4006aca7d45be88d9ae3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:46.374114 1613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73e83ccb99b643428aef635b8ea90f03. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:46.378358 1884 tablet_service.cc:1468] Processing CreateTablet for tablet 73e83ccb99b643428aef635b8ea90f03 (DEFAULT_TABLE table=default.table_486ee0377a714038aaf8f3f5b1ad7f79 [id=028e873d141c4006aca7d45be88d9ae3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:46.378536 2282 tablet_bootstrap.cc:492] T f94f30794d6143b1877dd45e589cfe76 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:46.378667 2282 ts_tablet_manager.cc:1397] T f94f30794d6143b1877dd45e589cfe76 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.016s user 0.001s sys 0.013s
I20250831 19:54:46.378698 1884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73e83ccb99b643428aef635b8ea90f03. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:46.379328 2282 raft_consensus.cc:357] T f94f30794d6143b1877dd45e589cfe76 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:46.379482 2282 raft_consensus.cc:383] T f94f30794d6143b1877dd45e589cfe76 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:46.379542 2282 raft_consensus.cc:738] T f94f30794d6143b1877dd45e589cfe76 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:46.379801 2282 consensus_queue.cc:260] T f94f30794d6143b1877dd45e589cfe76 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:46.380306 2282 ts_tablet_manager.cc:1428] T f94f30794d6143b1877dd45e589cfe76 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20250831 19:54:46.380565 2354 consensus_queue.cc:1035] T 2c2c52514c444ae382cd20d03c7ed456 P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:46.385952 1772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a50607b15c144326bcc2d40f5d3ff4ff" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197"
I20250831 19:54:46.386703 1772 raft_consensus.cc:3058] T a50607b15c144326bcc2d40f5d3ff4ff P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:46.389477 1772 raft_consensus.cc:2466] T a50607b15c144326bcc2d40f5d3ff4ff P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 1.
I20250831 19:54:46.389918 1842 leader_election.cc:304] T a50607b15c144326bcc2d40f5d3ff4ff P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:46.390159 2239 raft_consensus.cc:2802] T a50607b15c144326bcc2d40f5d3ff4ff P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:46.390283 2239 raft_consensus.cc:695] T a50607b15c144326bcc2d40f5d3ff4ff P 2441fafe1d62429386f4631ad423567d [term 1 LEADER]: Becoming Leader. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Running, Role: LEADER
I20250831 19:54:46.390491 2239 consensus_queue.cc:237] T a50607b15c144326bcc2d40f5d3ff4ff P 2441fafe1d62429386f4631ad423567d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:46.397326 1634 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a50607b15c144326bcc2d40f5d3ff4ff" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:54:46.397516 1634 raft_consensus.cc:3058] T a50607b15c144326bcc2d40f5d3ff4ff P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:46.400018 1634 raft_consensus.cc:2466] T a50607b15c144326bcc2d40f5d3ff4ff P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 1.
I20250831 19:54:46.402065 2303 leader_election.cc:290] T a50607b15c144326bcc2d40f5d3ff4ff P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 election: Requested vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:46.407737 2282 tablet_bootstrap.cc:492] T 73e83ccb99b643428aef635b8ea90f03 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:46.409365 2282 tablet_bootstrap.cc:654] T 73e83ccb99b643428aef635b8ea90f03 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:46.410645 2354 raft_consensus.cc:491] T 529eddf7703e4ddc87e974720404fdf3 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:46.410808 2354 raft_consensus.cc:513] T 529eddf7703e4ddc87e974720404fdf3 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:46.411526 2354 leader_election.cc:290] T 529eddf7703e4ddc87e974720404fdf3 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:46.412838 2284 tablet_bootstrap.cc:492] T 73e83ccb99b643428aef635b8ea90f03 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:46.412807 1904 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "529eddf7703e4ddc87e974720404fdf3" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:46.412987 1904 raft_consensus.cc:2466] T 529eddf7703e4ddc87e974720404fdf3 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 0.
I20250831 19:54:46.413354 1568 leader_election.cc:304] T 529eddf7703e4ddc87e974720404fdf3 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:54:46.413690 2354 raft_consensus.cc:2802] T 529eddf7703e4ddc87e974720404fdf3 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:46.413772 2354 raft_consensus.cc:491] T 529eddf7703e4ddc87e974720404fdf3 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:46.413879 2354 raft_consensus.cc:3058] T 529eddf7703e4ddc87e974720404fdf3 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:46.414752 2284 tablet_bootstrap.cc:654] T 73e83ccb99b643428aef635b8ea90f03 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:46.416551 2354 raft_consensus.cc:513] T 529eddf7703e4ddc87e974720404fdf3 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:46.417268 2283 tablet_bootstrap.cc:492] T 73e83ccb99b643428aef635b8ea90f03 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:46.417995 2328 raft_consensus.cc:491] T 2c2c52514c444ae382cd20d03c7ed456 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:46.418188 2328 raft_consensus.cc:513] T 2c2c52514c444ae382cd20d03c7ed456 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:46.418519 2354 leader_election.cc:290] T 529eddf7703e4ddc87e974720404fdf3 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Requested vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:46.418833 2283 tablet_bootstrap.cc:654] T 73e83ccb99b643428aef635b8ea90f03 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:46.418886 2328 leader_election.cc:290] T 2c2c52514c444ae382cd20d03c7ed456 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:46.419059 1772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "529eddf7703e4ddc87e974720404fdf3" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197"
I20250831 19:54:46.419358 1772 raft_consensus.cc:3058] T 529eddf7703e4ddc87e974720404fdf3 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:46.419478 1906 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2c2c52514c444ae382cd20d03c7ed456" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:46.419621 1904 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "529eddf7703e4ddc87e974720404fdf3" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:54:46.419744 1904 raft_consensus.cc:3058] T 529eddf7703e4ddc87e974720404fdf3 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:46.419797 1634 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2c2c52514c444ae382cd20d03c7ed456" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:46.420357 1706 leader_election.cc:304] T 2c2c52514c444ae382cd20d03c7ed456 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: de831f40fa1348a48a1f0260f4130197; no voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825
I20250831 19:54:46.420809 2328 raft_consensus.cc:2747] T 2c2c52514c444ae382cd20d03c7ed456 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250831 19:54:46.422814 1904 raft_consensus.cc:2466] T 529eddf7703e4ddc87e974720404fdf3 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1.
I20250831 19:54:46.423218 1771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "529eddf7703e4ddc87e974720404fdf3" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:46.424038 1568 leader_election.cc:304] T 529eddf7703e4ddc87e974720404fdf3 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:54:46.424710 2354 raft_consensus.cc:2802] T 529eddf7703e4ddc87e974720404fdf3 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:46.424899 2354 raft_consensus.cc:695] T 529eddf7703e4ddc87e974720404fdf3 P 89aa85d59c53436ebdf3074b13d14825 [term 1 LEADER]: Becoming Leader. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Running, Role: LEADER
I20250831 19:54:46.426285 2354 consensus_queue.cc:237] T 529eddf7703e4ddc87e974720404fdf3 P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:46.429879 1772 raft_consensus.cc:2466] T 529eddf7703e4ddc87e974720404fdf3 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1.
I20250831 19:54:46.431265 2121 catalog_manager.cc:5582] T 011ffff51cf94c76968725fca7721182 P 89aa85d59c53436ebdf3074b13d14825 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193). New cstate: current_term: 1 leader_uuid: "89aa85d59c53436ebdf3074b13d14825" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: HEALTHY } } }
I20250831 19:54:46.438256 2282 tablet_bootstrap.cc:492] T 73e83ccb99b643428aef635b8ea90f03 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:46.439400 2284 tablet_bootstrap.cc:492] T 73e83ccb99b643428aef635b8ea90f03 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:46.439766 2282 ts_tablet_manager.cc:1397] T 73e83ccb99b643428aef635b8ea90f03 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.032s user 0.009s sys 0.005s
I20250831 19:54:46.440579 2284 ts_tablet_manager.cc:1397] T 73e83ccb99b643428aef635b8ea90f03 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.028s user 0.006s sys 0.008s
I20250831 19:54:46.441568 2284 raft_consensus.cc:357] T 73e83ccb99b643428aef635b8ea90f03 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:46.442526 2282 raft_consensus.cc:357] T 73e83ccb99b643428aef635b8ea90f03 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:46.442816 2282 raft_consensus.cc:383] T 73e83ccb99b643428aef635b8ea90f03 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:46.442960 2282 raft_consensus.cc:738] T 73e83ccb99b643428aef635b8ea90f03 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:46.443090 2284 raft_consensus.cc:383] T 73e83ccb99b643428aef635b8ea90f03 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:46.445303 2284 raft_consensus.cc:738] T 73e83ccb99b643428aef635b8ea90f03 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:46.445484 2282 consensus_queue.cc:260] T 73e83ccb99b643428aef635b8ea90f03 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:46.445861 2284 consensus_queue.cc:260] T 73e83ccb99b643428aef635b8ea90f03 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:46.447669 2282 ts_tablet_manager.cc:1428] T 73e83ccb99b643428aef635b8ea90f03 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20250831 19:54:46.448129 2284 ts_tablet_manager.cc:1428] T 73e83ccb99b643428aef635b8ea90f03 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20250831 19:54:46.448180 2121 catalog_manager.cc:5582] T 6eda2f28ef194cba81661fbf080c5883 P de831f40fa1348a48a1f0260f4130197 reported cstate change: term changed from 0 to 1, leader changed from <none> to de831f40fa1348a48a1f0260f4130197 (127.1.1.194). New cstate: current_term: 1 leader_uuid: "de831f40fa1348a48a1f0260f4130197" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: HEALTHY } } }
I20250831 19:54:46.449966 2283 tablet_bootstrap.cc:492] T 73e83ccb99b643428aef635b8ea90f03 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:46.450107 2283 ts_tablet_manager.cc:1397] T 73e83ccb99b643428aef635b8ea90f03 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.033s user 0.009s sys 0.000s
I20250831 19:54:46.450877 2283 raft_consensus.cc:357] T 73e83ccb99b643428aef635b8ea90f03 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:46.451071 2283 raft_consensus.cc:383] T 73e83ccb99b643428aef635b8ea90f03 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:46.451151 2283 raft_consensus.cc:738] T 73e83ccb99b643428aef635b8ea90f03 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:46.451400 2283 consensus_queue.cc:260] T 73e83ccb99b643428aef635b8ea90f03 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:46.451929 2283 ts_tablet_manager.cc:1428] T 73e83ccb99b643428aef635b8ea90f03 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250831 19:54:46.456677 2239 raft_consensus.cc:491] T 5aa2af1f691a4fa0945d81ba94e03052 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:46.456888 2239 raft_consensus.cc:513] T 5aa2af1f691a4fa0945d81ba94e03052 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:46.457818 1634 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5aa2af1f691a4fa0945d81ba94e03052" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:46.458000 1634 raft_consensus.cc:2466] T 5aa2af1f691a4fa0945d81ba94e03052 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 0.
I20250831 19:54:46.458464 1841 leader_election.cc:304] T 5aa2af1f691a4fa0945d81ba94e03052 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:54:46.458727 2303 raft_consensus.cc:2802] T 5aa2af1f691a4fa0945d81ba94e03052 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:46.458823 2303 raft_consensus.cc:491] T 5aa2af1f691a4fa0945d81ba94e03052 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:46.458902 2303 raft_consensus.cc:3058] T 5aa2af1f691a4fa0945d81ba94e03052 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:46.458993 2120 catalog_manager.cc:2149] created HMS catalog entry for table [id=fe4053cd15a840d5b74f86e7894ea85e]
I20250831 19:54:46.459302 2239 leader_election.cc:290] T 5aa2af1f691a4fa0945d81ba94e03052 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
W20250831 19:54:46.464412 2125 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_bced462d6a2a4c929f51cfe29e54fe75 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250831 19:54:46.464552 2124 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_696724b65868432da5cd0914cbbf40a3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250831 19:54:46.464797 2126 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_2cfa6cbcf8244da6b6468895fd9e31cc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250831 19:54:46.466769 1772 raft_consensus.cc:3058] T 2c2c52514c444ae382cd20d03c7ed456 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:46.470405 2354 consensus_queue.cc:1035] T 2c2c52514c444ae382cd20d03c7ed456 P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:46.474928 1771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5aa2af1f691a4fa0945d81ba94e03052" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:46.475109 1771 raft_consensus.cc:2466] T 5aa2af1f691a4fa0945d81ba94e03052 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 0.
I20250831 19:54:46.475566 2120 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:36958 (request call id 32) took 1212 ms. Trace:
I20250831 19:54:46.475828 2303 raft_consensus.cc:513] T 5aa2af1f691a4fa0945d81ba94e03052 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:46.475688 2120 rpcz_store.cc:276] 0831 19:54:45.262889 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:45.930968 (+668079us) service_pool.cc:225] Handling call
0831 19:54:46.258923 (+327955us) catalog_manager.cc:2076] Acquired catalog manager lock
0831 19:54:46.259387 (+ 464us) catalog_manager.cc:2122] Created new table and tablet info
0831 19:54:46.458922 (+199535us) catalog_manager.cc:2148] Created new table in HMS catalog
0831 19:54:46.475259 (+ 16337us) catalog_manager.cc:2182] Wrote table and tablets to system table
0831 19:54:46.475404 (+ 145us) catalog_manager.cc:2216] Inserted table and tablets into CatalogManager maps
0831 19:54:46.475517 (+ 113us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:46.467176 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:46.467278 (+ 102us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:46.467284 (+ 6us) write_op.cc:435] Acquired schema lock
0831 19:54:46.467288 (+ 4us) tablet.cc:660] Decoding operations
0831 19:54:46.467375 (+ 87us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:46.467387 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:46.467394 (+ 7us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:46.467470 (+ 76us) tablet.cc:699] Row locks acquired
0831 19:54:46.467474 (+ 4us) write_op.cc:260] PREPARE: finished
0831 19:54:46.467542 (+ 68us) write_op.cc:270] Start()
0831 19:54:46.467572 (+ 30us) write_op.cc:276] Timestamp: P: 1756670086467476 usec, L: 0
0831 19:54:46.467577 (+ 5us) op_driver.cc:348] REPLICATION: starting
0831 19:54:46.467765 (+ 188us) log.cc:844] Serialized 433 byte log entry
0831 19:54:46.473363 (+ 5598us) op_driver.cc:464] REPLICATION: finished
0831 19:54:46.473516 (+ 153us) write_op.cc:301] APPLY: starting
0831 19:54:46.474631 (+ 1115us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:46.474684 (+ 53us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:46.474715 (+ 31us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:46.474854 (+ 139us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:46.474896 (+ 42us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0831 19:54:46.474907 (+ 11us) write_op.cc:312] APPLY: finished
0831 19:54:46.474983 (+ 76us) log.cc:844] Serialized 29 byte log entry
0831 19:54:46.475047 (+ 64us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:46.475069 (+ 22us) write_op.cc:454] Released schema lock
0831 19:54:46.475076 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0831 19:54:46.475151 (+ 75us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:46.475157 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":79731,"Hive Metastore.run_cpu_time_us":250,"Hive Metastore.run_wall_time_us":119540,"child_traces":[["op",{"apply.queue_time_us":112,"apply.run_cpu_time_us":548,"apply.run_wall_time_us":1623,"num_ops":2,"prepare.queue_time_us":7675,"prepare.run_cpu_time_us":683,"prepare.run_wall_time_us":683,"raft.queue_time_us":59,"raft.run_cpu_time_us":4,"raft.run_wall_time_us":4,"replication_time_us":5762}]]}
I20250831 19:54:46.476552 2303 leader_election.cc:290] T 5aa2af1f691a4fa0945d81ba94e03052 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 election: Requested vote from peers 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:46.477670 2328 raft_consensus.cc:491] T 73e83ccb99b643428aef635b8ea90f03 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:46.477856 1634 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5aa2af1f691a4fa0945d81ba94e03052" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:54:46.477869 2328 raft_consensus.cc:513] T 73e83ccb99b643428aef635b8ea90f03 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:46.478014 1634 raft_consensus.cc:3058] T 5aa2af1f691a4fa0945d81ba94e03052 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:46.477861 2120 catalog_manager.cc:5582] T 529eddf7703e4ddc87e974720404fdf3 P 89aa85d59c53436ebdf3074b13d14825 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193). New cstate: current_term: 1 leader_uuid: "89aa85d59c53436ebdf3074b13d14825" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: HEALTHY } } }
I20250831 19:54:46.478421 2328 leader_election.cc:290] T 73e83ccb99b643428aef635b8ea90f03 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197), 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237)
I20250831 19:54:46.479292 1903 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "73e83ccb99b643428aef635b8ea90f03" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:46.479454 1903 raft_consensus.cc:2466] T 73e83ccb99b643428aef635b8ea90f03 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 0.
I20250831 19:54:46.479982 1705 leader_election.cc:304] T 73e83ccb99b643428aef635b8ea90f03 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:46.480310 2328 raft_consensus.cc:2802] T 73e83ccb99b643428aef635b8ea90f03 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:46.480441 2328 raft_consensus.cc:491] T 73e83ccb99b643428aef635b8ea90f03 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:46.480538 1634 raft_consensus.cc:2466] T 5aa2af1f691a4fa0945d81ba94e03052 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 1.
I20250831 19:54:46.480571 2328 raft_consensus.cc:3058] T 73e83ccb99b643428aef635b8ea90f03 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:46.480842 1633 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "73e83ccb99b643428aef635b8ea90f03" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:46.481016 1633 raft_consensus.cc:2466] T 73e83ccb99b643428aef635b8ea90f03 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 0.
I20250831 19:54:46.481648 1841 leader_election.cc:304] T 5aa2af1f691a4fa0945d81ba94e03052 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:54:46.482398 2303 raft_consensus.cc:2802] T 5aa2af1f691a4fa0945d81ba94e03052 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:46.482666 2303 raft_consensus.cc:695] T 5aa2af1f691a4fa0945d81ba94e03052 P 2441fafe1d62429386f4631ad423567d [term 1 LEADER]: Becoming Leader. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Running, Role: LEADER
I20250831 19:54:46.483228 1771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5aa2af1f691a4fa0945d81ba94e03052" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197"
I20250831 19:54:46.483379 1771 raft_consensus.cc:3058] T 5aa2af1f691a4fa0945d81ba94e03052 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:46.484025 2303 consensus_queue.cc:237] T 5aa2af1f691a4fa0945d81ba94e03052 P 2441fafe1d62429386f4631ad423567d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:46.484658 2328 raft_consensus.cc:513] T 73e83ccb99b643428aef635b8ea90f03 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:46.485685 1633 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "73e83ccb99b643428aef635b8ea90f03" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:54:46.485836 1633 raft_consensus.cc:3058] T 73e83ccb99b643428aef635b8ea90f03 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:46.486157 2328 leader_election.cc:290] T 73e83ccb99b643428aef635b8ea90f03 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Requested vote from peers 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197), 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237)
I20250831 19:54:46.486625 1904 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "73e83ccb99b643428aef635b8ea90f03" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:54:46.486819 1904 raft_consensus.cc:3058] T 73e83ccb99b643428aef635b8ea90f03 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:46.488200 1633 raft_consensus.cc:2466] T 73e83ccb99b643428aef635b8ea90f03 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:54:46.490442 1706 leader_election.cc:304] T 73e83ccb99b643428aef635b8ea90f03 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:46.491175 1904 raft_consensus.cc:2466] T 73e83ccb99b643428aef635b8ea90f03 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:54:46.497092 2328 raft_consensus.cc:2802] T 73e83ccb99b643428aef635b8ea90f03 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:46.497632 2328 raft_consensus.cc:695] T 73e83ccb99b643428aef635b8ea90f03 P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: Becoming Leader. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Running, Role: LEADER
I20250831 19:54:46.498047 2328 consensus_queue.cc:237] T 73e83ccb99b643428aef635b8ea90f03 P de831f40fa1348a48a1f0260f4130197 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:46.498775 2120 catalog_manager.cc:5582] T a50607b15c144326bcc2d40f5d3ff4ff P 2441fafe1d62429386f4631ad423567d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2441fafe1d62429386f4631ad423567d (127.1.1.195). New cstate: current_term: 1 leader_uuid: "2441fafe1d62429386f4631ad423567d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: UNKNOWN } } }
I20250831 19:54:46.501215 2120 catalog_manager.cc:5674] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237) does not have the latest schema for tablet a50607b15c144326bcc2d40f5d3ff4ff (table default.table_87fbe752a7a54c9eaa7536ba0e611919 [id=8e6395b817aa4efc955cf0ed00f54e14]). Expected version 1 got 0
I20250831 19:54:46.504017 1771 raft_consensus.cc:2466] T 5aa2af1f691a4fa0945d81ba94e03052 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 1.
I20250831 19:54:46.523581 1884 tablet_service.cc:1468] Processing CreateTablet for tablet b6eee4e23718478cb107ddbcae2bbec2 (DEFAULT_TABLE table=default.table_1ca0a7f3c33945bd902a63ca09aa62ad [id=fe4053cd15a840d5b74f86e7894ea85e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:46.524029 1884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6eee4e23718478cb107ddbcae2bbec2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:46.525815 1613 tablet_service.cc:1468] Processing CreateTablet for tablet b6eee4e23718478cb107ddbcae2bbec2 (DEFAULT_TABLE table=default.table_1ca0a7f3c33945bd902a63ca09aa62ad [id=fe4053cd15a840d5b74f86e7894ea85e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:46.526265 1613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6eee4e23718478cb107ddbcae2bbec2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:46.530066 1750 tablet_service.cc:1468] Processing CreateTablet for tablet b6eee4e23718478cb107ddbcae2bbec2 (DEFAULT_TABLE table=default.table_1ca0a7f3c33945bd902a63ca09aa62ad [id=fe4053cd15a840d5b74f86e7894ea85e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:46.530494 1750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6eee4e23718478cb107ddbcae2bbec2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:46.540561 2283 tablet_bootstrap.cc:492] T b6eee4e23718478cb107ddbcae2bbec2 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:46.542279 2283 tablet_bootstrap.cc:654] T b6eee4e23718478cb107ddbcae2bbec2 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:46.550257 2282 tablet_bootstrap.cc:492] T b6eee4e23718478cb107ddbcae2bbec2 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:46.550551 2283 tablet_bootstrap.cc:492] T b6eee4e23718478cb107ddbcae2bbec2 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:46.550721 2283 ts_tablet_manager.cc:1397] T b6eee4e23718478cb107ddbcae2bbec2 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.006s
I20250831 19:54:46.551507 2283 raft_consensus.cc:357] T b6eee4e23718478cb107ddbcae2bbec2 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:46.551729 2283 raft_consensus.cc:383] T b6eee4e23718478cb107ddbcae2bbec2 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:46.551834 2283 raft_consensus.cc:738] T b6eee4e23718478cb107ddbcae2bbec2 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:46.551856 2282 tablet_bootstrap.cc:654] T b6eee4e23718478cb107ddbcae2bbec2 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:46.552134 2283 consensus_queue.cc:260] T b6eee4e23718478cb107ddbcae2bbec2 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:46.553728 2283 ts_tablet_manager.cc:1428] T b6eee4e23718478cb107ddbcae2bbec2 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20250831 19:54:46.559005 2284 tablet_bootstrap.cc:492] T b6eee4e23718478cb107ddbcae2bbec2 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:46.560578 2284 tablet_bootstrap.cc:654] T b6eee4e23718478cb107ddbcae2bbec2 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:46.562707 2120 catalog_manager.cc:5582] T 5aa2af1f691a4fa0945d81ba94e03052 P 2441fafe1d62429386f4631ad423567d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2441fafe1d62429386f4631ad423567d (127.1.1.195). New cstate: current_term: 1 leader_uuid: "2441fafe1d62429386f4631ad423567d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: UNKNOWN } } }
I20250831 19:54:46.563284 2121 master_service.cc:948] ReplaceTablet: received request to replace tablet 2c2c52514c444ae382cd20d03c7ed456 from {username='slave'} at 127.0.0.1:36958
I20250831 19:54:46.586058 2121 catalog_manager.cc:5869] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Sending DeleteTablet for 3 replicas of tablet 2c2c52514c444ae382cd20d03c7ed456
I20250831 19:54:46.587117 1884 tablet_service.cc:1515] Processing DeleteTablet for tablet 2c2c52514c444ae382cd20d03c7ed456 with delete_type TABLET_DATA_DELETED (replaced by tablet 1d5b0a02e35648ec966393f32065d6ee) from {username='slave'} at 127.0.0.1:45906
I20250831 19:54:46.587846 2419 tablet_replica.cc:331] T 2c2c52514c444ae382cd20d03c7ed456 P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:54:46.588219 1750 tablet_service.cc:1515] Processing DeleteTablet for tablet 2c2c52514c444ae382cd20d03c7ed456 with delete_type TABLET_DATA_DELETED (replaced by tablet 1d5b0a02e35648ec966393f32065d6ee) from {username='slave'} at 127.0.0.1:50674
I20250831 19:54:46.588553 2419 raft_consensus.cc:2241] T 2c2c52514c444ae382cd20d03c7ed456 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:46.588992 2419 raft_consensus.cc:2270] T 2c2c52514c444ae382cd20d03c7ed456 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:46.589169 1613 tablet_service.cc:1515] Processing DeleteTablet for tablet 2c2c52514c444ae382cd20d03c7ed456 with delete_type TABLET_DATA_DELETED (replaced by tablet 1d5b0a02e35648ec966393f32065d6ee) from {username='slave'} at 127.0.0.1:51022
I20250831 19:54:46.589751 2421 tablet_replica.cc:331] T 2c2c52514c444ae382cd20d03c7ed456 P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:54:46.589987 2421 raft_consensus.cc:2241] T 2c2c52514c444ae382cd20d03c7ed456 P 89aa85d59c53436ebdf3074b13d14825 [term 1 LEADER]: Raft consensus shutting down.
I20250831 19:54:46.590392 2421 raft_consensus.cc:2270] T 2c2c52514c444ae382cd20d03c7ed456 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:46.591166 2419 ts_tablet_manager.cc:1905] T 2c2c52514c444ae382cd20d03c7ed456 P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:46.592223 2421 ts_tablet_manager.cc:1905] T 2c2c52514c444ae382cd20d03c7ed456 P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:46.593928 2121 catalog_manager.cc:6652] ReplaceTablet: tablet 2c2c52514c444ae382cd20d03c7ed456 deleted and replaced by tablet 1d5b0a02e35648ec966393f32065d6ee
I20250831 19:54:46.598675 1752 tablet_service.cc:1468] Processing CreateTablet for tablet 1d5b0a02e35648ec966393f32065d6ee (DEFAULT_TABLE table=default.table_40da3badb9e84e4990e6171bd0dbe8ac [id=115e02286266464593ead506a011b5a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:46.599105 1752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d5b0a02e35648ec966393f32065d6ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:46.603229 2419 ts_tablet_manager.cc:1918] T 2c2c52514c444ae382cd20d03c7ed456 P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:46.606274 1613 tablet_service.cc:1468] Processing CreateTablet for tablet 1d5b0a02e35648ec966393f32065d6ee (DEFAULT_TABLE table=default.table_40da3badb9e84e4990e6171bd0dbe8ac [id=115e02286266464593ead506a011b5a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:46.606709 1613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d5b0a02e35648ec966393f32065d6ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:46.608981 2421 ts_tablet_manager.cc:1918] T 2c2c52514c444ae382cd20d03c7ed456 P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:46.605871 1884 tablet_service.cc:1468] Processing CreateTablet for tablet 1d5b0a02e35648ec966393f32065d6ee (DEFAULT_TABLE table=default.table_40da3badb9e84e4990e6171bd0dbe8ac [id=115e02286266464593ead506a011b5a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:46.610383 1884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d5b0a02e35648ec966393f32065d6ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:46.611516 2123 catalog_manager.cc:3460] renamed table default.table_f8db9b89d5e148b5ba271e3a17ff89b4 [id=ad7bb166843e423ea7e50a1d18710fa1] in HMS: new name default.table_26f70c27ca284c39a6201e33337404a9
I20250831 19:54:46.612636 2120 catalog_manager.cc:5582] T 73e83ccb99b643428aef635b8ea90f03 P de831f40fa1348a48a1f0260f4130197 reported cstate change: term changed from 0 to 1, leader changed from <none> to de831f40fa1348a48a1f0260f4130197 (127.1.1.194). New cstate: current_term: 1 leader_uuid: "de831f40fa1348a48a1f0260f4130197" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: HEALTHY } } }
I20250831 19:54:46.616262 2283 tablet_bootstrap.cc:492] T 1d5b0a02e35648ec966393f32065d6ee P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:46.618005 2121 master_service.cc:948] ReplaceTablet: received request to replace tablet e6b57e7935ac4fc5b1b3fff2e9d775b4 from {username='slave'} at 127.0.0.1:36958
I20250831 19:54:46.618127 2283 tablet_bootstrap.cc:654] T 1d5b0a02e35648ec966393f32065d6ee P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:46.619446 2284 tablet_bootstrap.cc:492] T b6eee4e23718478cb107ddbcae2bbec2 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:46.619616 2284 ts_tablet_manager.cc:1397] T b6eee4e23718478cb107ddbcae2bbec2 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.061s user 0.005s sys 0.003s
I20250831 19:54:46.620044 2303 consensus_queue.cc:1035] T 07a9cd92870045a7a3e5a8b007bf7f47 P 2441fafe1d62429386f4631ad423567d [LEADER]: Connected to new peer: Peer: permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:46.620543 2284 raft_consensus.cc:357] T b6eee4e23718478cb107ddbcae2bbec2 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:46.620785 2284 raft_consensus.cc:383] T b6eee4e23718478cb107ddbcae2bbec2 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:46.620877 2284 raft_consensus.cc:738] T b6eee4e23718478cb107ddbcae2bbec2 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:46.621170 2284 consensus_queue.cc:260] T b6eee4e23718478cb107ddbcae2bbec2 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:46.626051 2284 ts_tablet_manager.cc:1428] T b6eee4e23718478cb107ddbcae2bbec2 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20250831 19:54:46.626410 2284 tablet_bootstrap.cc:492] T 1d5b0a02e35648ec966393f32065d6ee P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:46.628264 2284 tablet_bootstrap.cc:654] T 1d5b0a02e35648ec966393f32065d6ee P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:46.629326 2419 log.cc:1199] T 2c2c52514c444ae382cd20d03c7ed456 P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/2c2c52514c444ae382cd20d03c7ed456
I20250831 19:54:46.630087 2419 ts_tablet_manager.cc:1939] T 2c2c52514c444ae382cd20d03c7ed456 P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:54:46.630606 2421 log.cc:1199] T 2c2c52514c444ae382cd20d03c7ed456 P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/2c2c52514c444ae382cd20d03c7ed456
I20250831 19:54:46.631477 2421 ts_tablet_manager.cc:1939] T 2c2c52514c444ae382cd20d03c7ed456 P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
I20250831 19:54:46.635703 2101 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet 2c2c52514c444ae382cd20d03c7ed456 (table default.table_40da3badb9e84e4990e6171bd0dbe8ac [id=115e02286266464593ead506a011b5a0]) successfully deleted
I20250831 19:54:46.636298 2104 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet 2c2c52514c444ae382cd20d03c7ed456 (table default.table_40da3badb9e84e4990e6171bd0dbe8ac [id=115e02286266464593ead506a011b5a0]) successfully deleted
I20250831 19:54:46.645419 2302 consensus_queue.cc:1035] T 07a9cd92870045a7a3e5a8b007bf7f47 P 2441fafe1d62429386f4631ad423567d [LEADER]: Connected to new peer: Peer: permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:46.672547 2121 catalog_manager.cc:5869] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Sending DeleteTablet for 3 replicas of tablet e6b57e7935ac4fc5b1b3fff2e9d775b4
I20250831 19:54:46.673987 1752 tablet_service.cc:1515] Processing DeleteTablet for tablet e6b57e7935ac4fc5b1b3fff2e9d775b4 with delete_type TABLET_DATA_DELETED (replaced by tablet a7a0312d22284f15a68d90f6e8cd7920) from {username='slave'} at 127.0.0.1:50674
I20250831 19:54:46.676546 1884 tablet_service.cc:1515] Processing DeleteTablet for tablet e6b57e7935ac4fc5b1b3fff2e9d775b4 with delete_type TABLET_DATA_DELETED (replaced by tablet a7a0312d22284f15a68d90f6e8cd7920) from {username='slave'} at 127.0.0.1:45906
I20250831 19:54:46.676842 2419 tablet_replica.cc:331] T e6b57e7935ac4fc5b1b3fff2e9d775b4 P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:54:46.677081 2419 raft_consensus.cc:2241] T e6b57e7935ac4fc5b1b3fff2e9d775b4 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:46.677251 2419 raft_consensus.cc:2270] T e6b57e7935ac4fc5b1b3fff2e9d775b4 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:46.677819 2419 ts_tablet_manager.cc:1905] T e6b57e7935ac4fc5b1b3fff2e9d775b4 P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:46.679332 2302 raft_consensus.cc:491] T b6eee4e23718478cb107ddbcae2bbec2 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:46.679486 2302 raft_consensus.cc:513] T b6eee4e23718478cb107ddbcae2bbec2 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:46.680131 2302 leader_election.cc:290] T b6eee4e23718478cb107ddbcae2bbec2 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:46.681100 1772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b6eee4e23718478cb107ddbcae2bbec2" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:46.681298 1772 raft_consensus.cc:2466] T b6eee4e23718478cb107ddbcae2bbec2 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 0.
I20250831 19:54:46.681967 1633 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b6eee4e23718478cb107ddbcae2bbec2" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:46.682791 1842 leader_election.cc:304] T b6eee4e23718478cb107ddbcae2bbec2 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters:
W20250831 19:54:46.683573 1841 leader_election.cc:343] T b6eee4e23718478cb107ddbcae2bbec2 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): Illegal state: must be running to vote when last-logged opid is not known
I20250831 19:54:46.683817 2419 ts_tablet_manager.cc:1918] T e6b57e7935ac4fc5b1b3fff2e9d775b4 P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20250831 19:54:46.683946 2419 log.cc:1199] T e6b57e7935ac4fc5b1b3fff2e9d775b4 P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/e6b57e7935ac4fc5b1b3fff2e9d775b4
I20250831 19:54:46.684190 2302 raft_consensus.cc:2802] T b6eee4e23718478cb107ddbcae2bbec2 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:46.684278 2302 raft_consensus.cc:491] T b6eee4e23718478cb107ddbcae2bbec2 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:46.684343 2419 ts_tablet_manager.cc:1939] T e6b57e7935ac4fc5b1b3fff2e9d775b4 P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:54:46.684377 2302 raft_consensus.cc:3058] T b6eee4e23718478cb107ddbcae2bbec2 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:46.684828 1614 tablet_service.cc:1468] Processing CreateTablet for tablet a7a0312d22284f15a68d90f6e8cd7920 (DEFAULT_TABLE table=default.table_179225213b4a45978264479432550f67 [id=bd456415108d49989ef0bc2af91eb2f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:46.685200 1614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7a0312d22284f15a68d90f6e8cd7920. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:46.685326 1752 tablet_service.cc:1468] Processing CreateTablet for tablet a7a0312d22284f15a68d90f6e8cd7920 (DEFAULT_TABLE table=default.table_179225213b4a45978264479432550f67 [id=bd456415108d49989ef0bc2af91eb2f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:46.685703 1752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7a0312d22284f15a68d90f6e8cd7920. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:46.686793 2302 raft_consensus.cc:513] T b6eee4e23718478cb107ddbcae2bbec2 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:46.687835 1772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b6eee4e23718478cb107ddbcae2bbec2" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197"
I20250831 19:54:46.688015 1772 raft_consensus.cc:3058] T b6eee4e23718478cb107ddbcae2bbec2 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:46.689716 1884 tablet_service.cc:1468] Processing CreateTablet for tablet a7a0312d22284f15a68d90f6e8cd7920 (DEFAULT_TABLE table=default.table_179225213b4a45978264479432550f67 [id=bd456415108d49989ef0bc2af91eb2f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:46.690052 1884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7a0312d22284f15a68d90f6e8cd7920. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:46.690524 1772 raft_consensus.cc:2466] T b6eee4e23718478cb107ddbcae2bbec2 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 1.
I20250831 19:54:46.691012 1842 leader_election.cc:304] T b6eee4e23718478cb107ddbcae2bbec2 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:46.691362 2239 raft_consensus.cc:2802] T b6eee4e23718478cb107ddbcae2bbec2 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:46.691543 2239 raft_consensus.cc:695] T b6eee4e23718478cb107ddbcae2bbec2 P 2441fafe1d62429386f4631ad423567d [term 1 LEADER]: Becoming Leader. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Running, Role: LEADER
I20250831 19:54:46.691592 1613 tablet_service.cc:1515] Processing DeleteTablet for tablet e6b57e7935ac4fc5b1b3fff2e9d775b4 with delete_type TABLET_DATA_DELETED (replaced by tablet a7a0312d22284f15a68d90f6e8cd7920) from {username='slave'} at 127.0.0.1:51022
I20250831 19:54:46.691792 2239 consensus_queue.cc:237] T b6eee4e23718478cb107ddbcae2bbec2 P 2441fafe1d62429386f4631ad423567d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:46.692143 2121 catalog_manager.cc:6652] ReplaceTablet: tablet e6b57e7935ac4fc5b1b3fff2e9d775b4 deleted and replaced by tablet a7a0312d22284f15a68d90f6e8cd7920
I20250831 19:54:46.692272 2121 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:36958 (request call id 43) took 1053 ms. Trace:
I20250831 19:54:46.692354 2121 rpcz_store.cc:276] 0831 19:54:45.638598 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:46.617909 (+979311us) service_pool.cc:225] Handling call
0831 19:54:46.672216 (+ 54307us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:46.672223 (+ 7us) write_op.cc:454] Released schema lock
0831 19:54:46.692245 (+ 20022us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:46.662987 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:46.663132 (+ 145us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:46.663139 (+ 7us) write_op.cc:435] Acquired schema lock
0831 19:54:46.663144 (+ 5us) tablet.cc:660] Decoding operations
0831 19:54:46.663289 (+ 145us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:46.663305 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:46.663312 (+ 7us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:46.663406 (+ 94us) tablet.cc:699] Row locks acquired
0831 19:54:46.663411 (+ 5us) write_op.cc:260] PREPARE: finished
0831 19:54:46.663446 (+ 35us) write_op.cc:270] Start()
0831 19:54:46.663482 (+ 36us) write_op.cc:276] Timestamp: P: 1756670086663377 usec, L: 0
0831 19:54:46.663487 (+ 5us) op_driver.cc:348] REPLICATION: starting
0831 19:54:46.663678 (+ 191us) log.cc:844] Serialized 656 byte log entry
0831 19:54:46.667395 (+ 3717us) op_driver.cc:464] REPLICATION: finished
0831 19:54:46.667627 (+ 232us) write_op.cc:301] APPLY: starting
0831 19:54:46.667644 (+ 17us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:46.667694 (+ 50us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:46.667731 (+ 37us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:46.667879 (+ 148us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:46.667940 (+ 61us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0831 19:54:46.667950 (+ 10us) write_op.cc:312] APPLY: finished
0831 19:54:46.668029 (+ 79us) log.cc:844] Serialized 29 byte log entry
0831 19:54:46.668089 (+ 60us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:46.668111 (+ 22us) write_op.cc:454] Released schema lock
0831 19:54:46.668118 (+ 7us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":171,"apply.run_cpu_time_us":548,"apply.run_wall_time_us":548,"num_ops":2,"prepare.queue_time_us":51,"prepare.run_cpu_time_us":834,"prepare.run_wall_time_us":1180,"raft.queue_time_us":118,"raft.run_cpu_time_us":274,"raft.run_wall_time_us":275,"replication_time_us":3876}]]}
I20250831 19:54:46.693591 2421 tablet_replica.cc:331] T e6b57e7935ac4fc5b1b3fff2e9d775b4 P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:54:46.693800 2421 raft_consensus.cc:2241] T e6b57e7935ac4fc5b1b3fff2e9d775b4 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:46.693961 2284 tablet_bootstrap.cc:492] T 1d5b0a02e35648ec966393f32065d6ee P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:46.694020 2421 raft_consensus.cc:2270] T e6b57e7935ac4fc5b1b3fff2e9d775b4 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:46.694110 2284 ts_tablet_manager.cc:1397] T 1d5b0a02e35648ec966393f32065d6ee P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.068s user 0.004s sys 0.004s
I20250831 19:54:46.694609 2421 ts_tablet_manager.cc:1905] T e6b57e7935ac4fc5b1b3fff2e9d775b4 P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:46.694720 1633 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b6eee4e23718478cb107ddbcae2bbec2" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:54:46.694850 2284 raft_consensus.cc:357] T 1d5b0a02e35648ec966393f32065d6ee P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:46.695000 2284 raft_consensus.cc:383] T 1d5b0a02e35648ec966393f32065d6ee P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:46.695078 2284 raft_consensus.cc:738] T 1d5b0a02e35648ec966393f32065d6ee P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
W20250831 19:54:46.695351 1841 leader_election.cc:343] T b6eee4e23718478cb107ddbcae2bbec2 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): Illegal state: must be running to vote when last-logged opid is not known
I20250831 19:54:46.695505 2420 tablet_replica.cc:331] T 2c2c52514c444ae382cd20d03c7ed456 P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:54:46.695612 2302 leader_election.cc:290] T b6eee4e23718478cb107ddbcae2bbec2 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 election: Requested vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:46.695681 2420 raft_consensus.cc:2241] T 2c2c52514c444ae382cd20d03c7ed456 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:46.695856 2420 raft_consensus.cc:2270] T 2c2c52514c444ae382cd20d03c7ed456 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:46.697888 2420 ts_tablet_manager.cc:1905] T 2c2c52514c444ae382cd20d03c7ed456 P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:46.699970 2421 ts_tablet_manager.cc:1918] T e6b57e7935ac4fc5b1b3fff2e9d775b4 P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20250831 19:54:46.700090 2421 log.cc:1199] T e6b57e7935ac4fc5b1b3fff2e9d775b4 P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/e6b57e7935ac4fc5b1b3fff2e9d775b4
I20250831 19:54:46.700430 2421 ts_tablet_manager.cc:1939] T e6b57e7935ac4fc5b1b3fff2e9d775b4 P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
I20250831 19:54:46.701458 2104 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet e6b57e7935ac4fc5b1b3fff2e9d775b4 (table default.table_179225213b4a45978264479432550f67 [id=bd456415108d49989ef0bc2af91eb2f0]) successfully deleted
I20250831 19:54:46.701956 2284 consensus_queue.cc:260] T 1d5b0a02e35648ec966393f32065d6ee P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:46.705073 2284 ts_tablet_manager.cc:1428] T 1d5b0a02e35648ec966393f32065d6ee P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20250831 19:54:46.708918 2101 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet e6b57e7935ac4fc5b1b3fff2e9d775b4 (table default.table_179225213b4a45978264479432550f67 [id=bd456415108d49989ef0bc2af91eb2f0]) successfully deleted
I20250831 19:54:46.710916 2282 tablet_bootstrap.cc:492] T b6eee4e23718478cb107ddbcae2bbec2 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:46.711136 2282 ts_tablet_manager.cc:1397] T b6eee4e23718478cb107ddbcae2bbec2 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.161s user 0.015s sys 0.041s
I20250831 19:54:46.712106 2282 raft_consensus.cc:357] T b6eee4e23718478cb107ddbcae2bbec2 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:46.712288 2282 raft_consensus.cc:383] T b6eee4e23718478cb107ddbcae2bbec2 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:46.712363 2282 raft_consensus.cc:738] T b6eee4e23718478cb107ddbcae2bbec2 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:46.712555 2282 consensus_queue.cc:260] T b6eee4e23718478cb107ddbcae2bbec2 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:46.713001 2282 ts_tablet_manager.cc:1428] T b6eee4e23718478cb107ddbcae2bbec2 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250831 19:54:46.713485 2284 tablet_bootstrap.cc:492] T a7a0312d22284f15a68d90f6e8cd7920 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:46.713901 2282 tablet_bootstrap.cc:492] T 1d5b0a02e35648ec966393f32065d6ee P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:46.715518 2282 tablet_bootstrap.cc:654] T 1d5b0a02e35648ec966393f32065d6ee P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:46.715497 2283 tablet_bootstrap.cc:492] T 1d5b0a02e35648ec966393f32065d6ee P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:46.715703 2283 ts_tablet_manager.cc:1397] T 1d5b0a02e35648ec966393f32065d6ee P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.100s user 0.014s sys 0.015s
I20250831 19:54:46.721268 2120 catalog_manager.cc:5582] T b6eee4e23718478cb107ddbcae2bbec2 P 2441fafe1d62429386f4631ad423567d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2441fafe1d62429386f4631ad423567d (127.1.1.195). New cstate: current_term: 1 leader_uuid: "2441fafe1d62429386f4631ad423567d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: UNKNOWN } } }
I20250831 19:54:46.721777 2283 raft_consensus.cc:357] T 1d5b0a02e35648ec966393f32065d6ee P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:46.722018 2283 raft_consensus.cc:383] T 1d5b0a02e35648ec966393f32065d6ee P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:46.722163 2283 raft_consensus.cc:738] T 1d5b0a02e35648ec966393f32065d6ee P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:46.722450 2283 consensus_queue.cc:260] T 1d5b0a02e35648ec966393f32065d6ee P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:46.722970 1633 raft_consensus.cc:1273] T a50607b15c144326bcc2d40f5d3ff4ff P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Refusing update from remote peer 2441fafe1d62429386f4631ad423567d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250831 19:54:46.723299 2284 tablet_bootstrap.cc:654] T a7a0312d22284f15a68d90f6e8cd7920 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:46.723440 1772 raft_consensus.cc:1273] T a50607b15c144326bcc2d40f5d3ff4ff P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Refusing update from remote peer 2441fafe1d62429386f4631ad423567d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250831 19:54:46.724640 2302 consensus_queue.cc:1035] T a50607b15c144326bcc2d40f5d3ff4ff P 2441fafe1d62429386f4631ad423567d [LEADER]: Connected to new peer: Peer: permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:46.726727 2302 consensus_queue.cc:1035] T a50607b15c144326bcc2d40f5d3ff4ff P 2441fafe1d62429386f4631ad423567d [LEADER]: Connected to new peer: Peer: permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:46.727304 2283 ts_tablet_manager.cc:1428] T 1d5b0a02e35648ec966393f32065d6ee P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.011s user 0.001s sys 0.001s
I20250831 19:54:46.728557 2283 tablet_bootstrap.cc:492] T a7a0312d22284f15a68d90f6e8cd7920 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:46.730217 2283 tablet_bootstrap.cc:654] T a7a0312d22284f15a68d90f6e8cd7920 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:46.735443 2283 tablet_bootstrap.cc:492] T a7a0312d22284f15a68d90f6e8cd7920 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:46.735461 2282 tablet_bootstrap.cc:492] T 1d5b0a02e35648ec966393f32065d6ee P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:46.735590 2282 ts_tablet_manager.cc:1397] T 1d5b0a02e35648ec966393f32065d6ee P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.022s user 0.001s sys 0.002s
I20250831 19:54:46.735602 2283 ts_tablet_manager.cc:1397] T a7a0312d22284f15a68d90f6e8cd7920 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.005s
I20250831 19:54:46.736255 2283 raft_consensus.cc:357] T a7a0312d22284f15a68d90f6e8cd7920 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:46.736279 2282 raft_consensus.cc:357] T 1d5b0a02e35648ec966393f32065d6ee P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:46.736420 2283 raft_consensus.cc:383] T a7a0312d22284f15a68d90f6e8cd7920 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:46.736423 2282 raft_consensus.cc:383] T 1d5b0a02e35648ec966393f32065d6ee P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:46.736490 2283 raft_consensus.cc:738] T a7a0312d22284f15a68d90f6e8cd7920 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:46.736512 2282 raft_consensus.cc:738] T 1d5b0a02e35648ec966393f32065d6ee P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:46.736706 2282 consensus_queue.cc:260] T 1d5b0a02e35648ec966393f32065d6ee P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:46.736754 2283 consensus_queue.cc:260] T a7a0312d22284f15a68d90f6e8cd7920 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:46.738150 2283 ts_tablet_manager.cc:1428] T a7a0312d22284f15a68d90f6e8cd7920 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250831 19:54:46.740449 2420 ts_tablet_manager.cc:1918] T 2c2c52514c444ae382cd20d03c7ed456 P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:46.740581 2420 log.cc:1199] T 2c2c52514c444ae382cd20d03c7ed456 P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/2c2c52514c444ae382cd20d03c7ed456
I20250831 19:54:46.743521 2120 catalog_manager.cc:5674] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197) does not have the latest schema for tablet a50607b15c144326bcc2d40f5d3ff4ff (table default.table_87fbe752a7a54c9eaa7536ba0e611919 [id=8e6395b817aa4efc955cf0ed00f54e14]). Expected version 1 got 0
I20250831 19:54:46.743978 2120 master_service.cc:948] ReplaceTablet: received request to replace tablet 2c2c52514c444ae382cd20d03c7ed456 from {username='slave'} at 127.0.0.1:36958
I20250831 19:54:46.744292 2120 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:36958 (request call id 44) took 1092 ms. Trace:
I20250831 19:54:46.744397 2120 rpcz_store.cc:276] 0831 19:54:45.652003 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:46.743903 (+1091900us) service_pool.cc:225] Handling call
0831 19:54:46.744253 (+ 350us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250831 19:54:46.745822 2282 ts_tablet_manager.cc:1428] T 1d5b0a02e35648ec966393f32065d6ee P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
I20250831 19:54:46.750533 2420 ts_tablet_manager.cc:1939] T 2c2c52514c444ae382cd20d03c7ed456 P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
I20250831 19:54:46.751718 2105 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet 2c2c52514c444ae382cd20d03c7ed456 (table default.table_40da3badb9e84e4990e6171bd0dbe8ac [id=115e02286266464593ead506a011b5a0]) successfully deleted
I20250831 19:54:46.752700 2121 catalog_manager.cc:5674] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237) does not have the latest schema for tablet a7a0312d22284f15a68d90f6e8cd7920 (table default.table_179225213b4a45978264479432550f67 [id=bd456415108d49989ef0bc2af91eb2f0]). Expected version 2 got 0
I20250831 19:54:46.752763 2282 tablet_bootstrap.cc:492] T a7a0312d22284f15a68d90f6e8cd7920 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
W20250831 19:54:46.753823 2121 catalog_manager.cc:5774] Failed to send AlterTable RPC for tablet a7a0312d22284f15a68d90f6e8cd7920 (table default.table_179225213b4a45978264479432550f67 [id=bd456415108d49989ef0bc2af91eb2f0], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet a7a0312d22284f15a68d90f6e8cd7920 consensus state has no leader
I20250831 19:54:46.755201 2121 catalog_manager.cc:5674] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475) does not have the latest schema for tablet a50607b15c144326bcc2d40f5d3ff4ff (table default.table_87fbe752a7a54c9eaa7536ba0e611919 [id=8e6395b817aa4efc955cf0ed00f54e14]). Expected version 1 got 0
I20250831 19:54:46.755792 2420 tablet_replica.cc:331] T e6b57e7935ac4fc5b1b3fff2e9d775b4 P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:54:46.756053 2420 raft_consensus.cc:2241] T e6b57e7935ac4fc5b1b3fff2e9d775b4 P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: Raft consensus shutting down.
I20250831 19:54:46.756407 2420 raft_consensus.cc:2270] T e6b57e7935ac4fc5b1b3fff2e9d775b4 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:46.757071 2420 ts_tablet_manager.cc:1905] T e6b57e7935ac4fc5b1b3fff2e9d775b4 P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:46.757261 2121 master_service.cc:948] ReplaceTablet: received request to replace tablet b4cc124dc284464f8e78562b4d0881c8 from {username='slave'} at 127.0.0.1:36958
I20250831 19:54:46.761873 2282 tablet_bootstrap.cc:654] T a7a0312d22284f15a68d90f6e8cd7920 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:46.762867 2120 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36958:
name: "default.Table_4db5965a988f4976ac4dfcb97cc013f0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:46.765244 2121 catalog_manager.cc:5869] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Sending DeleteTablet for 3 replicas of tablet b4cc124dc284464f8e78562b4d0881c8
I20250831 19:54:46.766006 1884 tablet_service.cc:1515] Processing DeleteTablet for tablet b4cc124dc284464f8e78562b4d0881c8 with delete_type TABLET_DATA_DELETED (replaced by tablet 9248d658274d4e818a75fd663480c3d8) from {username='slave'} at 127.0.0.1:45906
I20250831 19:54:46.766296 2419 tablet_replica.cc:331] T b4cc124dc284464f8e78562b4d0881c8 P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:54:46.766495 2419 raft_consensus.cc:2241] T b4cc124dc284464f8e78562b4d0881c8 P 2441fafe1d62429386f4631ad423567d [term 1 LEADER]: Raft consensus shutting down.
I20250831 19:54:46.766716 1750 tablet_service.cc:1515] Processing DeleteTablet for tablet b4cc124dc284464f8e78562b4d0881c8 with delete_type TABLET_DATA_DELETED (replaced by tablet 9248d658274d4e818a75fd663480c3d8) from {username='slave'} at 127.0.0.1:50674
I20250831 19:54:46.766845 2419 raft_consensus.cc:2270] T b4cc124dc284464f8e78562b4d0881c8 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:46.767648 1614 tablet_service.cc:1515] Processing DeleteTablet for tablet b4cc124dc284464f8e78562b4d0881c8 with delete_type TABLET_DATA_DELETED (replaced by tablet 9248d658274d4e818a75fd663480c3d8) from {username='slave'} at 127.0.0.1:51022
I20250831 19:54:46.767814 2419 ts_tablet_manager.cc:1905] T b4cc124dc284464f8e78562b4d0881c8 P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:46.767895 2421 tablet_replica.cc:331] T b4cc124dc284464f8e78562b4d0881c8 P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:54:46.768093 2421 raft_consensus.cc:2241] T b4cc124dc284464f8e78562b4d0881c8 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:46.768303 2421 raft_consensus.cc:2270] T b4cc124dc284464f8e78562b4d0881c8 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:46.769520 2432 tablet.cc:1722] T a50607b15c144326bcc2d40f5d3ff4ff P 2441fafe1d62429386f4631ad423567d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:46.772169 2421 ts_tablet_manager.cc:1905] T b4cc124dc284464f8e78562b4d0881c8 P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:46.775101 2117 catalog_manager.cc:3460] renamed table default.table_179225213b4a45978264479432550f67 [id=bd456415108d49989ef0bc2af91eb2f0] in HMS: new name default.table_c8611581e59f4d8a94cd6f4da06917a4
I20250831 19:54:46.775591 2419 ts_tablet_manager.cc:1918] T b4cc124dc284464f8e78562b4d0881c8 P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:46.775714 2419 log.cc:1199] T b4cc124dc284464f8e78562b4d0881c8 P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/b4cc124dc284464f8e78562b4d0881c8
I20250831 19:54:46.776154 2419 ts_tablet_manager.cc:1939] T b4cc124dc284464f8e78562b4d0881c8 P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:54:46.777822 2434 tablet.cc:1722] T a50607b15c144326bcc2d40f5d3ff4ff P de831f40fa1348a48a1f0260f4130197: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:46.781350 2101 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet b4cc124dc284464f8e78562b4d0881c8 (table default.table_041b766e57be48328a32ed288f99216a [id=c52f5ff0a57742749597f0406f63c8d8]) successfully deleted
I20250831 19:54:46.781558 2420 ts_tablet_manager.cc:1918] T e6b57e7935ac4fc5b1b3fff2e9d775b4 P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20250831 19:54:46.781714 2420 log.cc:1199] T e6b57e7935ac4fc5b1b3fff2e9d775b4 P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/e6b57e7935ac4fc5b1b3fff2e9d775b4
I20250831 19:54:46.782171 2420 ts_tablet_manager.cc:1939] T e6b57e7935ac4fc5b1b3fff2e9d775b4 P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
I20250831 19:54:46.783061 2420 tablet_replica.cc:331] T b4cc124dc284464f8e78562b4d0881c8 P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:54:46.783243 2420 raft_consensus.cc:2241] T b4cc124dc284464f8e78562b4d0881c8 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:46.783274 2105 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet e6b57e7935ac4fc5b1b3fff2e9d775b4 (table default.table_179225213b4a45978264479432550f67 [id=bd456415108d49989ef0bc2af91eb2f0]) successfully deleted
I20250831 19:54:46.783344 2433 tablet.cc:1722] T a50607b15c144326bcc2d40f5d3ff4ff P 89aa85d59c53436ebdf3074b13d14825: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:46.783416 2420 raft_consensus.cc:2270] T b4cc124dc284464f8e78562b4d0881c8 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:46.784327 2284 tablet_bootstrap.cc:492] T a7a0312d22284f15a68d90f6e8cd7920 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:46.784744 1614 tablet_service.cc:1468] Processing CreateTablet for tablet 9248d658274d4e818a75fd663480c3d8 (DEFAULT_TABLE table=default.table_041b766e57be48328a32ed288f99216a [id=c52f5ff0a57742749597f0406f63c8d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:46.785142 1614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9248d658274d4e818a75fd663480c3d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:46.785151 1750 tablet_service.cc:1468] Processing CreateTablet for tablet 9248d658274d4e818a75fd663480c3d8 (DEFAULT_TABLE table=default.table_041b766e57be48328a32ed288f99216a [id=c52f5ff0a57742749597f0406f63c8d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:46.785348 1884 tablet_service.cc:1468] Processing CreateTablet for tablet 9248d658274d4e818a75fd663480c3d8 (DEFAULT_TABLE table=default.table_041b766e57be48328a32ed288f99216a [id=c52f5ff0a57742749597f0406f63c8d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:46.785533 1750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9248d658274d4e818a75fd663480c3d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:46.785692 1884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9248d658274d4e818a75fd663480c3d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:46.791769 2283 tablet_bootstrap.cc:492] T 9248d658274d4e818a75fd663480c3d8 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:46.792515 2421 ts_tablet_manager.cc:1918] T b4cc124dc284464f8e78562b4d0881c8 P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:46.792683 2421 log.cc:1199] T b4cc124dc284464f8e78562b4d0881c8 P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/b4cc124dc284464f8e78562b4d0881c8
I20250831 19:54:46.793123 2421 ts_tablet_manager.cc:1939] T b4cc124dc284464f8e78562b4d0881c8 P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
I20250831 19:54:46.793573 2283 tablet_bootstrap.cc:654] T 9248d658274d4e818a75fd663480c3d8 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:46.794215 2284 ts_tablet_manager.cc:1397] T a7a0312d22284f15a68d90f6e8cd7920 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.081s user 0.010s sys 0.000s
I20250831 19:54:46.794728 2104 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet b4cc124dc284464f8e78562b4d0881c8 (table default.table_041b766e57be48328a32ed288f99216a [id=c52f5ff0a57742749597f0406f63c8d8]) successfully deleted
I20250831 19:54:46.796164 1031 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskfwTdIj/build/asan/bin/kudu
/tmp/dist-test-taskfwTdIj/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.1.254:34259
--webserver_interface=127.1.1.254
--webserver_port=34345
--builtin_ntp_servers=127.1.1.212:44077
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943
--hive_metastore_uris=thrift://127.0.0.1:46163
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20250831 19:54:46.797499 2284 raft_consensus.cc:357] T a7a0312d22284f15a68d90f6e8cd7920 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:46.797847 2284 raft_consensus.cc:383] T a7a0312d22284f15a68d90f6e8cd7920 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:46.797963 2284 raft_consensus.cc:738] T a7a0312d22284f15a68d90f6e8cd7920 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:46.798266 2284 consensus_queue.cc:260] T a7a0312d22284f15a68d90f6e8cd7920 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:46.798969 2284 ts_tablet_manager.cc:1428] T a7a0312d22284f15a68d90f6e8cd7920 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20250831 19:54:46.799427 2284 tablet_bootstrap.cc:492] T 9248d658274d4e818a75fd663480c3d8 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:46.801095 2284 tablet_bootstrap.cc:654] T 9248d658274d4e818a75fd663480c3d8 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:46.806599 2121 catalog_manager.cc:6652] ReplaceTablet: tablet b4cc124dc284464f8e78562b4d0881c8 deleted and replaced by tablet 9248d658274d4e818a75fd663480c3d8
I20250831 19:54:46.806780 2121 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:36958 (request call id 45) took 1133 ms. Trace:
I20250831 19:54:46.806931 2121 rpcz_store.cc:276] 0831 19:54:45.673389 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:46.757187 (+1083798us) service_pool.cc:225] Handling call
0831 19:54:46.764986 (+ 7799us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:46.764994 (+ 8us) write_op.cc:454] Released schema lock
0831 19:54:46.806743 (+ 41749us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:46.759240 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:46.759356 (+ 116us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:46.759362 (+ 6us) write_op.cc:435] Acquired schema lock
0831 19:54:46.759364 (+ 2us) tablet.cc:660] Decoding operations
0831 19:54:46.759473 (+ 109us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:46.759485 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:46.759490 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:46.759563 (+ 73us) tablet.cc:699] Row locks acquired
0831 19:54:46.759565 (+ 2us) write_op.cc:260] PREPARE: finished
0831 19:54:46.759600 (+ 35us) write_op.cc:270] Start()
0831 19:54:46.759629 (+ 29us) write_op.cc:276] Timestamp: P: 1756670086759575 usec, L: 0
0831 19:54:46.759633 (+ 4us) op_driver.cc:348] REPLICATION: starting
0831 19:54:46.759803 (+ 170us) log.cc:844] Serialized 656 byte log entry
0831 19:54:46.763010 (+ 3207us) op_driver.cc:464] REPLICATION: finished
0831 19:54:46.763152 (+ 142us) write_op.cc:301] APPLY: starting
0831 19:54:46.763167 (+ 15us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:46.763219 (+ 52us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:46.763249 (+ 30us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:46.763361 (+ 112us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:46.763436 (+ 75us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0831 19:54:46.763446 (+ 10us) write_op.cc:312] APPLY: finished
0831 19:54:46.763531 (+ 85us) log.cc:844] Serialized 29 byte log entry
0831 19:54:46.763596 (+ 65us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:46.763621 (+ 25us) write_op.cc:454] Released schema lock
0831 19:54:46.763629 (+ 8us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":92,"apply.run_cpu_time_us":528,"apply.run_wall_time_us":529,"num_ops":2,"prepare.queue_time_us":1073,"prepare.run_cpu_time_us":658,"prepare.run_wall_time_us":658,"raft.queue_time_us":995,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":205,"replication_time_us":3353}]]}
I20250831 19:54:46.810598 2121 catalog_manager.cc:5674] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475) does not have the latest schema for tablet a50607b15c144326bcc2d40f5d3ff4ff (table default.table_87fbe752a7a54c9eaa7536ba0e611919 [id=8e6395b817aa4efc955cf0ed00f54e14]). Expected version 1 got 0
I20250831 19:54:46.811190 2420 ts_tablet_manager.cc:1905] T b4cc124dc284464f8e78562b4d0881c8 P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:46.812887 2121 catalog_manager.cc:5674] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197) does not have the latest schema for tablet a50607b15c144326bcc2d40f5d3ff4ff (table default.table_87fbe752a7a54c9eaa7536ba0e611919 [id=8e6395b817aa4efc955cf0ed00f54e14]). Expected version 1 got 0
I20250831 19:54:46.816215 2121 catalog_manager.cc:5674] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475) does not have the latest schema for tablet a7a0312d22284f15a68d90f6e8cd7920 (table default.table_179225213b4a45978264479432550f67 [id=bd456415108d49989ef0bc2af91eb2f0]). Expected version 2 got 0
I20250831 19:54:46.816959 2121 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_87fbe752a7a54c9eaa7536ba0e611919" } modify_external_catalogs: true
I20250831 19:54:46.817142 2121 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_87fbe752a7a54c9eaa7536ba0e611919" } modify_external_catalogs: true
I20250831 19:54:46.825351 2420 ts_tablet_manager.cc:1918] T b4cc124dc284464f8e78562b4d0881c8 P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:46.825587 2420 log.cc:1199] T b4cc124dc284464f8e78562b4d0881c8 P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/b4cc124dc284464f8e78562b4d0881c8
I20250831 19:54:46.825664 2282 tablet_bootstrap.cc:492] T a7a0312d22284f15a68d90f6e8cd7920 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:46.825861 2282 ts_tablet_manager.cc:1397] T a7a0312d22284f15a68d90f6e8cd7920 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.074s user 0.008s sys 0.000s
I20250831 19:54:46.826164 2420 ts_tablet_manager.cc:1939] T b4cc124dc284464f8e78562b4d0881c8 P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
I20250831 19:54:46.826483 2283 tablet_bootstrap.cc:492] T 9248d658274d4e818a75fd663480c3d8 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:46.826804 2283 ts_tablet_manager.cc:1397] T 9248d658274d4e818a75fd663480c3d8 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.035s user 0.009s sys 0.004s
I20250831 19:54:46.827643 2283 raft_consensus.cc:357] T 9248d658274d4e818a75fd663480c3d8 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:46.827829 2283 raft_consensus.cc:383] T 9248d658274d4e818a75fd663480c3d8 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:46.827817 2105 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet b4cc124dc284464f8e78562b4d0881c8 (table default.table_041b766e57be48328a32ed288f99216a [id=c52f5ff0a57742749597f0406f63c8d8]) successfully deleted
I20250831 19:54:46.827925 2283 raft_consensus.cc:738] T 9248d658274d4e818a75fd663480c3d8 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:46.828132 2283 consensus_queue.cc:260] T 9248d658274d4e818a75fd663480c3d8 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:46.828625 2283 ts_tablet_manager.cc:1428] T 9248d658274d4e818a75fd663480c3d8 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20250831 19:54:46.833859 2282 raft_consensus.cc:357] T a7a0312d22284f15a68d90f6e8cd7920 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:46.834043 2282 raft_consensus.cc:383] T a7a0312d22284f15a68d90f6e8cd7920 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:46.834100 2282 raft_consensus.cc:738] T a7a0312d22284f15a68d90f6e8cd7920 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:46.835595 2282 consensus_queue.cc:260] T a7a0312d22284f15a68d90f6e8cd7920 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:46.836874 2282 ts_tablet_manager.cc:1428] T a7a0312d22284f15a68d90f6e8cd7920 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.011s user 0.001s sys 0.001s
I20250831 19:54:46.837167 2282 tablet_bootstrap.cc:492] T 9248d658274d4e818a75fd663480c3d8 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:46.841251 2282 tablet_bootstrap.cc:654] T 9248d658274d4e818a75fd663480c3d8 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:46.844862 2284 tablet_bootstrap.cc:492] T 9248d658274d4e818a75fd663480c3d8 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:46.845026 2284 ts_tablet_manager.cc:1397] T 9248d658274d4e818a75fd663480c3d8 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.046s user 0.010s sys 0.008s
I20250831 19:54:46.845566 2354 raft_consensus.cc:491] T 6eda2f28ef194cba81661fbf080c5883 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:46.845710 2354 raft_consensus.cc:513] T 6eda2f28ef194cba81661fbf080c5883 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:46.845798 2284 raft_consensus.cc:357] T 9248d658274d4e818a75fd663480c3d8 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:46.845992 2284 raft_consensus.cc:383] T 9248d658274d4e818a75fd663480c3d8 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:46.846087 2284 raft_consensus.cc:738] T 9248d658274d4e818a75fd663480c3d8 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:46.846318 2354 leader_election.cc:290] T 6eda2f28ef194cba81661fbf080c5883 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:46.846372 2284 consensus_queue.cc:260] T 9248d658274d4e818a75fd663480c3d8 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:46.847059 1904 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6eda2f28ef194cba81661fbf080c5883" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:46.847307 1904 raft_consensus.cc:2391] T 6eda2f28ef194cba81661fbf080c5883 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89aa85d59c53436ebdf3074b13d14825 in current term 1: Already voted for candidate de831f40fa1348a48a1f0260f4130197 in this term.
I20250831 19:54:46.847295 1772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6eda2f28ef194cba81661fbf080c5883" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:46.848065 1568 leader_election.cc:304] T 6eda2f28ef194cba81661fbf080c5883 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825; no voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197
I20250831 19:54:46.848433 2354 raft_consensus.cc:3058] T 6eda2f28ef194cba81661fbf080c5883 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:46.849977 2284 ts_tablet_manager.cc:1428] T 9248d658274d4e818a75fd663480c3d8 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20250831 19:54:46.851063 2354 raft_consensus.cc:2747] T 6eda2f28ef194cba81661fbf080c5883 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250831 19:54:46.863025 2282 tablet_bootstrap.cc:492] T 9248d658274d4e818a75fd663480c3d8 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:46.863201 2282 ts_tablet_manager.cc:1397] T 9248d658274d4e818a75fd663480c3d8 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.026s user 0.002s sys 0.001s
I20250831 19:54:46.863867 2282 raft_consensus.cc:357] T 9248d658274d4e818a75fd663480c3d8 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:46.864074 2282 raft_consensus.cc:383] T 9248d658274d4e818a75fd663480c3d8 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:46.864144 2282 raft_consensus.cc:738] T 9248d658274d4e818a75fd663480c3d8 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:46.867020 2282 consensus_queue.cc:260] T 9248d658274d4e818a75fd663480c3d8 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:46.867108 2118 catalog_manager.cc:2706] deleted HMS catalog entry for table default.table_041b766e57be48328a32ed288f99216a [id=c52f5ff0a57742749597f0406f63c8d8]
I20250831 19:54:46.870297 2282 ts_tablet_manager.cc:1428] T 9248d658274d4e818a75fd663480c3d8 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
W20250831 19:54:46.937659 2105 catalog_manager.cc:4726] Async tablet task AlterTable RPC for tablet a7a0312d22284f15a68d90f6e8cd7920 (table default.table_179225213b4a45978264479432550f67 [id=bd456415108d49989ef0bc2af91eb2f0], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet a7a0312d22284f15a68d90f6e8cd7920 consensus state has no leader
I20250831 19:54:46.943794 2354 raft_consensus.cc:491] T f94f30794d6143b1877dd45e589cfe76 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:46.943977 2354 raft_consensus.cc:513] T f94f30794d6143b1877dd45e589cfe76 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:46.944711 2354 leader_election.cc:290] T f94f30794d6143b1877dd45e589cfe76 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:46.946292 1772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f94f30794d6143b1877dd45e589cfe76" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:46.946518 1772 raft_consensus.cc:2466] T f94f30794d6143b1877dd45e589cfe76 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 0.
I20250831 19:54:46.947350 1904 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f94f30794d6143b1877dd45e589cfe76" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:46.947573 1904 raft_consensus.cc:2466] T f94f30794d6143b1877dd45e589cfe76 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 0.
I20250831 19:54:46.948120 1570 leader_election.cc:304] T f94f30794d6143b1877dd45e589cfe76 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:46.948169 2119 catalog_manager.cc:3460] renamed table default.table_609f839fcd04455fb64b8a7674b0f57b [id=0850f2b0e9324dd0a210fa7b2609c769] in HMS: new name default.table_0ab569c1a9dc4f91af81c84392bc5748
I20250831 19:54:46.949164 2354 raft_consensus.cc:2802] T f94f30794d6143b1877dd45e589cfe76 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:46.949268 2354 raft_consensus.cc:491] T f94f30794d6143b1877dd45e589cfe76 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:46.949366 2354 raft_consensus.cc:3058] T f94f30794d6143b1877dd45e589cfe76 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:46.951892 2354 raft_consensus.cc:513] T f94f30794d6143b1877dd45e589cfe76 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:46.953058 1904 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f94f30794d6143b1877dd45e589cfe76" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:54:46.953222 1904 raft_consensus.cc:3058] T f94f30794d6143b1877dd45e589cfe76 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:46.955647 1904 raft_consensus.cc:2466] T f94f30794d6143b1877dd45e589cfe76 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1.
I20250831 19:54:46.956135 1568 leader_election.cc:304] T f94f30794d6143b1877dd45e589cfe76 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:54:46.956436 2223 raft_consensus.cc:2802] T f94f30794d6143b1877dd45e589cfe76 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:46.956571 2223 raft_consensus.cc:695] T f94f30794d6143b1877dd45e589cfe76 P 89aa85d59c53436ebdf3074b13d14825 [term 1 LEADER]: Becoming Leader. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Running, Role: LEADER
I20250831 19:54:46.956827 2223 consensus_queue.cc:237] T f94f30794d6143b1877dd45e589cfe76 P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:46.959326 1772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f94f30794d6143b1877dd45e589cfe76" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197"
I20250831 19:54:46.959520 1772 raft_consensus.cc:3058] T f94f30794d6143b1877dd45e589cfe76 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:46.962210 1772 raft_consensus.cc:2466] T f94f30794d6143b1877dd45e589cfe76 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1.
I20250831 19:54:46.962833 2354 leader_election.cc:290] T f94f30794d6143b1877dd45e589cfe76 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Requested vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:47.000134 2122 catalog_manager.cc:2706] deleted HMS catalog entry for table default.table_21109c51ccde402faea41968420775a5 [id=d1d8c4304331413794b75cf39b81ad3a]
I20250831 19:54:47.029104 2125 catalog_manager.cc:2149] created HMS catalog entry for table [id=cd895a5e76c444838de76fc1f5160120]
I20250831 19:54:47.035749 2125 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:36958 (request call id 34) took 1714 ms. Trace:
I20250831 19:54:47.035892 2125 rpcz_store.cc:276] 0831 19:54:45.321218 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:45.982110 (+660892us) service_pool.cc:225] Handling call
0831 19:54:46.465037 (+482927us) catalog_manager.cc:2076] Acquired catalog manager lock
0831 19:54:46.465546 (+ 509us) catalog_manager.cc:2122] Created new table and tablet info
0831 19:54:47.029056 (+563510us) catalog_manager.cc:2148] Created new table in HMS catalog
0831 19:54:47.035421 (+ 6365us) catalog_manager.cc:2182] Wrote table and tablets to system table
0831 19:54:47.035558 (+ 137us) catalog_manager.cc:2216] Inserted table and tablets into CatalogManager maps
0831 19:54:47.035674 (+ 116us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:47.029853 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:47.029992 (+ 139us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:47.030000 (+ 8us) write_op.cc:435] Acquired schema lock
0831 19:54:47.030004 (+ 4us) tablet.cc:660] Decoding operations
0831 19:54:47.030118 (+ 114us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:47.030135 (+ 17us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:47.030141 (+ 6us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:47.030258 (+ 117us) tablet.cc:699] Row locks acquired
0831 19:54:47.030262 (+ 4us) write_op.cc:260] PREPARE: finished
0831 19:54:47.030305 (+ 43us) write_op.cc:270] Start()
0831 19:54:47.030345 (+ 40us) write_op.cc:276] Timestamp: P: 1756670087030250 usec, L: 0
0831 19:54:47.030350 (+ 5us) op_driver.cc:348] REPLICATION: starting
0831 19:54:47.030614 (+ 264us) log.cc:844] Serialized 433 byte log entry
0831 19:54:47.034587 (+ 3973us) op_driver.cc:464] REPLICATION: finished
0831 19:54:47.034735 (+ 148us) write_op.cc:301] APPLY: starting
0831 19:54:47.034764 (+ 29us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:47.034814 (+ 50us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:47.034878 (+ 64us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:47.034995 (+ 117us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:47.035038 (+ 43us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0831 19:54:47.035049 (+ 11us) write_op.cc:312] APPLY: finished
0831 19:54:47.035131 (+ 82us) log.cc:844] Serialized 29 byte log entry
0831 19:54:47.035196 (+ 65us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:47.035221 (+ 25us) write_op.cc:454] Released schema lock
0831 19:54:47.035228 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0831 19:54:47.035304 (+ 76us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:47.035310 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":534482,"Hive Metastore.run_cpu_time_us":242,"Hive Metastore.run_wall_time_us":28679,"child_traces":[["op",{"apply.queue_time_us":96,"apply.run_cpu_time_us":557,"apply.run_wall_time_us":556,"num_ops":2,"prepare.queue_time_us":44,"prepare.run_cpu_time_us":893,"prepare.run_wall_time_us":893,"raft.queue_time_us":1293,"raft.run_cpu_time_us":309,"raft.run_wall_time_us":310,"replication_time_us":4202}]]}
I20250831 19:54:47.052857 1884 tablet_service.cc:1468] Processing CreateTablet for tablet 5e8b8c83b1f445018f6a904bd430f736 (DEFAULT_TABLE table=default.table_bced462d6a2a4c929f51cfe29e54fe75 [id=cd895a5e76c444838de76fc1f5160120]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:47.053285 1884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e8b8c83b1f445018f6a904bd430f736. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:47.053236 1750 tablet_service.cc:1468] Processing CreateTablet for tablet 5e8b8c83b1f445018f6a904bd430f736 (DEFAULT_TABLE table=default.table_bced462d6a2a4c929f51cfe29e54fe75 [id=cd895a5e76c444838de76fc1f5160120]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:47.053630 1750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e8b8c83b1f445018f6a904bd430f736. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:47.057106 1614 tablet_service.cc:1468] Processing CreateTablet for tablet 5e8b8c83b1f445018f6a904bd430f736 (DEFAULT_TABLE table=default.table_bced462d6a2a4c929f51cfe29e54fe75 [id=cd895a5e76c444838de76fc1f5160120]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:47.057718 1614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e8b8c83b1f445018f6a904bd430f736. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:47.063649 2126 catalog_manager.cc:2149] created HMS catalog entry for table [id=321a68b57ebf4e3a80670c3c862403f1]
I20250831 19:54:47.063797 2284 tablet_bootstrap.cc:492] T 5e8b8c83b1f445018f6a904bd430f736 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:47.065303 2284 tablet_bootstrap.cc:654] T 5e8b8c83b1f445018f6a904bd430f736 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:47.065303 2283 tablet_bootstrap.cc:492] T 5e8b8c83b1f445018f6a904bd430f736 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:47.066404 2282 tablet_bootstrap.cc:492] T 5e8b8c83b1f445018f6a904bd430f736 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:47.066905 2283 tablet_bootstrap.cc:654] T 5e8b8c83b1f445018f6a904bd430f736 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:47.068034 2282 tablet_bootstrap.cc:654] T 5e8b8c83b1f445018f6a904bd430f736 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:47.071794 2126 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:36958 (request call id 35) took 1736 ms. Trace:
I20250831 19:54:47.071956 2126 rpcz_store.cc:276] 0831 19:54:45.335378 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:45.989321 (+653943us) service_pool.cc:225] Handling call
0831 19:54:46.465662 (+476341us) catalog_manager.cc:2076] Acquired catalog manager lock
0831 19:54:46.466115 (+ 453us) catalog_manager.cc:2122] Created new table and tablet info
0831 19:54:47.063607 (+597492us) catalog_manager.cc:2148] Created new table in HMS catalog
0831 19:54:47.071481 (+ 7874us) catalog_manager.cc:2182] Wrote table and tablets to system table
0831 19:54:47.071608 (+ 127us) catalog_manager.cc:2216] Inserted table and tablets into CatalogManager maps
0831 19:54:47.071738 (+ 130us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:47.066422 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:47.066530 (+ 108us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:47.066535 (+ 5us) write_op.cc:435] Acquired schema lock
0831 19:54:47.066537 (+ 2us) tablet.cc:660] Decoding operations
0831 19:54:47.066655 (+ 118us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:47.066667 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:47.066671 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:47.066768 (+ 97us) tablet.cc:699] Row locks acquired
0831 19:54:47.066771 (+ 3us) write_op.cc:260] PREPARE: finished
0831 19:54:47.066807 (+ 36us) write_op.cc:270] Start()
0831 19:54:47.066841 (+ 34us) write_op.cc:276] Timestamp: P: 1756670087066752 usec, L: 0
0831 19:54:47.066845 (+ 4us) op_driver.cc:348] REPLICATION: starting
0831 19:54:47.067035 (+ 190us) log.cc:844] Serialized 433 byte log entry
0831 19:54:47.070600 (+ 3565us) op_driver.cc:464] REPLICATION: finished
0831 19:54:47.070772 (+ 172us) write_op.cc:301] APPLY: starting
0831 19:54:47.070790 (+ 18us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:47.070844 (+ 54us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:47.070877 (+ 33us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:47.071036 (+ 159us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:47.071081 (+ 45us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0831 19:54:47.071093 (+ 12us) write_op.cc:312] APPLY: finished
0831 19:54:47.071183 (+ 90us) log.cc:844] Serialized 29 byte log entry
0831 19:54:47.071253 (+ 70us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:47.071279 (+ 26us) write_op.cc:454] Released schema lock
0831 19:54:47.071288 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0831 19:54:47.071369 (+ 81us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:47.071375 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":562661,"Hive Metastore.run_cpu_time_us":223,"Hive Metastore.run_wall_time_us":34512,"child_traces":[["op",{"apply.queue_time_us":105,"apply.run_cpu_time_us":596,"apply.run_wall_time_us":595,"num_ops":2,"prepare.queue_time_us":2288,"prepare.run_cpu_time_us":733,"prepare.run_wall_time_us":733,"raft.queue_time_us":408,"raft.run_cpu_time_us":241,"raft.run_wall_time_us":240,"replication_time_us":3719}]]}
I20250831 19:54:47.079892 2125 catalog_manager.cc:5582] T f94f30794d6143b1877dd45e589cfe76 P 89aa85d59c53436ebdf3074b13d14825 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193). New cstate: current_term: 1 leader_uuid: "89aa85d59c53436ebdf3074b13d14825" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: UNKNOWN } } }
I20250831 19:54:47.080379 2125 catalog_manager.cc:5674] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197) does not have the latest schema for tablet a7a0312d22284f15a68d90f6e8cd7920 (table default.table_179225213b4a45978264479432550f67 [id=bd456415108d49989ef0bc2af91eb2f0]). Expected version 2 got 0
I20250831 19:54:47.080977 2282 tablet_bootstrap.cc:492] T 5e8b8c83b1f445018f6a904bd430f736 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:47.081281 2282 ts_tablet_manager.cc:1397] T 5e8b8c83b1f445018f6a904bd430f736 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.015s user 0.006s sys 0.003s
I20250831 19:54:47.081367 2328 raft_consensus.cc:491] T 1d5b0a02e35648ec966393f32065d6ee P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:47.081535 2328 raft_consensus.cc:513] T 1d5b0a02e35648ec966393f32065d6ee P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:47.082204 2328 leader_election.cc:290] T 1d5b0a02e35648ec966393f32065d6ee P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:47.082353 2282 raft_consensus.cc:357] T 5e8b8c83b1f445018f6a904bd430f736 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:47.082592 2282 raft_consensus.cc:383] T 5e8b8c83b1f445018f6a904bd430f736 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:47.082697 2282 raft_consensus.cc:738] T 5e8b8c83b1f445018f6a904bd430f736 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:47.082859 1904 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1d5b0a02e35648ec966393f32065d6ee" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:47.083071 1904 raft_consensus.cc:2466] T 1d5b0a02e35648ec966393f32065d6ee P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 0.
I20250831 19:54:47.083071 2282 consensus_queue.cc:260] T 5e8b8c83b1f445018f6a904bd430f736 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:47.083478 1705 leader_election.cc:304] T 1d5b0a02e35648ec966393f32065d6ee P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:47.083688 2282 ts_tablet_manager.cc:1428] T 5e8b8c83b1f445018f6a904bd430f736 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250831 19:54:47.084738 2283 tablet_bootstrap.cc:492] T 5e8b8c83b1f445018f6a904bd430f736 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:47.084933 2283 ts_tablet_manager.cc:1397] T 5e8b8c83b1f445018f6a904bd430f736 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.020s user 0.009s sys 0.001s
I20250831 19:54:47.084990 1634 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1d5b0a02e35648ec966393f32065d6ee" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:47.085168 1634 raft_consensus.cc:2466] T 1d5b0a02e35648ec966393f32065d6ee P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 0.
I20250831 19:54:47.086205 2328 raft_consensus.cc:2802] T 1d5b0a02e35648ec966393f32065d6ee P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:47.086321 2328 raft_consensus.cc:491] T 1d5b0a02e35648ec966393f32065d6ee P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:47.086210 2283 raft_consensus.cc:357] T 5e8b8c83b1f445018f6a904bd430f736 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:47.086411 2328 raft_consensus.cc:3058] T 1d5b0a02e35648ec966393f32065d6ee P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:47.086551 2283 raft_consensus.cc:383] T 5e8b8c83b1f445018f6a904bd430f736 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:47.086659 2283 raft_consensus.cc:738] T 5e8b8c83b1f445018f6a904bd430f736 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:47.086949 2283 consensus_queue.cc:260] T 5e8b8c83b1f445018f6a904bd430f736 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:47.088951 2328 raft_consensus.cc:513] T 1d5b0a02e35648ec966393f32065d6ee P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:47.089808 1904 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1d5b0a02e35648ec966393f32065d6ee" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:54:47.089998 1904 raft_consensus.cc:3058] T 1d5b0a02e35648ec966393f32065d6ee P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:47.090570 2283 ts_tablet_manager.cc:1428] T 5e8b8c83b1f445018f6a904bd430f736 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20250831 19:54:47.092628 1904 raft_consensus.cc:2466] T 1d5b0a02e35648ec966393f32065d6ee P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:54:47.092998 1705 leader_election.cc:304] T 1d5b0a02e35648ec966393f32065d6ee P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:47.093516 2444 raft_consensus.cc:2802] T 1d5b0a02e35648ec966393f32065d6ee P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:47.093773 2328 leader_election.cc:290] T 1d5b0a02e35648ec966393f32065d6ee P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Requested vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:47.095940 1634 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1d5b0a02e35648ec966393f32065d6ee" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:54:47.096117 1634 raft_consensus.cc:3058] T 1d5b0a02e35648ec966393f32065d6ee P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:47.098519 1634 raft_consensus.cc:2466] T 1d5b0a02e35648ec966393f32065d6ee P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:54:47.105906 2126 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_cba30e3477524a4fb902655e070bfce2" } modify_external_catalogs: true
I20250831 19:54:47.106184 2126 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_cba30e3477524a4fb902655e070bfce2" } modify_external_catalogs: true
I20250831 19:54:47.107070 2444 raft_consensus.cc:695] T 1d5b0a02e35648ec966393f32065d6ee P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: Becoming Leader. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Running, Role: LEADER
I20250831 19:54:47.107447 2444 consensus_queue.cc:237] T 1d5b0a02e35648ec966393f32065d6ee P de831f40fa1348a48a1f0260f4130197 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:47.115729 2124 catalog_manager.cc:2149] created HMS catalog entry for table [id=5226b7f2958d4616b3fad9408fdd42cd]
I20250831 19:54:47.116729 1884 tablet_service.cc:1468] Processing CreateTablet for tablet 4e522e5dd8d84b3fb22cae56a95a8904 (DEFAULT_TABLE table=default.table_2cfa6cbcf8244da6b6468895fd9e31cc [id=321a68b57ebf4e3a80670c3c862403f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:47.117133 1884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e522e5dd8d84b3fb22cae56a95a8904. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:47.120855 1614 tablet_service.cc:1468] Processing CreateTablet for tablet 4e522e5dd8d84b3fb22cae56a95a8904 (DEFAULT_TABLE table=default.table_2cfa6cbcf8244da6b6468895fd9e31cc [id=321a68b57ebf4e3a80670c3c862403f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:47.121297 1614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e522e5dd8d84b3fb22cae56a95a8904. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:47.123250 2124 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:36958 (request call id 36) took 1745 ms. Trace:
I20250831 19:54:47.123353 2124 rpcz_store.cc:276] 0831 19:54:45.378035 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:45.990947 (+612912us) service_pool.cc:225] Handling call
0831 19:54:46.465811 (+474864us) catalog_manager.cc:2076] Acquired catalog manager lock
0831 19:54:46.468405 (+ 2594us) catalog_manager.cc:2122] Created new table and tablet info
0831 19:54:47.115676 (+647271us) catalog_manager.cc:2148] Created new table in HMS catalog
0831 19:54:47.123001 (+ 7325us) catalog_manager.cc:2182] Wrote table and tablets to system table
0831 19:54:47.123109 (+ 108us) catalog_manager.cc:2216] Inserted table and tablets into CatalogManager maps
0831 19:54:47.123206 (+ 97us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:47.116857 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:47.116947 (+ 90us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:47.116952 (+ 5us) write_op.cc:435] Acquired schema lock
0831 19:54:47.116954 (+ 2us) tablet.cc:660] Decoding operations
0831 19:54:47.117043 (+ 89us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:47.117053 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:47.117057 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:47.117131 (+ 74us) tablet.cc:699] Row locks acquired
0831 19:54:47.117133 (+ 2us) write_op.cc:260] PREPARE: finished
0831 19:54:47.117162 (+ 29us) write_op.cc:270] Start()
0831 19:54:47.117187 (+ 25us) write_op.cc:276] Timestamp: P: 1756670087117103 usec, L: 0
0831 19:54:47.117190 (+ 3us) op_driver.cc:348] REPLICATION: starting
0831 19:54:47.117314 (+ 124us) log.cc:844] Serialized 433 byte log entry
0831 19:54:47.120222 (+ 2908us) op_driver.cc:464] REPLICATION: finished
0831 19:54:47.120496 (+ 274us) write_op.cc:301] APPLY: starting
0831 19:54:47.120509 (+ 13us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:47.120552 (+ 43us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:47.120575 (+ 23us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:47.120665 (+ 90us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:47.120691 (+ 26us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0831 19:54:47.120697 (+ 6us) write_op.cc:312] APPLY: finished
0831 19:54:47.120757 (+ 60us) log.cc:844] Serialized 29 byte log entry
0831 19:54:47.120818 (+ 61us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:47.120835 (+ 17us) write_op.cc:454] Released schema lock
0831 19:54:47.120841 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0831 19:54:47.120905 (+ 64us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:47.120908 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":594891,"Hive Metastore.run_cpu_time_us":238,"Hive Metastore.run_wall_time_us":51680,"child_traces":[["op",{"apply.queue_time_us":218,"apply.run_cpu_time_us":409,"apply.run_wall_time_us":409,"num_ops":2,"prepare.queue_time_us":632,"prepare.run_cpu_time_us":555,"prepare.run_wall_time_us":846,"raft.queue_time_us":320,"raft.run_cpu_time_us":221,"raft.run_wall_time_us":220,"replication_time_us":3008}]]}
I20250831 19:54:47.125885 1750 tablet_service.cc:1468] Processing CreateTablet for tablet 4e522e5dd8d84b3fb22cae56a95a8904 (DEFAULT_TABLE table=default.table_2cfa6cbcf8244da6b6468895fd9e31cc [id=321a68b57ebf4e3a80670c3c862403f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:47.126413 1750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e522e5dd8d84b3fb22cae56a95a8904. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:47.127694 2124 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_40da3badb9e84e4990e6171bd0dbe8ac" } modify_external_catalogs: true
I20250831 19:54:47.128310 2124 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_40da3badb9e84e4990e6171bd0dbe8ac" } modify_external_catalogs: true
I20250831 19:54:47.130729 2282 tablet_bootstrap.cc:492] T 4e522e5dd8d84b3fb22cae56a95a8904 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:47.132390 2282 tablet_bootstrap.cc:654] T 4e522e5dd8d84b3fb22cae56a95a8904 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:47.141134 2432 tablet.cc:1722] T 07a9cd92870045a7a3e5a8b007bf7f47 P 2441fafe1d62429386f4631ad423567d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:47.143471 2283 tablet_bootstrap.cc:492] T 4e522e5dd8d84b3fb22cae56a95a8904 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:47.144937 2433 tablet.cc:1722] T 07a9cd92870045a7a3e5a8b007bf7f47 P 89aa85d59c53436ebdf3074b13d14825: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:47.145083 2283 tablet_bootstrap.cc:654] T 4e522e5dd8d84b3fb22cae56a95a8904 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:47.147440 2223 raft_consensus.cc:491] T 9248d658274d4e818a75fd663480c3d8 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:47.147639 2223 raft_consensus.cc:513] T 9248d658274d4e818a75fd663480c3d8 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:47.148239 2223 leader_election.cc:290] T 9248d658274d4e818a75fd663480c3d8 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:47.148874 2434 tablet.cc:1722] T 07a9cd92870045a7a3e5a8b007bf7f47 P de831f40fa1348a48a1f0260f4130197: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:47.149102 1772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9248d658274d4e818a75fd663480c3d8" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:47.149276 1772 raft_consensus.cc:2466] T 9248d658274d4e818a75fd663480c3d8 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 0.
I20250831 19:54:47.149791 1570 leader_election.cc:304] T 9248d658274d4e818a75fd663480c3d8 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:47.150102 2223 raft_consensus.cc:2802] T 9248d658274d4e818a75fd663480c3d8 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:47.150177 2223 raft_consensus.cc:491] T 9248d658274d4e818a75fd663480c3d8 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:47.150266 2223 raft_consensus.cc:3058] T 9248d658274d4e818a75fd663480c3d8 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:47.152715 2223 raft_consensus.cc:513] T 9248d658274d4e818a75fd663480c3d8 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:47.153735 1903 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9248d658274d4e818a75fd663480c3d8" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:54:47.153950 1903 raft_consensus.cc:3058] T 9248d658274d4e818a75fd663480c3d8 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:47.157054 1903 raft_consensus.cc:2466] T 9248d658274d4e818a75fd663480c3d8 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1.
I20250831 19:54:47.159945 1568 leader_election.cc:304] T 9248d658274d4e818a75fd663480c3d8 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:54:47.160214 2354 raft_consensus.cc:2802] T 9248d658274d4e818a75fd663480c3d8 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:47.160322 2354 raft_consensus.cc:695] T 9248d658274d4e818a75fd663480c3d8 P 89aa85d59c53436ebdf3074b13d14825 [term 1 LEADER]: Becoming Leader. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Running, Role: LEADER
I20250831 19:54:47.160571 2354 consensus_queue.cc:237] T 9248d658274d4e818a75fd663480c3d8 P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:47.166267 1772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9248d658274d4e818a75fd663480c3d8" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197"
I20250831 19:54:47.166484 1772 raft_consensus.cc:3058] T 9248d658274d4e818a75fd663480c3d8 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:47.166503 1904 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9248d658274d4e818a75fd663480c3d8" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:47.166744 1904 raft_consensus.cc:2374] T 9248d658274d4e818a75fd663480c3d8 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1. Re-sending same reply.
I20250831 19:54:47.169718 1772 raft_consensus.cc:2466] T 9248d658274d4e818a75fd663480c3d8 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1.
I20250831 19:54:47.166249 2284 tablet_bootstrap.cc:492] T 5e8b8c83b1f445018f6a904bd430f736 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:47.170094 2284 ts_tablet_manager.cc:1397] T 5e8b8c83b1f445018f6a904bd430f736 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.106s user 0.007s sys 0.002s
I20250831 19:54:47.171008 2284 raft_consensus.cc:357] T 5e8b8c83b1f445018f6a904bd430f736 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:47.171253 2284 raft_consensus.cc:383] T 5e8b8c83b1f445018f6a904bd430f736 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:47.171334 2284 raft_consensus.cc:738] T 5e8b8c83b1f445018f6a904bd430f736 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:47.171581 2284 consensus_queue.cc:260] T 5e8b8c83b1f445018f6a904bd430f736 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:47.172398 2284 ts_tablet_manager.cc:1428] T 5e8b8c83b1f445018f6a904bd430f736 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250831 19:54:47.173207 2284 tablet_bootstrap.cc:492] T 4e522e5dd8d84b3fb22cae56a95a8904 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:47.174770 2223 leader_election.cc:290] T 9248d658274d4e818a75fd663480c3d8 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Requested vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:47.175160 2284 tablet_bootstrap.cc:654] T 4e522e5dd8d84b3fb22cae56a95a8904 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:47.199935 2284 tablet_bootstrap.cc:492] T 4e522e5dd8d84b3fb22cae56a95a8904 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:47.200099 2284 ts_tablet_manager.cc:1397] T 4e522e5dd8d84b3fb22cae56a95a8904 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.027s user 0.004s sys 0.000s
I20250831 19:54:47.200884 2284 raft_consensus.cc:357] T 4e522e5dd8d84b3fb22cae56a95a8904 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:47.201100 2284 raft_consensus.cc:383] T 4e522e5dd8d84b3fb22cae56a95a8904 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:47.201188 2284 raft_consensus.cc:738] T 4e522e5dd8d84b3fb22cae56a95a8904 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:47.201439 2284 consensus_queue.cc:260] T 4e522e5dd8d84b3fb22cae56a95a8904 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:47.201998 2284 ts_tablet_manager.cc:1428] T 4e522e5dd8d84b3fb22cae56a95a8904 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20250831 19:54:47.207474 2283 tablet_bootstrap.cc:492] T 4e522e5dd8d84b3fb22cae56a95a8904 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:47.207816 2283 ts_tablet_manager.cc:1397] T 4e522e5dd8d84b3fb22cae56a95a8904 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.064s user 0.009s sys 0.003s
I20250831 19:54:47.211273 2283 raft_consensus.cc:357] T 4e522e5dd8d84b3fb22cae56a95a8904 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:47.211542 2283 raft_consensus.cc:383] T 4e522e5dd8d84b3fb22cae56a95a8904 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:47.211676 2283 raft_consensus.cc:738] T 4e522e5dd8d84b3fb22cae56a95a8904 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:47.211983 2283 consensus_queue.cc:260] T 4e522e5dd8d84b3fb22cae56a95a8904 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:47.215204 2283 ts_tablet_manager.cc:1428] T 4e522e5dd8d84b3fb22cae56a95a8904 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20250831 19:54:47.218295 2282 tablet_bootstrap.cc:492] T 4e522e5dd8d84b3fb22cae56a95a8904 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:47.218497 2282 ts_tablet_manager.cc:1397] T 4e522e5dd8d84b3fb22cae56a95a8904 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.088s user 0.003s sys 0.009s
I20250831 19:54:47.219339 2282 raft_consensus.cc:357] T 4e522e5dd8d84b3fb22cae56a95a8904 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:47.219611 2282 raft_consensus.cc:383] T 4e522e5dd8d84b3fb22cae56a95a8904 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:47.219725 2282 raft_consensus.cc:738] T 4e522e5dd8d84b3fb22cae56a95a8904 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:47.219982 2282 consensus_queue.cc:260] T 4e522e5dd8d84b3fb22cae56a95a8904 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:47.220484 2282 ts_tablet_manager.cc:1428] T 4e522e5dd8d84b3fb22cae56a95a8904 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250831 19:54:47.222936 2223 consensus_queue.cc:1035] T 011ffff51cf94c76968725fca7721182 P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:47.247956 2330 consensus_queue.cc:1035] T 011ffff51cf94c76968725fca7721182 P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:47.260958 2125 catalog_manager.cc:5674] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237) does not have the latest schema for tablet 07a9cd92870045a7a3e5a8b007bf7f47 (table default.table_26f70c27ca284c39a6201e33337404a9 [id=ad7bb166843e423ea7e50a1d18710fa1]). Expected version 1 got 0
I20250831 19:54:47.262919 2444 raft_consensus.cc:491] T 4e522e5dd8d84b3fb22cae56a95a8904 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:47.263098 2444 raft_consensus.cc:513] T 4e522e5dd8d84b3fb22cae56a95a8904 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:47.263656 2444 leader_election.cc:290] T 4e522e5dd8d84b3fb22cae56a95a8904 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:47.264231 1634 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4e522e5dd8d84b3fb22cae56a95a8904" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:47.264427 1634 raft_consensus.cc:2466] T 4e522e5dd8d84b3fb22cae56a95a8904 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 0.
I20250831 19:54:47.265017 1904 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4e522e5dd8d84b3fb22cae56a95a8904" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:47.265198 1904 raft_consensus.cc:2466] T 4e522e5dd8d84b3fb22cae56a95a8904 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 0.
I20250831 19:54:47.265708 1706 leader_election.cc:304] T 4e522e5dd8d84b3fb22cae56a95a8904 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:47.266136 2444 raft_consensus.cc:2802] T 4e522e5dd8d84b3fb22cae56a95a8904 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:47.266220 2444 raft_consensus.cc:491] T 4e522e5dd8d84b3fb22cae56a95a8904 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:47.266312 2444 raft_consensus.cc:3058] T 4e522e5dd8d84b3fb22cae56a95a8904 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:47.268903 1750 tablet_service.cc:1468] Processing CreateTablet for tablet 6210e006966a4c1dbe3a2d0388efac30 (DEFAULT_TABLE table=default.table_696724b65868432da5cd0914cbbf40a3 [id=5226b7f2958d4616b3fad9408fdd42cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:47.269277 1750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6210e006966a4c1dbe3a2d0388efac30. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:47.271332 1614 tablet_service.cc:1468] Processing CreateTablet for tablet 6210e006966a4c1dbe3a2d0388efac30 (DEFAULT_TABLE table=default.table_696724b65868432da5cd0914cbbf40a3 [id=5226b7f2958d4616b3fad9408fdd42cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:47.271768 1614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6210e006966a4c1dbe3a2d0388efac30. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:47.272797 2444 raft_consensus.cc:513] T 4e522e5dd8d84b3fb22cae56a95a8904 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:47.273633 1904 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4e522e5dd8d84b3fb22cae56a95a8904" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:54:47.273809 1904 raft_consensus.cc:3058] T 4e522e5dd8d84b3fb22cae56a95a8904 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:47.274192 2444 leader_election.cc:290] T 4e522e5dd8d84b3fb22cae56a95a8904 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Requested vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:47.274881 1884 tablet_service.cc:1468] Processing CreateTablet for tablet 6210e006966a4c1dbe3a2d0388efac30 (DEFAULT_TABLE table=default.table_696724b65868432da5cd0914cbbf40a3 [id=5226b7f2958d4616b3fad9408fdd42cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:47.275229 1884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6210e006966a4c1dbe3a2d0388efac30. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:47.276464 1904 raft_consensus.cc:2466] T 4e522e5dd8d84b3fb22cae56a95a8904 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:54:47.278494 1634 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4e522e5dd8d84b3fb22cae56a95a8904" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:54:47.278659 1634 raft_consensus.cc:3058] T 4e522e5dd8d84b3fb22cae56a95a8904 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:47.278703 2282 tablet_bootstrap.cc:492] T 6210e006966a4c1dbe3a2d0388efac30 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:47.280552 2282 tablet_bootstrap.cc:654] T 6210e006966a4c1dbe3a2d0388efac30 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:47.280638 2283 tablet_bootstrap.cc:492] T 6210e006966a4c1dbe3a2d0388efac30 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:47.281275 1634 raft_consensus.cc:2466] T 4e522e5dd8d84b3fb22cae56a95a8904 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:54:47.282687 2283 tablet_bootstrap.cc:654] T 6210e006966a4c1dbe3a2d0388efac30 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:47.278136 1705 leader_election.cc:304] T 4e522e5dd8d84b3fb22cae56a95a8904 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:47.283071 2445 raft_consensus.cc:2802] T 4e522e5dd8d84b3fb22cae56a95a8904 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:47.283195 2445 raft_consensus.cc:695] T 4e522e5dd8d84b3fb22cae56a95a8904 P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: Becoming Leader. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Running, Role: LEADER
I20250831 19:54:47.283439 2445 consensus_queue.cc:237] T 4e522e5dd8d84b3fb22cae56a95a8904 P de831f40fa1348a48a1f0260f4130197 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:47.292424 2283 tablet_bootstrap.cc:492] T 6210e006966a4c1dbe3a2d0388efac30 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:47.292436 2284 tablet_bootstrap.cc:492] T 6210e006966a4c1dbe3a2d0388efac30 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:47.292589 2283 ts_tablet_manager.cc:1397] T 6210e006966a4c1dbe3a2d0388efac30 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.012s user 0.010s sys 0.001s
I20250831 19:54:47.292850 2282 tablet_bootstrap.cc:492] T 6210e006966a4c1dbe3a2d0388efac30 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:47.292992 2282 ts_tablet_manager.cc:1397] T 6210e006966a4c1dbe3a2d0388efac30 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.008s
I20250831 19:54:47.293340 2283 raft_consensus.cc:357] T 6210e006966a4c1dbe3a2d0388efac30 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:47.293550 2283 raft_consensus.cc:383] T 6210e006966a4c1dbe3a2d0388efac30 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:47.293618 2283 raft_consensus.cc:738] T 6210e006966a4c1dbe3a2d0388efac30 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:47.293730 2282 raft_consensus.cc:357] T 6210e006966a4c1dbe3a2d0388efac30 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:47.293931 2282 raft_consensus.cc:383] T 6210e006966a4c1dbe3a2d0388efac30 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:47.294003 2282 raft_consensus.cc:738] T 6210e006966a4c1dbe3a2d0388efac30 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:47.294239 2282 consensus_queue.cc:260] T 6210e006966a4c1dbe3a2d0388efac30 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:47.294484 2284 tablet_bootstrap.cc:654] T 6210e006966a4c1dbe3a2d0388efac30 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:47.296370 2283 consensus_queue.cc:260] T 6210e006966a4c1dbe3a2d0388efac30 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:47.297044 2282 ts_tablet_manager.cc:1428] T 6210e006966a4c1dbe3a2d0388efac30 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20250831 19:54:47.300082 2125 catalog_manager.cc:6127] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: default.table_26f70c27ca284c39a6201e33337404a9 [id=ad7bb166843e423ea7e50a1d18710fa1] alter complete (version 1)
I20250831 19:54:47.300498 2283 ts_tablet_manager.cc:1428] T 6210e006966a4c1dbe3a2d0388efac30 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20250831 19:54:47.301843 2125 catalog_manager.cc:5582] T 1d5b0a02e35648ec966393f32065d6ee P de831f40fa1348a48a1f0260f4130197 reported cstate change: term changed from 0 to 1, leader changed from <none> to de831f40fa1348a48a1f0260f4130197 (127.1.1.194). New cstate: current_term: 1 leader_uuid: "de831f40fa1348a48a1f0260f4130197" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: UNKNOWN } } }
W20250831 19:54:47.312506 2186 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a7a0312d22284f15a68d90f6e8cd7920 consensus state has no leader
I20250831 19:54:47.313871 2186 catalog_manager.cc:2747] Deleting table default.table_041b766e57be48328a32ed288f99216a [id=c52f5ff0a57742749597f0406f63c8d8] in response to Hive Metastore notification log event 55
I20250831 19:54:47.319500 2284 tablet_bootstrap.cc:492] T 6210e006966a4c1dbe3a2d0388efac30 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:47.319679 2284 ts_tablet_manager.cc:1397] T 6210e006966a4c1dbe3a2d0388efac30 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.027s user 0.009s sys 0.011s
I20250831 19:54:47.320432 2284 raft_consensus.cc:357] T 6210e006966a4c1dbe3a2d0388efac30 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:47.320658 2284 raft_consensus.cc:383] T 6210e006966a4c1dbe3a2d0388efac30 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:47.320726 2284 raft_consensus.cc:738] T 6210e006966a4c1dbe3a2d0388efac30 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:47.321964 2284 consensus_queue.cc:260] T 6210e006966a4c1dbe3a2d0388efac30 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:47.322522 2284 ts_tablet_manager.cc:1428] T 6210e006966a4c1dbe3a2d0388efac30 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20250831 19:54:47.324683 2303 consensus_queue.cc:1035] T 5aa2af1f691a4fa0945d81ba94e03052 P 2441fafe1d62429386f4631ad423567d [LEADER]: Connected to new peer: Peer: permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:47.327673 2186 catalog_manager.cc:5869] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Sending DeleteTablet for 3 replicas of tablet 9248d658274d4e818a75fd663480c3d8
I20250831 19:54:47.328321 1884 tablet_service.cc:1515] Processing DeleteTablet for tablet 9248d658274d4e818a75fd663480c3d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:47 UTC) from {username='slave'} at 127.0.0.1:45906
I20250831 19:54:47.330444 1614 tablet_service.cc:1515] Processing DeleteTablet for tablet 9248d658274d4e818a75fd663480c3d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:47 UTC) from {username='slave'} at 127.0.0.1:51022
I20250831 19:54:47.331346 1750 tablet_service.cc:1515] Processing DeleteTablet for tablet 9248d658274d4e818a75fd663480c3d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:47 UTC) from {username='slave'} at 127.0.0.1:50674
I20250831 19:54:47.337831 2445 consensus_queue.cc:1035] T 6eda2f28ef194cba81661fbf080c5883 P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:47.341414 2354 consensus_queue.cc:1035] T 529eddf7703e4ddc87e974720404fdf3 P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:47.339031 2125 catalog_manager.cc:5582] T 4e522e5dd8d84b3fb22cae56a95a8904 P de831f40fa1348a48a1f0260f4130197 reported cstate change: term changed from 0 to 1, leader changed from <none> to de831f40fa1348a48a1f0260f4130197 (127.1.1.194). New cstate: current_term: 1 leader_uuid: "de831f40fa1348a48a1f0260f4130197" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: UNKNOWN } } }
I20250831 19:54:47.362809 2186 catalog_manager.cc:2747] Deleting table default.table_21109c51ccde402faea41968420775a5 [id=d1d8c4304331413794b75cf39b81ad3a] in response to Hive Metastore notification log event 57
I20250831 19:54:47.365983 2445 raft_consensus.cc:491] T 5e8b8c83b1f445018f6a904bd430f736 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:47.366156 2445 raft_consensus.cc:513] T 5e8b8c83b1f445018f6a904bd430f736 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:47.366869 2445 leader_election.cc:290] T 5e8b8c83b1f445018f6a904bd430f736 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197), 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237)
I20250831 19:54:47.367419 1904 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5e8b8c83b1f445018f6a904bd430f736" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:47.367676 1904 raft_consensus.cc:2466] T 5e8b8c83b1f445018f6a904bd430f736 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 0.
I20250831 19:54:47.367658 1632 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5e8b8c83b1f445018f6a904bd430f736" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:47.367893 1632 raft_consensus.cc:2466] T 5e8b8c83b1f445018f6a904bd430f736 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 0.
I20250831 19:54:47.368134 1705 leader_election.cc:304] T 5e8b8c83b1f445018f6a904bd430f736 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:47.368507 2445 raft_consensus.cc:2802] T 5e8b8c83b1f445018f6a904bd430f736 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:47.368609 2445 raft_consensus.cc:491] T 5e8b8c83b1f445018f6a904bd430f736 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:47.368680 2445 raft_consensus.cc:3058] T 5e8b8c83b1f445018f6a904bd430f736 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:47.373251 2445 raft_consensus.cc:513] T 5e8b8c83b1f445018f6a904bd430f736 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:47.376585 1632 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5e8b8c83b1f445018f6a904bd430f736" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:54:47.376747 1632 raft_consensus.cc:3058] T 5e8b8c83b1f445018f6a904bd430f736 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:47.377679 2445 leader_election.cc:290] T 5e8b8c83b1f445018f6a904bd430f736 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Requested vote from peers 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197), 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237)
I20250831 19:54:47.377928 1904 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5e8b8c83b1f445018f6a904bd430f736" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:54:47.378084 1904 raft_consensus.cc:3058] T 5e8b8c83b1f445018f6a904bd430f736 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:47.379119 1632 raft_consensus.cc:2466] T 5e8b8c83b1f445018f6a904bd430f736 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:54:47.379484 1706 leader_election.cc:304] T 5e8b8c83b1f445018f6a904bd430f736 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:47.381464 1904 raft_consensus.cc:2466] T 5e8b8c83b1f445018f6a904bd430f736 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:54:47.382237 2445 raft_consensus.cc:2802] T 5e8b8c83b1f445018f6a904bd430f736 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:47.382448 2445 raft_consensus.cc:695] T 5e8b8c83b1f445018f6a904bd430f736 P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: Becoming Leader. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Running, Role: LEADER
I20250831 19:54:47.382790 2445 consensus_queue.cc:237] T 5e8b8c83b1f445018f6a904bd430f736 P de831f40fa1348a48a1f0260f4130197 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:47.390280 2186 catalog_manager.cc:5869] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Sending DeleteTablet for 3 replicas of tablet 52329de858ab4af18b3639df57972eb5
I20250831 19:54:47.391855 1885 tablet_service.cc:1515] Processing DeleteTablet for tablet 52329de858ab4af18b3639df57972eb5 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:47 UTC) from {username='slave'} at 127.0.0.1:45906
I20250831 19:54:47.392514 1752 tablet_service.cc:1515] Processing DeleteTablet for tablet 52329de858ab4af18b3639df57972eb5 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:47 UTC) from {username='slave'} at 127.0.0.1:50674
I20250831 19:54:47.399529 2463 tablet_replica.cc:331] T 9248d658274d4e818a75fd663480c3d8 P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:54:47.399904 2461 tablet_replica.cc:331] T 9248d658274d4e818a75fd663480c3d8 P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:54:47.400076 2461 raft_consensus.cc:2241] T 9248d658274d4e818a75fd663480c3d8 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:47.401225 2462 tablet_replica.cc:331] T 9248d658274d4e818a75fd663480c3d8 P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:54:47.401486 2463 raft_consensus.cc:2241] T 9248d658274d4e818a75fd663480c3d8 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:47.401808 2461 raft_consensus.cc:2270] T 9248d658274d4e818a75fd663480c3d8 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:47.402122 2462 raft_consensus.cc:2241] T 9248d658274d4e818a75fd663480c3d8 P 89aa85d59c53436ebdf3074b13d14825 [term 1 LEADER]: Raft consensus shutting down.
I20250831 19:54:47.402415 2463 raft_consensus.cc:2270] T 9248d658274d4e818a75fd663480c3d8 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:47.403043 2461 ts_tablet_manager.cc:1905] T 9248d658274d4e818a75fd663480c3d8 P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:47.403401 2462 pending_rounds.cc:70] T 9248d658274d4e818a75fd663480c3d8 P 89aa85d59c53436ebdf3074b13d14825: Trying to abort 1 pending ops.
I20250831 19:54:47.404008 2463 ts_tablet_manager.cc:1905] T 9248d658274d4e818a75fd663480c3d8 P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:47.404268 2462 pending_rounds.cc:77] T 9248d658274d4e818a75fd663480c3d8 P 89aa85d59c53436ebdf3074b13d14825: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7195320677011673088 op_type: NO_OP noop_request { }
I20250831 19:54:47.409565 2462 raft_consensus.cc:2887] T 9248d658274d4e818a75fd663480c3d8 P 89aa85d59c53436ebdf3074b13d14825 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250831 19:54:47.412009 2462 raft_consensus.cc:2270] T 9248d658274d4e818a75fd663480c3d8 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:47.412897 2462 ts_tablet_manager.cc:1905] T 9248d658274d4e818a75fd663480c3d8 P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:47.414592 2444 raft_consensus.cc:491] T 6210e006966a4c1dbe3a2d0388efac30 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:47.414801 2444 raft_consensus.cc:513] T 6210e006966a4c1dbe3a2d0388efac30 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:47.416136 2444 leader_election.cc:290] T 6210e006966a4c1dbe3a2d0388efac30 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:47.416592 1903 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6210e006966a4c1dbe3a2d0388efac30" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:47.416646 1632 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6210e006966a4c1dbe3a2d0388efac30" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:47.416827 1632 raft_consensus.cc:2466] T 6210e006966a4c1dbe3a2d0388efac30 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 0.
I20250831 19:54:47.419207 2223 consensus_queue.cc:1035] T 529eddf7703e4ddc87e974720404fdf3 P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:47.433988 1706 leader_election.cc:304] T 6210e006966a4c1dbe3a2d0388efac30 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:47.434545 2444 raft_consensus.cc:2802] T 6210e006966a4c1dbe3a2d0388efac30 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:47.434693 2444 raft_consensus.cc:491] T 6210e006966a4c1dbe3a2d0388efac30 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:47.435381 2444 raft_consensus.cc:3058] T 6210e006966a4c1dbe3a2d0388efac30 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:47.438619 1903 raft_consensus.cc:2466] T 6210e006966a4c1dbe3a2d0388efac30 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 0.
I20250831 19:54:47.441164 2444 raft_consensus.cc:513] T 6210e006966a4c1dbe3a2d0388efac30 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:47.446978 1614 tablet_service.cc:1515] Processing DeleteTablet for tablet 52329de858ab4af18b3639df57972eb5 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:47 UTC) from {username='slave'} at 127.0.0.1:51022
I20250831 19:54:47.449841 1632 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6210e006966a4c1dbe3a2d0388efac30" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:54:47.450048 1632 raft_consensus.cc:3058] T 6210e006966a4c1dbe3a2d0388efac30 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:47.452667 1632 raft_consensus.cc:2466] T 6210e006966a4c1dbe3a2d0388efac30 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:54:47.453130 1706 leader_election.cc:304] T 6210e006966a4c1dbe3a2d0388efac30 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:47.453747 2472 raft_consensus.cc:2802] T 6210e006966a4c1dbe3a2d0388efac30 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:47.454679 1904 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6210e006966a4c1dbe3a2d0388efac30" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:54:47.454934 1904 raft_consensus.cc:3058] T 6210e006966a4c1dbe3a2d0388efac30 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:47.455098 2444 leader_election.cc:290] T 6210e006966a4c1dbe3a2d0388efac30 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Requested vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:47.459168 1904 raft_consensus.cc:2466] T 6210e006966a4c1dbe3a2d0388efac30 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:54:47.461563 2433 tablet.cc:1722] T 79a678e2a5ba495095865769a25ff68a P 89aa85d59c53436ebdf3074b13d14825: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250831 19:54:47.463027 2434 tablet.cc:1722] T 79a678e2a5ba495095865769a25ff68a P de831f40fa1348a48a1f0260f4130197: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250831 19:54:47.463403 2125 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_87e103a1db824462bc7d586a4682352e" } new_table_name: "default.Table_bcc81e72ea324a389ebbcc6a6b4512ac" modify_external_catalogs: true
I20250831 19:54:47.464493 2123 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:36958 (request call id 37) took 1943 ms. Trace:
I20250831 19:54:47.464618 2123 rpcz_store.cc:276] 0831 19:54:45.520944 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:45.994761 (+473817us) service_pool.cc:225] Handling call
0831 19:54:46.464156 (+469395us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:47.463875 (+999719us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:47.464192 (+ 317us) catalog_manager.cc:3683] Apply alter schema
0831 19:54:47.464457 (+ 265us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":394,"Hive Metastore.run_cpu_time_us":587,"Hive Metastore.run_wall_time_us":146606}
I20250831 19:54:47.465919 2444 consensus_queue.cc:1035] T 6eda2f28ef194cba81661fbf080c5883 P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:47.467157 2123 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_d0245eccd867474e98fe08e8ef86df18" } new_table_name: "default.Table_d3002519e6964bb484d995d871e766c9" modify_external_catalogs: true
I20250831 19:54:47.460682 2432 tablet.cc:1722] T 79a678e2a5ba495095865769a25ff68a P 2441fafe1d62429386f4631ad423567d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20250831 19:54:47.479249 2120 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_4db5965a988f4976ac4dfcb97cc013f0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250831 19:54:47.479359 2117 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:36958 (request call id 38) took 1858 ms. Trace:
I20250831 19:54:47.479460 2117 rpcz_store.cc:276] 0831 19:54:45.621056 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:46.055299 (+434243us) service_pool.cc:225] Handling call
0831 19:54:46.464348 (+409049us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:47.478803 (+1014455us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:47.479062 (+ 259us) catalog_manager.cc:3683] Apply alter schema
0831 19:54:47.479303 (+ 241us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":146887,"Hive Metastore.run_cpu_time_us":568,"Hive Metastore.run_wall_time_us":163582}
I20250831 19:54:47.483346 2117 master_service.cc:948] ReplaceTablet: received request to replace tablet 9ad8ad70eab04e7abd29597603a1ce33 from {username='slave'} at 127.0.0.1:36958
I20250831 19:54:47.485853 2463 ts_tablet_manager.cc:1918] T 9248d658274d4e818a75fd663480c3d8 P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250831 19:54:47.485967 2463 log.cc:1199] T 9248d658274d4e818a75fd663480c3d8 P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/9248d658274d4e818a75fd663480c3d8
I20250831 19:54:47.486323 2463 ts_tablet_manager.cc:1939] T 9248d658274d4e818a75fd663480c3d8 P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
I20250831 19:54:47.487228 2105 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet 9248d658274d4e818a75fd663480c3d8 (table default.table_041b766e57be48328a32ed288f99216a [id=c52f5ff0a57742749597f0406f63c8d8]) successfully deleted
I20250831 19:54:47.488526 2122 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:36958 (request call id 40) took 1857 ms. Trace:
I20250831 19:54:47.488688 2118 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:36958 (request call id 39) took 1867 ms. Trace:
I20250831 19:54:47.488628 2122 rpcz_store.cc:276] 0831 19:54:45.631471 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:46.195256 (+563785us) service_pool.cc:225] Handling call
0831 19:54:46.464637 (+269381us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:47.488474 (+1023837us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":482674,"Hive Metastore.run_cpu_time_us":179,"Hive Metastore.run_wall_time_us":52025}
I20250831 19:54:47.488792 2118 rpcz_store.cc:276] 0831 19:54:45.621177 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:46.103557 (+482380us) service_pool.cc:225] Handling call
0831 19:54:46.464505 (+360948us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:47.488619 (+1024114us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":310368,"Hive Metastore.run_cpu_time_us":169,"Hive Metastore.run_wall_time_us":91929}
I20250831 19:54:47.489320 2122 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36958:
name: "default.Table_160ddd96ddce4f1788f276ea8535d70b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:47.490753 2462 ts_tablet_manager.cc:1918] T 9248d658274d4e818a75fd663480c3d8 P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:47.490893 2462 log.cc:1199] T 9248d658274d4e818a75fd663480c3d8 P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/9248d658274d4e818a75fd663480c3d8
I20250831 19:54:47.491752 2117 catalog_manager.cc:5869] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Sending DeleteTablet for 3 replicas of tablet 9ad8ad70eab04e7abd29597603a1ce33
I20250831 19:54:47.495491 1750 tablet_service.cc:1515] Processing DeleteTablet for tablet 9ad8ad70eab04e7abd29597603a1ce33 with delete_type TABLET_DATA_DELETED (replaced by tablet f8871812b0734f40b63bef0473e2a58d) from {username='slave'} at 127.0.0.1:50674
I20250831 19:54:47.495769 1884 tablet_service.cc:1515] Processing DeleteTablet for tablet 9ad8ad70eab04e7abd29597603a1ce33 with delete_type TABLET_DATA_DELETED (replaced by tablet f8871812b0734f40b63bef0473e2a58d) from {username='slave'} at 127.0.0.1:45906
I20250831 19:54:47.496037 1614 tablet_service.cc:1515] Processing DeleteTablet for tablet 9ad8ad70eab04e7abd29597603a1ce33 with delete_type TABLET_DATA_DELETED (replaced by tablet f8871812b0734f40b63bef0473e2a58d) from {username='slave'} at 127.0.0.1:51022
I20250831 19:54:47.500185 2461 ts_tablet_manager.cc:1918] T 9248d658274d4e818a75fd663480c3d8 P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250831 19:54:47.500303 2461 log.cc:1199] T 9248d658274d4e818a75fd663480c3d8 P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/9248d658274d4e818a75fd663480c3d8
I20250831 19:54:47.500682 2461 ts_tablet_manager.cc:1939] T 9248d658274d4e818a75fd663480c3d8 P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:54:47.502866 2462 ts_tablet_manager.cc:1939] T 9248d658274d4e818a75fd663480c3d8 P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
I20250831 19:54:47.504364 2463 tablet_replica.cc:331] T 52329de858ab4af18b3639df57972eb5 P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:54:47.504601 2463 raft_consensus.cc:2241] T 52329de858ab4af18b3639df57972eb5 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:47.504778 2463 raft_consensus.cc:2270] T 52329de858ab4af18b3639df57972eb5 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:47.507210 2462 tablet_replica.cc:331] T 52329de858ab4af18b3639df57972eb5 P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:54:47.507401 2462 raft_consensus.cc:2241] T 52329de858ab4af18b3639df57972eb5 P 89aa85d59c53436ebdf3074b13d14825 [term 1 LEADER]: Raft consensus shutting down.
I20250831 19:54:47.507777 2462 raft_consensus.cc:2270] T 52329de858ab4af18b3639df57972eb5 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:47.508175 2303 consensus_queue.cc:1035] T 5aa2af1f691a4fa0945d81ba94e03052 P 2441fafe1d62429386f4631ad423567d [LEADER]: Connected to new peer: Peer: permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:47.509379 2463 ts_tablet_manager.cc:1905] T 52329de858ab4af18b3639df57972eb5 P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:47.494837 2117 catalog_manager.cc:6652] ReplaceTablet: tablet 9ad8ad70eab04e7abd29597603a1ce33 deleted and replaced by tablet f8871812b0734f40b63bef0473e2a58d
I20250831 19:54:47.503886 2104 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet 9248d658274d4e818a75fd663480c3d8 (table default.table_041b766e57be48328a32ed288f99216a [id=c52f5ff0a57742749597f0406f63c8d8]) successfully deleted
I20250831 19:54:47.510650 2117 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:36958 (request call id 52) took 1317 ms. Trace:
I20250831 19:54:47.509033 2101 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet 9248d658274d4e818a75fd663480c3d8 (table default.table_041b766e57be48328a32ed288f99216a [id=c52f5ff0a57742749597f0406f63c8d8]) successfully deleted
I20250831 19:54:47.510793 2117 rpcz_store.cc:276] 0831 19:54:46.192797 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:47.481430 (+1288633us) service_pool.cc:225] Handling call
0831 19:54:47.510605 (+ 29175us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:47.484270 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:47.484369 (+ 99us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:47.484374 (+ 5us) write_op.cc:435] Acquired schema lock
0831 19:54:47.484376 (+ 2us) tablet.cc:660] Decoding operations
0831 19:54:47.484475 (+ 99us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:47.484487 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:47.484492 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:47.484569 (+ 77us) tablet.cc:699] Row locks acquired
0831 19:54:47.484571 (+ 2us) write_op.cc:260] PREPARE: finished
0831 19:54:47.484604 (+ 33us) write_op.cc:270] Start()
0831 19:54:47.484634 (+ 30us) write_op.cc:276] Timestamp: P: 1756670087484558 usec, L: 0
0831 19:54:47.484637 (+ 3us) op_driver.cc:348] REPLICATION: starting
0831 19:54:47.484801 (+ 164us) log.cc:844] Serialized 656 byte log entry
0831 19:54:47.490365 (+ 5564us) op_driver.cc:464] REPLICATION: finished
0831 19:54:47.490504 (+ 139us) write_op.cc:301] APPLY: starting
0831 19:54:47.490523 (+ 19us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:47.490569 (+ 46us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:47.490597 (+ 28us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:47.490709 (+ 112us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:47.490771 (+ 62us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0831 19:54:47.490781 (+ 10us) write_op.cc:312] APPLY: finished
0831 19:54:47.490859 (+ 78us) log.cc:844] Serialized 29 byte log entry
0831 19:54:47.490925 (+ 66us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:47.490945 (+ 20us) write_op.cc:454] Released schema lock
0831 19:54:47.490954 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0831 19:54:47.491075 (+ 121us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:47.491081 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":90,"apply.run_cpu_time_us":515,"apply.run_wall_time_us":515,"num_ops":2,"prepare.queue_time_us":44,"prepare.run_cpu_time_us":640,"prepare.run_wall_time_us":641,"raft.queue_time_us":347,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":185,"replication_time_us":5701}]]}
I20250831 19:54:47.511976 2461 tablet_replica.cc:331] T 52329de858ab4af18b3639df57972eb5 P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:54:47.512507 2462 ts_tablet_manager.cc:1905] T 52329de858ab4af18b3639df57972eb5 P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:47.512872 2461 raft_consensus.cc:2241] T 52329de858ab4af18b3639df57972eb5 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:47.514264 2118 catalog_manager.cc:6127] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: default.table_0ab569c1a9dc4f91af81c84392bc5748 [id=0850f2b0e9324dd0a210fa7b2609c769] alter complete (version 2)
I20250831 19:54:47.515394 2119 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:36958 (request call id 41) took 1881 ms. Trace:
I20250831 19:54:47.515488 2119 rpcz_store.cc:276] 0831 19:54:45.634408 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:46.225944 (+591536us) service_pool.cc:225] Handling call
0831 19:54:46.464677 (+238733us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:47.491277 (+1026600us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:47.515091 (+ 23814us) catalog_manager.cc:3683] Apply alter schema
0831 19:54:47.515345 (+ 254us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":401691,"Hive Metastore.run_cpu_time_us":689,"Hive Metastore.run_wall_time_us":81026}
I20250831 19:54:47.516317 2120 catalog_manager.cc:2149] created HMS catalog entry for table [id=7deae0a4a0124436a9a1f7b5acd6bd70]
I20250831 19:54:47.517582 2461 raft_consensus.cc:2270] T 52329de858ab4af18b3639df57972eb5 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:47.519174 1750 tablet_service.cc:1468] Processing CreateTablet for tablet f8871812b0734f40b63bef0473e2a58d (DEFAULT_TABLE table=default.table_87e103a1db824462bc7d586a4682352e [id=f63d391a9c824314bf6789cc7bbb5ffb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:47.519639 1750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8871812b0734f40b63bef0473e2a58d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:47.525799 1614 tablet_service.cc:1468] Processing CreateTablet for tablet f8871812b0734f40b63bef0473e2a58d (DEFAULT_TABLE table=default.table_87e103a1db824462bc7d586a4682352e [id=f63d391a9c824314bf6789cc7bbb5ffb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:47.527659 2284 tablet_bootstrap.cc:492] T f8871812b0734f40b63bef0473e2a58d P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:47.529538 2284 tablet_bootstrap.cc:654] T f8871812b0734f40b63bef0473e2a58d P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:47.529551 2117 catalog_manager.cc:5582] T 5e8b8c83b1f445018f6a904bd430f736 P de831f40fa1348a48a1f0260f4130197 reported cstate change: term changed from 0 to 1, leader changed from <none> to de831f40fa1348a48a1f0260f4130197 (127.1.1.194). New cstate: current_term: 1 leader_uuid: "de831f40fa1348a48a1f0260f4130197" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: HEALTHY } } }
I20250831 19:54:47.532822 2444 consensus_queue.cc:1035] T 73e83ccb99b643428aef635b8ea90f03 P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:47.541260 2284 tablet_bootstrap.cc:492] T f8871812b0734f40b63bef0473e2a58d P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:47.541486 2284 ts_tablet_manager.cc:1397] T f8871812b0734f40b63bef0473e2a58d P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.006s
I20250831 19:54:47.542865 2223 raft_consensus.cc:491] T a7a0312d22284f15a68d90f6e8cd7920 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:47.543068 2223 raft_consensus.cc:513] T a7a0312d22284f15a68d90f6e8cd7920 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:47.543167 2284 raft_consensus.cc:357] T f8871812b0734f40b63bef0473e2a58d P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:47.543475 2284 raft_consensus.cc:383] T f8871812b0734f40b63bef0473e2a58d P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:47.543689 2223 leader_election.cc:290] T a7a0312d22284f15a68d90f6e8cd7920 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:47.543628 2284 raft_consensus.cc:738] T f8871812b0734f40b63bef0473e2a58d P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:47.544230 1771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a7a0312d22284f15a68d90f6e8cd7920" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:47.544698 1771 raft_consensus.cc:2466] T a7a0312d22284f15a68d90f6e8cd7920 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 0.
I20250831 19:54:47.545161 1570 leader_election.cc:304] T a7a0312d22284f15a68d90f6e8cd7920 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:47.545470 2223 raft_consensus.cc:2802] T a7a0312d22284f15a68d90f6e8cd7920 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:47.545565 2223 raft_consensus.cc:491] T a7a0312d22284f15a68d90f6e8cd7920 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:47.545656 2223 raft_consensus.cc:3058] T a7a0312d22284f15a68d90f6e8cd7920 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:47.548134 2223 raft_consensus.cc:513] T a7a0312d22284f15a68d90f6e8cd7920 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:47.549525 2223 leader_election.cc:290] T a7a0312d22284f15a68d90f6e8cd7920 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Requested vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:47.549566 1772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a7a0312d22284f15a68d90f6e8cd7920" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197"
I20250831 19:54:47.549775 1772 raft_consensus.cc:3058] T a7a0312d22284f15a68d90f6e8cd7920 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:47.518729 1884 tablet_service.cc:1468] Processing CreateTablet for tablet f8871812b0734f40b63bef0473e2a58d (DEFAULT_TABLE table=default.table_87e103a1db824462bc7d586a4682352e [id=f63d391a9c824314bf6789cc7bbb5ffb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:47.550264 1884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8871812b0734f40b63bef0473e2a58d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:47.544227 1903 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a7a0312d22284f15a68d90f6e8cd7920" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:47.549044 1906 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a7a0312d22284f15a68d90f6e8cd7920" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:54:47.553612 1903 raft_consensus.cc:2466] T a7a0312d22284f15a68d90f6e8cd7920 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 0.
I20250831 19:54:47.557296 2283 tablet_bootstrap.cc:492] T f8871812b0734f40b63bef0473e2a58d P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:47.559357 2283 tablet_bootstrap.cc:654] T f8871812b0734f40b63bef0473e2a58d P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:47.559263 2118 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36958:
name: "default.Table_ada526abffc1474c8cebeb3bcbb17824"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:47.561336 2119 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36958:
name: "default.Table_2b373bd597c54990856bf4882d180dcd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:47.566383 1614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8871812b0734f40b63bef0473e2a58d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:47.569370 2120 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:36958 (request call id 46) took 1478 ms. Trace:
I20250831 19:54:47.569626 2120 rpcz_store.cc:276] 0831 19:54:46.091242 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:46.762688 (+671446us) service_pool.cc:225] Handling call
0831 19:54:47.479363 (+716675us) catalog_manager.cc:2076] Acquired catalog manager lock
0831 19:54:47.479931 (+ 568us) catalog_manager.cc:2122] Created new table and tablet info
0831 19:54:47.516286 (+ 36355us) catalog_manager.cc:2148] Created new table in HMS catalog
0831 19:54:47.569124 (+ 52838us) catalog_manager.cc:2182] Wrote table and tablets to system table
0831 19:54:47.569220 (+ 96us) catalog_manager.cc:2216] Inserted table and tablets into CatalogManager maps
0831 19:54:47.569309 (+ 89us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:47.516904 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:47.516987 (+ 83us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:47.516991 (+ 4us) write_op.cc:435] Acquired schema lock
0831 19:54:47.516994 (+ 3us) tablet.cc:660] Decoding operations
0831 19:54:47.517078 (+ 84us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:47.517087 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:47.517091 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:47.517160 (+ 69us) tablet.cc:699] Row locks acquired
0831 19:54:47.517163 (+ 3us) write_op.cc:260] PREPARE: finished
0831 19:54:47.517200 (+ 37us) write_op.cc:270] Start()
0831 19:54:47.517224 (+ 24us) write_op.cc:276] Timestamp: P: 1756670087517153 usec, L: 0
0831 19:54:47.517228 (+ 4us) op_driver.cc:348] REPLICATION: starting
0831 19:54:47.558002 (+ 40774us) log.cc:844] Serialized 433 byte log entry
0831 19:54:47.558339 (+ 337us) spinlock_profiling.cc:243] Waited 40.6 ms on lock 0x616000040c54. stack: 00007f1e3b0dc7d6 00007f1e3b0dc590 00007f1e3a0cf3ad 0000000000972d94 0000000000972d5d 000000000097272a 00007f1e46b38d62 00007f1e47ee12d5 00007f1e47edfdf9 00007f1e47ee8220 00007f1e47ee802d 0000000000a774dc 00007f1e3b122b5f 00007f1e3b125e2b 00007f1e3b125ca8 0000000000a774dc
0831 19:54:47.568500 (+ 10161us) op_driver.cc:464] REPLICATION: finished
0831 19:54:47.568633 (+ 133us) write_op.cc:301] APPLY: starting
0831 19:54:47.568648 (+ 15us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:47.568694 (+ 46us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:47.568697 (+ 3us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:47.568812 (+ 115us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:47.568854 (+ 42us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0831 19:54:47.568864 (+ 10us) write_op.cc:312] APPLY: finished
0831 19:54:47.568957 (+ 93us) log.cc:844] Serialized 29 byte log entry
0831 19:54:47.569019 (+ 62us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:47.569035 (+ 16us) write_op.cc:454] Released schema lock
0831 19:54:47.569041 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0831 19:54:47.569107 (+ 66us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:47.569111 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":43,"Hive Metastore.run_cpu_time_us":228,"Hive Metastore.run_wall_time_us":36029,"child_traces":[["op",{"apply.queue_time_us":88,"apply.run_cpu_time_us":466,"apply.run_wall_time_us":466,"num_ops":2,"prepare.queue_time_us":44,"prepare.run_cpu_time_us":1618,"prepare.run_wall_time_us":41507,"raft.queue_time_us":1925,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":230,"replication_time_us":51244,"spinlock_wait_cycles":93336320}]]}
I20250831 19:54:47.570957 2117 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36958:
name: "default.Table_15260b732e8c4a32ab2c268a74a7dfb7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:47.571847 2461 ts_tablet_manager.cc:1905] T 52329de858ab4af18b3639df57972eb5 P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:47.576475 2120 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36958:
name: "default.Table_31929d9da7554974b50e28cd094fd2df"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:47.581832 1772 raft_consensus.cc:2466] T a7a0312d22284f15a68d90f6e8cd7920 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1.
I20250831 19:54:47.582052 2472 raft_consensus.cc:695] T 6210e006966a4c1dbe3a2d0388efac30 P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: Becoming Leader. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Running, Role: LEADER
I20250831 19:54:47.582301 1570 leader_election.cc:304] T a7a0312d22284f15a68d90f6e8cd7920 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197; no voters: 2441fafe1d62429386f4631ad423567d
I20250831 19:54:47.582707 2223 raft_consensus.cc:2802] T a7a0312d22284f15a68d90f6e8cd7920 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:47.582616 2472 consensus_queue.cc:237] T 6210e006966a4c1dbe3a2d0388efac30 P de831f40fa1348a48a1f0260f4130197 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:47.582837 2223 raft_consensus.cc:695] T a7a0312d22284f15a68d90f6e8cd7920 P 89aa85d59c53436ebdf3074b13d14825 [term 1 LEADER]: Becoming Leader. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Running, Role: LEADER
I20250831 19:54:47.583045 2223 consensus_queue.cc:237] T a7a0312d22284f15a68d90f6e8cd7920 P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
W20250831 19:54:47.583837 2437 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20250831 19:54:47.584219 2437 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20250831 19:54:47.584350 2437 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20250831 19:54:47.586354 2461 ts_tablet_manager.cc:1918] T 52329de858ab4af18b3639df57972eb5 P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:47.587133 2463 ts_tablet_manager.cc:1918] T 52329de858ab4af18b3639df57972eb5 P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:47.587046 2284 consensus_queue.cc:260] T f8871812b0734f40b63bef0473e2a58d P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:47.589222 1613 tablet_service.cc:1468] Processing CreateTablet for tablet c8300924480443bcbad8345cf743bb58 (DEFAULT_TABLE table=default.table_4db5965a988f4976ac4dfcb97cc013f0 [id=7deae0a4a0124436a9a1f7b5acd6bd70]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:47.589614 1613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8300924480443bcbad8345cf743bb58. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:47.590211 2284 ts_tablet_manager.cc:1428] T f8871812b0734f40b63bef0473e2a58d P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.049s user 0.002s sys 0.000s
I20250831 19:54:47.591262 2463 log.cc:1199] T 52329de858ab4af18b3639df57972eb5 P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/52329de858ab4af18b3639df57972eb5
I20250831 19:54:47.591686 2463 ts_tablet_manager.cc:1939] T 52329de858ab4af18b3639df57972eb5 P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
I20250831 19:54:47.592608 2105 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet 52329de858ab4af18b3639df57972eb5 (table default.table_21109c51ccde402faea41968420775a5 [id=d1d8c4304331413794b75cf39b81ad3a]) successfully deleted
I20250831 19:54:47.591643 2283 tablet_bootstrap.cc:492] T f8871812b0734f40b63bef0473e2a58d P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:47.593888 2283 ts_tablet_manager.cc:1397] T f8871812b0734f40b63bef0473e2a58d P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.037s user 0.004s sys 0.007s
I20250831 19:54:47.594414 1750 tablet_service.cc:1468] Processing CreateTablet for tablet c8300924480443bcbad8345cf743bb58 (DEFAULT_TABLE table=default.table_4db5965a988f4976ac4dfcb97cc013f0 [id=7deae0a4a0124436a9a1f7b5acd6bd70]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:47.594611 2283 raft_consensus.cc:357] T f8871812b0734f40b63bef0473e2a58d P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:47.594944 1750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8300924480443bcbad8345cf743bb58. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:47.594960 2283 raft_consensus.cc:383] T f8871812b0734f40b63bef0473e2a58d P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:47.595088 2283 raft_consensus.cc:738] T f8871812b0734f40b63bef0473e2a58d P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:47.595337 2283 consensus_queue.cc:260] T f8871812b0734f40b63bef0473e2a58d P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:47.598634 2283 ts_tablet_manager.cc:1428] T f8871812b0734f40b63bef0473e2a58d P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20250831 19:54:47.602041 2461 log.cc:1199] T 52329de858ab4af18b3639df57972eb5 P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/52329de858ab4af18b3639df57972eb5
I20250831 19:54:47.602573 2461 ts_tablet_manager.cc:1939] T 52329de858ab4af18b3639df57972eb5 P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:54:47.602829 2463 tablet_replica.cc:331] T 9ad8ad70eab04e7abd29597603a1ce33 P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:54:47.603308 2463 raft_consensus.cc:2241] T 9ad8ad70eab04e7abd29597603a1ce33 P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: Raft consensus shutting down.
I20250831 19:54:47.603664 1884 tablet_service.cc:1468] Processing CreateTablet for tablet c8300924480443bcbad8345cf743bb58 (DEFAULT_TABLE table=default.table_4db5965a988f4976ac4dfcb97cc013f0 [id=7deae0a4a0124436a9a1f7b5acd6bd70]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:47.604115 1884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8300924480443bcbad8345cf743bb58. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:47.604130 2474 consensus_queue.cc:1035] T 73e83ccb99b643428aef635b8ea90f03 P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:47.604674 2474 raft_consensus.cc:491] T f8871812b0734f40b63bef0473e2a58d P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:47.604816 2474 raft_consensus.cc:513] T f8871812b0734f40b63bef0473e2a58d P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:47.605118 2101 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet 52329de858ab4af18b3639df57972eb5 (table default.table_21109c51ccde402faea41968420775a5 [id=d1d8c4304331413794b75cf39b81ad3a]) successfully deleted
I20250831 19:54:47.605793 2461 tablet_replica.cc:331] T 9ad8ad70eab04e7abd29597603a1ce33 P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:54:47.606215 2461 raft_consensus.cc:2241] T 9ad8ad70eab04e7abd29597603a1ce33 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:47.606419 1906 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f8871812b0734f40b63bef0473e2a58d" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:47.606619 1906 raft_consensus.cc:2466] T f8871812b0734f40b63bef0473e2a58d P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 0.
I20250831 19:54:47.607081 2461 raft_consensus.cc:2270] T 9ad8ad70eab04e7abd29597603a1ce33 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:47.607626 1705 leader_election.cc:304] T f8871812b0734f40b63bef0473e2a58d P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:47.607877 2444 raft_consensus.cc:2802] T f8871812b0734f40b63bef0473e2a58d P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:47.607992 2444 raft_consensus.cc:491] T f8871812b0734f40b63bef0473e2a58d P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:47.608067 2444 raft_consensus.cc:3058] T f8871812b0734f40b63bef0473e2a58d P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:47.608328 1634 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f8871812b0734f40b63bef0473e2a58d" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
W20250831 19:54:47.608821 1706 leader_election.cc:343] T f8871812b0734f40b63bef0473e2a58d P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): Illegal state: must be running to vote when last-logged opid is not known
I20250831 19:54:47.608984 2474 leader_election.cc:290] T f8871812b0734f40b63bef0473e2a58d P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:47.609997 2282 tablet_bootstrap.cc:492] T f8871812b0734f40b63bef0473e2a58d P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:47.610777 2444 raft_consensus.cc:513] T f8871812b0734f40b63bef0473e2a58d P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:47.611323 2444 leader_election.cc:290] T f8871812b0734f40b63bef0473e2a58d P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Requested vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:47.612154 2282 tablet_bootstrap.cc:654] T f8871812b0734f40b63bef0473e2a58d P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:47.612103 1634 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f8871812b0734f40b63bef0473e2a58d" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
W20250831 19:54:47.612625 1706 leader_election.cc:343] T f8871812b0734f40b63bef0473e2a58d P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): Illegal state: must be running to vote when last-logged opid is not known
I20250831 19:54:47.613225 1906 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f8871812b0734f40b63bef0473e2a58d" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:54:47.613387 1906 raft_consensus.cc:3058] T f8871812b0734f40b63bef0473e2a58d P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:47.616168 1906 raft_consensus.cc:2466] T f8871812b0734f40b63bef0473e2a58d P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:54:47.616633 1705 leader_election.cc:304] T f8871812b0734f40b63bef0473e2a58d P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters: 89aa85d59c53436ebdf3074b13d14825
I20250831 19:54:47.617159 2445 raft_consensus.cc:2802] T f8871812b0734f40b63bef0473e2a58d P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:47.617419 2445 raft_consensus.cc:695] T f8871812b0734f40b63bef0473e2a58d P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: Becoming Leader. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Running, Role: LEADER
I20250831 19:54:47.618444 2445 consensus_queue.cc:237] T f8871812b0734f40b63bef0473e2a58d P de831f40fa1348a48a1f0260f4130197 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:47.620851 2284 tablet_bootstrap.cc:492] T c8300924480443bcbad8345cf743bb58 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:47.604146 2463 raft_consensus.cc:2270] T 9ad8ad70eab04e7abd29597603a1ce33 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:47.624009 2463 ts_tablet_manager.cc:1905] T 9ad8ad70eab04e7abd29597603a1ce33 P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:47.624542 2283 tablet_bootstrap.cc:492] T c8300924480443bcbad8345cf743bb58 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:47.626612 2462 ts_tablet_manager.cc:1918] T 52329de858ab4af18b3639df57972eb5 P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:47.626726 2462 log.cc:1199] T 52329de858ab4af18b3639df57972eb5 P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/52329de858ab4af18b3639df57972eb5
I20250831 19:54:47.630332 2283 tablet_bootstrap.cc:654] T c8300924480443bcbad8345cf743bb58 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:47.632616 2462 ts_tablet_manager.cc:1939] T 52329de858ab4af18b3639df57972eb5 P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
I20250831 19:54:47.633569 2104 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet 52329de858ab4af18b3639df57972eb5 (table default.table_21109c51ccde402faea41968420775a5 [id=d1d8c4304331413794b75cf39b81ad3a]) successfully deleted
I20250831 19:54:47.634217 2284 tablet_bootstrap.cc:654] T c8300924480443bcbad8345cf743bb58 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:47.634742 2462 tablet_replica.cc:331] T 9ad8ad70eab04e7abd29597603a1ce33 P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:54:47.634985 2462 raft_consensus.cc:2241] T 9ad8ad70eab04e7abd29597603a1ce33 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:47.635166 2462 raft_consensus.cc:2270] T 9ad8ad70eab04e7abd29597603a1ce33 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:47.635669 2462 ts_tablet_manager.cc:1905] T 9ad8ad70eab04e7abd29597603a1ce33 P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:47.640928 2282 tablet_bootstrap.cc:492] T f8871812b0734f40b63bef0473e2a58d P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:47.641079 2282 ts_tablet_manager.cc:1397] T f8871812b0734f40b63bef0473e2a58d P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.031s user 0.005s sys 0.009s
I20250831 19:54:47.641938 2282 raft_consensus.cc:357] T f8871812b0734f40b63bef0473e2a58d P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:47.642119 2282 raft_consensus.cc:383] T f8871812b0734f40b63bef0473e2a58d P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:47.642201 2282 raft_consensus.cc:738] T f8871812b0734f40b63bef0473e2a58d P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:47.642432 2282 consensus_queue.cc:260] T f8871812b0734f40b63bef0473e2a58d P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:47.644565 2121 catalog_manager.cc:2706] deleted HMS catalog entry for table default.table_87fbe752a7a54c9eaa7536ba0e611919 [id=8e6395b817aa4efc955cf0ed00f54e14]
I20250831 19:54:47.644989 2282 ts_tablet_manager.cc:1428] T f8871812b0734f40b63bef0473e2a58d P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20250831 19:54:47.646754 2282 tablet_bootstrap.cc:492] T c8300924480443bcbad8345cf743bb58 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:47.652432 2462 ts_tablet_manager.cc:1918] T 9ad8ad70eab04e7abd29597603a1ce33 P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:47.652567 2462 log.cc:1199] T 9ad8ad70eab04e7abd29597603a1ce33 P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/9ad8ad70eab04e7abd29597603a1ce33
W20250831 19:54:47.652738 2437 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20250831 19:54:47.652851 2437 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
I20250831 19:54:47.652916 2462 ts_tablet_manager.cc:1939] T 9ad8ad70eab04e7abd29597603a1ce33 P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
W20250831 19:54:47.652937 2437 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20250831 19:54:47.652992 2437 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20250831 19:54:47.653738 2282 tablet_bootstrap.cc:654] T c8300924480443bcbad8345cf743bb58 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:47.656718 2461 ts_tablet_manager.cc:1905] T 9ad8ad70eab04e7abd29597603a1ce33 P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:47.661007 2463 ts_tablet_manager.cc:1918] T 9ad8ad70eab04e7abd29597603a1ce33 P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:47.662236 2283 tablet_bootstrap.cc:492] T c8300924480443bcbad8345cf743bb58 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:47.662410 2283 ts_tablet_manager.cc:1397] T c8300924480443bcbad8345cf743bb58 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.038s user 0.001s sys 0.005s
I20250831 19:54:47.663230 2283 raft_consensus.cc:357] T c8300924480443bcbad8345cf743bb58 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:47.663407 2283 raft_consensus.cc:383] T c8300924480443bcbad8345cf743bb58 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:47.663484 2283 raft_consensus.cc:738] T c8300924480443bcbad8345cf743bb58 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:47.663743 2283 consensus_queue.cc:260] T c8300924480443bcbad8345cf743bb58 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:47.665335 2283 ts_tablet_manager.cc:1428] T c8300924480443bcbad8345cf743bb58 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20250831 19:54:47.667399 2463 log.cc:1199] T 9ad8ad70eab04e7abd29597603a1ce33 P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/9ad8ad70eab04e7abd29597603a1ce33
I20250831 19:54:47.667824 2104 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet 9ad8ad70eab04e7abd29597603a1ce33 (table default.table_87e103a1db824462bc7d586a4682352e [id=f63d391a9c824314bf6789cc7bbb5ffb]) successfully deleted
I20250831 19:54:47.668895 2461 ts_tablet_manager.cc:1918] T 9ad8ad70eab04e7abd29597603a1ce33 P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:47.669804 2461 log.cc:1199] T 9ad8ad70eab04e7abd29597603a1ce33 P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/9ad8ad70eab04e7abd29597603a1ce33
I20250831 19:54:47.670282 2282 tablet_bootstrap.cc:492] T c8300924480443bcbad8345cf743bb58 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:47.670449 2461 ts_tablet_manager.cc:1939] T 9ad8ad70eab04e7abd29597603a1ce33 P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:54:47.670454 2282 ts_tablet_manager.cc:1397] T c8300924480443bcbad8345cf743bb58 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.025s user 0.003s sys 0.001s
I20250831 19:54:47.670300 2223 raft_consensus.cc:491] T b6eee4e23718478cb107ddbcae2bbec2 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:47.671386 2101 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet 9ad8ad70eab04e7abd29597603a1ce33 (table default.table_87e103a1db824462bc7d586a4682352e [id=f63d391a9c824314bf6789cc7bbb5ffb]) successfully deleted
I20250831 19:54:47.671492 2223 raft_consensus.cc:513] T b6eee4e23718478cb107ddbcae2bbec2 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:47.672108 2463 ts_tablet_manager.cc:1939] T 9ad8ad70eab04e7abd29597603a1ce33 P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
I20250831 19:54:47.672209 2223 leader_election.cc:290] T b6eee4e23718478cb107ddbcae2bbec2 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:47.673221 1903 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b6eee4e23718478cb107ddbcae2bbec2" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:47.673795 1772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b6eee4e23718478cb107ddbcae2bbec2" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:47.674050 1772 raft_consensus.cc:2391] T b6eee4e23718478cb107ddbcae2bbec2 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89aa85d59c53436ebdf3074b13d14825 in current term 1: Already voted for candidate 2441fafe1d62429386f4631ad423567d in this term.
I20250831 19:54:47.674618 2105 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet 9ad8ad70eab04e7abd29597603a1ce33 (table default.table_87e103a1db824462bc7d586a4682352e [id=f63d391a9c824314bf6789cc7bbb5ffb]) successfully deleted
I20250831 19:54:47.675060 1570 leader_election.cc:304] T b6eee4e23718478cb107ddbcae2bbec2 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825; no voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197
I20250831 19:54:47.675415 2223 raft_consensus.cc:3058] T b6eee4e23718478cb107ddbcae2bbec2 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:47.677739 2223 raft_consensus.cc:2747] T b6eee4e23718478cb107ddbcae2bbec2 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250831 19:54:47.671177 2282 raft_consensus.cc:357] T c8300924480443bcbad8345cf743bb58 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:47.667261 2284 tablet_bootstrap.cc:492] T c8300924480443bcbad8345cf743bb58 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:47.678277 2282 raft_consensus.cc:383] T c8300924480443bcbad8345cf743bb58 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:47.678357 2284 ts_tablet_manager.cc:1397] T c8300924480443bcbad8345cf743bb58 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.058s user 0.004s sys 0.000s
I20250831 19:54:47.678390 2282 raft_consensus.cc:738] T c8300924480443bcbad8345cf743bb58 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:47.678699 2282 consensus_queue.cc:260] T c8300924480443bcbad8345cf743bb58 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:47.679049 2303 consensus_queue.cc:1035] T b6eee4e23718478cb107ddbcae2bbec2 P 2441fafe1d62429386f4631ad423567d [LEADER]: Connected to new peer: Peer: permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:47.679070 2284 raft_consensus.cc:357] T c8300924480443bcbad8345cf743bb58 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:47.679229 2284 raft_consensus.cc:383] T c8300924480443bcbad8345cf743bb58 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:47.679306 2284 raft_consensus.cc:738] T c8300924480443bcbad8345cf743bb58 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:47.679538 2284 consensus_queue.cc:260] T c8300924480443bcbad8345cf743bb58 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:47.680089 2284 ts_tablet_manager.cc:1428] T c8300924480443bcbad8345cf743bb58 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250831 19:54:47.681057 2282 ts_tablet_manager.cc:1428] T c8300924480443bcbad8345cf743bb58 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.011s user 0.001s sys 0.001s
I20250831 19:54:47.694074 2239 consensus_queue.cc:1035] T b6eee4e23718478cb107ddbcae2bbec2 P 2441fafe1d62429386f4631ad423567d [LEADER]: Connected to new peer: Peer: permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:47.694289 2437 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.1.212:44077
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-0/wal
--hive_metastore_uris=thrift://127.0.0.1:46163
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.1.254:34259
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.1.254
--webserver_port=34345
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 06466b25e294b4d7d455e6c56263318dc34a80ef
build type FASTDEBUG
built by None at 31 Aug 2025 19:43:25 UTC on 24a791456cd2
build id 7836
ASAN enabled
I20250831 19:54:47.697783 2437 env_posix.cc:2264] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20250831 19:54:47.700374 2437 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250831 19:54:47.722590 2497 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250831 19:54:47.723181 2498 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250831 19:54:47.726049 2500 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250831 19:54:47.726713 2437 server_base.cc:1047] running on GCE node
I20250831 19:54:47.728153 2126 catalog_manager.cc:2706] deleted HMS catalog entry for table default.table_cba30e3477524a4fb902655e070bfce2 [id=b1daf7387b1749019e5377ab08146d20]
I20250831 19:54:47.728688 2437 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20250831 19:54:47.730607 2437 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20250831 19:54:47.731879 2437 hybrid_clock.cc:648] HybridClock initialized: now 1756670087731819 us; error 43 us; skew 500 ppm
I20250831 19:54:47.732333 2437 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250831 19:54:47.740869 2437 webserver.cc:480] Webserver started at http://127.1.1.254:34345/ using document root <none> and password file <none>
I20250831 19:54:47.741967 2437 fs_manager.cc:362] Metadata directory not provided
I20250831 19:54:47.742129 2437 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250831 19:54:47.762495 2437 fs_manager.cc:714] Time spent opening directory manager: real 0.018s user 0.008s sys 0.008s
I20250831 19:54:47.765656 2445 raft_consensus.cc:491] T c8300924480443bcbad8345cf743bb58 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:47.765909 2445 raft_consensus.cc:513] T c8300924480443bcbad8345cf743bb58 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:47.767293 2124 catalog_manager.cc:2706] deleted HMS catalog entry for table default.table_40da3badb9e84e4990e6171bd0dbe8ac [id=115e02286266464593ead506a011b5a0]
I20250831 19:54:47.767634 2445 leader_election.cc:290] T c8300924480443bcbad8345cf743bb58 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:47.768306 1903 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c8300924480443bcbad8345cf743bb58" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:47.768229 1634 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c8300924480443bcbad8345cf743bb58" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:47.768507 1903 raft_consensus.cc:2466] T c8300924480443bcbad8345cf743bb58 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 0.
I20250831 19:54:47.768615 1634 raft_consensus.cc:2466] T c8300924480443bcbad8345cf743bb58 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 0.
I20250831 19:54:47.769090 1705 leader_election.cc:304] T c8300924480443bcbad8345cf743bb58 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:47.769338 2445 raft_consensus.cc:2802] T c8300924480443bcbad8345cf743bb58 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:47.769526 2445 raft_consensus.cc:491] T c8300924480443bcbad8345cf743bb58 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:47.769627 2445 raft_consensus.cc:3058] T c8300924480443bcbad8345cf743bb58 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:47.771318 2445 raft_consensus.cc:513] T c8300924480443bcbad8345cf743bb58 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:47.771796 2445 leader_election.cc:290] T c8300924480443bcbad8345cf743bb58 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Requested vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:47.772302 1634 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c8300924480443bcbad8345cf743bb58" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:54:47.772495 1634 raft_consensus.cc:3058] T c8300924480443bcbad8345cf743bb58 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:47.772461 1903 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c8300924480443bcbad8345cf743bb58" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:54:47.772653 1903 raft_consensus.cc:3058] T c8300924480443bcbad8345cf743bb58 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:47.775266 1903 raft_consensus.cc:2466] T c8300924480443bcbad8345cf743bb58 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:54:47.775640 1705 leader_election.cc:304] T c8300924480443bcbad8345cf743bb58 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:47.775962 2445 raft_consensus.cc:2802] T c8300924480443bcbad8345cf743bb58 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:47.777212 1634 raft_consensus.cc:2466] T c8300924480443bcbad8345cf743bb58 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:54:47.778155 2445 raft_consensus.cc:695] T c8300924480443bcbad8345cf743bb58 P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: Becoming Leader. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Running, Role: LEADER
I20250831 19:54:47.778447 2445 consensus_queue.cc:237] T c8300924480443bcbad8345cf743bb58 P de831f40fa1348a48a1f0260f4130197 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:47.786199 2506 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250831 19:54:47.790334 2437 fs_manager.cc:730] Time spent opening block manager: real 0.024s user 0.006s sys 0.000s
I20250831 19:54:47.790541 2437 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-0/data,/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-0/wal
uuid: "6c830f6055d64a3b8a9f78b405ad8aa3"
format_stamp: "Formatted at 2025-08-31 19:54:38 on dist-test-slave-v4kn"
I20250831 19:54:47.791666 2437 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250831 19:54:47.807929 2123 catalog_manager.cc:3460] renamed table default.table_d0245eccd867474e98fe08e8ef86df18 [id=1137b2754d104964bbe5bbaa4a0578b8] in HMS: new name default.table_d3002519e6964bb484d995d871e766c9
I20250831 19:54:47.851682 2125 catalog_manager.cc:3460] renamed table default.table_87e103a1db824462bc7d586a4682352e [id=f63d391a9c824314bf6789cc7bbb5ffb] in HMS: new name default.table_bcc81e72ea324a389ebbcc6a6b4512ac
I20250831 19:54:47.855010 2186 catalog_manager.cc:2747] Deleting table default.table_87fbe752a7a54c9eaa7536ba0e611919 [id=8e6395b817aa4efc955cf0ed00f54e14] in response to Hive Metastore notification log event 62
I20250831 19:54:47.870631 2437 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250831 19:54:47.871739 2437 env_posix.cc:2264] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20250831 19:54:47.872102 2437 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250831 19:54:47.873641 2186 catalog_manager.cc:5869] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Sending DeleteTablet for 3 replicas of tablet a50607b15c144326bcc2d40f5d3ff4ff
I20250831 19:54:47.874814 2186 catalog_manager.cc:2747] Deleting table default.table_cba30e3477524a4fb902655e070bfce2 [id=b1daf7387b1749019e5377ab08146d20] in response to Hive Metastore notification log event 63
I20250831 19:54:47.876274 1614 tablet_service.cc:1515] Processing DeleteTablet for tablet a50607b15c144326bcc2d40f5d3ff4ff with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:47 UTC) from {username='slave'} at 127.0.0.1:51022
I20250831 19:54:47.876628 2462 tablet_replica.cc:331] T a50607b15c144326bcc2d40f5d3ff4ff P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:54:47.876835 2462 raft_consensus.cc:2241] T a50607b15c144326bcc2d40f5d3ff4ff P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:47.877058 2462 raft_consensus.cc:2270] T a50607b15c144326bcc2d40f5d3ff4ff P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:47.877700 2462 ts_tablet_manager.cc:1905] T a50607b15c144326bcc2d40f5d3ff4ff P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:47.881623 1884 tablet_service.cc:1515] Processing DeleteTablet for tablet a50607b15c144326bcc2d40f5d3ff4ff with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:47 UTC) from {username='slave'} at 127.0.0.1:45906
I20250831 19:54:47.881897 1750 tablet_service.cc:1515] Processing DeleteTablet for tablet a50607b15c144326bcc2d40f5d3ff4ff with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:47 UTC) from {username='slave'} at 127.0.0.1:50674
I20250831 19:54:47.882144 2461 tablet_replica.cc:331] T a50607b15c144326bcc2d40f5d3ff4ff P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:54:47.882344 2461 raft_consensus.cc:2241] T a50607b15c144326bcc2d40f5d3ff4ff P 2441fafe1d62429386f4631ad423567d [term 1 LEADER]: Raft consensus shutting down.
I20250831 19:54:47.882658 2461 raft_consensus.cc:2270] T a50607b15c144326bcc2d40f5d3ff4ff P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:47.883147 2461 ts_tablet_manager.cc:1905] T a50607b15c144326bcc2d40f5d3ff4ff P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:47.885600 2463 tablet_replica.cc:331] T a50607b15c144326bcc2d40f5d3ff4ff P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:54:47.885800 2463 raft_consensus.cc:2241] T a50607b15c144326bcc2d40f5d3ff4ff P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:47.885968 2463 raft_consensus.cc:2270] T a50607b15c144326bcc2d40f5d3ff4ff P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:47.886456 2463 ts_tablet_manager.cc:1905] T a50607b15c144326bcc2d40f5d3ff4ff P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:47.893437 2461 ts_tablet_manager.cc:1918] T a50607b15c144326bcc2d40f5d3ff4ff P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250831 19:54:47.893689 2461 log.cc:1199] T a50607b15c144326bcc2d40f5d3ff4ff P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/a50607b15c144326bcc2d40f5d3ff4ff
I20250831 19:54:47.893839 2462 ts_tablet_manager.cc:1918] T a50607b15c144326bcc2d40f5d3ff4ff P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250831 19:54:47.894004 2462 log.cc:1199] T a50607b15c144326bcc2d40f5d3ff4ff P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/a50607b15c144326bcc2d40f5d3ff4ff
I20250831 19:54:47.894284 2461 ts_tablet_manager.cc:1939] T a50607b15c144326bcc2d40f5d3ff4ff P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:54:47.894503 2462 ts_tablet_manager.cc:1939] T a50607b15c144326bcc2d40f5d3ff4ff P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
I20250831 19:54:47.895515 2101 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet a50607b15c144326bcc2d40f5d3ff4ff (table default.table_87fbe752a7a54c9eaa7536ba0e611919 [id=8e6395b817aa4efc955cf0ed00f54e14]) successfully deleted
I20250831 19:54:47.895752 2104 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet a50607b15c144326bcc2d40f5d3ff4ff (table default.table_87fbe752a7a54c9eaa7536ba0e611919 [id=8e6395b817aa4efc955cf0ed00f54e14]) successfully deleted
I20250831 19:54:47.896624 2186 catalog_manager.cc:5869] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Sending DeleteTablet for 3 replicas of tablet 1a617be966d0410d9c273d6b25e383c4
I20250831 19:54:47.897346 1884 tablet_service.cc:1515] Processing DeleteTablet for tablet 1a617be966d0410d9c273d6b25e383c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:47 UTC) from {username='slave'} at 127.0.0.1:45906
I20250831 19:54:47.897370 1750 tablet_service.cc:1515] Processing DeleteTablet for tablet 1a617be966d0410d9c273d6b25e383c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:47 UTC) from {username='slave'} at 127.0.0.1:50674
I20250831 19:54:47.898089 1614 tablet_service.cc:1515] Processing DeleteTablet for tablet 1a617be966d0410d9c273d6b25e383c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:47 UTC) from {username='slave'} at 127.0.0.1:51022
I20250831 19:54:47.898548 2186 catalog_manager.cc:2747] Deleting table default.table_40da3badb9e84e4990e6171bd0dbe8ac [id=115e02286266464593ead506a011b5a0] in response to Hive Metastore notification log event 64
I20250831 19:54:47.900914 2463 ts_tablet_manager.cc:1918] T a50607b15c144326bcc2d40f5d3ff4ff P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250831 19:54:47.901028 2463 log.cc:1199] T a50607b15c144326bcc2d40f5d3ff4ff P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/a50607b15c144326bcc2d40f5d3ff4ff
I20250831 19:54:47.901368 2463 ts_tablet_manager.cc:1939] T a50607b15c144326bcc2d40f5d3ff4ff P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
I20250831 19:54:47.902379 2105 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet a50607b15c144326bcc2d40f5d3ff4ff (table default.table_87fbe752a7a54c9eaa7536ba0e611919 [id=8e6395b817aa4efc955cf0ed00f54e14]) successfully deleted
I20250831 19:54:47.902688 2463 tablet_replica.cc:331] T 1a617be966d0410d9c273d6b25e383c4 P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:54:47.902868 2462 tablet_replica.cc:331] T 1a617be966d0410d9c273d6b25e383c4 P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:54:47.903054 2463 raft_consensus.cc:2241] T 1a617be966d0410d9c273d6b25e383c4 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:47.903604 2462 raft_consensus.cc:2241] T 1a617be966d0410d9c273d6b25e383c4 P 89aa85d59c53436ebdf3074b13d14825 [term 1 LEADER]: Raft consensus shutting down.
I20250831 19:54:47.903841 2463 raft_consensus.cc:2270] T 1a617be966d0410d9c273d6b25e383c4 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:47.904227 2462 raft_consensus.cc:2270] T 1a617be966d0410d9c273d6b25e383c4 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:47.904701 2463 ts_tablet_manager.cc:1905] T 1a617be966d0410d9c273d6b25e383c4 P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:47.905233 2462 ts_tablet_manager.cc:1905] T 1a617be966d0410d9c273d6b25e383c4 P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:47.908366 2461 tablet_replica.cc:331] T 1a617be966d0410d9c273d6b25e383c4 P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:54:47.909157 2461 raft_consensus.cc:2241] T 1a617be966d0410d9c273d6b25e383c4 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:47.909413 2461 raft_consensus.cc:2270] T 1a617be966d0410d9c273d6b25e383c4 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:47.915064 2461 ts_tablet_manager.cc:1905] T 1a617be966d0410d9c273d6b25e383c4 P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:47.923738 2186 catalog_manager.cc:5869] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Sending DeleteTablet for 3 replicas of tablet 1d5b0a02e35648ec966393f32065d6ee
I20250831 19:54:47.927700 1614 tablet_service.cc:1515] Processing DeleteTablet for tablet 1d5b0a02e35648ec966393f32065d6ee with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:47 UTC) from {username='slave'} at 127.0.0.1:51022
I20250831 19:54:47.928139 1750 tablet_service.cc:1515] Processing DeleteTablet for tablet 1d5b0a02e35648ec966393f32065d6ee with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:47 UTC) from {username='slave'} at 127.0.0.1:50674
I20250831 19:54:47.928539 1884 tablet_service.cc:1515] Processing DeleteTablet for tablet 1d5b0a02e35648ec966393f32065d6ee with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:47 UTC) from {username='slave'} at 127.0.0.1:45906
I20250831 19:54:47.929788 2223 consensus_queue.cc:1035] T f94f30794d6143b1877dd45e589cfe76 P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:47.930548 2462 ts_tablet_manager.cc:1918] T 1a617be966d0410d9c273d6b25e383c4 P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250831 19:54:47.930727 2462 log.cc:1199] T 1a617be966d0410d9c273d6b25e383c4 P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/1a617be966d0410d9c273d6b25e383c4
I20250831 19:54:47.932077 2462 ts_tablet_manager.cc:1939] T 1a617be966d0410d9c273d6b25e383c4 P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
I20250831 19:54:47.938572 2463 ts_tablet_manager.cc:1918] T 1a617be966d0410d9c273d6b25e383c4 P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250831 19:54:47.939107 2104 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet 1a617be966d0410d9c273d6b25e383c4 (table default.table_cba30e3477524a4fb902655e070bfce2 [id=b1daf7387b1749019e5377ab08146d20]) successfully deleted
I20250831 19:54:47.939961 2461 ts_tablet_manager.cc:1918] T 1a617be966d0410d9c273d6b25e383c4 P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250831 19:54:47.940284 2462 tablet_replica.cc:331] T 1d5b0a02e35648ec966393f32065d6ee P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:54:47.940462 2463 log.cc:1199] T 1a617be966d0410d9c273d6b25e383c4 P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/1a617be966d0410d9c273d6b25e383c4
I20250831 19:54:47.940770 2462 raft_consensus.cc:2241] T 1d5b0a02e35648ec966393f32065d6ee P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:47.941246 2463 ts_tablet_manager.cc:1939] T 1a617be966d0410d9c273d6b25e383c4 P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
I20250831 19:54:47.941396 2461 log.cc:1199] T 1a617be966d0410d9c273d6b25e383c4 P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/1a617be966d0410d9c273d6b25e383c4
I20250831 19:54:47.941658 2462 raft_consensus.cc:2270] T 1d5b0a02e35648ec966393f32065d6ee P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:47.942143 2461 ts_tablet_manager.cc:1939] T 1a617be966d0410d9c273d6b25e383c4 P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
W20250831 19:54:47.942595 2186 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f8871812b0734f40b63bef0473e2a58d consensus state has no leader
W20250831 19:54:47.943451 2104 catalog_manager.cc:4726] Async tablet task AlterTable RPC for tablet a7a0312d22284f15a68d90f6e8cd7920 (table default.table_c8611581e59f4d8a94cd6f4da06917a4 [id=bd456415108d49989ef0bc2af91eb2f0], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet a7a0312d22284f15a68d90f6e8cd7920 consensus state has no leader
W20250831 19:54:47.945001 2122 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_160ddd96ddce4f1788f276ea8535d70b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250831 19:54:47.947439 2462 ts_tablet_manager.cc:1905] T 1d5b0a02e35648ec966393f32065d6ee P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:47.948704 2101 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet 1a617be966d0410d9c273d6b25e383c4 (table default.table_cba30e3477524a4fb902655e070bfce2 [id=b1daf7387b1749019e5377ab08146d20]) successfully deleted
I20250831 19:54:47.949960 2105 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet 1a617be966d0410d9c273d6b25e383c4 (table default.table_cba30e3477524a4fb902655e070bfce2 [id=b1daf7387b1749019e5377ab08146d20]) successfully deleted
I20250831 19:54:47.953678 2463 tablet_replica.cc:331] T 1d5b0a02e35648ec966393f32065d6ee P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:54:47.953955 2461 tablet_replica.cc:331] T 1d5b0a02e35648ec966393f32065d6ee P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:54:47.954252 2463 raft_consensus.cc:2241] T 1d5b0a02e35648ec966393f32065d6ee P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: Raft consensus shutting down.
I20250831 19:54:47.954586 2461 raft_consensus.cc:2241] T 1d5b0a02e35648ec966393f32065d6ee P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:47.954917 2463 pending_rounds.cc:70] T 1d5b0a02e35648ec966393f32065d6ee P de831f40fa1348a48a1f0260f4130197: Trying to abort 1 pending ops.
I20250831 19:54:47.955123 2461 raft_consensus.cc:2270] T 1d5b0a02e35648ec966393f32065d6ee P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:47.955276 2463 pending_rounds.cc:77] T 1d5b0a02e35648ec966393f32065d6ee P de831f40fa1348a48a1f0260f4130197: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7195320676795252736 op_type: NO_OP noop_request { }
I20250831 19:54:47.955987 2461 ts_tablet_manager.cc:1905] T 1d5b0a02e35648ec966393f32065d6ee P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:47.956578 2463 raft_consensus.cc:2887] T 1d5b0a02e35648ec966393f32065d6ee P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250831 19:54:47.957115 2463 raft_consensus.cc:2270] T 1d5b0a02e35648ec966393f32065d6ee P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:47.961957 2223 consensus_queue.cc:1035] T f94f30794d6143b1877dd45e589cfe76 P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:47.963306 2463 ts_tablet_manager.cc:1905] T 1d5b0a02e35648ec966393f32065d6ee P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:47.975512 2461 ts_tablet_manager.cc:1918] T 1d5b0a02e35648ec966393f32065d6ee P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250831 19:54:47.975626 2461 log.cc:1199] T 1d5b0a02e35648ec966393f32065d6ee P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/1d5b0a02e35648ec966393f32065d6ee
I20250831 19:54:47.975945 2461 ts_tablet_manager.cc:1939] T 1d5b0a02e35648ec966393f32065d6ee P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:54:47.976984 2101 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet 1d5b0a02e35648ec966393f32065d6ee (table default.table_40da3badb9e84e4990e6171bd0dbe8ac [id=115e02286266464593ead506a011b5a0]) successfully deleted
I20250831 19:54:47.997172 2462 ts_tablet_manager.cc:1918] T 1d5b0a02e35648ec966393f32065d6ee P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250831 19:54:47.997406 2462 log.cc:1199] T 1d5b0a02e35648ec966393f32065d6ee P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/1d5b0a02e35648ec966393f32065d6ee
I20250831 19:54:48.002277 2462 ts_tablet_manager.cc:1939] T 1d5b0a02e35648ec966393f32065d6ee P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
I20250831 19:54:48.003397 2104 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet 1d5b0a02e35648ec966393f32065d6ee (table default.table_40da3badb9e84e4990e6171bd0dbe8ac [id=115e02286266464593ead506a011b5a0]) successfully deleted
I20250831 19:54:48.007874 2463 ts_tablet_manager.cc:1918] T 1d5b0a02e35648ec966393f32065d6ee P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:48.008059 2463 log.cc:1199] T 1d5b0a02e35648ec966393f32065d6ee P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/1d5b0a02e35648ec966393f32065d6ee
I20250831 19:54:48.008530 2463 ts_tablet_manager.cc:1939] T 1d5b0a02e35648ec966393f32065d6ee P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
I20250831 19:54:48.009629 2105 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet 1d5b0a02e35648ec966393f32065d6ee (table default.table_40da3badb9e84e4990e6171bd0dbe8ac [id=115e02286266464593ead506a011b5a0]) successfully deleted
I20250831 19:54:48.013639 2525 tablet.cc:1722] T f318ccc4400f4830b6a80e27b002b562 P 2441fafe1d62429386f4631ad423567d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250831 19:54:48.013797 2526 tablet.cc:1722] T f318ccc4400f4830b6a80e27b002b562 P de831f40fa1348a48a1f0260f4130197: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250831 19:54:48.020812 2122 catalog_manager.cc:2149] created HMS catalog entry for table [id=d39100e5184f4a9ca1932e0d3cd0b243]
I20250831 19:54:48.025182 2533 tablet.cc:1722] T f318ccc4400f4830b6a80e27b002b562 P 89aa85d59c53436ebdf3074b13d14825: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250831 19:54:48.027755 2122 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:36958 (request call id 53) took 1828 ms. Trace:
I20250831 19:54:48.027870 2122 rpcz_store.cc:276] 0831 19:54:46.199576 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:47.489132 (+1289556us) service_pool.cc:225] Handling call
0831 19:54:47.945124 (+455992us) catalog_manager.cc:2076] Acquired catalog manager lock
0831 19:54:47.945820 (+ 696us) catalog_manager.cc:2122] Created new table and tablet info
0831 19:54:48.020758 (+ 74938us) catalog_manager.cc:2148] Created new table in HMS catalog
0831 19:54:48.027484 (+ 6726us) catalog_manager.cc:2182] Wrote table and tablets to system table
0831 19:54:48.027622 (+ 138us) catalog_manager.cc:2216] Inserted table and tablets into CatalogManager maps
0831 19:54:48.027718 (+ 96us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:48.022206 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:48.022376 (+ 170us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:48.022385 (+ 9us) write_op.cc:435] Acquired schema lock
0831 19:54:48.022388 (+ 3us) tablet.cc:660] Decoding operations
0831 19:54:48.022526 (+ 138us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:48.022542 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:48.022550 (+ 8us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:48.022685 (+ 135us) tablet.cc:699] Row locks acquired
0831 19:54:48.022689 (+ 4us) write_op.cc:260] PREPARE: finished
0831 19:54:48.022726 (+ 37us) write_op.cc:270] Start()
0831 19:54:48.022767 (+ 41us) write_op.cc:276] Timestamp: P: 1756670088022677 usec, L: 0
0831 19:54:48.022772 (+ 5us) op_driver.cc:348] REPLICATION: starting
0831 19:54:48.023003 (+ 231us) log.cc:844] Serialized 433 byte log entry
0831 19:54:48.026260 (+ 3257us) op_driver.cc:464] REPLICATION: finished
0831 19:54:48.026386 (+ 126us) write_op.cc:301] APPLY: starting
0831 19:54:48.026401 (+ 15us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:48.026445 (+ 44us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:48.026469 (+ 24us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:48.026617 (+ 148us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:48.026651 (+ 34us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0831 19:54:48.026657 (+ 6us) write_op.cc:312] APPLY: finished
0831 19:54:48.026732 (+ 75us) log.cc:844] Serialized 29 byte log entry
0831 19:54:48.026805 (+ 73us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:48.026822 (+ 17us) write_op.cc:454] Released schema lock
0831 19:54:48.026827 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0831 19:54:48.026887 (+ 60us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:48.026890 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":39,"Hive Metastore.run_cpu_time_us":280,"Hive Metastore.run_wall_time_us":74528,"child_traces":[["op",{"apply.queue_time_us":81,"apply.run_cpu_time_us":493,"apply.run_wall_time_us":494,"num_ops":2,"prepare.queue_time_us":64,"prepare.run_cpu_time_us":928,"prepare.run_wall_time_us":927,"raft.queue_time_us":1289,"raft.run_cpu_time_us":306,"raft.run_wall_time_us":306,"replication_time_us":3461}]]}
I20250831 19:54:48.029541 2122 catalog_manager.cc:5674] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237) does not have the latest schema for tablet f8871812b0734f40b63bef0473e2a58d (table default.table_bcc81e72ea324a389ebbcc6a6b4512ac [id=f63d391a9c824314bf6789cc7bbb5ffb]). Expected version 1 got 0
I20250831 19:54:48.038388 2124 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:36958 (request call id 49) took 1899 ms. Trace:
I20250831 19:54:48.038491 2124 rpcz_store.cc:276] 0831 19:54:46.138930 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:47.127574 (+988644us) service_pool.cc:225] Handling call
0831 19:54:47.547185 (+419611us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:48.038327 (+491142us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":180770,"Hive Metastore.run_cpu_time_us":196,"Hive Metastore.run_wall_time_us":39089}
W20250831 19:54:48.038666 2118 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_ada526abffc1474c8cebeb3bcbb17824 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250831 19:54:48.039036 2119 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_2b373bd597c54990856bf4882d180dcd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250831 19:54:48.039589 2120 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_31929d9da7554974b50e28cd094fd2df in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250831 19:54:48.039759 2121 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:36958 (request call id 47) took 1901 ms. Trace:
I20250831 19:54:48.039851 2121 rpcz_store.cc:276] 0831 19:54:46.138716 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:46.816797 (+678081us) service_pool.cc:225] Handling call
0831 19:54:47.488269 (+671472us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:48.039712 (+551443us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":27759,"Hive Metastore.run_cpu_time_us":168,"Hive Metastore.run_wall_time_us":128197}
I20250831 19:54:48.040908 2126 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:36958 (request call id 48) took 1902 ms. Trace:
I20250831 19:54:48.040992 2126 rpcz_store.cc:276] 0831 19:54:46.138846 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:47.105709 (+966863us) service_pool.cc:225] Handling call
0831 19:54:47.546859 (+441150us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:48.040844 (+493985us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":97350,"Hive Metastore.run_cpu_time_us":205,"Hive Metastore.run_wall_time_us":83645}
W20250831 19:54:48.042014 2117 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_15260b732e8c4a32ab2c268a74a7dfb7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250831 19:54:48.041409 2126 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36958:
name: "default.Table_35ecd102852d45ef82370764dbe230af"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250831 19:54:48.047984 2126 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_35ecd102852d45ef82370764dbe230af in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250831 19:54:48.049957 2123 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:36958 (request call id 51) took 1910 ms. Trace:
I20250831 19:54:48.050071 2123 rpcz_store.cc:276] 0831 19:54:46.139091 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:47.467023 (+1327932us) service_pool.cc:225] Handling call
0831 19:54:47.547377 (+ 80354us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:48.041549 (+494172us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:48.049694 (+ 8145us) catalog_manager.cc:3683] Apply alter schema
0831 19:54:48.049925 (+ 231us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":219655,"Hive Metastore.run_cpu_time_us":764,"Hive Metastore.run_wall_time_us":40572}
I20250831 19:54:48.050351 2123 master_service.cc:948] ReplaceTablet: received request to replace tablet 5aa2af1f691a4fa0945d81ba94e03052 from {username='slave'} at 127.0.0.1:36958
I20250831 19:54:48.051925 2125 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:36958 (request call id 50) took 1912 ms. Trace:
I20250831 19:54:48.052006 2125 rpcz_store.cc:276] 0831 19:54:46.138995 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:47.388709 (+1249714us) service_pool.cc:225] Handling call
0831 19:54:47.547899 (+159190us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:48.041592 (+493693us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:48.051678 (+ 10086us) catalog_manager.cc:3683] Apply alter schema
0831 19:54:48.051873 (+ 195us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":259818,"Hive Metastore.run_cpu_time_us":638,"Hive Metastore.run_wall_time_us":43597}
I20250831 19:54:48.052299 2125 master_service.cc:948] ReplaceTablet: received request to replace tablet 011ffff51cf94c76968725fca7721182 from {username='slave'} at 127.0.0.1:36958
I20250831 19:54:48.076812 2125 catalog_manager.cc:5869] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Sending DeleteTablet for 3 replicas of tablet 011ffff51cf94c76968725fca7721182
I20250831 19:54:48.077227 2125 catalog_manager.cc:6652] ReplaceTablet: tablet 011ffff51cf94c76968725fca7721182 deleted and replaced by tablet 114d1f10fa634e57b570568d83615f46
I20250831 19:54:48.077338 2125 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:36958 (request call id 60) took 1179 ms. Trace:
I20250831 19:54:48.077435 2125 rpcz_store.cc:276] 0831 19:54:46.897660 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:48.052227 (+1154567us) service_pool.cc:225] Handling call
0831 19:54:48.077309 (+ 25082us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:48.057035 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:48.057122 (+ 87us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:48.057126 (+ 4us) write_op.cc:435] Acquired schema lock
0831 19:54:48.057128 (+ 2us) tablet.cc:660] Decoding operations
0831 19:54:48.057211 (+ 83us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:48.057218 (+ 7us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:48.057222 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:48.057275 (+ 53us) tablet.cc:699] Row locks acquired
0831 19:54:48.057278 (+ 3us) write_op.cc:260] PREPARE: finished
0831 19:54:48.057304 (+ 26us) write_op.cc:270] Start()
0831 19:54:48.057327 (+ 23us) write_op.cc:276] Timestamp: P: 1756670088057254 usec, L: 0
0831 19:54:48.057329 (+ 2us) op_driver.cc:348] REPLICATION: starting
0831 19:54:48.061191 (+ 3862us) log.cc:844] Serialized 656 byte log entry
0831 19:54:48.072925 (+ 11734us) op_driver.cc:464] REPLICATION: finished
0831 19:54:48.075946 (+ 3021us) write_op.cc:301] APPLY: starting
0831 19:54:48.075956 (+ 10us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:48.075992 (+ 36us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:48.076021 (+ 29us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:48.076096 (+ 75us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:48.076138 (+ 42us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0831 19:54:48.076145 (+ 7us) write_op.cc:312] APPLY: finished
0831 19:54:48.076194 (+ 49us) log.cc:844] Serialized 29 byte log entry
0831 19:54:48.076229 (+ 35us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:48.076241 (+ 12us) write_op.cc:454] Released schema lock
0831 19:54:48.076246 (+ 5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":2993,"apply.run_cpu_time_us":344,"apply.run_wall_time_us":344,"num_ops":2,"prepare.queue_time_us":4003,"prepare.run_cpu_time_us":542,"prepare.run_wall_time_us":4240,"raft.queue_time_us":52,"raft.run_cpu_time_us":3,"raft.run_wall_time_us":4,"replication_time_us":15569,"threads_started":1}]]}
I20250831 19:54:48.077998 2125 master_service.cc:948] ReplaceTablet: received request to replace tablet 9248d658274d4e818a75fd663480c3d8 from {username='slave'} at 127.0.0.1:36958
I20250831 19:54:48.078635 1614 tablet_service.cc:1515] Processing DeleteTablet for tablet 011ffff51cf94c76968725fca7721182 with delete_type TABLET_DATA_DELETED (replaced by tablet 114d1f10fa634e57b570568d83615f46) from {username='slave'} at 127.0.0.1:51022
I20250831 19:54:48.081815 2462 tablet_replica.cc:331] T 011ffff51cf94c76968725fca7721182 P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:54:48.082042 2462 raft_consensus.cc:2241] T 011ffff51cf94c76968725fca7721182 P 89aa85d59c53436ebdf3074b13d14825 [term 1 LEADER]: Raft consensus shutting down.
I20250831 19:54:48.082285 1750 tablet_service.cc:1515] Processing DeleteTablet for tablet 011ffff51cf94c76968725fca7721182 with delete_type TABLET_DATA_DELETED (replaced by tablet 114d1f10fa634e57b570568d83615f46) from {username='slave'} at 127.0.0.1:50674
I20250831 19:54:48.082378 2462 raft_consensus.cc:2270] T 011ffff51cf94c76968725fca7721182 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:48.083175 1884 tablet_service.cc:1515] Processing DeleteTablet for tablet 011ffff51cf94c76968725fca7721182 with delete_type TABLET_DATA_DELETED (replaced by tablet 114d1f10fa634e57b570568d83615f46) from {username='slave'} at 127.0.0.1:45906
I20250831 19:54:48.083266 2462 ts_tablet_manager.cc:1905] T 011ffff51cf94c76968725fca7721182 P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:48.083431 2461 tablet_replica.cc:331] T 011ffff51cf94c76968725fca7721182 P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:54:48.083600 2461 raft_consensus.cc:2241] T 011ffff51cf94c76968725fca7721182 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:48.083796 2461 raft_consensus.cc:2270] T 011ffff51cf94c76968725fca7721182 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:48.084038 2123 catalog_manager.cc:5869] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Sending DeleteTablet for 3 replicas of tablet 5aa2af1f691a4fa0945d81ba94e03052
I20250831 19:54:48.084561 2123 catalog_manager.cc:6652] ReplaceTablet: tablet 5aa2af1f691a4fa0945d81ba94e03052 deleted and replaced by tablet b6ef0e612b7e4b80af6fa5b2a66242c0
I20250831 19:54:48.084694 2123 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:36958 (request call id 59) took 1279 ms. Trace:
I20250831 19:54:48.084770 2123 rpcz_store.cc:276] 0831 19:54:46.805462 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:48.050301 (+1244839us) service_pool.cc:225] Handling call
0831 19:54:48.084642 (+ 34341us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:48.056398 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:48.056491 (+ 93us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:48.056496 (+ 5us) write_op.cc:435] Acquired schema lock
0831 19:54:48.056498 (+ 2us) tablet.cc:660] Decoding operations
0831 19:54:48.056607 (+ 109us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:48.056620 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:48.056624 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:48.056689 (+ 65us) tablet.cc:699] Row locks acquired
0831 19:54:48.056691 (+ 2us) write_op.cc:260] PREPARE: finished
0831 19:54:48.056724 (+ 33us) write_op.cc:270] Start()
0831 19:54:48.056754 (+ 30us) write_op.cc:276] Timestamp: P: 1756670088056673 usec, L: 0
0831 19:54:48.056758 (+ 4us) op_driver.cc:348] REPLICATION: starting
0831 19:54:48.056917 (+ 159us) log.cc:844] Serialized 656 byte log entry
0831 19:54:48.072843 (+ 15926us) op_driver.cc:464] REPLICATION: finished
0831 19:54:48.073076 (+ 233us) write_op.cc:301] APPLY: starting
0831 19:54:48.073091 (+ 15us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:48.073135 (+ 44us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:48.073163 (+ 28us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:48.073414 (+ 251us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:48.075649 (+ 2235us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0831 19:54:48.075657 (+ 8us) write_op.cc:312] APPLY: finished
0831 19:54:48.075733 (+ 76us) log.cc:844] Serialized 29 byte log entry
0831 19:54:48.075795 (+ 62us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:48.075812 (+ 17us) write_op.cc:454] Released schema lock
0831 19:54:48.075818 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0831 19:54:48.075880 (+ 62us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:48.075884 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":181,"apply.run_cpu_time_us":646,"apply.run_wall_time_us":2797,"num_ops":2,"prepare.queue_time_us":5153,"prepare.run_cpu_time_us":613,"prepare.run_wall_time_us":614,"raft.queue_time_us":1303,"raft.run_cpu_time_us":263,"raft.run_wall_time_us":262,"replication_time_us":16049}]]}
I20250831 19:54:48.085361 2123 master_service.cc:948] ReplaceTablet: received request to replace tablet 1d5b0a02e35648ec966393f32065d6ee from {username='slave'} at 127.0.0.1:36958
I20250831 19:54:48.085843 2461 ts_tablet_manager.cc:1905] T 011ffff51cf94c76968725fca7721182 P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:48.086006 1614 tablet_service.cc:1515] Processing DeleteTablet for tablet 5aa2af1f691a4fa0945d81ba94e03052 with delete_type TABLET_DATA_DELETED (replaced by tablet b6ef0e612b7e4b80af6fa5b2a66242c0) from {username='slave'} at 127.0.0.1:51022
I20250831 19:54:48.086768 1750 tablet_service.cc:1515] Processing DeleteTablet for tablet 5aa2af1f691a4fa0945d81ba94e03052 with delete_type TABLET_DATA_DELETED (replaced by tablet b6ef0e612b7e4b80af6fa5b2a66242c0) from {username='slave'} at 127.0.0.1:50674
I20250831 19:54:48.087229 1884 tablet_service.cc:1515] Processing DeleteTablet for tablet 5aa2af1f691a4fa0945d81ba94e03052 with delete_type TABLET_DATA_DELETED (replaced by tablet b6ef0e612b7e4b80af6fa5b2a66242c0) from {username='slave'} at 127.0.0.1:45906
I20250831 19:54:48.089265 2123 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:36958 (request call id 62) took 1074 ms. Trace:
I20250831 19:54:48.089742 2462 ts_tablet_manager.cc:1918] T 011ffff51cf94c76968725fca7721182 P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:48.090062 2462 log.cc:1199] T 011ffff51cf94c76968725fca7721182 P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/011ffff51cf94c76968725fca7721182
I20250831 19:54:48.090376 2125 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:36958 (request call id 61) took 1132 ms. Trace:
I20250831 19:54:48.090513 2462 ts_tablet_manager.cc:1939] T 011ffff51cf94c76968725fca7721182 P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
I20250831 19:54:48.090538 2125 rpcz_store.cc:276] 0831 19:54:46.958108 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:48.077945 (+1119837us) service_pool.cc:225] Handling call
0831 19:54:48.090171 (+ 12226us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x616000040c54. stack: 00007f1e3b0dc7d6 00007f1e3b0dc590 00007f1e3a0cf3ad 0000000000972d94 0000000000972d5d 00007f1e49ea714d 00007f1e49ea7243 00007f1e46b66941 00007f1e4e6f1a5d 00007f1e4e887bdb 00007f1e456bf0e7 00007f1e456bee15 00007f1e41e8a2ce 00007f1e41e891ae 00007f1e41e8f3e5 00007f1e41e8fd0f
0831 19:54:48.090325 (+ 154us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":27473792}
I20250831 19:54:48.091403 2462 tablet_replica.cc:331] T 5aa2af1f691a4fa0945d81ba94e03052 P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:54:48.091502 2104 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet 011ffff51cf94c76968725fca7721182 (table default.table_9706596e6715417ebc8fb06420b56bde [id=aabaa79336954b3ab0450dcff3afa7bf]) successfully deleted
I20250831 19:54:48.091557 2461 ts_tablet_manager.cc:1918] T 011ffff51cf94c76968725fca7721182 P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:48.091595 2462 raft_consensus.cc:2241] T 5aa2af1f691a4fa0945d81ba94e03052 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:48.091660 2461 log.cc:1199] T 011ffff51cf94c76968725fca7721182 P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/011ffff51cf94c76968725fca7721182
I20250831 19:54:48.092000 2462 raft_consensus.cc:2270] T 5aa2af1f691a4fa0945d81ba94e03052 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:48.092088 2461 ts_tablet_manager.cc:1939] T 011ffff51cf94c76968725fca7721182 P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:54:48.092830 2462 ts_tablet_manager.cc:1905] T 5aa2af1f691a4fa0945d81ba94e03052 P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:48.092963 2461 tablet_replica.cc:331] T 5aa2af1f691a4fa0945d81ba94e03052 P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:54:48.093058 2101 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet 011ffff51cf94c76968725fca7721182 (table default.table_9706596e6715417ebc8fb06420b56bde [id=aabaa79336954b3ab0450dcff3afa7bf]) successfully deleted
I20250831 19:54:48.093145 2461 raft_consensus.cc:2241] T 5aa2af1f691a4fa0945d81ba94e03052 P 2441fafe1d62429386f4631ad423567d [term 1 LEADER]: Raft consensus shutting down.
I20250831 19:54:48.093374 2125 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36958:
name: "default.Table_a01df8e629084e9c988bca1b80c7d640"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:48.093966 2461 raft_consensus.cc:2270] T 5aa2af1f691a4fa0945d81ba94e03052 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:48.094739 2461 ts_tablet_manager.cc:1905] T 5aa2af1f691a4fa0945d81ba94e03052 P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:48.089370 2123 rpcz_store.cc:276] 0831 19:54:47.014409 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:48.085291 (+1070882us) service_pool.cc:225] Handling call
0831 19:54:48.089049 (+ 3758us) spinlock_profiling.cc:243] Waited 3.4 ms on lock 0x616000040c54. stack: 00007f1e3b0dc7d6 00007f1e3b0dc590 00007f1e3a0cf3ad 0000000000972d94 0000000000972d5d 00007f1e49ea714d 00007f1e49ea7243 00007f1e46b66941 00007f1e4e6f1a5d 00007f1e4e887bdb 00007f1e456bf0e7 00007f1e456bee15 00007f1e41e8a2ce 00007f1e41e891ae 00007f1e41e8f3e5 00007f1e41e8fd0f
0831 19:54:48.089216 (+ 167us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":7819008}
I20250831 19:54:48.101076 2461 ts_tablet_manager.cc:1918] T 5aa2af1f691a4fa0945d81ba94e03052 P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:48.101285 2461 log.cc:1199] T 5aa2af1f691a4fa0945d81ba94e03052 P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/5aa2af1f691a4fa0945d81ba94e03052
I20250831 19:54:48.101752 2461 ts_tablet_manager.cc:1939] T 5aa2af1f691a4fa0945d81ba94e03052 P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:54:48.101866 2123 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36958:
name: "default.Table_0c22133a9af24fe3b029fc31f3c63625"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:48.104841 2462 ts_tablet_manager.cc:1918] T 5aa2af1f691a4fa0945d81ba94e03052 P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:48.104969 2462 log.cc:1199] T 5aa2af1f691a4fa0945d81ba94e03052 P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/5aa2af1f691a4fa0945d81ba94e03052
I20250831 19:54:48.105049 1750 tablet_service.cc:1468] Processing CreateTablet for tablet b7576e353a1c46b5af830f437afcb207 (DEFAULT_TABLE table=default.table_160ddd96ddce4f1788f276ea8535d70b [id=d39100e5184f4a9ca1932e0d3cd0b243]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:48.105357 2462 ts_tablet_manager.cc:1939] T 5aa2af1f691a4fa0945d81ba94e03052 P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
I20250831 19:54:48.105422 1750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7576e353a1c46b5af830f437afcb207. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:48.110016 1614 tablet_service.cc:1468] Processing CreateTablet for tablet b7576e353a1c46b5af830f437afcb207 (DEFAULT_TABLE table=default.table_160ddd96ddce4f1788f276ea8535d70b [id=d39100e5184f4a9ca1932e0d3cd0b243]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:48.110389 1614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7576e353a1c46b5af830f437afcb207. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:48.122483 1752 tablet_service.cc:1468] Processing CreateTablet for tablet b6ef0e612b7e4b80af6fa5b2a66242c0 (DEFAULT_TABLE table=default.table_544f7d804f564e83be8fb83049aa8dea [id=2cd4af6b415c4e3a92a3732fa145aa42]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:48.122913 1752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6ef0e612b7e4b80af6fa5b2a66242c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:48.103581 2101 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet 5aa2af1f691a4fa0945d81ba94e03052 (table default.table_544f7d804f564e83be8fb83049aa8dea [id=2cd4af6b415c4e3a92a3732fa145aa42]) successfully deleted
I20250831 19:54:48.109539 2104 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet 5aa2af1f691a4fa0945d81ba94e03052 (table default.table_544f7d804f564e83be8fb83049aa8dea [id=2cd4af6b415c4e3a92a3732fa145aa42]) successfully deleted
I20250831 19:54:48.121412 2124 catalog_manager.cc:5582] T a7a0312d22284f15a68d90f6e8cd7920 P 89aa85d59c53436ebdf3074b13d14825 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193). New cstate: current_term: 1 leader_uuid: "89aa85d59c53436ebdf3074b13d14825" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: UNKNOWN } } }
I20250831 19:54:48.125828 2124 catalog_manager.cc:5674] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197) does not have the latest schema for tablet a7a0312d22284f15a68d90f6e8cd7920 (table default.table_c8611581e59f4d8a94cd6f4da06917a4 [id=bd456415108d49989ef0bc2af91eb2f0]). Expected version 3 got 0
I20250831 19:54:48.127808 1612 tablet_service.cc:1468] Processing CreateTablet for tablet 114d1f10fa634e57b570568d83615f46 (DEFAULT_TABLE table=default.table_9706596e6715417ebc8fb06420b56bde [id=aabaa79336954b3ab0450dcff3afa7bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:48.128243 1612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 114d1f10fa634e57b570568d83615f46. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:48.128651 1751 tablet_service.cc:1468] Processing CreateTablet for tablet 114d1f10fa634e57b570568d83615f46 (DEFAULT_TABLE table=default.table_9706596e6715417ebc8fb06420b56bde [id=aabaa79336954b3ab0450dcff3afa7bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:48.128990 1751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 114d1f10fa634e57b570568d83615f46. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:48.129784 1613 tablet_service.cc:1468] Processing CreateTablet for tablet b6ef0e612b7e4b80af6fa5b2a66242c0 (DEFAULT_TABLE table=default.table_544f7d804f564e83be8fb83049aa8dea [id=2cd4af6b415c4e3a92a3732fa145aa42]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:48.130071 1613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6ef0e612b7e4b80af6fa5b2a66242c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:48.134279 1885 tablet_service.cc:1468] Processing CreateTablet for tablet b6ef0e612b7e4b80af6fa5b2a66242c0 (DEFAULT_TABLE table=default.table_544f7d804f564e83be8fb83049aa8dea [id=2cd4af6b415c4e3a92a3732fa145aa42]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:48.134361 1886 tablet_service.cc:1468] Processing CreateTablet for tablet 114d1f10fa634e57b570568d83615f46 (DEFAULT_TABLE table=default.table_9706596e6715417ebc8fb06420b56bde [id=aabaa79336954b3ab0450dcff3afa7bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:48.134676 1885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6ef0e612b7e4b80af6fa5b2a66242c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:48.134884 1886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 114d1f10fa634e57b570568d83615f46. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:48.135227 1884 tablet_service.cc:1468] Processing CreateTablet for tablet b7576e353a1c46b5af830f437afcb207 (DEFAULT_TABLE table=default.table_160ddd96ddce4f1788f276ea8535d70b [id=d39100e5184f4a9ca1932e0d3cd0b243]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:48.135675 1884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7576e353a1c46b5af830f437afcb207. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:48.142856 2283 tablet_bootstrap.cc:492] T 114d1f10fa634e57b570568d83615f46 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:48.122879 2121 catalog_manager.cc:5582] T 6210e006966a4c1dbe3a2d0388efac30 P de831f40fa1348a48a1f0260f4130197 reported cstate change: term changed from 0 to 1, leader changed from <none> to de831f40fa1348a48a1f0260f4130197 (127.1.1.194). New cstate: current_term: 1 leader_uuid: "de831f40fa1348a48a1f0260f4130197" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: UNKNOWN } } }
I20250831 19:54:48.144382 2283 tablet_bootstrap.cc:654] T 114d1f10fa634e57b570568d83615f46 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
W20250831 19:54:48.155121 2105 consensus_peers.cc:489] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 -> Peer 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259): Couldn't send request to peer 6c830f6055d64a3b8a9f78b405ad8aa3. Status: Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20250831 19:54:48.156610 2282 tablet_bootstrap.cc:492] T b6ef0e612b7e4b80af6fa5b2a66242c0 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:48.157897 2283 tablet_bootstrap.cc:492] T 114d1f10fa634e57b570568d83615f46 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:48.158113 2283 ts_tablet_manager.cc:1397] T 114d1f10fa634e57b570568d83615f46 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.007s
I20250831 19:54:48.158187 2282 tablet_bootstrap.cc:654] T b6ef0e612b7e4b80af6fa5b2a66242c0 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:48.159056 2283 raft_consensus.cc:357] T 114d1f10fa634e57b570568d83615f46 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:48.159319 2283 raft_consensus.cc:383] T 114d1f10fa634e57b570568d83615f46 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:48.159439 2283 raft_consensus.cc:738] T 114d1f10fa634e57b570568d83615f46 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:48.159716 2283 consensus_queue.cc:260] T 114d1f10fa634e57b570568d83615f46 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:48.160712 2122 catalog_manager.cc:5674] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237) does not have the latest schema for tablet f8871812b0734f40b63bef0473e2a58d (table default.table_bcc81e72ea324a389ebbcc6a6b4512ac [id=f63d391a9c824314bf6789cc7bbb5ffb]). Expected version 1 got 0
I20250831 19:54:48.161283 2283 ts_tablet_manager.cc:1428] T 114d1f10fa634e57b570568d83615f46 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
I20250831 19:54:48.161556 2283 tablet_bootstrap.cc:492] T b6ef0e612b7e4b80af6fa5b2a66242c0 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:48.161806 2463 tablet_replica.cc:331] T 011ffff51cf94c76968725fca7721182 P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:54:48.163008 2463 raft_consensus.cc:2241] T 011ffff51cf94c76968725fca7721182 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:48.163226 2463 raft_consensus.cc:2270] T 011ffff51cf94c76968725fca7721182 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:48.163564 2284 tablet_bootstrap.cc:492] T b7576e353a1c46b5af830f437afcb207 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:48.165238 2283 tablet_bootstrap.cc:654] T b6ef0e612b7e4b80af6fa5b2a66242c0 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:48.165334 2284 tablet_bootstrap.cc:654] T b7576e353a1c46b5af830f437afcb207 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:48.166126 2124 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36958:
name: "default.Table_4b100a5c91f9467497d138af9f82f726"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:48.173801 2239 raft_consensus.cc:491] T 114d1f10fa634e57b570568d83615f46 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:48.173964 2239 raft_consensus.cc:513] T 114d1f10fa634e57b570568d83615f46 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:48.174589 2239 leader_election.cc:290] T 114d1f10fa634e57b570568d83615f46 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:48.175027 1771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "114d1f10fa634e57b570568d83615f46" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:48.175117 1634 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "114d1f10fa634e57b570568d83615f46" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
W20250831 19:54:48.175621 1841 leader_election.cc:343] T 114d1f10fa634e57b570568d83615f46 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): Illegal state: must be running to vote when last-logged opid is not known
W20250831 19:54:48.175791 1842 leader_election.cc:343] T 114d1f10fa634e57b570568d83615f46 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): Illegal state: must be running to vote when last-logged opid is not known
I20250831 19:54:48.175951 1842 leader_election.cc:304] T 114d1f10fa634e57b570568d83615f46 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2441fafe1d62429386f4631ad423567d; no voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197
I20250831 19:54:48.176227 2239 raft_consensus.cc:2747] T 114d1f10fa634e57b570568d83615f46 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250831 19:54:48.178390 2121 catalog_manager.cc:5674] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197) does not have the latest schema for tablet f8871812b0734f40b63bef0473e2a58d (table default.table_bcc81e72ea324a389ebbcc6a6b4512ac [id=f63d391a9c824314bf6789cc7bbb5ffb]). Expected version 1 got 0
I20250831 19:54:48.181277 2445 consensus_queue.cc:1035] T 5e8b8c83b1f445018f6a904bd430f736 P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:48.182881 2122 catalog_manager.cc:6127] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: default.table_d3002519e6964bb484d995d871e766c9 [id=1137b2754d104964bbe5bbaa4a0578b8] alter complete (version 3)
I20250831 19:54:48.189091 2472 consensus_queue.cc:1035] T 5e8b8c83b1f445018f6a904bd430f736 P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:48.206431 1750 tablet_service.cc:1515] Processing DeleteTablet for tablet 9ad8ad70eab04e7abd29597603a1ce33 with delete_type TABLET_DATA_DELETED (replaced by tablet f8871812b0734f40b63bef0473e2a58d) from {username='slave'} at 127.0.0.1:50674
I20250831 19:54:48.216694 2463 ts_tablet_manager.cc:1905] T 011ffff51cf94c76968725fca7721182 P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:48.247617 2122 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_26f70c27ca284c39a6201e33337404a9" } new_table_name: "default.Table_6c2f9309b58643529114857aae0568f2" modify_external_catalogs: true
I20250831 19:54:48.252135 2330 raft_consensus.cc:491] T f8871812b0734f40b63bef0473e2a58d P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:48.252396 2330 raft_consensus.cc:513] T f8871812b0734f40b63bef0473e2a58d P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:48.253214 2330 leader_election.cc:290] T f8871812b0734f40b63bef0473e2a58d P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:48.254211 1771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f8871812b0734f40b63bef0473e2a58d" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:48.255163 1906 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f8871812b0734f40b63bef0473e2a58d" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:48.255451 1906 raft_consensus.cc:2391] T f8871812b0734f40b63bef0473e2a58d P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89aa85d59c53436ebdf3074b13d14825 in current term 1: Already voted for candidate de831f40fa1348a48a1f0260f4130197 in this term.
I20250831 19:54:48.256273 1570 leader_election.cc:304] T f8871812b0734f40b63bef0473e2a58d P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825; no voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197
I20250831 19:54:48.256947 2330 raft_consensus.cc:3058] T f8871812b0734f40b63bef0473e2a58d P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:48.258690 2121 catalog_manager.cc:5582] T c8300924480443bcbad8345cf743bb58 P de831f40fa1348a48a1f0260f4130197 reported cstate change: term changed from 0 to 1, leader changed from <none> to de831f40fa1348a48a1f0260f4130197 (127.1.1.194). New cstate: current_term: 1 leader_uuid: "de831f40fa1348a48a1f0260f4130197" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: HEALTHY } } }
I20250831 19:54:48.259305 2121 catalog_manager.cc:5582] T f8871812b0734f40b63bef0473e2a58d P de831f40fa1348a48a1f0260f4130197 reported cstate change: term changed from 0 to 1, leader changed from <none> to de831f40fa1348a48a1f0260f4130197 (127.1.1.194). New cstate: current_term: 1 leader_uuid: "de831f40fa1348a48a1f0260f4130197" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: UNKNOWN } } }
I20250831 19:54:48.259780 2121 catalog_manager.cc:5674] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475) does not have the latest schema for tablet f8871812b0734f40b63bef0473e2a58d (table default.table_bcc81e72ea324a389ebbcc6a6b4512ac [id=f63d391a9c824314bf6789cc7bbb5ffb]). Expected version 1 got 0
I20250831 19:54:48.260356 2330 raft_consensus.cc:2747] T f8871812b0734f40b63bef0473e2a58d P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250831 19:54:48.268390 2282 tablet_bootstrap.cc:492] T b6ef0e612b7e4b80af6fa5b2a66242c0 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:48.268570 2282 ts_tablet_manager.cc:1397] T b6ef0e612b7e4b80af6fa5b2a66242c0 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.112s user 0.004s sys 0.008s
I20250831 19:54:48.269552 2282 raft_consensus.cc:357] T b6ef0e612b7e4b80af6fa5b2a66242c0 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:48.269781 2282 raft_consensus.cc:383] T b6ef0e612b7e4b80af6fa5b2a66242c0 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:48.269886 2282 raft_consensus.cc:738] T b6ef0e612b7e4b80af6fa5b2a66242c0 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:48.270171 2282 consensus_queue.cc:260] T b6ef0e612b7e4b80af6fa5b2a66242c0 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:48.270807 2282 ts_tablet_manager.cc:1428] T b6ef0e612b7e4b80af6fa5b2a66242c0 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20250831 19:54:48.271903 2282 tablet_bootstrap.cc:492] T b7576e353a1c46b5af830f437afcb207 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:48.277050 2282 tablet_bootstrap.cc:654] T b7576e353a1c46b5af830f437afcb207 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:48.282959 2284 tablet_bootstrap.cc:492] T b7576e353a1c46b5af830f437afcb207 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:48.283140 2284 ts_tablet_manager.cc:1397] T b7576e353a1c46b5af830f437afcb207 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.120s user 0.019s sys 0.003s
I20250831 19:54:48.284052 2284 raft_consensus.cc:357] T b7576e353a1c46b5af830f437afcb207 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:48.284269 2284 raft_consensus.cc:383] T b7576e353a1c46b5af830f437afcb207 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:48.284371 2284 raft_consensus.cc:738] T b7576e353a1c46b5af830f437afcb207 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:48.284648 2284 consensus_queue.cc:260] T b7576e353a1c46b5af830f437afcb207 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:48.285221 2284 ts_tablet_manager.cc:1428] T b7576e353a1c46b5af830f437afcb207 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250831 19:54:48.285524 2284 tablet_bootstrap.cc:492] T 114d1f10fa634e57b570568d83615f46 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:48.288023 2463 ts_tablet_manager.cc:1918] T 011ffff51cf94c76968725fca7721182 P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:48.288168 2463 log.cc:1199] T 011ffff51cf94c76968725fca7721182 P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/011ffff51cf94c76968725fca7721182
I20250831 19:54:48.288569 2463 ts_tablet_manager.cc:1939] T 011ffff51cf94c76968725fca7721182 P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
I20250831 19:54:48.289040 2463 tablet_replica.cc:331] T 5aa2af1f691a4fa0945d81ba94e03052 P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:54:48.289224 2463 raft_consensus.cc:2241] T 5aa2af1f691a4fa0945d81ba94e03052 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:48.289381 2463 raft_consensus.cc:2270] T 5aa2af1f691a4fa0945d81ba94e03052 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:48.289907 2105 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet 011ffff51cf94c76968725fca7721182 (table default.table_9706596e6715417ebc8fb06420b56bde [id=aabaa79336954b3ab0450dcff3afa7bf]) successfully deleted
I20250831 19:54:48.293128 2284 tablet_bootstrap.cc:654] T 114d1f10fa634e57b570568d83615f46 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:48.298497 2282 tablet_bootstrap.cc:492] T b7576e353a1c46b5af830f437afcb207 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:48.298769 2282 ts_tablet_manager.cc:1397] T b7576e353a1c46b5af830f437afcb207 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.027s user 0.000s sys 0.004s
I20250831 19:54:48.299772 2282 raft_consensus.cc:357] T b7576e353a1c46b5af830f437afcb207 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:48.300091 2282 raft_consensus.cc:383] T b7576e353a1c46b5af830f437afcb207 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:48.300211 2282 raft_consensus.cc:738] T b7576e353a1c46b5af830f437afcb207 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:48.300578 2282 consensus_queue.cc:260] T b7576e353a1c46b5af830f437afcb207 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:48.305032 2282 ts_tablet_manager.cc:1428] T b7576e353a1c46b5af830f437afcb207 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.006s user 0.000s sys 0.002s
I20250831 19:54:48.306825 2284 tablet_bootstrap.cc:492] T 114d1f10fa634e57b570568d83615f46 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:48.306964 2463 ts_tablet_manager.cc:1905] T 5aa2af1f691a4fa0945d81ba94e03052 P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:48.307001 2284 ts_tablet_manager.cc:1397] T 114d1f10fa634e57b570568d83615f46 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.022s user 0.001s sys 0.002s
I20250831 19:54:48.307749 2284 raft_consensus.cc:357] T 114d1f10fa634e57b570568d83615f46 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:48.307960 2284 raft_consensus.cc:383] T 114d1f10fa634e57b570568d83615f46 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:48.308039 2284 raft_consensus.cc:738] T 114d1f10fa634e57b570568d83615f46 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:48.308257 2284 consensus_queue.cc:260] T 114d1f10fa634e57b570568d83615f46 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:48.308732 2283 tablet_bootstrap.cc:492] T b6ef0e612b7e4b80af6fa5b2a66242c0 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:48.308898 2283 ts_tablet_manager.cc:1397] T b6ef0e612b7e4b80af6fa5b2a66242c0 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.147s user 0.034s sys 0.074s
I20250831 19:54:48.309670 2284 ts_tablet_manager.cc:1428] T 114d1f10fa634e57b570568d83615f46 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20250831 19:54:48.309667 2283 raft_consensus.cc:357] T b6ef0e612b7e4b80af6fa5b2a66242c0 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:48.309842 2283 raft_consensus.cc:383] T b6ef0e612b7e4b80af6fa5b2a66242c0 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:48.309914 2283 raft_consensus.cc:738] T b6ef0e612b7e4b80af6fa5b2a66242c0 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:48.310120 2283 consensus_queue.cc:260] T b6ef0e612b7e4b80af6fa5b2a66242c0 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:48.310534 2283 ts_tablet_manager.cc:1428] T b6ef0e612b7e4b80af6fa5b2a66242c0 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250831 19:54:48.310662 2284 tablet_bootstrap.cc:492] T b6ef0e612b7e4b80af6fa5b2a66242c0 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:48.312871 2284 tablet_bootstrap.cc:654] T b6ef0e612b7e4b80af6fa5b2a66242c0 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:48.313788 2121 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_544f7d804f564e83be8fb83049aa8dea" } new_table_name: "default.Table_ca18962558654590b5d74892b4e00d0f" modify_external_catalogs: true
I20250831 19:54:48.315348 2283 tablet_bootstrap.cc:492] T b7576e353a1c46b5af830f437afcb207 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:48.319818 2283 tablet_bootstrap.cc:654] T b7576e353a1c46b5af830f437afcb207 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:48.320228 2284 tablet_bootstrap.cc:492] T b6ef0e612b7e4b80af6fa5b2a66242c0 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:48.320346 2284 ts_tablet_manager.cc:1397] T b6ef0e612b7e4b80af6fa5b2a66242c0 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.000s
I20250831 19:54:48.321074 2284 raft_consensus.cc:357] T b6ef0e612b7e4b80af6fa5b2a66242c0 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:48.321261 2284 raft_consensus.cc:383] T b6ef0e612b7e4b80af6fa5b2a66242c0 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:48.321357 2284 raft_consensus.cc:738] T b6ef0e612b7e4b80af6fa5b2a66242c0 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:48.321615 2284 consensus_queue.cc:260] T b6ef0e612b7e4b80af6fa5b2a66242c0 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:48.322115 2463 ts_tablet_manager.cc:1918] T 5aa2af1f691a4fa0945d81ba94e03052 P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:48.322480 2463 log.cc:1199] T 5aa2af1f691a4fa0945d81ba94e03052 P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/5aa2af1f691a4fa0945d81ba94e03052
I20250831 19:54:48.322489 2284 ts_tablet_manager.cc:1428] T b6ef0e612b7e4b80af6fa5b2a66242c0 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250831 19:54:48.322894 2463 ts_tablet_manager.cc:1939] T 5aa2af1f691a4fa0945d81ba94e03052 P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
I20250831 19:54:48.324772 2105 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet 5aa2af1f691a4fa0945d81ba94e03052 (table default.table_544f7d804f564e83be8fb83049aa8dea [id=2cd4af6b415c4e3a92a3732fa145aa42]) successfully deleted
I20250831 19:54:48.327335 2282 tablet_bootstrap.cc:492] T 114d1f10fa634e57b570568d83615f46 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:48.330042 2282 tablet_bootstrap.cc:654] T 114d1f10fa634e57b570568d83615f46 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:48.344471 2472 consensus_queue.cc:1035] T 4e522e5dd8d84b3fb22cae56a95a8904 P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:48.347390 2120 catalog_manager.cc:2149] created HMS catalog entry for table [id=1df66f6230794e939a25c0f2254d6e17]
W20250831 19:54:48.347573 2105 catalog_manager.cc:4895] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): delete failed for tablet 9ad8ad70eab04e7abd29597603a1ce33 because the tablet was not found. No further retry: Not found: Tablet not found: 9ad8ad70eab04e7abd29597603a1ce33
I20250831 19:54:48.348135 2282 tablet_bootstrap.cc:492] T 114d1f10fa634e57b570568d83615f46 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:48.348265 2282 ts_tablet_manager.cc:1397] T 114d1f10fa634e57b570568d83615f46 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.021s user 0.003s sys 0.000s
I20250831 19:54:48.349012 2282 raft_consensus.cc:357] T 114d1f10fa634e57b570568d83615f46 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:48.349174 2282 raft_consensus.cc:383] T 114d1f10fa634e57b570568d83615f46 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:48.349256 2282 raft_consensus.cc:738] T 114d1f10fa634e57b570568d83615f46 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:48.349471 2282 consensus_queue.cc:260] T 114d1f10fa634e57b570568d83615f46 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:48.349942 2282 ts_tablet_manager.cc:1428] T 114d1f10fa634e57b570568d83615f46 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20250831 19:54:48.353919 2120 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:36958 (request call id 57) took 1805 ms. Trace:
I20250831 19:54:48.354027 2120 rpcz_store.cc:276] 0831 19:54:46.547964 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:47.576309 (+1028345us) service_pool.cc:225] Handling call
0831 19:54:48.053334 (+477025us) catalog_manager.cc:2076] Acquired catalog manager lock
0831 19:54:48.053771 (+ 437us) catalog_manager.cc:2122] Created new table and tablet info
0831 19:54:48.347343 (+293572us) catalog_manager.cc:2148] Created new table in HMS catalog
0831 19:54:48.353681 (+ 6338us) catalog_manager.cc:2182] Wrote table and tablets to system table
0831 19:54:48.353791 (+ 110us) catalog_manager.cc:2216] Inserted table and tablets into CatalogManager maps
0831 19:54:48.353886 (+ 95us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:48.348150 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:48.348279 (+ 129us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:48.348287 (+ 8us) write_op.cc:435] Acquired schema lock
0831 19:54:48.348290 (+ 3us) tablet.cc:660] Decoding operations
0831 19:54:48.348397 (+ 107us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:48.348409 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:48.348413 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:48.348488 (+ 75us) tablet.cc:699] Row locks acquired
0831 19:54:48.348491 (+ 3us) write_op.cc:260] PREPARE: finished
0831 19:54:48.348527 (+ 36us) write_op.cc:270] Start()
0831 19:54:48.348560 (+ 33us) write_op.cc:276] Timestamp: P: 1756670088348494 usec, L: 0
0831 19:54:48.348563 (+ 3us) op_driver.cc:348] REPLICATION: starting
0831 19:54:48.348723 (+ 160us) log.cc:844] Serialized 433 byte log entry
0831 19:54:48.352606 (+ 3883us) op_driver.cc:464] REPLICATION: finished
0831 19:54:48.352712 (+ 106us) write_op.cc:301] APPLY: starting
0831 19:54:48.352726 (+ 14us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:48.352778 (+ 52us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:48.352808 (+ 30us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:48.352898 (+ 90us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:48.352928 (+ 30us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0831 19:54:48.352935 (+ 7us) write_op.cc:312] APPLY: finished
0831 19:54:48.353001 (+ 66us) log.cc:844] Serialized 29 byte log entry
0831 19:54:48.353055 (+ 54us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:48.353073 (+ 18us) write_op.cc:454] Released schema lock
0831 19:54:48.353078 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0831 19:54:48.353132 (+ 54us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:48.353135 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":1432,"Hive Metastore.run_cpu_time_us":225,"Hive Metastore.run_wall_time_us":291729,"child_traces":[["op",{"apply.queue_time_us":67,"apply.run_cpu_time_us":413,"apply.run_wall_time_us":413,"num_ops":2,"prepare.queue_time_us":76,"prepare.run_cpu_time_us":690,"prepare.run_wall_time_us":690,"raft.queue_time_us":1041,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":208,"replication_time_us":4019}]]}
I20250831 19:54:48.360538 2283 tablet_bootstrap.cc:492] T b7576e353a1c46b5af830f437afcb207 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:48.360723 2283 ts_tablet_manager.cc:1397] T b7576e353a1c46b5af830f437afcb207 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.045s user 0.017s sys 0.008s
I20250831 19:54:48.361627 2283 raft_consensus.cc:357] T b7576e353a1c46b5af830f437afcb207 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:48.361825 2283 raft_consensus.cc:383] T b7576e353a1c46b5af830f437afcb207 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:48.361937 2283 raft_consensus.cc:738] T b7576e353a1c46b5af830f437afcb207 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:48.362291 2283 consensus_queue.cc:260] T b7576e353a1c46b5af830f437afcb207 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:48.362831 2283 ts_tablet_manager.cc:1428] T b7576e353a1c46b5af830f437afcb207 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250831 19:54:48.363484 1884 tablet_service.cc:1468] Processing CreateTablet for tablet 98c37cdff24447039bf0b8d832dbb8e5 (DEFAULT_TABLE table=default.table_31929d9da7554974b50e28cd094fd2df [id=1df66f6230794e939a25c0f2254d6e17]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:48.364462 1750 tablet_service.cc:1468] Processing CreateTablet for tablet 98c37cdff24447039bf0b8d832dbb8e5 (DEFAULT_TABLE table=default.table_31929d9da7554974b50e28cd094fd2df [id=1df66f6230794e939a25c0f2254d6e17]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:48.364980 1750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98c37cdff24447039bf0b8d832dbb8e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:48.368521 2120 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_6b2346554c4543e684ad6275a7946831" } modify_external_catalogs: true
I20250831 19:54:48.368754 2120 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_6b2346554c4543e684ad6275a7946831" } modify_external_catalogs: true
I20250831 19:54:48.369463 1884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98c37cdff24447039bf0b8d832dbb8e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:48.370903 1612 tablet_service.cc:1468] Processing CreateTablet for tablet 98c37cdff24447039bf0b8d832dbb8e5 (DEFAULT_TABLE table=default.table_31929d9da7554974b50e28cd094fd2df [id=1df66f6230794e939a25c0f2254d6e17]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:48.371263 1612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98c37cdff24447039bf0b8d832dbb8e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:48.374209 2284 tablet_bootstrap.cc:492] T 98c37cdff24447039bf0b8d832dbb8e5 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:48.376204 2284 tablet_bootstrap.cc:654] T 98c37cdff24447039bf0b8d832dbb8e5 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:48.377336 2282 tablet_bootstrap.cc:492] T 98c37cdff24447039bf0b8d832dbb8e5 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:48.378835 2282 tablet_bootstrap.cc:654] T 98c37cdff24447039bf0b8d832dbb8e5 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:48.379180 2445 consensus_queue.cc:1035] T 4e522e5dd8d84b3fb22cae56a95a8904 P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:48.383749 2283 tablet_bootstrap.cc:492] T 98c37cdff24447039bf0b8d832dbb8e5 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:48.384284 2330 consensus_queue.cc:1035] T a7a0312d22284f15a68d90f6e8cd7920 P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:48.385816 2283 tablet_bootstrap.cc:654] T 98c37cdff24447039bf0b8d832dbb8e5 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:48.394054 2282 tablet_bootstrap.cc:492] T 98c37cdff24447039bf0b8d832dbb8e5 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:48.394224 2282 ts_tablet_manager.cc:1397] T 98c37cdff24447039bf0b8d832dbb8e5 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.017s user 0.005s sys 0.005s
I20250831 19:54:48.395092 2282 raft_consensus.cc:357] T 98c37cdff24447039bf0b8d832dbb8e5 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:48.395305 2282 raft_consensus.cc:383] T 98c37cdff24447039bf0b8d832dbb8e5 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:48.395370 2282 raft_consensus.cc:738] T 98c37cdff24447039bf0b8d832dbb8e5 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:48.395612 2282 consensus_queue.cc:260] T 98c37cdff24447039bf0b8d832dbb8e5 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:48.397078 2282 ts_tablet_manager.cc:1428] T 98c37cdff24447039bf0b8d832dbb8e5 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20250831 19:54:48.430101 1903 raft_consensus.cc:3058] T a7a0312d22284f15a68d90f6e8cd7920 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:48.433110 2283 tablet_bootstrap.cc:492] T 98c37cdff24447039bf0b8d832dbb8e5 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:48.433315 2283 ts_tablet_manager.cc:1397] T 98c37cdff24447039bf0b8d832dbb8e5 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.050s user 0.017s sys 0.015s
I20250831 19:54:48.434303 2283 raft_consensus.cc:357] T 98c37cdff24447039bf0b8d832dbb8e5 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:48.434546 2283 raft_consensus.cc:383] T 98c37cdff24447039bf0b8d832dbb8e5 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:48.434634 2283 raft_consensus.cc:738] T 98c37cdff24447039bf0b8d832dbb8e5 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:48.434918 2283 consensus_queue.cc:260] T 98c37cdff24447039bf0b8d832dbb8e5 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:48.435266 2330 raft_consensus.cc:491] T 114d1f10fa634e57b570568d83615f46 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:48.435423 2330 raft_consensus.cc:513] T 114d1f10fa634e57b570568d83615f46 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:48.435992 2330 leader_election.cc:290] T 114d1f10fa634e57b570568d83615f46 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:48.437107 1772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "114d1f10fa634e57b570568d83615f46" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:48.437311 1772 raft_consensus.cc:2466] T 114d1f10fa634e57b570568d83615f46 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 0.
I20250831 19:54:48.437887 1570 leader_election.cc:304] T 114d1f10fa634e57b570568d83615f46 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:48.438050 1906 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "114d1f10fa634e57b570568d83615f46" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:48.438294 1906 raft_consensus.cc:2466] T 114d1f10fa634e57b570568d83615f46 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 0.
I20250831 19:54:48.438588 2330 raft_consensus.cc:2802] T 114d1f10fa634e57b570568d83615f46 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:48.438678 2330 raft_consensus.cc:491] T 114d1f10fa634e57b570568d83615f46 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:48.438784 2330 raft_consensus.cc:3058] T 114d1f10fa634e57b570568d83615f46 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:48.438969 2283 ts_tablet_manager.cc:1428] T 98c37cdff24447039bf0b8d832dbb8e5 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20250831 19:54:48.441931 2330 raft_consensus.cc:513] T 114d1f10fa634e57b570568d83615f46 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:48.443220 2223 consensus_queue.cc:1035] T a7a0312d22284f15a68d90f6e8cd7920 P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:48.443445 1906 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "114d1f10fa634e57b570568d83615f46" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:54:48.443657 1906 raft_consensus.cc:3058] T 114d1f10fa634e57b570568d83615f46 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:48.445390 2330 leader_election.cc:290] T 114d1f10fa634e57b570568d83615f46 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Requested vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:48.445981 1772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "114d1f10fa634e57b570568d83615f46" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197"
I20250831 19:54:48.446154 1772 raft_consensus.cc:3058] T 114d1f10fa634e57b570568d83615f46 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:48.447563 1906 raft_consensus.cc:2466] T 114d1f10fa634e57b570568d83615f46 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1.
I20250831 19:54:48.448757 2284 tablet_bootstrap.cc:492] T 98c37cdff24447039bf0b8d832dbb8e5 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:48.448966 2284 ts_tablet_manager.cc:1397] T 98c37cdff24447039bf0b8d832dbb8e5 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.075s user 0.008s sys 0.004s
I20250831 19:54:48.449155 1772 raft_consensus.cc:2466] T 114d1f10fa634e57b570568d83615f46 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1.
I20250831 19:54:48.449716 1568 leader_election.cc:304] T 114d1f10fa634e57b570568d83615f46 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:54:48.450248 2223 raft_consensus.cc:2802] T 114d1f10fa634e57b570568d83615f46 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:48.450142 2284 raft_consensus.cc:357] T 98c37cdff24447039bf0b8d832dbb8e5 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:48.450357 2223 raft_consensus.cc:695] T 114d1f10fa634e57b570568d83615f46 P 89aa85d59c53436ebdf3074b13d14825 [term 1 LEADER]: Becoming Leader. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Running, Role: LEADER
I20250831 19:54:48.450367 2284 raft_consensus.cc:383] T 98c37cdff24447039bf0b8d832dbb8e5 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:48.450449 2284 raft_consensus.cc:738] T 98c37cdff24447039bf0b8d832dbb8e5 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:48.450587 2223 consensus_queue.cc:237] T 114d1f10fa634e57b570568d83615f46 P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:48.450748 2284 consensus_queue.cc:260] T 98c37cdff24447039bf0b8d832dbb8e5 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:48.453181 2284 ts_tablet_manager.cc:1428] T 98c37cdff24447039bf0b8d832dbb8e5 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.004s user 0.002s sys 0.001s
I20250831 19:54:48.454919 2119 catalog_manager.cc:2149] created HMS catalog entry for table [id=ed77a92cc1114d2398722bc6269e3a4d]
I20250831 19:54:48.462400 2119 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:36958 (request call id 54) took 2201 ms. Trace:
I20250831 19:54:48.462541 2119 rpcz_store.cc:276] 0831 19:54:46.261248 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:47.515743 (+1254495us) service_pool.cc:225] Handling call
0831 19:54:47.561238 (+ 45495us) spinlock_profiling.cc:243] Waited 45.1 ms on lock 0x616000040c54. stack: 00007f1e3b0dc7d6 00007f1e3b0dc590 00007f1e3a0cf3ad 0000000000972d94 0000000000972d5d 00007f1e49ea714d 00007f1e49ea7243 00007f1e46b66941 00007f1e4e6f1a5d 00007f1e4e87ae93 00007f1e456b27a6 00007f1e456b24d5 00007f1e41e8a2ce 00007f1e41e891ae 00007f1e41e8f3e5 00007f1e41e8fd0f
0831 19:54:48.053912 (+492674us) catalog_manager.cc:2076] Acquired catalog manager lock
0831 19:54:48.054291 (+ 379us) catalog_manager.cc:2122] Created new table and tablet info
0831 19:54:48.454853 (+400562us) catalog_manager.cc:2148] Created new table in HMS catalog
0831 19:54:48.462056 (+ 7203us) catalog_manager.cc:2182] Wrote table and tablets to system table
0831 19:54:48.462210 (+ 154us) catalog_manager.cc:2216] Inserted table and tablets into CatalogManager maps
0831 19:54:48.462358 (+ 148us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:48.455802 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:48.455975 (+ 173us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:48.455984 (+ 9us) write_op.cc:435] Acquired schema lock
0831 19:54:48.455988 (+ 4us) tablet.cc:660] Decoding operations
0831 19:54:48.456120 (+ 132us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:48.456136 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:48.456144 (+ 8us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:48.456247 (+ 103us) tablet.cc:699] Row locks acquired
0831 19:54:48.456251 (+ 4us) write_op.cc:260] PREPARE: finished
0831 19:54:48.456303 (+ 52us) write_op.cc:270] Start()
0831 19:54:48.456343 (+ 40us) write_op.cc:276] Timestamp: P: 1756670088456258 usec, L: 0
0831 19:54:48.456348 (+ 5us) op_driver.cc:348] REPLICATION: starting
0831 19:54:48.456547 (+ 199us) log.cc:844] Serialized 433 byte log entry
0831 19:54:48.459858 (+ 3311us) op_driver.cc:464] REPLICATION: finished
0831 19:54:48.459996 (+ 138us) write_op.cc:301] APPLY: starting
0831 19:54:48.460014 (+ 18us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:48.460080 (+ 66us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:48.460114 (+ 34us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:48.460229 (+ 115us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:48.460271 (+ 42us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0831 19:54:48.460280 (+ 9us) write_op.cc:312] APPLY: finished
0831 19:54:48.460364 (+ 84us) log.cc:844] Serialized 29 byte log entry
0831 19:54:48.460429 (+ 65us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:48.460451 (+ 22us) write_op.cc:454] Released schema lock
0831 19:54:48.460476 (+ 25us) write_op.cc:341] FINISH: Updating metrics
0831 19:54:48.460550 (+ 74us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:48.460555 (+ 5us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":292687,"Hive Metastore.run_cpu_time_us":325,"Hive Metastore.run_wall_time_us":107683,"spinlock_wait_cycles":103822208,"child_traces":[["op",{"apply.queue_time_us":87,"apply.run_cpu_time_us":542,"apply.run_wall_time_us":541,"num_ops":2,"prepare.queue_time_us":218,"prepare.run_cpu_time_us":884,"prepare.run_wall_time_us":884,"raft.queue_time_us":1270,"raft.run_cpu_time_us":257,"raft.run_wall_time_us":256,"replication_time_us":3476}]]}
I20250831 19:54:48.478215 2117 catalog_manager.cc:2149] created HMS catalog entry for table [id=f48af5bc3eff4c819be4aeeff4128c2a]
I20250831 19:54:48.483855 1884 tablet_service.cc:1468] Processing CreateTablet for tablet 00926e7f9fc74f1e9094fdfec9a1115f (DEFAULT_TABLE table=default.table_2b373bd597c54990856bf4882d180dcd [id=ed77a92cc1114d2398722bc6269e3a4d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:48.483938 1612 tablet_service.cc:1468] Processing CreateTablet for tablet 00926e7f9fc74f1e9094fdfec9a1115f (DEFAULT_TABLE table=default.table_2b373bd597c54990856bf4882d180dcd [id=ed77a92cc1114d2398722bc6269e3a4d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:48.484280 1884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00926e7f9fc74f1e9094fdfec9a1115f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:48.484340 2533 tablet.cc:1722] T a7a0312d22284f15a68d90f6e8cd7920 P 89aa85d59c53436ebdf3074b13d14825: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250831 19:54:48.484364 1612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00926e7f9fc74f1e9094fdfec9a1115f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:48.486790 2525 tablet.cc:1722] T a7a0312d22284f15a68d90f6e8cd7920 P 2441fafe1d62429386f4631ad423567d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250831 19:54:48.487277 2526 tablet.cc:1722] T a7a0312d22284f15a68d90f6e8cd7920 P de831f40fa1348a48a1f0260f4130197: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250831 19:54:48.488306 1750 tablet_service.cc:1468] Processing CreateTablet for tablet 00926e7f9fc74f1e9094fdfec9a1115f (DEFAULT_TABLE table=default.table_2b373bd597c54990856bf4882d180dcd [id=ed77a92cc1114d2398722bc6269e3a4d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:48.488714 1750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00926e7f9fc74f1e9094fdfec9a1115f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:48.499926 2117 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:36958 (request call id 56) took 2073 ms. Trace:
I20250831 19:54:48.500111 2117 rpcz_store.cc:276] 0831 19:54:46.426377 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:47.570750 (+1144373us) service_pool.cc:225] Handling call
0831 19:54:48.054431 (+483681us) catalog_manager.cc:2076] Acquired catalog manager lock
0831 19:54:48.054796 (+ 365us) catalog_manager.cc:2122] Created new table and tablet info
0831 19:54:48.478171 (+423375us) catalog_manager.cc:2148] Created new table in HMS catalog
0831 19:54:48.497600 (+ 19429us) catalog_manager.cc:2182] Wrote table and tablets to system table
0831 19:54:48.498138 (+ 538us) catalog_manager.cc:2216] Inserted table and tablets into CatalogManager maps
0831 19:54:48.499874 (+ 1736us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:48.478859 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:48.478966 (+ 107us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:48.478970 (+ 4us) write_op.cc:435] Acquired schema lock
0831 19:54:48.478972 (+ 2us) tablet.cc:660] Decoding operations
0831 19:54:48.479055 (+ 83us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:48.479065 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:48.479069 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:48.479138 (+ 69us) tablet.cc:699] Row locks acquired
0831 19:54:48.479140 (+ 2us) write_op.cc:260] PREPARE: finished
0831 19:54:48.479174 (+ 34us) write_op.cc:270] Start()
0831 19:54:48.479206 (+ 32us) write_op.cc:276] Timestamp: P: 1756670088479128 usec, L: 0
0831 19:54:48.479209 (+ 3us) op_driver.cc:348] REPLICATION: starting
0831 19:54:48.479363 (+ 154us) log.cc:844] Serialized 433 byte log entry
0831 19:54:48.494314 (+ 14951us) op_driver.cc:464] REPLICATION: finished
0831 19:54:48.494508 (+ 194us) write_op.cc:301] APPLY: starting
0831 19:54:48.494522 (+ 14us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:48.494558 (+ 36us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:48.494593 (+ 35us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:48.494682 (+ 89us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:48.494710 (+ 28us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0831 19:54:48.494717 (+ 7us) write_op.cc:312] APPLY: finished
0831 19:54:48.494793 (+ 76us) log.cc:844] Serialized 29 byte log entry
0831 19:54:48.494852 (+ 59us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:48.494869 (+ 17us) write_op.cc:454] Released schema lock
0831 19:54:48.494875 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0831 19:54:48.494937 (+ 62us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:48.494941 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":399969,"Hive Metastore.run_cpu_time_us":306,"Hive Metastore.run_wall_time_us":23086,"child_traces":[["op",{"apply.queue_time_us":150,"apply.run_cpu_time_us":422,"apply.run_wall_time_us":421,"num_ops":2,"prepare.queue_time_us":95,"prepare.run_cpu_time_us":590,"prepare.run_wall_time_us":591,"raft.queue_time_us":146,"raft.run_cpu_time_us":5,"raft.run_wall_time_us":7,"replication_time_us":15080}]]}
I20250831 19:54:48.504539 2117 catalog_manager.cc:5582] T 114d1f10fa634e57b570568d83615f46 P 89aa85d59c53436ebdf3074b13d14825 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193). New cstate: current_term: 1 leader_uuid: "89aa85d59c53436ebdf3074b13d14825" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: HEALTHY } } }
I20250831 19:54:48.506837 2472 raft_consensus.cc:491] T 98c37cdff24447039bf0b8d832dbb8e5 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:48.506980 2472 raft_consensus.cc:513] T 98c37cdff24447039bf0b8d832dbb8e5 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:48.507553 2472 leader_election.cc:290] T 98c37cdff24447039bf0b8d832dbb8e5 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:48.508235 1906 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "98c37cdff24447039bf0b8d832dbb8e5" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:48.508435 1906 raft_consensus.cc:2466] T 98c37cdff24447039bf0b8d832dbb8e5 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 0.
I20250831 19:54:48.508596 2283 tablet_bootstrap.cc:492] T 00926e7f9fc74f1e9094fdfec9a1115f P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:48.508867 1705 leader_election.cc:304] T 98c37cdff24447039bf0b8d832dbb8e5 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:48.509332 1634 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "98c37cdff24447039bf0b8d832dbb8e5" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:48.509537 1634 raft_consensus.cc:2466] T 98c37cdff24447039bf0b8d832dbb8e5 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 0.
I20250831 19:54:48.510352 2472 raft_consensus.cc:2802] T 98c37cdff24447039bf0b8d832dbb8e5 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:48.510438 2472 raft_consensus.cc:491] T 98c37cdff24447039bf0b8d832dbb8e5 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:48.510542 2472 raft_consensus.cc:3058] T 98c37cdff24447039bf0b8d832dbb8e5 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:48.510707 2283 tablet_bootstrap.cc:654] T 00926e7f9fc74f1e9094fdfec9a1115f P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:48.513051 2472 raft_consensus.cc:513] T 98c37cdff24447039bf0b8d832dbb8e5 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:48.516453 2282 tablet_bootstrap.cc:492] T 00926e7f9fc74f1e9094fdfec9a1115f P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:48.516870 1906 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "98c37cdff24447039bf0b8d832dbb8e5" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:54:48.517024 1906 raft_consensus.cc:3058] T 98c37cdff24447039bf0b8d832dbb8e5 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:48.518640 2282 tablet_bootstrap.cc:654] T 00926e7f9fc74f1e9094fdfec9a1115f P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:48.519541 1906 raft_consensus.cc:2466] T 98c37cdff24447039bf0b8d832dbb8e5 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:54:48.520044 1705 leader_election.cc:304] T 98c37cdff24447039bf0b8d832dbb8e5 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:48.520308 2445 raft_consensus.cc:2802] T 98c37cdff24447039bf0b8d832dbb8e5 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:48.520965 2284 tablet_bootstrap.cc:492] T 00926e7f9fc74f1e9094fdfec9a1115f P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:48.523015 2284 tablet_bootstrap.cc:654] T 00926e7f9fc74f1e9094fdfec9a1115f P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:48.526132 1634 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "98c37cdff24447039bf0b8d832dbb8e5" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:54:48.526335 1634 raft_consensus.cc:3058] T 98c37cdff24447039bf0b8d832dbb8e5 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:48.529193 1634 raft_consensus.cc:2466] T 98c37cdff24447039bf0b8d832dbb8e5 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:54:48.530918 2284 tablet_bootstrap.cc:492] T 00926e7f9fc74f1e9094fdfec9a1115f P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:48.531046 2284 ts_tablet_manager.cc:1397] T 00926e7f9fc74f1e9094fdfec9a1115f P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.001s
I20250831 19:54:48.532407 2284 raft_consensus.cc:357] T 00926e7f9fc74f1e9094fdfec9a1115f P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:48.532639 2284 raft_consensus.cc:383] T 00926e7f9fc74f1e9094fdfec9a1115f P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:48.532732 2284 raft_consensus.cc:738] T 00926e7f9fc74f1e9094fdfec9a1115f P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:48.532914 2284 consensus_queue.cc:260] T 00926e7f9fc74f1e9094fdfec9a1115f P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:48.538782 2519 raft_consensus.cc:491] T b7576e353a1c46b5af830f437afcb207 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:48.538949 2519 raft_consensus.cc:513] T b7576e353a1c46b5af830f437afcb207 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:48.539390 2472 leader_election.cc:290] T 98c37cdff24447039bf0b8d832dbb8e5 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Requested vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:48.539685 2519 leader_election.cc:290] T b7576e353a1c46b5af830f437afcb207 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:48.540628 1906 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b7576e353a1c46b5af830f437afcb207" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:48.540925 1906 raft_consensus.cc:2466] T b7576e353a1c46b5af830f437afcb207 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 0.
I20250831 19:54:48.541019 2283 tablet_bootstrap.cc:492] T 00926e7f9fc74f1e9094fdfec9a1115f P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:48.541201 2283 ts_tablet_manager.cc:1397] T 00926e7f9fc74f1e9094fdfec9a1115f P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.033s user 0.004s sys 0.004s
I20250831 19:54:48.541394 1568 leader_election.cc:304] T b7576e353a1c46b5af830f437afcb207 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:54:48.541728 2519 raft_consensus.cc:2802] T b7576e353a1c46b5af830f437afcb207 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:48.541832 2519 raft_consensus.cc:491] T b7576e353a1c46b5af830f437afcb207 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:48.541914 2519 raft_consensus.cc:3058] T b7576e353a1c46b5af830f437afcb207 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:48.542146 2283 raft_consensus.cc:357] T 00926e7f9fc74f1e9094fdfec9a1115f P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:48.542347 2283 raft_consensus.cc:383] T 00926e7f9fc74f1e9094fdfec9a1115f P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:48.542438 2283 raft_consensus.cc:738] T 00926e7f9fc74f1e9094fdfec9a1115f P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:48.542706 2283 consensus_queue.cc:260] T 00926e7f9fc74f1e9094fdfec9a1115f P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:48.543275 2283 ts_tablet_manager.cc:1428] T 00926e7f9fc74f1e9094fdfec9a1115f P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20250831 19:54:48.544838 2519 raft_consensus.cc:513] T b7576e353a1c46b5af830f437afcb207 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:48.546237 1903 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b7576e353a1c46b5af830f437afcb207" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:54:48.546392 1903 raft_consensus.cc:3058] T b7576e353a1c46b5af830f437afcb207 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:48.546399 2519 leader_election.cc:290] T b7576e353a1c46b5af830f437afcb207 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Requested vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:48.546880 2584 consensus_queue.cc:1035] T 6210e006966a4c1dbe3a2d0388efac30 P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:48.549285 1903 raft_consensus.cc:2466] T b7576e353a1c46b5af830f437afcb207 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1.
I20250831 19:54:48.550275 1568 leader_election.cc:304] T b7576e353a1c46b5af830f437afcb207 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:54:48.550583 2284 ts_tablet_manager.cc:1428] T 00926e7f9fc74f1e9094fdfec9a1115f P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.019s user 0.003s sys 0.007s
I20250831 19:54:48.550670 2519 raft_consensus.cc:2802] T b7576e353a1c46b5af830f437afcb207 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:48.551988 2519 raft_consensus.cc:695] T b7576e353a1c46b5af830f437afcb207 P 89aa85d59c53436ebdf3074b13d14825 [term 1 LEADER]: Becoming Leader. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Running, Role: LEADER
I20250831 19:54:48.552325 2519 consensus_queue.cc:237] T b7576e353a1c46b5af830f437afcb207 P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:48.561604 2119 catalog_manager.cc:6127] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: default.table_c8611581e59f4d8a94cd6f4da06917a4 [id=bd456415108d49989ef0bc2af91eb2f0] alter complete (version 3)
I20250831 19:54:48.569324 1612 tablet_service.cc:1468] Processing CreateTablet for tablet 81293470431c4deda5efbc30a03ce0ed (DEFAULT_TABLE table=default.table_15260b732e8c4a32ab2c268a74a7dfb7 [id=f48af5bc3eff4c819be4aeeff4128c2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:48.568821 2117 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_1ca0a7f3c33945bd902a63ca09aa62ad" } modify_external_catalogs: true
I20250831 19:54:48.569866 1612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81293470431c4deda5efbc30a03ce0ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:48.569785 2117 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_1ca0a7f3c33945bd902a63ca09aa62ad" } modify_external_catalogs: true
I20250831 19:54:48.569765 1884 tablet_service.cc:1468] Processing CreateTablet for tablet 81293470431c4deda5efbc30a03ce0ed (DEFAULT_TABLE table=default.table_15260b732e8c4a32ab2c268a74a7dfb7 [id=f48af5bc3eff4c819be4aeeff4128c2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:48.570240 1884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81293470431c4deda5efbc30a03ce0ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:48.577111 2119 catalog_manager.cc:5582] T b7576e353a1c46b5af830f437afcb207 P 89aa85d59c53436ebdf3074b13d14825 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193). New cstate: current_term: 1 leader_uuid: "89aa85d59c53436ebdf3074b13d14825" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: HEALTHY } } }
I20250831 19:54:48.585107 2283 tablet_bootstrap.cc:492] T 81293470431c4deda5efbc30a03ce0ed P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:48.587239 2283 tablet_bootstrap.cc:654] T 81293470431c4deda5efbc30a03ce0ed P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:48.588228 2586 raft_consensus.cc:491] T b7576e353a1c46b5af830f437afcb207 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:48.588402 2586 raft_consensus.cc:513] T b7576e353a1c46b5af830f437afcb207 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:48.589263 1750 tablet_service.cc:1468] Processing CreateTablet for tablet 81293470431c4deda5efbc30a03ce0ed (DEFAULT_TABLE table=default.table_15260b732e8c4a32ab2c268a74a7dfb7 [id=f48af5bc3eff4c819be4aeeff4128c2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:48.589748 1750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81293470431c4deda5efbc30a03ce0ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:48.590389 1903 raft_consensus.cc:1273] T f8871812b0734f40b63bef0473e2a58d P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Refusing update from remote peer de831f40fa1348a48a1f0260f4130197: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250831 19:54:48.591347 2584 consensus_queue.cc:1035] T f8871812b0734f40b63bef0473e2a58d P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:48.591986 2119 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_0ab569c1a9dc4f91af81c84392bc5748" } new_table_name: "default.Table_fd98179fb4584ad6bde229ee78f7dfde" modify_external_catalogs: true
I20250831 19:54:48.594568 1904 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b7576e353a1c46b5af830f437afcb207" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:48.594637 2586 leader_election.cc:290] T b7576e353a1c46b5af830f437afcb207 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:48.594825 1904 raft_consensus.cc:2391] T b7576e353a1c46b5af830f437afcb207 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate de831f40fa1348a48a1f0260f4130197 in current term 1: Already voted for candidate 89aa85d59c53436ebdf3074b13d14825 in this term.
I20250831 19:54:48.594362 1634 raft_consensus.cc:1273] T f8871812b0734f40b63bef0473e2a58d P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Refusing update from remote peer de831f40fa1348a48a1f0260f4130197: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250831 19:54:48.596156 1771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b7576e353a1c46b5af830f437afcb207" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:48.596359 1771 raft_consensus.cc:2466] T b7576e353a1c46b5af830f437afcb207 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 0.
I20250831 19:54:48.596426 1772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b7576e353a1c46b5af830f437afcb207" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197"
I20250831 19:54:48.596590 1772 raft_consensus.cc:3058] T b7576e353a1c46b5af830f437afcb207 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:48.599522 2284 tablet_bootstrap.cc:492] T 81293470431c4deda5efbc30a03ce0ed P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:48.599728 1772 raft_consensus.cc:2466] T b7576e353a1c46b5af830f437afcb207 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1.
I20250831 19:54:48.600322 2239 raft_consensus.cc:491] T b6ef0e612b7e4b80af6fa5b2a66242c0 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:48.600477 2239 raft_consensus.cc:513] T b6ef0e612b7e4b80af6fa5b2a66242c0 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:48.601076 2239 leader_election.cc:290] T b6ef0e612b7e4b80af6fa5b2a66242c0 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:48.601682 2284 tablet_bootstrap.cc:654] T 81293470431c4deda5efbc30a03ce0ed P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:48.601648 1634 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b6ef0e612b7e4b80af6fa5b2a66242c0" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:48.601845 1634 raft_consensus.cc:2466] T b6ef0e612b7e4b80af6fa5b2a66242c0 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 0.
I20250831 19:54:48.602207 1841 leader_election.cc:304] T b6ef0e612b7e4b80af6fa5b2a66242c0 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:54:48.602447 2118 catalog_manager.cc:2149] created HMS catalog entry for table [id=83de1930a88d4d86a0dc9a69a45333f6]
I20250831 19:54:48.602475 2239 raft_consensus.cc:2802] T b6ef0e612b7e4b80af6fa5b2a66242c0 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:48.602555 2239 raft_consensus.cc:491] T b6ef0e612b7e4b80af6fa5b2a66242c0 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:48.602645 2239 raft_consensus.cc:3058] T b6ef0e612b7e4b80af6fa5b2a66242c0 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:48.604949 2239 raft_consensus.cc:513] T b6ef0e612b7e4b80af6fa5b2a66242c0 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:48.606906 2526 tablet.cc:1722] T f8871812b0734f40b63bef0473e2a58d P de831f40fa1348a48a1f0260f4130197: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:48.611636 2239 leader_election.cc:290] T b6ef0e612b7e4b80af6fa5b2a66242c0 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 election: Requested vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:48.611690 1632 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b6ef0e612b7e4b80af6fa5b2a66242c0" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:54:48.611860 1632 raft_consensus.cc:3058] T b6ef0e612b7e4b80af6fa5b2a66242c0 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:48.614492 2118 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:36958 (request call id 55) took 2249 ms. Trace:
I20250831 19:54:48.614540 1632 raft_consensus.cc:2466] T b6ef0e612b7e4b80af6fa5b2a66242c0 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 1.
I20250831 19:54:48.614601 2118 rpcz_store.cc:276] 0831 19:54:46.364945 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:47.559045 (+1194100us) service_pool.cc:225] Handling call
0831 19:54:48.049004 (+489959us) catalog_manager.cc:2076] Acquired catalog manager lock
0831 19:54:48.055541 (+ 6537us) catalog_manager.cc:2122] Created new table and tablet info
0831 19:54:48.602419 (+546878us) catalog_manager.cc:2148] Created new table in HMS catalog
0831 19:54:48.614223 (+ 11804us) catalog_manager.cc:2182] Wrote table and tablets to system table
0831 19:54:48.614328 (+ 105us) catalog_manager.cc:2216] Inserted table and tablets into CatalogManager maps
0831 19:54:48.614436 (+ 108us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:48.603169 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:48.603305 (+ 136us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:48.603312 (+ 7us) write_op.cc:435] Acquired schema lock
0831 19:54:48.603317 (+ 5us) tablet.cc:660] Decoding operations
0831 19:54:48.603434 (+ 117us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:48.603451 (+ 17us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:48.603458 (+ 7us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:48.603551 (+ 93us) tablet.cc:699] Row locks acquired
0831 19:54:48.603553 (+ 2us) write_op.cc:260] PREPARE: finished
0831 19:54:48.603589 (+ 36us) write_op.cc:270] Start()
0831 19:54:48.603628 (+ 39us) write_op.cc:276] Timestamp: P: 1756670088603530 usec, L: 0
0831 19:54:48.603634 (+ 6us) op_driver.cc:348] REPLICATION: starting
0831 19:54:48.603854 (+ 220us) log.cc:844] Serialized 433 byte log entry
0831 19:54:48.613509 (+ 9655us) op_driver.cc:464] REPLICATION: finished
0831 19:54:48.613657 (+ 148us) write_op.cc:301] APPLY: starting
0831 19:54:48.613674 (+ 17us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:48.613738 (+ 64us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:48.613764 (+ 26us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:48.613892 (+ 128us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:48.613924 (+ 32us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0831 19:54:48.613930 (+ 6us) write_op.cc:312] APPLY: finished
0831 19:54:48.613999 (+ 69us) log.cc:844] Serialized 29 byte log entry
0831 19:54:48.614051 (+ 52us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:48.614070 (+ 19us) write_op.cc:454] Released schema lock
0831 19:54:48.614076 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0831 19:54:48.614136 (+ 60us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:48.614140 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":422350,"Hive Metastore.run_cpu_time_us":232,"Hive Metastore.run_wall_time_us":124162,"child_traces":[["op",{"apply.queue_time_us":101,"apply.run_cpu_time_us":471,"apply.run_wall_time_us":471,"num_ops":2,"prepare.queue_time_us":82,"prepare.run_cpu_time_us":811,"prepare.run_wall_time_us":812,"raft.queue_time_us":425,"raft.run_cpu_time_us":239,"raft.run_wall_time_us":239,"replication_time_us":9846}]]}
I20250831 19:54:48.615463 2118 master_service.cc:948] ReplaceTablet: received request to replace tablet 4e522e5dd8d84b3fb22cae56a95a8904 from {username='slave'} at 127.0.0.1:36958
I20250831 19:54:48.615924 2283 tablet_bootstrap.cc:492] T 81293470431c4deda5efbc30a03ce0ed P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:48.616091 2283 ts_tablet_manager.cc:1397] T 81293470431c4deda5efbc30a03ce0ed P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.031s user 0.004s sys 0.005s
I20250831 19:54:48.616938 2283 raft_consensus.cc:357] T 81293470431c4deda5efbc30a03ce0ed P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:48.617149 2283 raft_consensus.cc:383] T 81293470431c4deda5efbc30a03ce0ed P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:48.617215 2283 raft_consensus.cc:738] T 81293470431c4deda5efbc30a03ce0ed P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:48.617483 2283 consensus_queue.cc:260] T 81293470431c4deda5efbc30a03ce0ed P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:48.617594 1841 leader_election.cc:304] T b6ef0e612b7e4b80af6fa5b2a66242c0 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:54:48.617862 2239 raft_consensus.cc:2802] T b6ef0e612b7e4b80af6fa5b2a66242c0 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:48.617993 2239 raft_consensus.cc:695] T b6ef0e612b7e4b80af6fa5b2a66242c0 P 2441fafe1d62429386f4631ad423567d [term 1 LEADER]: Becoming Leader. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Running, Role: LEADER
I20250831 19:54:48.618221 2239 consensus_queue.cc:237] T b6ef0e612b7e4b80af6fa5b2a66242c0 P 2441fafe1d62429386f4631ad423567d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:48.618832 2284 tablet_bootstrap.cc:492] T 81293470431c4deda5efbc30a03ce0ed P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:48.618975 2284 ts_tablet_manager.cc:1397] T 81293470431c4deda5efbc30a03ce0ed P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.020s user 0.006s sys 0.006s
I20250831 19:54:48.619387 2283 ts_tablet_manager.cc:1428] T 81293470431c4deda5efbc30a03ce0ed P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20250831 19:54:48.619742 2284 raft_consensus.cc:357] T 81293470431c4deda5efbc30a03ce0ed P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:48.619962 2284 raft_consensus.cc:383] T 81293470431c4deda5efbc30a03ce0ed P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:48.620563 2284 raft_consensus.cc:738] T 81293470431c4deda5efbc30a03ce0ed P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:48.620783 2284 consensus_queue.cc:260] T 81293470431c4deda5efbc30a03ce0ed P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:48.624331 2284 ts_tablet_manager.cc:1428] T 81293470431c4deda5efbc30a03ce0ed P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20250831 19:54:48.625979 2118 catalog_manager.cc:5869] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Sending DeleteTablet for 3 replicas of tablet 4e522e5dd8d84b3fb22cae56a95a8904
I20250831 19:54:48.626534 2118 catalog_manager.cc:6652] ReplaceTablet: tablet 4e522e5dd8d84b3fb22cae56a95a8904 deleted and replaced by tablet d7551c6a0ebd493dba75b1f766c4db0f
I20250831 19:54:48.626971 2118 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36958:
name: "default.Table_15539726e4e647e5a28a991bc6e07cd7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:48.628346 1612 tablet_service.cc:1515] Processing DeleteTablet for tablet 4e522e5dd8d84b3fb22cae56a95a8904 with delete_type TABLET_DATA_DELETED (replaced by tablet d7551c6a0ebd493dba75b1f766c4db0f) from {username='slave'} at 127.0.0.1:51022
I20250831 19:54:48.640575 1750 tablet_service.cc:1515] Processing DeleteTablet for tablet 4e522e5dd8d84b3fb22cae56a95a8904 with delete_type TABLET_DATA_DELETED (replaced by tablet d7551c6a0ebd493dba75b1f766c4db0f) from {username='slave'} at 127.0.0.1:50674
I20250831 19:54:48.640843 2463 tablet_replica.cc:331] T 4e522e5dd8d84b3fb22cae56a95a8904 P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:54:48.641040 2463 raft_consensus.cc:2241] T 4e522e5dd8d84b3fb22cae56a95a8904 P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: Raft consensus shutting down.
I20250831 19:54:48.641348 2463 raft_consensus.cc:2270] T 4e522e5dd8d84b3fb22cae56a95a8904 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:48.642232 2463 ts_tablet_manager.cc:1905] T 4e522e5dd8d84b3fb22cae56a95a8904 P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:48.646646 2598 tablet_replica.cc:331] T 4e522e5dd8d84b3fb22cae56a95a8904 P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:54:48.646849 2598 raft_consensus.cc:2241] T 4e522e5dd8d84b3fb22cae56a95a8904 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:48.647055 2598 raft_consensus.cc:2270] T 4e522e5dd8d84b3fb22cae56a95a8904 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:48.649739 2598 ts_tablet_manager.cc:1905] T 4e522e5dd8d84b3fb22cae56a95a8904 P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:48.649689 1885 tablet_service.cc:1468] Processing CreateTablet for tablet d7551c6a0ebd493dba75b1f766c4db0f (DEFAULT_TABLE table=default.table_2cfa6cbcf8244da6b6468895fd9e31cc [id=321a68b57ebf4e3a80670c3c862403f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:48.650099 1885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7551c6a0ebd493dba75b1f766c4db0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:48.654738 2126 catalog_manager.cc:2149] created HMS catalog entry for table [id=98afc1315ef847eaa56545a18123993b]
I20250831 19:54:48.660393 2126 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:36958 (request call id 58) took 1979 ms. Trace:
I20250831 19:54:48.660522 2126 rpcz_store.cc:276] 0831 19:54:46.680723 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:48.041206 (+1360483us) service_pool.cc:225] Handling call
0831 19:54:48.055919 (+ 14713us) catalog_manager.cc:2076] Acquired catalog manager lock
0831 19:54:48.056248 (+ 329us) catalog_manager.cc:2122] Created new table and tablet info
0831 19:54:48.654680 (+598432us) catalog_manager.cc:2148] Created new table in HMS catalog
0831 19:54:48.660125 (+ 5445us) catalog_manager.cc:2182] Wrote table and tablets to system table
0831 19:54:48.660249 (+ 124us) catalog_manager.cc:2216] Inserted table and tablets into CatalogManager maps
0831 19:54:48.660344 (+ 95us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:48.655567 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:48.655726 (+ 159us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:48.655735 (+ 9us) write_op.cc:435] Acquired schema lock
0831 19:54:48.655739 (+ 4us) tablet.cc:660] Decoding operations
0831 19:54:48.655879 (+ 140us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:48.655896 (+ 17us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:48.655904 (+ 8us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:48.656022 (+ 118us) tablet.cc:699] Row locks acquired
0831 19:54:48.656026 (+ 4us) write_op.cc:260] PREPARE: finished
0831 19:54:48.656067 (+ 41us) write_op.cc:270] Start()
0831 19:54:48.656110 (+ 43us) write_op.cc:276] Timestamp: P: 1756670088656003 usec, L: 0
0831 19:54:48.656116 (+ 6us) op_driver.cc:348] REPLICATION: starting
0831 19:54:48.656331 (+ 215us) log.cc:844] Serialized 433 byte log entry
0831 19:54:48.659452 (+ 3121us) op_driver.cc:464] REPLICATION: finished
0831 19:54:48.659629 (+ 177us) write_op.cc:301] APPLY: starting
0831 19:54:48.659642 (+ 13us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:48.659682 (+ 40us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:48.659727 (+ 45us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:48.659824 (+ 97us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:48.659874 (+ 50us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0831 19:54:48.659881 (+ 7us) write_op.cc:312] APPLY: finished
0831 19:54:48.659951 (+ 70us) log.cc:844] Serialized 29 byte log entry
0831 19:54:48.659998 (+ 47us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:48.660014 (+ 16us) write_op.cc:454] Released schema lock
0831 19:54:48.660020 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0831 19:54:48.660087 (+ 67us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:48.660091 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":545876,"Hive Metastore.run_cpu_time_us":295,"Hive Metastore.run_wall_time_us":52275,"child_traces":[["op",{"apply.queue_time_us":136,"apply.run_cpu_time_us":449,"apply.run_wall_time_us":448,"num_ops":2,"prepare.queue_time_us":73,"prepare.run_cpu_time_us":886,"prepare.run_wall_time_us":885,"raft.queue_time_us":512,"raft.run_cpu_time_us":337,"raft.run_wall_time_us":336,"replication_time_us":3311}]]}
I20250831 19:54:48.661350 2126 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36958:
name: "default.Table_c3cffc1117c341b0b3a7d4f82c01763a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:48.664647 2283 tablet_bootstrap.cc:492] T d7551c6a0ebd493dba75b1f766c4db0f P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:48.666671 2283 tablet_bootstrap.cc:654] T d7551c6a0ebd493dba75b1f766c4db0f P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:48.666941 1750 tablet_service.cc:1468] Processing CreateTablet for tablet d7551c6a0ebd493dba75b1f766c4db0f (DEFAULT_TABLE table=default.table_2cfa6cbcf8244da6b6468895fd9e31cc [id=321a68b57ebf4e3a80670c3c862403f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:48.667402 1750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7551c6a0ebd493dba75b1f766c4db0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:48.670079 2598 ts_tablet_manager.cc:1918] T 4e522e5dd8d84b3fb22cae56a95a8904 P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:48.670864 1612 tablet_service.cc:1468] Processing CreateTablet for tablet d7551c6a0ebd493dba75b1f766c4db0f (DEFAULT_TABLE table=default.table_2cfa6cbcf8244da6b6468895fd9e31cc [id=321a68b57ebf4e3a80670c3c862403f1]), partition=RANGE (key) PARTITION UNBOUNDED
W20250831 19:54:48.672686 2125 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_a01df8e629084e9c988bca1b80c7d640 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250831 19:54:48.672740 1612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7551c6a0ebd493dba75b1f766c4db0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:48.675983 1886 tablet_service.cc:1468] Processing CreateTablet for tablet 76a46b9cd969481193f399c6fc229eec (DEFAULT_TABLE table=default.table_ada526abffc1474c8cebeb3bcbb17824 [id=83de1930a88d4d86a0dc9a69a45333f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:48.676375 1886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76a46b9cd969481193f399c6fc229eec. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:48.676334 1752 tablet_service.cc:1468] Processing CreateTablet for tablet 76a46b9cd969481193f399c6fc229eec (DEFAULT_TABLE table=default.table_ada526abffc1474c8cebeb3bcbb17824 [id=83de1930a88d4d86a0dc9a69a45333f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:48.676723 1752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76a46b9cd969481193f399c6fc229eec. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:48.682399 2284 tablet_bootstrap.cc:492] T 76a46b9cd969481193f399c6fc229eec P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:48.683979 2284 tablet_bootstrap.cc:654] T 76a46b9cd969481193f399c6fc229eec P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:48.684502 1614 tablet_service.cc:1468] Processing CreateTablet for tablet 76a46b9cd969481193f399c6fc229eec (DEFAULT_TABLE table=default.table_ada526abffc1474c8cebeb3bcbb17824 [id=83de1930a88d4d86a0dc9a69a45333f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:48.684949 1614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76a46b9cd969481193f399c6fc229eec. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:48.685137 2283 tablet_bootstrap.cc:492] T d7551c6a0ebd493dba75b1f766c4db0f P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:48.685266 2283 ts_tablet_manager.cc:1397] T d7551c6a0ebd493dba75b1f766c4db0f P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.021s user 0.003s sys 0.004s
I20250831 19:54:48.686035 2283 raft_consensus.cc:357] T d7551c6a0ebd493dba75b1f766c4db0f P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:48.686257 2283 raft_consensus.cc:383] T d7551c6a0ebd493dba75b1f766c4db0f P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:48.686952 2283 raft_consensus.cc:738] T d7551c6a0ebd493dba75b1f766c4db0f P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:48.687186 2283 consensus_queue.cc:260] T d7551c6a0ebd493dba75b1f766c4db0f P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:48.687867 2283 ts_tablet_manager.cc:1428] T d7551c6a0ebd493dba75b1f766c4db0f P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20250831 19:54:48.688093 2283 tablet_bootstrap.cc:492] T 76a46b9cd969481193f399c6fc229eec P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:48.689683 2283 tablet_bootstrap.cc:654] T 76a46b9cd969481193f399c6fc229eec P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:48.693068 2598 log.cc:1199] T 4e522e5dd8d84b3fb22cae56a95a8904 P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/4e522e5dd8d84b3fb22cae56a95a8904
I20250831 19:54:48.694259 2598 ts_tablet_manager.cc:1939] T 4e522e5dd8d84b3fb22cae56a95a8904 P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
I20250831 19:54:48.696538 1634 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b7576e353a1c46b5af830f437afcb207" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:48.698279 2104 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet 4e522e5dd8d84b3fb22cae56a95a8904 (table default.table_2cfa6cbcf8244da6b6468895fd9e31cc [id=321a68b57ebf4e3a80670c3c862403f1]) successfully deleted
I20250831 19:54:48.703569 1884 tablet_service.cc:1515] Processing DeleteTablet for tablet 4e522e5dd8d84b3fb22cae56a95a8904 with delete_type TABLET_DATA_DELETED (replaced by tablet d7551c6a0ebd493dba75b1f766c4db0f) from {username='slave'} at 127.0.0.1:45906
I20250831 19:54:48.702030 2586 consensus_queue.cc:1035] T c8300924480443bcbad8345cf743bb58 P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20250831 19:54:48.707674 2283 tablet_bootstrap.cc:492] T 76a46b9cd969481193f399c6fc229eec P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:48.707880 2283 ts_tablet_manager.cc:1397] T 76a46b9cd969481193f399c6fc229eec P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.020s user 0.000s sys 0.005s
I20250831 19:54:48.703945 1771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b6ef0e612b7e4b80af6fa5b2a66242c0" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197"
I20250831 19:54:48.708369 1771 raft_consensus.cc:3058] T b6ef0e612b7e4b80af6fa5b2a66242c0 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:48.709204 2283 raft_consensus.cc:357] T 76a46b9cd969481193f399c6fc229eec P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:48.709393 2283 raft_consensus.cc:383] T 76a46b9cd969481193f399c6fc229eec P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:48.709481 2283 raft_consensus.cc:738] T 76a46b9cd969481193f399c6fc229eec P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:48.709766 2283 consensus_queue.cc:260] T 76a46b9cd969481193f399c6fc229eec P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:48.710414 2283 ts_tablet_manager.cc:1428] T 76a46b9cd969481193f399c6fc229eec P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250831 19:54:48.710788 1771 raft_consensus.cc:2466] T b6ef0e612b7e4b80af6fa5b2a66242c0 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 1.
I20250831 19:54:48.703197 1772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b6ef0e612b7e4b80af6fa5b2a66242c0" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:48.711341 1772 raft_consensus.cc:2374] T b6ef0e612b7e4b80af6fa5b2a66242c0 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 1. Re-sending same reply.
I20250831 19:54:48.693424 2463 ts_tablet_manager.cc:1918] T 4e522e5dd8d84b3fb22cae56a95a8904 P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:48.704439 1706 leader_election.cc:304] T b7576e353a1c46b5af830f437afcb207 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: de831f40fa1348a48a1f0260f4130197; no voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825
I20250831 19:54:48.704527 2472 consensus_queue.cc:1035] T f8871812b0734f40b63bef0473e2a58d P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20250831 19:54:48.713363 2585 raft_consensus.cc:2747] T b7576e353a1c46b5af830f437afcb207 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250831 19:54:48.713574 2585 consensus_queue.cc:1035] T 6210e006966a4c1dbe3a2d0388efac30 P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:48.719064 2584 consensus_queue.cc:1035] T c8300924480443bcbad8345cf743bb58 P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:48.722486 1614 tablet_service.cc:1468] Processing CreateTablet for tablet 99d703eb7412458e95070fffe3cde91b (DEFAULT_TABLE table=default.table_35ecd102852d45ef82370764dbe230af [id=98afc1315ef847eaa56545a18123993b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:48.722517 1885 tablet_service.cc:1468] Processing CreateTablet for tablet 99d703eb7412458e95070fffe3cde91b (DEFAULT_TABLE table=default.table_35ecd102852d45ef82370764dbe230af [id=98afc1315ef847eaa56545a18123993b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:48.722952 1614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99d703eb7412458e95070fffe3cde91b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:48.723066 1885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99d703eb7412458e95070fffe3cde91b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:48.725749 1752 tablet_service.cc:1468] Processing CreateTablet for tablet 99d703eb7412458e95070fffe3cde91b (DEFAULT_TABLE table=default.table_35ecd102852d45ef82370764dbe230af [id=98afc1315ef847eaa56545a18123993b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:48.726143 1752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99d703eb7412458e95070fffe3cde91b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:48.736647 2283 tablet_bootstrap.cc:492] T 99d703eb7412458e95070fffe3cde91b P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:48.739126 2283 tablet_bootstrap.cc:654] T 99d703eb7412458e95070fffe3cde91b P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:48.748054 2606 tablet_replica.cc:331] T 4e522e5dd8d84b3fb22cae56a95a8904 P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:54:48.748337 2284 tablet_bootstrap.cc:492] T 76a46b9cd969481193f399c6fc229eec P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:48.748342 2606 raft_consensus.cc:2241] T 4e522e5dd8d84b3fb22cae56a95a8904 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:48.748524 2284 ts_tablet_manager.cc:1397] T 76a46b9cd969481193f399c6fc229eec P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.066s user 0.006s sys 0.019s
I20250831 19:54:48.748695 2606 raft_consensus.cc:2270] T 4e522e5dd8d84b3fb22cae56a95a8904 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:48.749511 2606 ts_tablet_manager.cc:1905] T 4e522e5dd8d84b3fb22cae56a95a8904 P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:48.752557 2283 tablet_bootstrap.cc:492] T 99d703eb7412458e95070fffe3cde91b P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:48.752714 2283 ts_tablet_manager.cc:1397] T 99d703eb7412458e95070fffe3cde91b P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.016s user 0.001s sys 0.004s
I20250831 19:54:48.752732 2445 raft_consensus.cc:695] T 98c37cdff24447039bf0b8d832dbb8e5 P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: Becoming Leader. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Running, Role: LEADER
I20250831 19:54:48.753039 2445 consensus_queue.cc:237] T 98c37cdff24447039bf0b8d832dbb8e5 P de831f40fa1348a48a1f0260f4130197 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:48.749333 2284 raft_consensus.cc:357] T 76a46b9cd969481193f399c6fc229eec P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:48.753422 2284 raft_consensus.cc:383] T 76a46b9cd969481193f399c6fc229eec P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:48.753546 2284 raft_consensus.cc:738] T 76a46b9cd969481193f399c6fc229eec P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:48.753530 2283 raft_consensus.cc:357] T 99d703eb7412458e95070fffe3cde91b P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:48.753686 2283 raft_consensus.cc:383] T 99d703eb7412458e95070fffe3cde91b P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:48.753783 2283 raft_consensus.cc:738] T 99d703eb7412458e95070fffe3cde91b P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:48.754047 2283 consensus_queue.cc:260] T 99d703eb7412458e95070fffe3cde91b P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:48.754418 2284 consensus_queue.cc:260] T 76a46b9cd969481193f399c6fc229eec P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:48.754603 2283 ts_tablet_manager.cc:1428] T 99d703eb7412458e95070fffe3cde91b P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250831 19:54:48.754727 2525 tablet.cc:1722] T f8871812b0734f40b63bef0473e2a58d P 2441fafe1d62429386f4631ad423567d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:48.762153 2125 catalog_manager.cc:2149] created HMS catalog entry for table [id=5acaabe7b54f4abd8885a01190afef85]
I20250831 19:54:48.763126 2284 ts_tablet_manager.cc:1428] T 76a46b9cd969481193f399c6fc229eec P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.014s user 0.001s sys 0.001s
I20250831 19:54:48.763382 2284 tablet_bootstrap.cc:492] T d7551c6a0ebd493dba75b1f766c4db0f P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:48.764259 2472 raft_consensus.cc:491] T 81293470431c4deda5efbc30a03ce0ed P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:48.764676 2472 raft_consensus.cc:513] T 81293470431c4deda5efbc30a03ce0ed P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:48.765182 2472 leader_election.cc:290] T 81293470431c4deda5efbc30a03ce0ed P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:48.763530 2463 log.cc:1199] T 4e522e5dd8d84b3fb22cae56a95a8904 P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/4e522e5dd8d84b3fb22cae56a95a8904
I20250831 19:54:48.766075 1634 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "81293470431c4deda5efbc30a03ce0ed" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
W20250831 19:54:48.766538 1706 leader_election.cc:343] T 81293470431c4deda5efbc30a03ce0ed P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): Illegal state: must be running to vote when last-logged opid is not known
I20250831 19:54:48.766939 2463 ts_tablet_manager.cc:1939] T 4e522e5dd8d84b3fb22cae56a95a8904 P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
I20250831 19:54:48.767369 2533 tablet.cc:1722] T f8871812b0734f40b63bef0473e2a58d P 89aa85d59c53436ebdf3074b13d14825: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:48.768136 2125 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:36958 (request call id 63) took 1524 ms. Trace:
I20250831 19:54:48.768271 2125 rpcz_store.cc:276] 0831 19:54:47.243906 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:48.091209 (+847303us) service_pool.cc:225] Handling call
0831 19:54:48.672789 (+581580us) catalog_manager.cc:2076] Acquired catalog manager lock
0831 19:54:48.673326 (+ 537us) catalog_manager.cc:2122] Created new table and tablet info
0831 19:54:48.762090 (+ 88764us) catalog_manager.cc:2148] Created new table in HMS catalog
0831 19:54:48.767831 (+ 5741us) catalog_manager.cc:2182] Wrote table and tablets to system table
0831 19:54:48.767989 (+ 158us) catalog_manager.cc:2216] Inserted table and tablets into CatalogManager maps
0831 19:54:48.768099 (+ 110us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:48.762980 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:48.763085 (+ 105us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:48.763092 (+ 7us) write_op.cc:435] Acquired schema lock
0831 19:54:48.763095 (+ 3us) tablet.cc:660] Decoding operations
0831 19:54:48.763198 (+ 103us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:48.763212 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:48.763216 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:48.763292 (+ 76us) tablet.cc:699] Row locks acquired
0831 19:54:48.763294 (+ 2us) write_op.cc:260] PREPARE: finished
0831 19:54:48.763331 (+ 37us) write_op.cc:270] Start()
0831 19:54:48.763363 (+ 32us) write_op.cc:276] Timestamp: P: 1756670088763309 usec, L: 0
0831 19:54:48.763366 (+ 3us) op_driver.cc:348] REPLICATION: starting
0831 19:54:48.763528 (+ 162us) log.cc:844] Serialized 433 byte log entry
0831 19:54:48.766644 (+ 3116us) op_driver.cc:464] REPLICATION: finished
0831 19:54:48.766794 (+ 150us) write_op.cc:301] APPLY: starting
0831 19:54:48.766821 (+ 27us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:48.766872 (+ 51us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:48.766907 (+ 35us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:48.767051 (+ 144us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:48.767092 (+ 41us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0831 19:54:48.767103 (+ 11us) write_op.cc:312] APPLY: finished
0831 19:54:48.767189 (+ 86us) log.cc:844] Serialized 29 byte log entry
0831 19:54:48.767246 (+ 57us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:48.767267 (+ 21us) write_op.cc:454] Released schema lock
0831 19:54:48.767274 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0831 19:54:48.767342 (+ 68us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:48.767347 (+ 5us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":2956,"Hive Metastore.run_cpu_time_us":274,"Hive Metastore.run_wall_time_us":85465,"child_traces":[["op",{"apply.queue_time_us":101,"apply.run_cpu_time_us":538,"apply.run_wall_time_us":538,"num_ops":2,"prepare.queue_time_us":78,"prepare.run_cpu_time_us":658,"prepare.run_wall_time_us":659,"raft.queue_time_us":793,"raft.run_cpu_time_us":245,"raft.run_wall_time_us":244,"replication_time_us":3247}]]}
I20250831 19:54:48.770311 1904 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "81293470431c4deda5efbc30a03ce0ed" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:48.770514 1904 raft_consensus.cc:2466] T 81293470431c4deda5efbc30a03ce0ed P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 0.
I20250831 19:54:48.770884 1705 leader_election.cc:304] T 81293470431c4deda5efbc30a03ce0ed P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters: 89aa85d59c53436ebdf3074b13d14825
I20250831 19:54:48.770902 2105 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet 4e522e5dd8d84b3fb22cae56a95a8904 (table default.table_2cfa6cbcf8244da6b6468895fd9e31cc [id=321a68b57ebf4e3a80670c3c862403f1]) successfully deleted
I20250831 19:54:48.771221 2472 raft_consensus.cc:2802] T 81293470431c4deda5efbc30a03ce0ed P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:48.771310 2472 raft_consensus.cc:491] T 81293470431c4deda5efbc30a03ce0ed P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:48.771399 2472 raft_consensus.cc:3058] T 81293470431c4deda5efbc30a03ce0ed P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:48.771984 2125 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_696724b65868432da5cd0914cbbf40a3" } modify_external_catalogs: true
I20250831 19:54:48.773204 2125 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_696724b65868432da5cd0914cbbf40a3" } modify_external_catalogs: true
I20250831 19:54:48.774500 2472 raft_consensus.cc:513] T 81293470431c4deda5efbc30a03ce0ed P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:48.775429 1903 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "81293470431c4deda5efbc30a03ce0ed" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:54:48.775599 1903 raft_consensus.cc:3058] T 81293470431c4deda5efbc30a03ce0ed P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:48.778599 1903 raft_consensus.cc:2466] T 81293470431c4deda5efbc30a03ce0ed P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:54:48.779191 1705 leader_election.cc:304] T 81293470431c4deda5efbc30a03ce0ed P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:48.780012 2472 leader_election.cc:290] T 81293470431c4deda5efbc30a03ce0ed P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Requested vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:48.780228 2472 raft_consensus.cc:2802] T 81293470431c4deda5efbc30a03ce0ed P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:48.780930 2472 raft_consensus.cc:695] T 81293470431c4deda5efbc30a03ce0ed P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: Becoming Leader. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Running, Role: LEADER
I20250831 19:54:48.781904 2472 consensus_queue.cc:237] T 81293470431c4deda5efbc30a03ce0ed P de831f40fa1348a48a1f0260f4130197 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:48.782305 2586 raft_consensus.cc:491] T 00926e7f9fc74f1e9094fdfec9a1115f P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:48.782473 2586 raft_consensus.cc:513] T 00926e7f9fc74f1e9094fdfec9a1115f P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:48.782990 2586 leader_election.cc:290] T 00926e7f9fc74f1e9094fdfec9a1115f P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
W20250831 19:54:48.784750 2123 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_0c22133a9af24fe3b029fc31f3c63625 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250831 19:54:48.785893 2124 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_4b100a5c91f9467497d138af9f82f726 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250831 19:54:48.786741 1633 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "81293470431c4deda5efbc30a03ce0ed" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
W20250831 19:54:48.787221 1706 leader_election.cc:343] T 81293470431c4deda5efbc30a03ce0ed P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): Illegal state: must be running to vote when last-logged opid is not known
W20250831 19:54:48.787669 2126 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_c3cffc1117c341b0b3a7d4f82c01763a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250831 19:54:48.787789 1903 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "00926e7f9fc74f1e9094fdfec9a1115f" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:48.787967 1903 raft_consensus.cc:2466] T 00926e7f9fc74f1e9094fdfec9a1115f P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 0.
I20250831 19:54:48.788337 1705 leader_election.cc:304] T 00926e7f9fc74f1e9094fdfec9a1115f P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:48.788589 2586 raft_consensus.cc:2802] T 00926e7f9fc74f1e9094fdfec9a1115f P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:48.788693 2586 raft_consensus.cc:491] T 00926e7f9fc74f1e9094fdfec9a1115f P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:48.788790 2586 raft_consensus.cc:3058] T 00926e7f9fc74f1e9094fdfec9a1115f P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
W20250831 19:54:48.789026 2118 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_15539726e4e647e5a28a991bc6e07cd7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250831 19:54:48.791435 2586 raft_consensus.cc:513] T 00926e7f9fc74f1e9094fdfec9a1115f P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:48.791994 2586 leader_election.cc:290] T 00926e7f9fc74f1e9094fdfec9a1115f P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Requested vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:48.805603 1633 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "00926e7f9fc74f1e9094fdfec9a1115f" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:54:48.806208 1614 tablet_service.cc:1468] Processing CreateTablet for tablet 7e9810ebc28e4e07a83307c470ad92b3 (DEFAULT_TABLE table=default.table_a01df8e629084e9c988bca1b80c7d640 [id=5acaabe7b54f4abd8885a01190afef85]), partition=RANGE (key) PARTITION UNBOUNDED
W20250831 19:54:48.806314 1706 leader_election.cc:343] T 00926e7f9fc74f1e9094fdfec9a1115f P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): Illegal state: must be running to vote when last-logged opid is not known
I20250831 19:54:48.806692 1614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e9810ebc28e4e07a83307c470ad92b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:48.806803 1903 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "00926e7f9fc74f1e9094fdfec9a1115f" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:54:48.806977 1903 raft_consensus.cc:3058] T 00926e7f9fc74f1e9094fdfec9a1115f P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:48.810411 1634 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "00926e7f9fc74f1e9094fdfec9a1115f" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
W20250831 19:54:48.810926 1706 leader_election.cc:343] T 00926e7f9fc74f1e9094fdfec9a1115f P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): Illegal state: must be running to vote when last-logged opid is not known
I20250831 19:54:48.811398 1903 raft_consensus.cc:2466] T 00926e7f9fc74f1e9094fdfec9a1115f P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:54:48.811846 1705 leader_election.cc:304] T 00926e7f9fc74f1e9094fdfec9a1115f P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters: 89aa85d59c53436ebdf3074b13d14825
I20250831 19:54:48.812270 2586 raft_consensus.cc:2802] T 00926e7f9fc74f1e9094fdfec9a1115f P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:48.812525 2586 raft_consensus.cc:695] T 00926e7f9fc74f1e9094fdfec9a1115f P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: Becoming Leader. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Running, Role: LEADER
I20250831 19:54:48.813460 2586 consensus_queue.cc:237] T 00926e7f9fc74f1e9094fdfec9a1115f P de831f40fa1348a48a1f0260f4130197 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:48.814893 1884 tablet_service.cc:1468] Processing CreateTablet for tablet 7e9810ebc28e4e07a83307c470ad92b3 (DEFAULT_TABLE table=default.table_a01df8e629084e9c988bca1b80c7d640 [id=5acaabe7b54f4abd8885a01190afef85]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:48.815451 1750 tablet_service.cc:1468] Processing CreateTablet for tablet 7e9810ebc28e4e07a83307c470ad92b3 (DEFAULT_TABLE table=default.table_a01df8e629084e9c988bca1b80c7d640 [id=5acaabe7b54f4abd8885a01190afef85]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:48.815889 1750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e9810ebc28e4e07a83307c470ad92b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:48.817618 2594 raft_consensus.cc:491] T 99d703eb7412458e95070fffe3cde91b P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:48.817782 2594 raft_consensus.cc:513] T 99d703eb7412458e95070fffe3cde91b P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:48.819873 1772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "99d703eb7412458e95070fffe3cde91b" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
W20250831 19:54:48.820382 1842 leader_election.cc:343] T 99d703eb7412458e95070fffe3cde91b P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): Illegal state: must be running to vote when last-logged opid is not known
I20250831 19:54:48.821784 2284 tablet_bootstrap.cc:654] T d7551c6a0ebd493dba75b1f766c4db0f P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:48.822839 1634 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "99d703eb7412458e95070fffe3cde91b" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
W20250831 19:54:48.823319 1841 leader_election.cc:343] T 99d703eb7412458e95070fffe3cde91b P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): Illegal state: must be running to vote when last-logged opid is not known
I20250831 19:54:48.823454 1841 leader_election.cc:304] T 99d703eb7412458e95070fffe3cde91b P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2441fafe1d62429386f4631ad423567d; no voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197
I20250831 19:54:48.823935 2239 raft_consensus.cc:2747] T 99d703eb7412458e95070fffe3cde91b P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250831 19:54:48.847460 2594 leader_election.cc:290] T 99d703eb7412458e95070fffe3cde91b P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:48.849248 2282 tablet_bootstrap.cc:492] T 00926e7f9fc74f1e9094fdfec9a1115f P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:48.849521 2282 ts_tablet_manager.cc:1397] T 00926e7f9fc74f1e9094fdfec9a1115f P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.333s user 0.013s sys 0.075s
I20250831 19:54:48.850306 2282 raft_consensus.cc:357] T 00926e7f9fc74f1e9094fdfec9a1115f P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:48.850683 2282 raft_consensus.cc:383] T 00926e7f9fc74f1e9094fdfec9a1115f P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:48.850829 2282 raft_consensus.cc:738] T 00926e7f9fc74f1e9094fdfec9a1115f P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:48.856329 2284 tablet_bootstrap.cc:492] T d7551c6a0ebd493dba75b1f766c4db0f P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:48.856582 2284 ts_tablet_manager.cc:1397] T d7551c6a0ebd493dba75b1f766c4db0f P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.093s user 0.006s sys 0.006s
I20250831 19:54:48.857280 2284 raft_consensus.cc:357] T d7551c6a0ebd493dba75b1f766c4db0f P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:48.857738 2282 consensus_queue.cc:260] T 00926e7f9fc74f1e9094fdfec9a1115f P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:48.857991 2284 raft_consensus.cc:383] T d7551c6a0ebd493dba75b1f766c4db0f P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:48.861624 2284 raft_consensus.cc:738] T d7551c6a0ebd493dba75b1f766c4db0f P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:48.862433 2284 consensus_queue.cc:260] T d7551c6a0ebd493dba75b1f766c4db0f P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:48.864120 2284 ts_tablet_manager.cc:1428] T d7551c6a0ebd493dba75b1f766c4db0f P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20250831 19:54:48.864460 2284 tablet_bootstrap.cc:492] T 99d703eb7412458e95070fffe3cde91b P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:48.866220 2284 tablet_bootstrap.cc:654] T 99d703eb7412458e95070fffe3cde91b P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:48.869092 2282 ts_tablet_manager.cc:1428] T 00926e7f9fc74f1e9094fdfec9a1115f P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.013s user 0.001s sys 0.000s
I20250831 19:54:48.872115 1884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e9810ebc28e4e07a83307c470ad92b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:48.880590 2123 catalog_manager.cc:2149] created HMS catalog entry for table [id=c3969aded3a64f8c9707c760286a4312]
I20250831 19:54:48.885789 2606 ts_tablet_manager.cc:1918] T 4e522e5dd8d84b3fb22cae56a95a8904 P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:48.886384 2123 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:36958 (request call id 64) took 1609 ms. Trace:
I20250831 19:54:48.886915 2606 log.cc:1199] T 4e522e5dd8d84b3fb22cae56a95a8904 P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/4e522e5dd8d84b3fb22cae56a95a8904
I20250831 19:54:48.886978 2282 tablet_bootstrap.cc:492] T 81293470431c4deda5efbc30a03ce0ed P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:48.886483 2123 rpcz_store.cc:276] 0831 19:54:47.276946 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:48.101652 (+824706us) service_pool.cc:225] Handling call
0831 19:54:48.784874 (+683222us) catalog_manager.cc:2076] Acquired catalog manager lock
0831 19:54:48.785392 (+ 518us) catalog_manager.cc:2122] Created new table and tablet info
0831 19:54:48.880556 (+ 95164us) catalog_manager.cc:2148] Created new table in HMS catalog
0831 19:54:48.886128 (+ 5572us) catalog_manager.cc:2182] Wrote table and tablets to system table
0831 19:54:48.886234 (+ 106us) catalog_manager.cc:2216] Inserted table and tablets into CatalogManager maps
0831 19:54:48.886331 (+ 97us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:48.881387 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:48.881546 (+ 159us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:48.881556 (+ 10us) write_op.cc:435] Acquired schema lock
0831 19:54:48.881561 (+ 5us) tablet.cc:660] Decoding operations
0831 19:54:48.881690 (+ 129us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:48.881710 (+ 20us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:48.881718 (+ 8us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:48.881842 (+ 124us) tablet.cc:699] Row locks acquired
0831 19:54:48.881847 (+ 5us) write_op.cc:260] PREPARE: finished
0831 19:54:48.881896 (+ 49us) write_op.cc:270] Start()
0831 19:54:48.881941 (+ 45us) write_op.cc:276] Timestamp: P: 1756670088881858 usec, L: 0
0831 19:54:48.881947 (+ 6us) op_driver.cc:348] REPLICATION: starting
0831 19:54:48.882185 (+ 238us) log.cc:844] Serialized 433 byte log entry
0831 19:54:48.885002 (+ 2817us) op_driver.cc:464] REPLICATION: finished
0831 19:54:48.885130 (+ 128us) write_op.cc:301] APPLY: starting
0831 19:54:48.885144 (+ 14us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:48.885195 (+ 51us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:48.885247 (+ 52us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:48.885347 (+ 100us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:48.885382 (+ 35us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0831 19:54:48.885389 (+ 7us) write_op.cc:312] APPLY: finished
0831 19:54:48.885476 (+ 87us) log.cc:844] Serialized 29 byte log entry
0831 19:54:48.885553 (+ 77us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:48.885578 (+ 25us) write_op.cc:454] Released schema lock
0831 19:54:48.885586 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0831 19:54:48.885668 (+ 82us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:48.885674 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":4768,"Hive Metastore.run_cpu_time_us":260,"Hive Metastore.run_wall_time_us":89922,"child_traces":[["op",{"apply.queue_time_us":79,"apply.run_cpu_time_us":527,"apply.run_wall_time_us":526,"num_ops":2,"prepare.queue_time_us":58,"prepare.run_cpu_time_us":956,"prepare.run_wall_time_us":957,"raft.queue_time_us":504,"raft.run_cpu_time_us":286,"raft.run_wall_time_us":286,"replication_time_us":3024}]]}
I20250831 19:54:48.887735 2606 ts_tablet_manager.cc:1939] T 4e522e5dd8d84b3fb22cae56a95a8904 P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:54:48.888664 2282 tablet_bootstrap.cc:654] T 81293470431c4deda5efbc30a03ce0ed P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:48.888983 2101 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet 4e522e5dd8d84b3fb22cae56a95a8904 (table default.table_2cfa6cbcf8244da6b6468895fd9e31cc [id=321a68b57ebf4e3a80670c3c862403f1]) successfully deleted
I20250831 19:54:48.898358 2626 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.1.254:34259 every 8 connection(s)
I20250831 19:54:48.898461 2283 tablet_bootstrap.cc:492] T 7e9810ebc28e4e07a83307c470ad92b3 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:48.898679 2437 rpc_server.cc:307] RPC server started. Bound to: 127.1.1.254:34259
I20250831 19:54:48.900468 2283 tablet_bootstrap.cc:654] T 7e9810ebc28e4e07a83307c470ad92b3 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:48.900453 1614 tablet_service.cc:1468] Processing CreateTablet for tablet fe0a9178363d432f96eea9422293a2ed (DEFAULT_TABLE table=default.table_0c22133a9af24fe3b029fc31f3c63625 [id=c3969aded3a64f8c9707c760286a4312]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:48.900857 1614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe0a9178363d432f96eea9422293a2ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:48.900887 2437 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-0/data/info.pb
I20250831 19:54:48.902551 1885 tablet_service.cc:1468] Processing CreateTablet for tablet fe0a9178363d432f96eea9422293a2ed (DEFAULT_TABLE table=default.table_0c22133a9af24fe3b029fc31f3c63625 [id=c3969aded3a64f8c9707c760286a4312]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:48.902877 1885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe0a9178363d432f96eea9422293a2ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:48.906414 1031 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskfwTdIj/build/asan/bin/kudu as pid 2437
I20250831 19:54:48.906504 2123 catalog_manager.cc:6127] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: default.table_bcc81e72ea324a389ebbcc6a6b4512ac [id=f63d391a9c824314bf6789cc7bbb5ffb] alter complete (version 1)
I20250831 19:54:48.907073 1752 tablet_service.cc:1468] Processing CreateTablet for tablet fe0a9178363d432f96eea9422293a2ed (DEFAULT_TABLE table=default.table_0c22133a9af24fe3b029fc31f3c63625 [id=c3969aded3a64f8c9707c760286a4312]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:48.907403 1752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe0a9178363d432f96eea9422293a2ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:48.924808 2123 catalog_manager.cc:5582] T 98c37cdff24447039bf0b8d832dbb8e5 P de831f40fa1348a48a1f0260f4130197 reported cstate change: term changed from 0 to 1, leader changed from <none> to de831f40fa1348a48a1f0260f4130197 (127.1.1.194). New cstate: current_term: 1 leader_uuid: "de831f40fa1348a48a1f0260f4130197" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: HEALTHY } } }
I20250831 19:54:48.926664 2284 tablet_bootstrap.cc:492] T 99d703eb7412458e95070fffe3cde91b P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:48.926849 2284 ts_tablet_manager.cc:1397] T 99d703eb7412458e95070fffe3cde91b P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.062s user 0.002s sys 0.002s
I20250831 19:54:48.927809 2284 raft_consensus.cc:357] T 99d703eb7412458e95070fffe3cde91b P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:48.928013 2284 raft_consensus.cc:383] T 99d703eb7412458e95070fffe3cde91b P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:48.928544 2284 raft_consensus.cc:738] T 99d703eb7412458e95070fffe3cde91b P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:48.928813 2284 consensus_queue.cc:260] T 99d703eb7412458e95070fffe3cde91b P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:48.931789 2618 raft_consensus.cc:491] T d7551c6a0ebd493dba75b1f766c4db0f P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:48.931942 2618 raft_consensus.cc:513] T d7551c6a0ebd493dba75b1f766c4db0f P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:48.932633 2618 leader_election.cc:290] T d7551c6a0ebd493dba75b1f766c4db0f P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:48.933247 1634 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d7551c6a0ebd493dba75b1f766c4db0f" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
W20250831 19:54:48.933745 1841 leader_election.cc:343] T d7551c6a0ebd493dba75b1f766c4db0f P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): Illegal state: must be running to vote when last-logged opid is not known
I20250831 19:54:48.933234 1772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d7551c6a0ebd493dba75b1f766c4db0f" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:48.935695 1772 raft_consensus.cc:2466] T d7551c6a0ebd493dba75b1f766c4db0f P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 0.
I20250831 19:54:48.937803 1842 leader_election.cc:304] T d7551c6a0ebd493dba75b1f766c4db0f P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters: 89aa85d59c53436ebdf3074b13d14825
I20250831 19:54:48.938133 2618 raft_consensus.cc:2802] T d7551c6a0ebd493dba75b1f766c4db0f P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:48.938241 2618 raft_consensus.cc:491] T d7551c6a0ebd493dba75b1f766c4db0f P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:48.938326 2618 raft_consensus.cc:3058] T d7551c6a0ebd493dba75b1f766c4db0f P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:48.940953 2618 raft_consensus.cc:513] T d7551c6a0ebd493dba75b1f766c4db0f P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:48.943885 2284 ts_tablet_manager.cc:1428] T 99d703eb7412458e95070fffe3cde91b P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.017s user 0.002s sys 0.001s
I20250831 19:54:48.944430 2618 leader_election.cc:290] T d7551c6a0ebd493dba75b1f766c4db0f P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 election: Requested vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:48.945377 1633 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d7551c6a0ebd493dba75b1f766c4db0f" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
W20250831 19:54:48.946779 1841 leader_election.cc:343] T d7551c6a0ebd493dba75b1f766c4db0f P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): Illegal state: must be running to vote when last-logged opid is not known
I20250831 19:54:48.947908 1772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d7551c6a0ebd493dba75b1f766c4db0f" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197"
I20250831 19:54:48.948143 1772 raft_consensus.cc:3058] T d7551c6a0ebd493dba75b1f766c4db0f P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:48.950258 2123 catalog_manager.cc:5582] T b6ef0e612b7e4b80af6fa5b2a66242c0 P 2441fafe1d62429386f4631ad423567d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2441fafe1d62429386f4631ad423567d (127.1.1.195). New cstate: current_term: 1 leader_uuid: "2441fafe1d62429386f4631ad423567d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: UNKNOWN } } }
I20250831 19:54:48.960520 1772 raft_consensus.cc:2466] T d7551c6a0ebd493dba75b1f766c4db0f P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 1.
I20250831 19:54:48.961979 1842 leader_election.cc:304] T d7551c6a0ebd493dba75b1f766c4db0f P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters: 89aa85d59c53436ebdf3074b13d14825
I20250831 19:54:48.962513 2618 raft_consensus.cc:2802] T d7551c6a0ebd493dba75b1f766c4db0f P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:48.962760 2618 raft_consensus.cc:695] T d7551c6a0ebd493dba75b1f766c4db0f P 2441fafe1d62429386f4631ad423567d [term 1 LEADER]: Becoming Leader. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Running, Role: LEADER
I20250831 19:54:48.963027 2618 consensus_queue.cc:237] T d7551c6a0ebd493dba75b1f766c4db0f P 2441fafe1d62429386f4631ad423567d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:48.967728 2123 catalog_manager.cc:5582] T 00926e7f9fc74f1e9094fdfec9a1115f P de831f40fa1348a48a1f0260f4130197 reported cstate change: term changed from 0 to 1, leader changed from <none> to de831f40fa1348a48a1f0260f4130197 (127.1.1.194). New cstate: current_term: 1 leader_uuid: "de831f40fa1348a48a1f0260f4130197" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: UNKNOWN } } }
I20250831 19:54:48.968340 2123 catalog_manager.cc:5582] T 81293470431c4deda5efbc30a03ce0ed P de831f40fa1348a48a1f0260f4130197 reported cstate change: term changed from 0 to 1, leader changed from <none> to de831f40fa1348a48a1f0260f4130197 (127.1.1.194). New cstate: current_term: 1 leader_uuid: "de831f40fa1348a48a1f0260f4130197" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: UNKNOWN } } }
I20250831 19:54:48.980144 2628 sys_catalog.cc:263] Verifying existing consensus state
I20250831 19:54:48.995693 2284 tablet_bootstrap.cc:492] T fe0a9178363d432f96eea9422293a2ed P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:48.998306 2284 tablet_bootstrap.cc:654] T fe0a9178363d432f96eea9422293a2ed P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:49.003839 2123 catalog_manager.cc:5582] T d7551c6a0ebd493dba75b1f766c4db0f P 2441fafe1d62429386f4631ad423567d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2441fafe1d62429386f4631ad423567d (127.1.1.195). New cstate: current_term: 1 leader_uuid: "2441fafe1d62429386f4631ad423567d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: UNKNOWN } } }
I20250831 19:54:49.007735 1952 heartbeater.cc:344] Connected to a master server at 127.1.1.254:34259
I20250831 19:54:49.017578 2282 tablet_bootstrap.cc:492] T 81293470431c4deda5efbc30a03ce0ed P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:49.017735 2282 ts_tablet_manager.cc:1397] T 81293470431c4deda5efbc30a03ce0ed P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.131s user 0.013s sys 0.064s
I20250831 19:54:49.018473 2282 raft_consensus.cc:357] T 81293470431c4deda5efbc30a03ce0ed P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:49.018682 2282 raft_consensus.cc:383] T 81293470431c4deda5efbc30a03ce0ed P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:49.018755 2282 raft_consensus.cc:738] T 81293470431c4deda5efbc30a03ce0ed P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:49.019007 2282 consensus_queue.cc:260] T 81293470431c4deda5efbc30a03ce0ed P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:49.024451 1818 heartbeater.cc:344] Connected to a master server at 127.1.1.254:34259
I20250831 19:54:49.030881 2283 tablet_bootstrap.cc:492] T 7e9810ebc28e4e07a83307c470ad92b3 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:49.031702 2283 ts_tablet_manager.cc:1397] T 7e9810ebc28e4e07a83307c470ad92b3 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.133s user 0.008s sys 0.003s
I20250831 19:54:49.032502 2283 raft_consensus.cc:357] T 7e9810ebc28e4e07a83307c470ad92b3 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:49.032769 2283 raft_consensus.cc:383] T 7e9810ebc28e4e07a83307c470ad92b3 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:49.032835 2283 raft_consensus.cc:738] T 7e9810ebc28e4e07a83307c470ad92b3 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:49.033151 2282 ts_tablet_manager.cc:1428] T 81293470431c4deda5efbc30a03ce0ed P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.015s user 0.002s sys 0.000s
I20250831 19:54:49.033499 2282 tablet_bootstrap.cc:492] T d7551c6a0ebd493dba75b1f766c4db0f P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:49.034384 2283 consensus_queue.cc:260] T 7e9810ebc28e4e07a83307c470ad92b3 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:49.035049 2282 tablet_bootstrap.cc:654] T d7551c6a0ebd493dba75b1f766c4db0f P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:49.036895 1680 heartbeater.cc:344] Connected to a master server at 127.1.1.254:34259
I20250831 19:54:49.023437 2628 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3: Bootstrap starting.
I20250831 19:54:49.040352 2283 ts_tablet_manager.cc:1428] T 7e9810ebc28e4e07a83307c470ad92b3 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20250831 19:54:49.044768 2283 tablet_bootstrap.cc:492] T fe0a9178363d432f96eea9422293a2ed P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:49.045262 2124 catalog_manager.cc:2149] created HMS catalog entry for table [id=ecc3359620c94491ac39b0f7dc2f88c8]
I20250831 19:54:49.045758 1952 heartbeater.cc:344] Connected to a master server at 127.1.1.254:34259
I20250831 19:54:49.047068 2282 tablet_bootstrap.cc:492] T d7551c6a0ebd493dba75b1f766c4db0f P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:49.047236 2282 ts_tablet_manager.cc:1397] T d7551c6a0ebd493dba75b1f766c4db0f P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.000s
I20250831 19:54:49.047989 2282 raft_consensus.cc:357] T d7551c6a0ebd493dba75b1f766c4db0f P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:49.048156 2282 raft_consensus.cc:383] T d7551c6a0ebd493dba75b1f766c4db0f P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:49.048225 2282 raft_consensus.cc:738] T d7551c6a0ebd493dba75b1f766c4db0f P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:49.048429 2282 consensus_queue.cc:260] T d7551c6a0ebd493dba75b1f766c4db0f P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:49.051155 2124 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:36958 (request call id 65) took 1721 ms. Trace:
I20250831 19:54:49.051304 2124 rpcz_store.cc:276] 0831 19:54:47.329639 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:48.165902 (+836263us) service_pool.cc:225] Handling call
0831 19:54:48.785988 (+620086us) catalog_manager.cc:2076] Acquired catalog manager lock
0831 19:54:48.786451 (+ 463us) catalog_manager.cc:2122] Created new table and tablet info
0831 19:54:49.045216 (+258765us) catalog_manager.cc:2148] Created new table in HMS catalog
0831 19:54:49.050866 (+ 5650us) catalog_manager.cc:2182] Wrote table and tablets to system table
0831 19:54:49.050993 (+ 127us) catalog_manager.cc:2216] Inserted table and tablets into CatalogManager maps
0831 19:54:49.051110 (+ 117us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:49.046309 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:49.046421 (+ 112us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:49.046426 (+ 5us) write_op.cc:435] Acquired schema lock
0831 19:54:49.046428 (+ 2us) tablet.cc:660] Decoding operations
0831 19:54:49.046510 (+ 82us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:49.046521 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:49.046526 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:49.046591 (+ 65us) tablet.cc:699] Row locks acquired
0831 19:54:49.046593 (+ 2us) write_op.cc:260] PREPARE: finished
0831 19:54:49.046624 (+ 31us) write_op.cc:270] Start()
0831 19:54:49.046650 (+ 26us) write_op.cc:276] Timestamp: P: 1756670089046576 usec, L: 0
0831 19:54:49.046653 (+ 3us) op_driver.cc:348] REPLICATION: starting
0831 19:54:49.046837 (+ 184us) log.cc:844] Serialized 433 byte log entry
0831 19:54:49.050299 (+ 3462us) op_driver.cc:464] REPLICATION: finished
0831 19:54:49.050426 (+ 127us) write_op.cc:301] APPLY: starting
0831 19:54:49.050439 (+ 13us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:49.050474 (+ 35us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:49.050499 (+ 25us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:49.050591 (+ 92us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:49.050620 (+ 29us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0831 19:54:49.050625 (+ 5us) write_op.cc:312] APPLY: finished
0831 19:54:49.050687 (+ 62us) log.cc:844] Serialized 29 byte log entry
0831 19:54:49.050744 (+ 57us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:49.050761 (+ 17us) write_op.cc:454] Released schema lock
0831 19:54:49.050766 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0831 19:54:49.050847 (+ 81us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:49.050852 (+ 5us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":93776,"Hive Metastore.run_cpu_time_us":243,"Hive Metastore.run_wall_time_us":164702,"child_traces":[["op",{"apply.queue_time_us":81,"apply.run_cpu_time_us":412,"apply.run_wall_time_us":410,"num_ops":2,"prepare.queue_time_us":393,"prepare.run_cpu_time_us":653,"prepare.run_wall_time_us":653,"raft.queue_time_us":348,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":200,"replication_time_us":3617}]]}
I20250831 19:54:49.052663 2283 tablet_bootstrap.cc:654] T fe0a9178363d432f96eea9422293a2ed P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:49.057241 2282 ts_tablet_manager.cc:1428] T d7551c6a0ebd493dba75b1f766c4db0f P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.010s user 0.001s sys 0.000s
I20250831 19:54:49.059921 2519 raft_consensus.cc:491] T d7551c6a0ebd493dba75b1f766c4db0f P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:49.060098 2519 raft_consensus.cc:513] T d7551c6a0ebd493dba75b1f766c4db0f P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:49.060643 2519 leader_election.cc:290] T d7551c6a0ebd493dba75b1f766c4db0f P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:49.061125 1906 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d7551c6a0ebd493dba75b1f766c4db0f" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:49.062124 1772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d7551c6a0ebd493dba75b1f766c4db0f" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:49.062335 1772 raft_consensus.cc:2391] T d7551c6a0ebd493dba75b1f766c4db0f P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89aa85d59c53436ebdf3074b13d14825 in current term 1: Already voted for candidate 2441fafe1d62429386f4631ad423567d in this term.
I20250831 19:54:49.062692 1570 leader_election.cc:304] T d7551c6a0ebd493dba75b1f766c4db0f P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825; no voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197
I20250831 19:54:49.063165 2124 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_c8611581e59f4d8a94cd6f4da06917a4" } modify_external_catalogs: true
I20250831 19:54:49.063432 2124 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_c8611581e59f4d8a94cd6f4da06917a4" } modify_external_catalogs: true
I20250831 19:54:49.063839 2519 raft_consensus.cc:3058] T d7551c6a0ebd493dba75b1f766c4db0f P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:49.066272 2519 raft_consensus.cc:2747] T d7551c6a0ebd493dba75b1f766c4db0f P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250831 19:54:49.068552 1614 tablet_service.cc:1468] Processing CreateTablet for tablet de75786bcb5549149a81e52ac1a257db (DEFAULT_TABLE table=default.table_4b100a5c91f9467497d138af9f82f726 [id=ecc3359620c94491ac39b0f7dc2f88c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:49.068960 1614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de75786bcb5549149a81e52ac1a257db. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:49.069016 1884 tablet_service.cc:1468] Processing CreateTablet for tablet de75786bcb5549149a81e52ac1a257db (DEFAULT_TABLE table=default.table_4b100a5c91f9467497d138af9f82f726 [id=ecc3359620c94491ac39b0f7dc2f88c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:49.069337 1884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de75786bcb5549149a81e52ac1a257db. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:49.073973 1750 tablet_service.cc:1468] Processing CreateTablet for tablet de75786bcb5549149a81e52ac1a257db (DEFAULT_TABLE table=default.table_4b100a5c91f9467497d138af9f82f726 [id=ecc3359620c94491ac39b0f7dc2f88c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:49.074357 1750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de75786bcb5549149a81e52ac1a257db. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:49.075513 2282 tablet_bootstrap.cc:492] T 76a46b9cd969481193f399c6fc229eec P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:49.078388 2284 tablet_bootstrap.cc:492] T fe0a9178363d432f96eea9422293a2ed P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:49.078557 2284 ts_tablet_manager.cc:1397] T fe0a9178363d432f96eea9422293a2ed P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.083s user 0.007s sys 0.003s
I20250831 19:54:49.079388 2284 raft_consensus.cc:357] T fe0a9178363d432f96eea9422293a2ed P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:49.079608 2284 raft_consensus.cc:383] T fe0a9178363d432f96eea9422293a2ed P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:49.079689 2284 raft_consensus.cc:738] T fe0a9178363d432f96eea9422293a2ed P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:49.079973 2284 consensus_queue.cc:260] T fe0a9178363d432f96eea9422293a2ed P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:49.087092 2284 ts_tablet_manager.cc:1428] T fe0a9178363d432f96eea9422293a2ed P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20250831 19:54:49.092705 2282 tablet_bootstrap.cc:654] T 76a46b9cd969481193f399c6fc229eec P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:49.092979 2284 tablet_bootstrap.cc:492] T 7e9810ebc28e4e07a83307c470ad92b3 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:49.094661 2284 tablet_bootstrap.cc:654] T 7e9810ebc28e4e07a83307c470ad92b3 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:49.100237 2283 tablet_bootstrap.cc:492] T fe0a9178363d432f96eea9422293a2ed P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:49.100457 2283 ts_tablet_manager.cc:1397] T fe0a9178363d432f96eea9422293a2ed P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.056s user 0.000s sys 0.004s
I20250831 19:54:49.100703 2628 log.cc:826] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3: Log is configured to *not* fsync() on all Append() calls
I20250831 19:54:49.101481 2283 raft_consensus.cc:357] T fe0a9178363d432f96eea9422293a2ed P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:49.101794 2283 raft_consensus.cc:383] T fe0a9178363d432f96eea9422293a2ed P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:49.101939 2283 raft_consensus.cc:738] T fe0a9178363d432f96eea9422293a2ed P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:49.102252 2283 consensus_queue.cc:260] T fe0a9178363d432f96eea9422293a2ed P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:49.102838 2283 ts_tablet_manager.cc:1428] T fe0a9178363d432f96eea9422293a2ed P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250831 19:54:49.103109 2283 tablet_bootstrap.cc:492] T de75786bcb5549149a81e52ac1a257db P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:49.104686 2283 tablet_bootstrap.cc:654] T de75786bcb5549149a81e52ac1a257db P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:49.115792 2282 tablet_bootstrap.cc:492] T 76a46b9cd969481193f399c6fc229eec P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:49.116034 2282 ts_tablet_manager.cc:1397] T 76a46b9cd969481193f399c6fc229eec P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.041s user 0.002s sys 0.006s
I20250831 19:54:49.116917 2123 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_bced462d6a2a4c929f51cfe29e54fe75" } modify_external_catalogs: true
I20250831 19:54:49.117188 2123 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_bced462d6a2a4c929f51cfe29e54fe75" } modify_external_catalogs: true
I20250831 19:54:49.117115 2282 raft_consensus.cc:357] T 76a46b9cd969481193f399c6fc229eec P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:49.117368 2282 raft_consensus.cc:383] T 76a46b9cd969481193f399c6fc229eec P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:49.118397 2284 tablet_bootstrap.cc:492] T 7e9810ebc28e4e07a83307c470ad92b3 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:49.118554 2284 ts_tablet_manager.cc:1397] T 7e9810ebc28e4e07a83307c470ad92b3 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.026s user 0.003s sys 0.000s
I20250831 19:54:49.119216 2284 raft_consensus.cc:357] T 7e9810ebc28e4e07a83307c470ad92b3 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:49.119402 2284 raft_consensus.cc:383] T 7e9810ebc28e4e07a83307c470ad92b3 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:49.119484 2284 raft_consensus.cc:738] T 7e9810ebc28e4e07a83307c470ad92b3 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:49.119693 2284 consensus_queue.cc:260] T 7e9810ebc28e4e07a83307c470ad92b3 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:49.121212 2284 ts_tablet_manager.cc:1428] T 7e9810ebc28e4e07a83307c470ad92b3 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20250831 19:54:49.123677 2284 tablet_bootstrap.cc:492] T de75786bcb5549149a81e52ac1a257db P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:49.125181 2283 tablet_bootstrap.cc:492] T de75786bcb5549149a81e52ac1a257db P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:49.125329 2283 ts_tablet_manager.cc:1397] T de75786bcb5549149a81e52ac1a257db P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.022s user 0.002s sys 0.001s
I20250831 19:54:49.125650 2282 raft_consensus.cc:738] T 76a46b9cd969481193f399c6fc229eec P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:49.126724 2283 raft_consensus.cc:357] T de75786bcb5549149a81e52ac1a257db P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:49.126895 2283 raft_consensus.cc:383] T de75786bcb5549149a81e52ac1a257db P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:49.126972 2283 raft_consensus.cc:738] T de75786bcb5549149a81e52ac1a257db P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:49.127214 2283 consensus_queue.cc:260] T de75786bcb5549149a81e52ac1a257db P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:49.127199 2282 consensus_queue.cc:260] T 76a46b9cd969481193f399c6fc229eec P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:49.131661 2283 ts_tablet_manager.cc:1428] T de75786bcb5549149a81e52ac1a257db P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.006s user 0.000s sys 0.003s
I20250831 19:54:49.136817 2445 raft_consensus.cc:491] T 76a46b9cd969481193f399c6fc229eec P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:49.136957 2445 raft_consensus.cc:513] T 76a46b9cd969481193f399c6fc229eec P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:49.137503 2445 leader_election.cc:290] T 76a46b9cd969481193f399c6fc229eec P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:49.138002 1906 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "76a46b9cd969481193f399c6fc229eec" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:49.138162 1906 raft_consensus.cc:2466] T 76a46b9cd969481193f399c6fc229eec P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 0.
I20250831 19:54:49.138701 1705 leader_election.cc:304] T 76a46b9cd969481193f399c6fc229eec P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:49.139249 1633 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "76a46b9cd969481193f399c6fc229eec" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:49.139434 1633 raft_consensus.cc:2466] T 76a46b9cd969481193f399c6fc229eec P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 0.
I20250831 19:54:49.139950 2445 raft_consensus.cc:2802] T 76a46b9cd969481193f399c6fc229eec P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:49.140044 2445 raft_consensus.cc:491] T 76a46b9cd969481193f399c6fc229eec P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:49.140110 2445 raft_consensus.cc:3058] T 76a46b9cd969481193f399c6fc229eec P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:49.143538 2282 ts_tablet_manager.cc:1428] T 76a46b9cd969481193f399c6fc229eec P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.027s user 0.002s sys 0.000s
I20250831 19:54:49.146870 2282 tablet_bootstrap.cc:492] T 99d703eb7412458e95070fffe3cde91b P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:49.148793 2282 tablet_bootstrap.cc:654] T 99d703eb7412458e95070fffe3cde91b P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:49.152693 2445 raft_consensus.cc:513] T 76a46b9cd969481193f399c6fc229eec P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:49.153702 1906 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "76a46b9cd969481193f399c6fc229eec" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:54:49.153853 1906 raft_consensus.cc:3058] T 76a46b9cd969481193f399c6fc229eec P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:49.156622 1906 raft_consensus.cc:2466] T 76a46b9cd969481193f399c6fc229eec P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:54:49.157052 1705 leader_election.cc:304] T 76a46b9cd969481193f399c6fc229eec P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:49.157300 2584 raft_consensus.cc:2802] T 76a46b9cd969481193f399c6fc229eec P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:49.157528 2584 raft_consensus.cc:695] T 76a46b9cd969481193f399c6fc229eec P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: Becoming Leader. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Running, Role: LEADER
I20250831 19:54:49.157841 2584 consensus_queue.cc:237] T 76a46b9cd969481193f399c6fc229eec P de831f40fa1348a48a1f0260f4130197 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:49.157874 1633 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "76a46b9cd969481193f399c6fc229eec" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:54:49.158349 1633 raft_consensus.cc:3058] T 76a46b9cd969481193f399c6fc229eec P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:49.159991 2445 leader_election.cc:290] T 76a46b9cd969481193f399c6fc229eec P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Requested vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:49.160616 1633 raft_consensus.cc:2466] T 76a46b9cd969481193f399c6fc229eec P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:54:49.167415 2284 tablet_bootstrap.cc:654] T de75786bcb5549149a81e52ac1a257db P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:49.177031 2282 tablet_bootstrap.cc:492] T 99d703eb7412458e95070fffe3cde91b P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:49.177219 2282 ts_tablet_manager.cc:1397] T 99d703eb7412458e95070fffe3cde91b P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.030s user 0.004s sys 0.002s
I20250831 19:54:49.178018 2282 raft_consensus.cc:357] T 99d703eb7412458e95070fffe3cde91b P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:49.178254 2282 raft_consensus.cc:383] T 99d703eb7412458e95070fffe3cde91b P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:49.178350 2282 raft_consensus.cc:738] T 99d703eb7412458e95070fffe3cde91b P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:49.178568 2282 consensus_queue.cc:260] T 99d703eb7412458e95070fffe3cde91b P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:49.180981 2282 ts_tablet_manager.cc:1428] T 99d703eb7412458e95070fffe3cde91b P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20250831 19:54:49.181334 2282 tablet_bootstrap.cc:492] T 7e9810ebc28e4e07a83307c470ad92b3 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:49.182940 2282 tablet_bootstrap.cc:654] T 7e9810ebc28e4e07a83307c470ad92b3 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:49.198168 2284 tablet_bootstrap.cc:492] T de75786bcb5549149a81e52ac1a257db P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:49.198361 2284 ts_tablet_manager.cc:1397] T de75786bcb5549149a81e52ac1a257db P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.076s user 0.005s sys 0.005s
I20250831 19:54:49.199143 2284 raft_consensus.cc:357] T de75786bcb5549149a81e52ac1a257db P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:49.199350 2284 raft_consensus.cc:383] T de75786bcb5549149a81e52ac1a257db P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:49.199430 2284 raft_consensus.cc:738] T de75786bcb5549149a81e52ac1a257db P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:49.199717 2284 consensus_queue.cc:260] T de75786bcb5549149a81e52ac1a257db P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:49.200326 2284 ts_tablet_manager.cc:1428] T de75786bcb5549149a81e52ac1a257db P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250831 19:54:49.215848 2282 tablet_bootstrap.cc:492] T 7e9810ebc28e4e07a83307c470ad92b3 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:49.216037 2282 ts_tablet_manager.cc:1397] T 7e9810ebc28e4e07a83307c470ad92b3 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.035s user 0.012s sys 0.000s
I20250831 19:54:49.216817 2282 raft_consensus.cc:357] T 7e9810ebc28e4e07a83307c470ad92b3 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:49.217031 2282 raft_consensus.cc:383] T 7e9810ebc28e4e07a83307c470ad92b3 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:49.217104 2282 raft_consensus.cc:738] T 7e9810ebc28e4e07a83307c470ad92b3 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:49.217334 2282 consensus_queue.cc:260] T 7e9810ebc28e4e07a83307c470ad92b3 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:49.217829 2282 ts_tablet_manager.cc:1428] T 7e9810ebc28e4e07a83307c470ad92b3 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250831 19:54:49.218916 1680 heartbeater.cc:344] Connected to a master server at 127.1.1.254:34259
I20250831 19:54:49.221091 2282 tablet_bootstrap.cc:492] T fe0a9178363d432f96eea9422293a2ed P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:49.231786 2282 tablet_bootstrap.cc:654] T fe0a9178363d432f96eea9422293a2ed P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:49.249946 2282 tablet_bootstrap.cc:492] T fe0a9178363d432f96eea9422293a2ed P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:49.250197 2282 ts_tablet_manager.cc:1397] T fe0a9178363d432f96eea9422293a2ed P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.029s user 0.004s sys 0.000s
I20250831 19:54:49.251089 2282 raft_consensus.cc:357] T fe0a9178363d432f96eea9422293a2ed P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:49.251355 2282 raft_consensus.cc:383] T fe0a9178363d432f96eea9422293a2ed P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:49.251490 2282 raft_consensus.cc:738] T fe0a9178363d432f96eea9422293a2ed P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:49.251808 2282 consensus_queue.cc:260] T fe0a9178363d432f96eea9422293a2ed P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:49.259580 2282 ts_tablet_manager.cc:1428] T fe0a9178363d432f96eea9422293a2ed P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20250831 19:54:49.263845 2282 tablet_bootstrap.cc:492] T de75786bcb5549149a81e52ac1a257db P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:49.266418 2282 tablet_bootstrap.cc:654] T de75786bcb5549149a81e52ac1a257db P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:49.272908 2122 catalog_manager.cc:3460] renamed table default.table_26f70c27ca284c39a6201e33337404a9 [id=ad7bb166843e423ea7e50a1d18710fa1] in HMS: new name default.table_6c2f9309b58643529114857aae0568f2
I20250831 19:54:49.283134 2282 tablet_bootstrap.cc:492] T de75786bcb5549149a81e52ac1a257db P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:49.283296 2282 ts_tablet_manager.cc:1397] T de75786bcb5549149a81e52ac1a257db P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.020s user 0.006s sys 0.003s
I20250831 19:54:49.284119 2282 raft_consensus.cc:357] T de75786bcb5549149a81e52ac1a257db P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:49.284355 2282 raft_consensus.cc:383] T de75786bcb5549149a81e52ac1a257db P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:49.284441 2282 raft_consensus.cc:738] T de75786bcb5549149a81e52ac1a257db P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:49.284729 2282 consensus_queue.cc:260] T de75786bcb5549149a81e52ac1a257db P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:49.285284 2282 ts_tablet_manager.cc:1428] T de75786bcb5549149a81e52ac1a257db P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250831 19:54:49.292584 2631 raft_consensus.cc:491] T fe0a9178363d432f96eea9422293a2ed P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:49.292742 2631 raft_consensus.cc:513] T fe0a9178363d432f96eea9422293a2ed P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:49.293467 2631 leader_election.cc:290] T fe0a9178363d432f96eea9422293a2ed P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:49.294054 1772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "fe0a9178363d432f96eea9422293a2ed" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:49.294270 1772 raft_consensus.cc:2466] T fe0a9178363d432f96eea9422293a2ed P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 0.
I20250831 19:54:49.294705 1842 leader_election.cc:304] T fe0a9178363d432f96eea9422293a2ed P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:49.295162 2239 raft_consensus.cc:2802] T fe0a9178363d432f96eea9422293a2ed P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:49.295276 2239 raft_consensus.cc:491] T fe0a9178363d432f96eea9422293a2ed P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:49.295349 2239 raft_consensus.cc:3058] T fe0a9178363d432f96eea9422293a2ed P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:49.295382 1633 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "fe0a9178363d432f96eea9422293a2ed" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:49.295564 1633 raft_consensus.cc:2466] T fe0a9178363d432f96eea9422293a2ed P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 0.
I20250831 19:54:49.298645 2239 raft_consensus.cc:513] T fe0a9178363d432f96eea9422293a2ed P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:49.299610 1772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "fe0a9178363d432f96eea9422293a2ed" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197"
I20250831 19:54:49.299794 1772 raft_consensus.cc:3058] T fe0a9178363d432f96eea9422293a2ed P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:49.302398 1772 raft_consensus.cc:2466] T fe0a9178363d432f96eea9422293a2ed P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 1.
I20250831 19:54:49.302917 2223 raft_consensus.cc:491] T 00926e7f9fc74f1e9094fdfec9a1115f P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:49.303058 2223 raft_consensus.cc:513] T 00926e7f9fc74f1e9094fdfec9a1115f P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:49.303638 2223 leader_election.cc:290] T 00926e7f9fc74f1e9094fdfec9a1115f P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237)
I20250831 19:54:49.304375 1842 leader_election.cc:304] T fe0a9178363d432f96eea9422293a2ed P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:49.304636 2631 raft_consensus.cc:2802] T fe0a9178363d432f96eea9422293a2ed P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:49.304718 1906 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "00926e7f9fc74f1e9094fdfec9a1115f" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:49.304800 2631 raft_consensus.cc:695] T fe0a9178363d432f96eea9422293a2ed P 2441fafe1d62429386f4631ad423567d [term 1 LEADER]: Becoming Leader. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Running, Role: LEADER
I20250831 19:54:49.304975 1906 raft_consensus.cc:2391] T 00926e7f9fc74f1e9094fdfec9a1115f P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89aa85d59c53436ebdf3074b13d14825 in current term 1: Already voted for candidate de831f40fa1348a48a1f0260f4130197 in this term.
I20250831 19:54:49.305109 2631 consensus_queue.cc:237] T fe0a9178363d432f96eea9422293a2ed P 2441fafe1d62429386f4631ad423567d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:49.305568 2628 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3: Bootstrap replayed 1/1 log segments. Stats: ops{read=105 overwritten=0 applied=105 ignored=0} inserts{seen=66 ignored=0} mutations{seen=82 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250831 19:54:49.306074 1772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "00926e7f9fc74f1e9094fdfec9a1115f" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:49.306713 2628 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3: Bootstrap complete.
I20250831 19:54:49.306723 1570 leader_election.cc:304] T 00926e7f9fc74f1e9094fdfec9a1115f P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825; no voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197
I20250831 19:54:49.307281 2223 raft_consensus.cc:3058] T 00926e7f9fc74f1e9094fdfec9a1115f P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:49.310046 2638 raft_consensus.cc:491] T 99d703eb7412458e95070fffe3cde91b P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:49.309880 2223 raft_consensus.cc:2747] T 00926e7f9fc74f1e9094fdfec9a1115f P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250831 19:54:49.310227 2638 raft_consensus.cc:513] T 99d703eb7412458e95070fffe3cde91b P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:49.310824 2638 leader_election.cc:290] T 99d703eb7412458e95070fffe3cde91b P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237)
I20250831 19:54:49.311811 2638 consensus_queue.cc:1035] T b7576e353a1c46b5af830f437afcb207 P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:49.311908 1906 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "99d703eb7412458e95070fffe3cde91b" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:49.312078 1906 raft_consensus.cc:2466] T 99d703eb7412458e95070fffe3cde91b P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 0.
I20250831 19:54:49.313673 1568 leader_election.cc:304] T 99d703eb7412458e95070fffe3cde91b P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:54:49.313995 2638 raft_consensus.cc:2802] T 99d703eb7412458e95070fffe3cde91b P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:49.314071 2638 raft_consensus.cc:491] T 99d703eb7412458e95070fffe3cde91b P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:49.314149 2638 raft_consensus.cc:3058] T 99d703eb7412458e95070fffe3cde91b P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:49.316574 2638 raft_consensus.cc:513] T 99d703eb7412458e95070fffe3cde91b P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:49.317126 2638 leader_election.cc:290] T 99d703eb7412458e95070fffe3cde91b P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Requested vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237)
I20250831 19:54:49.319808 1771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "99d703eb7412458e95070fffe3cde91b" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197"
I20250831 19:54:49.319986 1771 raft_consensus.cc:3058] T 99d703eb7412458e95070fffe3cde91b P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:49.320185 2628 raft_consensus.cc:357] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } }
I20250831 19:54:49.321548 2628 raft_consensus.cc:738] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c830f6055d64a3b8a9f78b405ad8aa3, State: Initialized, Role: FOLLOWER
I20250831 19:54:49.322559 1771 raft_consensus.cc:2466] T 99d703eb7412458e95070fffe3cde91b P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1.
I20250831 19:54:49.322598 2628 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 105, Last appended: 3.105, Last appended by leader: 105, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } }
I20250831 19:54:49.323369 1570 leader_election.cc:304] T 99d703eb7412458e95070fffe3cde91b P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:49.324160 1904 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "99d703eb7412458e95070fffe3cde91b" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:54:49.324352 1904 raft_consensus.cc:3058] T 99d703eb7412458e95070fffe3cde91b P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:49.324856 2519 raft_consensus.cc:2802] T 99d703eb7412458e95070fffe3cde91b P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:49.324967 2519 raft_consensus.cc:695] T 99d703eb7412458e95070fffe3cde91b P 89aa85d59c53436ebdf3074b13d14825 [term 1 LEADER]: Becoming Leader. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Running, Role: LEADER
I20250831 19:54:49.325232 2519 consensus_queue.cc:237] T 99d703eb7412458e95070fffe3cde91b P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:49.327057 1904 raft_consensus.cc:2466] T 99d703eb7412458e95070fffe3cde91b P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1.
I20250831 19:54:49.327220 2042 master_runner.cc:186] Error getting master registration for 127.1.1.254:34259: OK, instance_id { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" instance_seqno: 1756670088573880 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20250831 19:54:49.327597 2042 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20250831 19:54:49.336671 1772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "99d703eb7412458e95070fffe3cde91b" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:49.336864 1772 raft_consensus.cc:2374] T 99d703eb7412458e95070fffe3cde91b P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1. Re-sending same reply.
I20250831 19:54:49.339179 2239 leader_election.cc:290] T fe0a9178363d432f96eea9422293a2ed P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 election: Requested vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:49.340402 1410 master_runner.cc:186] Error getting master registration for 127.1.1.254:34259: OK, instance_id { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" instance_seqno: 1756670088573880 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20250831 19:54:49.340629 1410 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20250831 19:54:49.344748 2223 consensus_queue.cc:1035] T b7576e353a1c46b5af830f437afcb207 P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:49.347427 1818 heartbeater.cc:344] Connected to a master server at 127.1.1.254:34259
I20250831 19:54:49.355484 2652 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } } }
I20250831 19:54:49.360034 2652 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [sys.catalog]: This master's current role is: FOLLOWER
I20250831 19:54:49.364037 2628 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [sys.catalog]: configured and running, proceeding with master startup.
I20250831 19:54:49.393671 1633 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "fe0a9178363d432f96eea9422293a2ed" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:54:49.393882 1633 raft_consensus.cc:3058] T fe0a9178363d432f96eea9422293a2ed P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:49.395968 2654 consensus_queue.cc:1035] T 114d1f10fa634e57b570568d83615f46 P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:49.402827 1633 raft_consensus.cc:2466] T fe0a9178363d432f96eea9422293a2ed P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 1.
I20250831 19:54:49.416453 2654 consensus_queue.cc:1035] T 114d1f10fa634e57b570568d83615f46 P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:49.435427 2121 catalog_manager.cc:3460] renamed table default.table_544f7d804f564e83be8fb83049aa8dea [id=2cd4af6b415c4e3a92a3732fa145aa42] in HMS: new name default.table_ca18962558654590b5d74892b4e00d0f
I20250831 19:54:49.443161 2652 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a4d46bc3ef5a4fbb8c9e4349c86c54a5. Latest consensus state: current_term: 3 leader_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } } }
I20250831 19:54:49.443429 2652 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [sys.catalog]: This master's current role is: FOLLOWER
I20250831 19:54:49.444387 2484 sys_catalog.cc:455] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } } }
I20250831 19:54:49.444586 2484 sys_catalog.cc:458] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [sys.catalog]: This master's current role is: LEADER
I20250831 19:54:49.449558 2239 raft_consensus.cc:491] T de75786bcb5549149a81e52ac1a257db P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:49.449718 2239 raft_consensus.cc:513] T de75786bcb5549149a81e52ac1a257db P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:49.450505 2239 leader_election.cc:290] T de75786bcb5549149a81e52ac1a257db P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:49.450910 1772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "de75786bcb5549149a81e52ac1a257db" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:49.451094 1772 raft_consensus.cc:2466] T de75786bcb5549149a81e52ac1a257db P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 0.
I20250831 19:54:49.451509 1842 leader_election.cc:304] T de75786bcb5549149a81e52ac1a257db P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:49.451746 2239 raft_consensus.cc:2802] T de75786bcb5549149a81e52ac1a257db P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:49.451838 2239 raft_consensus.cc:491] T de75786bcb5549149a81e52ac1a257db P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:49.451908 2239 raft_consensus.cc:3058] T de75786bcb5549149a81e52ac1a257db P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:49.451921 1633 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "de75786bcb5549149a81e52ac1a257db" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:49.452121 1633 raft_consensus.cc:2466] T de75786bcb5549149a81e52ac1a257db P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 0.
I20250831 19:54:49.454957 2239 raft_consensus.cc:513] T de75786bcb5549149a81e52ac1a257db P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:49.455708 2239 leader_election.cc:290] T de75786bcb5549149a81e52ac1a257db P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 election: Requested vote from peers 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:49.456084 1772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "de75786bcb5549149a81e52ac1a257db" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197"
I20250831 19:54:49.456238 1772 raft_consensus.cc:3058] T de75786bcb5549149a81e52ac1a257db P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:49.459205 1772 raft_consensus.cc:2466] T de75786bcb5549149a81e52ac1a257db P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 1.
I20250831 19:54:49.459589 1842 leader_election.cc:304] T de75786bcb5549149a81e52ac1a257db P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:49.460093 1633 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "de75786bcb5549149a81e52ac1a257db" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:54:49.460283 1633 raft_consensus.cc:3058] T de75786bcb5549149a81e52ac1a257db P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:49.462889 2594 raft_consensus.cc:2802] T de75786bcb5549149a81e52ac1a257db P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:49.463024 2594 raft_consensus.cc:695] T de75786bcb5549149a81e52ac1a257db P 2441fafe1d62429386f4631ad423567d [term 1 LEADER]: Becoming Leader. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Running, Role: LEADER
I20250831 19:54:49.463259 2594 consensus_queue.cc:237] T de75786bcb5549149a81e52ac1a257db P 2441fafe1d62429386f4631ad423567d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:49.464733 1633 raft_consensus.cc:2466] T de75786bcb5549149a81e52ac1a257db P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 1.
I20250831 19:54:49.492036 2684 catalog_manager.cc:797] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20250831 19:54:49.569746 2594 consensus_queue.cc:1035] T b6ef0e612b7e4b80af6fa5b2a66242c0 P 2441fafe1d62429386f4631ad423567d [LEADER]: Connected to new peer: Peer: permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:49.578974 2239 consensus_queue.cc:1035] T b6ef0e612b7e4b80af6fa5b2a66242c0 P 2441fafe1d62429386f4631ad423567d [LEADER]: Connected to new peer: Peer: permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:49.579418 2120 catalog_manager.cc:2706] deleted HMS catalog entry for table default.table_6b2346554c4543e684ad6275a7946831 [id=8b308db3bde240de873d138c0eec73a9]
I20250831 19:54:49.580796 2534 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" instance_seqno: 1756670079933967) as {username='slave'} at 127.1.1.193:41839; Asking this server to re-register.
I20250831 19:54:49.584650 2534 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "2441fafe1d62429386f4631ad423567d" instance_seqno: 1756670080785002) as {username='slave'} at 127.1.1.195:45673; Asking this server to re-register.
I20250831 19:54:49.586728 1952 heartbeater.cc:461] Registering TS with master...
I20250831 19:54:49.588740 1680 heartbeater.cc:461] Registering TS with master...
I20250831 19:54:49.589483 2534 ts_manager.cc:194] Registered new tserver with Master: 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237)
I20250831 19:54:49.592363 2534 ts_manager.cc:194] Registered new tserver with Master: 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:49.595764 2239 raft_consensus.cc:491] T 7e9810ebc28e4e07a83307c470ad92b3 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:49.595925 2239 raft_consensus.cc:513] T 7e9810ebc28e4e07a83307c470ad92b3 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:49.596457 2239 leader_election.cc:290] T 7e9810ebc28e4e07a83307c470ad92b3 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:49.596823 1771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7e9810ebc28e4e07a83307c470ad92b3" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:49.597009 1771 raft_consensus.cc:2466] T 7e9810ebc28e4e07a83307c470ad92b3 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 0.
I20250831 19:54:49.597417 1842 leader_election.cc:304] T 7e9810ebc28e4e07a83307c470ad92b3 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:49.597674 1633 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7e9810ebc28e4e07a83307c470ad92b3" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:49.597862 1633 raft_consensus.cc:2466] T 7e9810ebc28e4e07a83307c470ad92b3 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 0.
I20250831 19:54:49.598374 2239 raft_consensus.cc:2802] T 7e9810ebc28e4e07a83307c470ad92b3 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:49.598466 2239 raft_consensus.cc:491] T 7e9810ebc28e4e07a83307c470ad92b3 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:49.598555 2239 raft_consensus.cc:3058] T 7e9810ebc28e4e07a83307c470ad92b3 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:49.600383 2239 raft_consensus.cc:513] T 7e9810ebc28e4e07a83307c470ad92b3 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:49.600837 2239 leader_election.cc:290] T 7e9810ebc28e4e07a83307c470ad92b3 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 election: Requested vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:49.601141 1771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7e9810ebc28e4e07a83307c470ad92b3" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197"
I20250831 19:54:49.601325 1771 raft_consensus.cc:3058] T 7e9810ebc28e4e07a83307c470ad92b3 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:49.604317 1771 raft_consensus.cc:2466] T 7e9810ebc28e4e07a83307c470ad92b3 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 1.
I20250831 19:54:49.605106 1842 leader_election.cc:304] T 7e9810ebc28e4e07a83307c470ad92b3 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:49.605499 1633 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7e9810ebc28e4e07a83307c470ad92b3" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:54:49.605667 1633 raft_consensus.cc:3058] T 7e9810ebc28e4e07a83307c470ad92b3 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:49.608107 1633 raft_consensus.cc:2466] T 7e9810ebc28e4e07a83307c470ad92b3 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 1.
I20250831 19:54:49.608552 2239 raft_consensus.cc:2802] T 7e9810ebc28e4e07a83307c470ad92b3 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:49.608733 2239 raft_consensus.cc:695] T 7e9810ebc28e4e07a83307c470ad92b3 P 2441fafe1d62429386f4631ad423567d [term 1 LEADER]: Becoming Leader. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Running, Role: LEADER
I20250831 19:54:49.609097 2239 consensus_queue.cc:237] T 7e9810ebc28e4e07a83307c470ad92b3 P 2441fafe1d62429386f4631ad423567d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:49.610234 2117 catalog_manager.cc:2706] deleted HMS catalog entry for table default.table_1ca0a7f3c33945bd902a63ca09aa62ad [id=fe4053cd15a840d5b74f86e7894ea85e]
I20250831 19:54:49.617573 2534 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "de831f40fa1348a48a1f0260f4130197" instance_seqno: 1756670080362800) as {username='slave'} at 127.1.1.194:40397; Asking this server to re-register.
I20250831 19:54:49.618726 1818 heartbeater.cc:461] Registering TS with master...
I20250831 19:54:49.621026 2534 ts_manager.cc:194] Registered new tserver with Master: de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:49.630125 2126 catalog_manager.cc:2149] created HMS catalog entry for table [id=da5a81d8cada4041bd31e0bb6369d108]
I20250831 19:54:49.650705 2126 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:36958 (request call id 73) took 1417 ms. Trace:
I20250831 19:54:49.650852 2126 rpcz_store.cc:276] 0831 19:54:48.233107 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:48.661168 (+428061us) service_pool.cc:225] Handling call
0831 19:54:48.787767 (+126599us) catalog_manager.cc:2076] Acquired catalog manager lock
0831 19:54:48.788283 (+ 516us) catalog_manager.cc:2122] Created new table and tablet info
0831 19:54:49.630086 (+841803us) catalog_manager.cc:2148] Created new table in HMS catalog
0831 19:54:49.649858 (+ 19772us) catalog_manager.cc:2182] Wrote table and tablets to system table
0831 19:54:49.650012 (+ 154us) catalog_manager.cc:2216] Inserted table and tablets into CatalogManager maps
0831 19:54:49.650125 (+ 113us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:49.632954 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:49.633052 (+ 98us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:49.633056 (+ 4us) write_op.cc:435] Acquired schema lock
0831 19:54:49.633058 (+ 2us) tablet.cc:660] Decoding operations
0831 19:54:49.633137 (+ 79us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:49.633148 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:49.633151 (+ 3us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:49.633225 (+ 74us) tablet.cc:699] Row locks acquired
0831 19:54:49.633228 (+ 3us) write_op.cc:260] PREPARE: finished
0831 19:54:49.633264 (+ 36us) write_op.cc:270] Start()
0831 19:54:49.633293 (+ 29us) write_op.cc:276] Timestamp: P: 1756670089633211 usec, L: 0
0831 19:54:49.633296 (+ 3us) op_driver.cc:348] REPLICATION: starting
0831 19:54:49.633507 (+ 211us) log.cc:844] Serialized 433 byte log entry
0831 19:54:49.643711 (+ 10204us) op_driver.cc:464] REPLICATION: finished
0831 19:54:49.649298 (+ 5587us) write_op.cc:301] APPLY: starting
0831 19:54:49.649314 (+ 16us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:49.649354 (+ 40us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:49.649381 (+ 27us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:49.649551 (+ 170us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:49.649583 (+ 32us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0831 19:54:49.649588 (+ 5us) write_op.cc:312] APPLY: finished
0831 19:54:49.649670 (+ 82us) log.cc:844] Serialized 29 byte log entry
0831 19:54:49.649737 (+ 67us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:49.649764 (+ 27us) write_op.cc:454] Released schema lock
0831 19:54:49.649771 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0831 19:54:49.649845 (+ 74us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:49.649848 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":821567,"Hive Metastore.run_cpu_time_us":306,"Hive Metastore.run_wall_time_us":20054,"child_traces":[["op",{"apply.queue_time_us":5516,"apply.run_cpu_time_us":548,"apply.run_wall_time_us":548,"num_ops":2,"prepare.queue_time_us":2203,"prepare.run_cpu_time_us":704,"prepare.run_wall_time_us":1607,"raft.queue_time_us":71,"raft.run_cpu_time_us":437,"raft.run_wall_time_us":437,"replication_time_us":10384,"thread_start_us":7539,"threads_started":2}]]}
I20250831 19:54:49.652711 2118 catalog_manager.cc:2149] created HMS catalog entry for table [id=c64d0e4719134d4185b4f4dbfd60cd19]
I20250831 19:54:49.663731 2118 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:36958 (request call id 72) took 1886 ms. Trace:
I20250831 19:54:49.663862 2118 rpcz_store.cc:276] 0831 19:54:47.777594 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:48.626756 (+849162us) service_pool.cc:225] Handling call
0831 19:54:48.789126 (+162370us) catalog_manager.cc:2076] Acquired catalog manager lock
0831 19:54:48.789703 (+ 577us) catalog_manager.cc:2122] Created new table and tablet info
0831 19:54:49.652682 (+862979us) catalog_manager.cc:2148] Created new table in HMS catalog
0831 19:54:49.663489 (+ 10807us) catalog_manager.cc:2182] Wrote table and tablets to system table
0831 19:54:49.663584 (+ 95us) catalog_manager.cc:2216] Inserted table and tablets into CatalogManager maps
0831 19:54:49.663668 (+ 84us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:49.653548 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:49.653658 (+ 110us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:49.653663 (+ 5us) write_op.cc:435] Acquired schema lock
0831 19:54:49.653665 (+ 2us) tablet.cc:660] Decoding operations
0831 19:54:49.653766 (+ 101us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:49.653779 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:49.653784 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:49.653854 (+ 70us) tablet.cc:699] Row locks acquired
0831 19:54:49.653856 (+ 2us) write_op.cc:260] PREPARE: finished
0831 19:54:49.653886 (+ 30us) write_op.cc:270] Start()
0831 19:54:49.653908 (+ 22us) write_op.cc:276] Timestamp: P: 1756670089653833 usec, L: 0
0831 19:54:49.653910 (+ 2us) op_driver.cc:348] REPLICATION: starting
0831 19:54:49.654061 (+ 151us) log.cc:844] Serialized 433 byte log entry
0831 19:54:49.659036 (+ 4975us) op_driver.cc:464] REPLICATION: finished
0831 19:54:49.662555 (+ 3519us) write_op.cc:301] APPLY: starting
0831 19:54:49.662568 (+ 13us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:49.662599 (+ 31us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:49.662627 (+ 28us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:49.662763 (+ 136us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:49.662794 (+ 31us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0831 19:54:49.662800 (+ 6us) write_op.cc:312] APPLY: finished
0831 19:54:49.662860 (+ 60us) log.cc:844] Serialized 29 byte log entry
0831 19:54:49.662923 (+ 63us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:49.662937 (+ 14us) write_op.cc:454] Released schema lock
0831 19:54:49.662942 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0831 19:54:49.663480 (+ 538us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:49.663484 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":840240,"Hive Metastore.run_cpu_time_us":275,"Hive Metastore.run_wall_time_us":21666,"child_traces":[["op",{"apply.queue_time_us":3454,"apply.run_cpu_time_us":456,"apply.run_wall_time_us":918,"num_ops":2,"prepare.queue_time_us":280,"prepare.run_cpu_time_us":620,"prepare.run_wall_time_us":620,"raft.queue_time_us":1123,"raft.run_cpu_time_us":722,"raft.run_wall_time_us":721,"replication_time_us":5100}]]}
I20250831 19:54:49.666894 2118 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_2cfa6cbcf8244da6b6468895fd9e31cc" } new_table_name: "default.Table_6a83a43f21484b2ba465fe72560bb53f" modify_external_catalogs: true
I20250831 19:54:49.667317 2126 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_9706596e6715417ebc8fb06420b56bde" } new_table_name: "default.Table_f5e850536e8c40ccae5b78ae7e787b7d" modify_external_catalogs: true
I20250831 19:54:49.669150 1750 tablet_service.cc:1468] Processing CreateTablet for tablet 3d3be834ca8642c584da4265819c14ab (DEFAULT_TABLE table=default.table_c3cffc1117c341b0b3a7d4f82c01763a [id=da5a81d8cada4041bd31e0bb6369d108]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:49.669589 1750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d3be834ca8642c584da4265819c14ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:49.672154 1884 tablet_service.cc:1468] Processing CreateTablet for tablet 3d3be834ca8642c584da4265819c14ab (DEFAULT_TABLE table=default.table_c3cffc1117c341b0b3a7d4f82c01763a [id=da5a81d8cada4041bd31e0bb6369d108]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:49.672523 1884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d3be834ca8642c584da4265819c14ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:49.673794 1614 tablet_service.cc:1468] Processing CreateTablet for tablet 3d3be834ca8642c584da4265819c14ab (DEFAULT_TABLE table=default.table_c3cffc1117c341b0b3a7d4f82c01763a [id=da5a81d8cada4041bd31e0bb6369d108]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:49.674185 1614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d3be834ca8642c584da4265819c14ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:49.683336 1612 tablet_service.cc:1468] Processing CreateTablet for tablet 2c343954bf6e44d683310415da3c0e58 (DEFAULT_TABLE table=default.table_15539726e4e647e5a28a991bc6e07cd7 [id=c64d0e4719134d4185b4f4dbfd60cd19]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:49.683743 1612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c343954bf6e44d683310415da3c0e58. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:49.687239 2284 tablet_bootstrap.cc:492] T 3d3be834ca8642c584da4265819c14ab P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:49.687384 2282 tablet_bootstrap.cc:492] T 3d3be834ca8642c584da4265819c14ab P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:49.689002 2284 tablet_bootstrap.cc:654] T 3d3be834ca8642c584da4265819c14ab P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:49.689095 2282 tablet_bootstrap.cc:654] T 3d3be834ca8642c584da4265819c14ab P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:49.690630 1885 tablet_service.cc:1468] Processing CreateTablet for tablet 2c343954bf6e44d683310415da3c0e58 (DEFAULT_TABLE table=default.table_15539726e4e647e5a28a991bc6e07cd7 [id=c64d0e4719134d4185b4f4dbfd60cd19]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:49.691133 1885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c343954bf6e44d683310415da3c0e58. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:49.701691 2282 tablet_bootstrap.cc:492] T 3d3be834ca8642c584da4265819c14ab P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:49.701908 2282 ts_tablet_manager.cc:1397] T 3d3be834ca8642c584da4265819c14ab P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.006s
I20250831 19:54:49.702522 1750 tablet_service.cc:1468] Processing CreateTablet for tablet 2c343954bf6e44d683310415da3c0e58 (DEFAULT_TABLE table=default.table_15539726e4e647e5a28a991bc6e07cd7 [id=c64d0e4719134d4185b4f4dbfd60cd19]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:49.702728 2282 raft_consensus.cc:357] T 3d3be834ca8642c584da4265819c14ab P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:49.702971 2282 raft_consensus.cc:383] T 3d3be834ca8642c584da4265819c14ab P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:49.703003 1750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c343954bf6e44d683310415da3c0e58. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:49.703115 2282 raft_consensus.cc:738] T 3d3be834ca8642c584da4265819c14ab P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:49.703408 2282 consensus_queue.cc:260] T 3d3be834ca8642c584da4265819c14ab P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:49.706377 2282 ts_tablet_manager.cc:1428] T 3d3be834ca8642c584da4265819c14ab P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20250831 19:54:49.706692 2282 tablet_bootstrap.cc:492] T 2c343954bf6e44d683310415da3c0e58 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:49.712603 2699 tablet_bootstrap.cc:492] T 3d3be834ca8642c584da4265819c14ab P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:49.713470 2282 tablet_bootstrap.cc:654] T 2c343954bf6e44d683310415da3c0e58 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:49.715926 2472 consensus_queue.cc:1035] T 98c37cdff24447039bf0b8d832dbb8e5 P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:49.716488 2284 tablet_bootstrap.cc:492] T 3d3be834ca8642c584da4265819c14ab P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:49.716630 2284 ts_tablet_manager.cc:1397] T 3d3be834ca8642c584da4265819c14ab P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.029s user 0.003s sys 0.007s
I20250831 19:54:49.717371 2284 raft_consensus.cc:357] T 3d3be834ca8642c584da4265819c14ab P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:49.717604 2284 raft_consensus.cc:383] T 3d3be834ca8642c584da4265819c14ab P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:49.717684 2284 raft_consensus.cc:738] T 3d3be834ca8642c584da4265819c14ab P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:49.717905 2284 consensus_queue.cc:260] T 3d3be834ca8642c584da4265819c14ab P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:49.719062 2284 ts_tablet_manager.cc:1428] T 3d3be834ca8642c584da4265819c14ab P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250831 19:54:49.719388 2284 tablet_bootstrap.cc:492] T 2c343954bf6e44d683310415da3c0e58 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:49.721079 2284 tablet_bootstrap.cc:654] T 2c343954bf6e44d683310415da3c0e58 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:49.730379 2284 tablet_bootstrap.cc:492] T 2c343954bf6e44d683310415da3c0e58 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:49.730932 2284 ts_tablet_manager.cc:1397] T 2c343954bf6e44d683310415da3c0e58 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.004s
I20250831 19:54:49.732091 2284 raft_consensus.cc:357] T 2c343954bf6e44d683310415da3c0e58 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:49.732363 2284 raft_consensus.cc:383] T 2c343954bf6e44d683310415da3c0e58 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:49.732508 2284 raft_consensus.cc:738] T 2c343954bf6e44d683310415da3c0e58 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:49.732869 2284 consensus_queue.cc:260] T 2c343954bf6e44d683310415da3c0e58 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:49.734005 2284 ts_tablet_manager.cc:1428] T 2c343954bf6e44d683310415da3c0e58 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20250831 19:54:49.735267 2472 consensus_queue.cc:1035] T 00926e7f9fc74f1e9094fdfec9a1115f P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:49.736380 2282 tablet_bootstrap.cc:492] T 2c343954bf6e44d683310415da3c0e58 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:49.736588 2282 ts_tablet_manager.cc:1397] T 2c343954bf6e44d683310415da3c0e58 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.030s user 0.004s sys 0.000s
I20250831 19:54:49.737368 2282 raft_consensus.cc:357] T 2c343954bf6e44d683310415da3c0e58 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:49.737665 2282 raft_consensus.cc:383] T 2c343954bf6e44d683310415da3c0e58 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:49.737797 2282 raft_consensus.cc:738] T 2c343954bf6e44d683310415da3c0e58 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:49.738101 2282 consensus_queue.cc:260] T 2c343954bf6e44d683310415da3c0e58 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:49.738703 2282 ts_tablet_manager.cc:1428] T 2c343954bf6e44d683310415da3c0e58 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250831 19:54:49.741904 2699 tablet_bootstrap.cc:654] T 3d3be834ca8642c584da4265819c14ab P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:49.743089 2119 catalog_manager.cc:3460] renamed table default.table_0ab569c1a9dc4f91af81c84392bc5748 [id=0850f2b0e9324dd0a210fa7b2609c769] in HMS: new name default.table_fd98179fb4584ad6bde229ee78f7dfde
I20250831 19:54:49.761202 2699 tablet_bootstrap.cc:492] T 3d3be834ca8642c584da4265819c14ab P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:49.761432 2699 ts_tablet_manager.cc:1397] T 3d3be834ca8642c584da4265819c14ab P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.049s user 0.000s sys 0.010s
I20250831 19:54:49.762274 2699 raft_consensus.cc:357] T 3d3be834ca8642c584da4265819c14ab P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:49.762481 2699 raft_consensus.cc:383] T 3d3be834ca8642c584da4265819c14ab P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:49.762586 2699 raft_consensus.cc:738] T 3d3be834ca8642c584da4265819c14ab P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:49.762528 2584 consensus_queue.cc:1035] T 00926e7f9fc74f1e9094fdfec9a1115f P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:49.762782 2699 consensus_queue.cc:260] T 3d3be834ca8642c584da4265819c14ab P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:49.763213 2699 ts_tablet_manager.cc:1428] T 3d3be834ca8642c584da4265819c14ab P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20250831 19:54:49.767757 2699 tablet_bootstrap.cc:492] T 2c343954bf6e44d683310415da3c0e58 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:49.769327 2699 tablet_bootstrap.cc:654] T 2c343954bf6e44d683310415da3c0e58 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:49.772923 2445 consensus_queue.cc:1035] T 98c37cdff24447039bf0b8d832dbb8e5 P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:49.782598 2699 tablet_bootstrap.cc:492] T 2c343954bf6e44d683310415da3c0e58 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:49.783105 2699 ts_tablet_manager.cc:1397] T 2c343954bf6e44d683310415da3c0e58 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.003s
I20250831 19:54:49.783977 2699 raft_consensus.cc:357] T 2c343954bf6e44d683310415da3c0e58 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:49.784950 2699 raft_consensus.cc:383] T 2c343954bf6e44d683310415da3c0e58 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:49.785183 2699 raft_consensus.cc:738] T 2c343954bf6e44d683310415da3c0e58 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:49.785611 2699 consensus_queue.cc:260] T 2c343954bf6e44d683310415da3c0e58 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:49.794019 2699 ts_tablet_manager.cc:1428] T 2c343954bf6e44d683310415da3c0e58 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.011s user 0.000s sys 0.001s
I20250831 19:54:49.797377 2631 consensus_queue.cc:1035] T d7551c6a0ebd493dba75b1f766c4db0f P 2441fafe1d62429386f4631ad423567d [LEADER]: Connected to new peer: Peer: permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:49.798310 2445 raft_consensus.cc:491] T 3d3be834ca8642c584da4265819c14ab P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:49.798488 2445 raft_consensus.cc:513] T 3d3be834ca8642c584da4265819c14ab P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:49.799067 2445 leader_election.cc:290] T 3d3be834ca8642c584da4265819c14ab P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197), 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237)
I20250831 19:54:49.800698 1634 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3d3be834ca8642c584da4265819c14ab" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:49.800885 1634 raft_consensus.cc:2466] T 3d3be834ca8642c584da4265819c14ab P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 0.
I20250831 19:54:49.801584 1904 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3d3be834ca8642c584da4265819c14ab" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:49.801782 1904 raft_consensus.cc:2466] T 3d3be834ca8642c584da4265819c14ab P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 0.
I20250831 19:54:49.802250 1705 leader_election.cc:304] T 3d3be834ca8642c584da4265819c14ab P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:49.802601 2472 raft_consensus.cc:2802] T 3d3be834ca8642c584da4265819c14ab P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:49.802721 2472 raft_consensus.cc:491] T 3d3be834ca8642c584da4265819c14ab P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:49.802821 2472 raft_consensus.cc:3058] T 3d3be834ca8642c584da4265819c14ab P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:49.805279 2472 raft_consensus.cc:513] T 3d3be834ca8642c584da4265819c14ab P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:49.806237 1634 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3d3be834ca8642c584da4265819c14ab" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:54:49.806398 1634 raft_consensus.cc:3058] T 3d3be834ca8642c584da4265819c14ab P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:49.808848 1634 raft_consensus.cc:2466] T 3d3be834ca8642c584da4265819c14ab P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:54:49.810222 1706 leader_election.cc:304] T 3d3be834ca8642c584da4265819c14ab P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:49.810513 2445 raft_consensus.cc:2802] T 3d3be834ca8642c584da4265819c14ab P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:49.810618 2445 raft_consensus.cc:695] T 3d3be834ca8642c584da4265819c14ab P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: Becoming Leader. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Running, Role: LEADER
I20250831 19:54:49.810858 2445 consensus_queue.cc:237] T 3d3be834ca8642c584da4265819c14ab P de831f40fa1348a48a1f0260f4130197 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:49.811115 2125 catalog_manager.cc:2706] deleted HMS catalog entry for table default.table_696724b65868432da5cd0914cbbf40a3 [id=5226b7f2958d4616b3fad9408fdd42cd]
I20250831 19:54:49.812624 1904 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3d3be834ca8642c584da4265819c14ab" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:54:49.812789 1904 raft_consensus.cc:3058] T 3d3be834ca8642c584da4265819c14ab P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:49.823706 1904 raft_consensus.cc:2466] T 3d3be834ca8642c584da4265819c14ab P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:54:49.805821 2472 leader_election.cc:290] T 3d3be834ca8642c584da4265819c14ab P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Requested vote from peers 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197), 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237)
I20250831 19:54:49.840050 2594 consensus_queue.cc:1035] T d7551c6a0ebd493dba75b1f766c4db0f P 2441fafe1d62429386f4631ad423567d [LEADER]: Connected to new peer: Peer: permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:49.840550 2186 catalog_manager.cc:2747] Deleting table default.table_6b2346554c4543e684ad6275a7946831 [id=8b308db3bde240de873d138c0eec73a9] in response to Hive Metastore notification log event 78
I20250831 19:54:49.851460 2186 catalog_manager.cc:5869] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Sending DeleteTablet for 3 replicas of tablet 529eddf7703e4ddc87e974720404fdf3
I20250831 19:54:49.852499 1750 tablet_service.cc:1515] Processing DeleteTablet for tablet 529eddf7703e4ddc87e974720404fdf3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:49 UTC) from {username='slave'} at 127.0.0.1:50674
I20250831 19:54:49.853286 1884 tablet_service.cc:1515] Processing DeleteTablet for tablet 529eddf7703e4ddc87e974720404fdf3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:49 UTC) from {username='slave'} at 127.0.0.1:45906
I20250831 19:54:49.857323 1612 tablet_service.cc:1515] Processing DeleteTablet for tablet 529eddf7703e4ddc87e974720404fdf3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:49 UTC) from {username='slave'} at 127.0.0.1:51022
I20250831 19:54:49.858106 2186 catalog_manager.cc:2747] Deleting table default.table_1ca0a7f3c33945bd902a63ca09aa62ad [id=fe4053cd15a840d5b74f86e7894ea85e] in response to Hive Metastore notification log event 79
I20250831 19:54:49.892483 2186 catalog_manager.cc:5869] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Sending DeleteTablet for 3 replicas of tablet b6eee4e23718478cb107ddbcae2bbec2
I20250831 19:54:49.893558 1885 tablet_service.cc:1515] Processing DeleteTablet for tablet b6eee4e23718478cb107ddbcae2bbec2 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:49 UTC) from {username='slave'} at 127.0.0.1:45906
I20250831 19:54:49.893853 1752 tablet_service.cc:1515] Processing DeleteTablet for tablet b6eee4e23718478cb107ddbcae2bbec2 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:49 UTC) from {username='slave'} at 127.0.0.1:50674
I20250831 19:54:49.894886 1614 tablet_service.cc:1515] Processing DeleteTablet for tablet b6eee4e23718478cb107ddbcae2bbec2 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:49 UTC) from {username='slave'} at 127.0.0.1:51022
I20250831 19:54:49.907859 2719 tablet.cc:1722] T b6ef0e612b7e4b80af6fa5b2a66242c0 P 2441fafe1d62429386f4631ad423567d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:49.934000 2714 tablet_replica.cc:331] T 529eddf7703e4ddc87e974720404fdf3 P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:54:49.934370 2714 raft_consensus.cc:2241] T 529eddf7703e4ddc87e974720404fdf3 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:49.934675 2714 raft_consensus.cc:2270] T 529eddf7703e4ddc87e974720404fdf3 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:49.934695 2654 raft_consensus.cc:491] T 81293470431c4deda5efbc30a03ce0ed P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:49.934841 2654 raft_consensus.cc:513] T 81293470431c4deda5efbc30a03ce0ed P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:49.935370 2714 ts_tablet_manager.cc:1905] T 529eddf7703e4ddc87e974720404fdf3 P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:49.935494 2654 leader_election.cc:290] T 81293470431c4deda5efbc30a03ce0ed P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:49.936473 1904 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "81293470431c4deda5efbc30a03ce0ed" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:49.936697 1904 raft_consensus.cc:2391] T 81293470431c4deda5efbc30a03ce0ed P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89aa85d59c53436ebdf3074b13d14825 in current term 1: Already voted for candidate de831f40fa1348a48a1f0260f4130197 in this term.
I20250831 19:54:49.936985 1770 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "81293470431c4deda5efbc30a03ce0ed" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:49.937594 1568 leader_election.cc:304] T 81293470431c4deda5efbc30a03ce0ed P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825; no voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197
I20250831 19:54:49.938007 2654 raft_consensus.cc:3058] T 81293470431c4deda5efbc30a03ce0ed P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:49.938383 2723 tablet.cc:1722] T b6ef0e612b7e4b80af6fa5b2a66242c0 P de831f40fa1348a48a1f0260f4130197: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:49.939093 2722 tablet.cc:1722] T 07a9cd92870045a7a3e5a8b007bf7f47 P 2441fafe1d62429386f4631ad423567d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250831 19:54:49.940522 2654 raft_consensus.cc:2747] T 81293470431c4deda5efbc30a03ce0ed P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250831 19:54:49.941785 2715 tablet_replica.cc:331] T 529eddf7703e4ddc87e974720404fdf3 P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:54:49.942094 2715 raft_consensus.cc:2241] T 529eddf7703e4ddc87e974720404fdf3 P 89aa85d59c53436ebdf3074b13d14825 [term 1 LEADER]: Raft consensus shutting down.
I20250831 19:54:49.942533 2715 raft_consensus.cc:2270] T 529eddf7703e4ddc87e974720404fdf3 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:49.943220 2715 ts_tablet_manager.cc:1905] T 529eddf7703e4ddc87e974720404fdf3 P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:49.943972 2720 tablet.cc:1722] T b6ef0e612b7e4b80af6fa5b2a66242c0 P 89aa85d59c53436ebdf3074b13d14825: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:49.944490 2721 tablet.cc:1722] T 07a9cd92870045a7a3e5a8b007bf7f47 P de831f40fa1348a48a1f0260f4130197: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250831 19:54:49.947567 2186 catalog_manager.cc:2747] Deleting table default.table_696724b65868432da5cd0914cbbf40a3 [id=5226b7f2958d4616b3fad9408fdd42cd] in response to Hive Metastore notification log event 83
I20250831 19:54:49.950433 2445 consensus_queue.cc:1035] T 81293470431c4deda5efbc30a03ce0ed P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:49.952576 2724 tablet.cc:1722] T 07a9cd92870045a7a3e5a8b007bf7f47 P 89aa85d59c53436ebdf3074b13d14825: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250831 19:54:49.957489 2445 consensus_queue.cc:1035] T 81293470431c4deda5efbc30a03ce0ed P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:49.970324 2713 tablet_replica.cc:331] T 529eddf7703e4ddc87e974720404fdf3 P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:54:49.976235 2719 tablet.cc:1722] T 79a678e2a5ba495095865769a25ff68a P 2441fafe1d62429386f4631ad423567d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250831 19:54:49.983116 2713 raft_consensus.cc:2241] T 529eddf7703e4ddc87e974720404fdf3 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:49.981014 2720 tablet.cc:1722] T 79a678e2a5ba495095865769a25ff68a P 89aa85d59c53436ebdf3074b13d14825: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250831 19:54:49.999946 2713 raft_consensus.cc:2270] T 529eddf7703e4ddc87e974720404fdf3 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:50.000393 2713 ts_tablet_manager.cc:1905] T 529eddf7703e4ddc87e974720404fdf3 P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:49.999475 2721 tablet.cc:1722] T 79a678e2a5ba495095865769a25ff68a P de831f40fa1348a48a1f0260f4130197: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250831 19:54:50.009588 2186 catalog_manager.cc:5869] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Sending DeleteTablet for 3 replicas of tablet 6210e006966a4c1dbe3a2d0388efac30
I20250831 19:54:50.010610 1884 tablet_service.cc:1515] Processing DeleteTablet for tablet 6210e006966a4c1dbe3a2d0388efac30 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:49 UTC) from {username='slave'} at 127.0.0.1:45906
I20250831 19:54:50.011250 1612 tablet_service.cc:1515] Processing DeleteTablet for tablet 6210e006966a4c1dbe3a2d0388efac30 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:49 UTC) from {username='slave'} at 127.0.0.1:51022
I20250831 19:54:50.012723 1750 tablet_service.cc:1515] Processing DeleteTablet for tablet 6210e006966a4c1dbe3a2d0388efac30 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:49 UTC) from {username='slave'} at 127.0.0.1:50674
I20250831 19:54:50.016700 2713 ts_tablet_manager.cc:1918] T 529eddf7703e4ddc87e974720404fdf3 P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:50.016865 2713 log.cc:1199] T 529eddf7703e4ddc87e974720404fdf3 P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/529eddf7703e4ddc87e974720404fdf3
I20250831 19:54:50.017253 2715 ts_tablet_manager.cc:1918] T 529eddf7703e4ddc87e974720404fdf3 P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:50.017372 2715 log.cc:1199] T 529eddf7703e4ddc87e974720404fdf3 P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/529eddf7703e4ddc87e974720404fdf3
I20250831 19:54:50.017508 2713 ts_tablet_manager.cc:1939] T 529eddf7703e4ddc87e974720404fdf3 P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
I20250831 19:54:50.018501 2105 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet 529eddf7703e4ddc87e974720404fdf3 (table default.table_6b2346554c4543e684ad6275a7946831 [id=8b308db3bde240de873d138c0eec73a9]) successfully deleted
I20250831 19:54:50.018929 2713 tablet_replica.cc:331] T b6eee4e23718478cb107ddbcae2bbec2 P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:54:50.019194 2713 raft_consensus.cc:2241] T b6eee4e23718478cb107ddbcae2bbec2 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:50.019485 2713 raft_consensus.cc:2270] T b6eee4e23718478cb107ddbcae2bbec2 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:50.020031 2713 ts_tablet_manager.cc:1905] T b6eee4e23718478cb107ddbcae2bbec2 P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:50.026911 2714 ts_tablet_manager.cc:1918] T 529eddf7703e4ddc87e974720404fdf3 P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:50.027030 2714 log.cc:1199] T 529eddf7703e4ddc87e974720404fdf3 P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/529eddf7703e4ddc87e974720404fdf3
I20250831 19:54:50.027420 2714 ts_tablet_manager.cc:1939] T 529eddf7703e4ddc87e974720404fdf3 P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:54:50.029098 2101 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet 529eddf7703e4ddc87e974720404fdf3 (table default.table_6b2346554c4543e684ad6275a7946831 [id=8b308db3bde240de873d138c0eec73a9]) successfully deleted
I20250831 19:54:50.036223 2713 ts_tablet_manager.cc:1918] T b6eee4e23718478cb107ddbcae2bbec2 P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:50.036401 2713 log.cc:1199] T b6eee4e23718478cb107ddbcae2bbec2 P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/b6eee4e23718478cb107ddbcae2bbec2
I20250831 19:54:50.036813 2713 ts_tablet_manager.cc:1939] T b6eee4e23718478cb107ddbcae2bbec2 P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
I20250831 19:54:50.037698 2105 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet b6eee4e23718478cb107ddbcae2bbec2 (table default.table_1ca0a7f3c33945bd902a63ca09aa62ad [id=fe4053cd15a840d5b74f86e7894ea85e]) successfully deleted
I20250831 19:54:50.038082 2713 tablet_replica.cc:331] T 6210e006966a4c1dbe3a2d0388efac30 P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:54:50.038280 2713 raft_consensus.cc:2241] T 6210e006966a4c1dbe3a2d0388efac30 P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: Raft consensus shutting down.
I20250831 19:54:50.038609 2713 raft_consensus.cc:2270] T 6210e006966a4c1dbe3a2d0388efac30 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:50.039115 2713 ts_tablet_manager.cc:1905] T 6210e006966a4c1dbe3a2d0388efac30 P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:50.044298 2713 ts_tablet_manager.cc:1918] T 6210e006966a4c1dbe3a2d0388efac30 P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:50.044435 2713 log.cc:1199] T 6210e006966a4c1dbe3a2d0388efac30 P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/6210e006966a4c1dbe3a2d0388efac30
I20250831 19:54:50.044799 2713 ts_tablet_manager.cc:1939] T 6210e006966a4c1dbe3a2d0388efac30 P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
I20250831 19:54:50.045651 2105 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet 6210e006966a4c1dbe3a2d0388efac30 (table default.table_696724b65868432da5cd0914cbbf40a3 [id=5226b7f2958d4616b3fad9408fdd42cd]) successfully deleted
I20250831 19:54:50.048629 2124 catalog_manager.cc:2706] deleted HMS catalog entry for table default.table_c8611581e59f4d8a94cd6f4da06917a4 [id=bd456415108d49989ef0bc2af91eb2f0]
I20250831 19:54:50.049604 2715 ts_tablet_manager.cc:1939] T 529eddf7703e4ddc87e974720404fdf3 P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
I20250831 19:54:50.049959 2714 tablet_replica.cc:331] T b6eee4e23718478cb107ddbcae2bbec2 P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:54:50.050180 2714 raft_consensus.cc:2241] T b6eee4e23718478cb107ddbcae2bbec2 P 2441fafe1d62429386f4631ad423567d [term 1 LEADER]: Raft consensus shutting down.
I20250831 19:54:50.050506 2714 raft_consensus.cc:2270] T b6eee4e23718478cb107ddbcae2bbec2 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:50.051056 2714 ts_tablet_manager.cc:1905] T b6eee4e23718478cb107ddbcae2bbec2 P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:50.052209 2715 tablet_replica.cc:331] T b6eee4e23718478cb107ddbcae2bbec2 P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:54:50.053727 2104 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet 529eddf7703e4ddc87e974720404fdf3 (table default.table_6b2346554c4543e684ad6275a7946831 [id=8b308db3bde240de873d138c0eec73a9]) successfully deleted
I20250831 19:54:50.054121 2715 raft_consensus.cc:2241] T b6eee4e23718478cb107ddbcae2bbec2 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:50.054337 2715 raft_consensus.cc:2270] T b6eee4e23718478cb107ddbcae2bbec2 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:50.055210 2715 ts_tablet_manager.cc:1905] T b6eee4e23718478cb107ddbcae2bbec2 P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:50.055852 2117 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:36958 (request call id 69) took 2362 ms. Trace:
I20250831 19:54:50.055970 2117 rpcz_store.cc:276] 0831 19:54:47.692969 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:48.568596 (+875627us) service_pool.cc:225] Handling call
0831 19:54:48.787203 (+218607us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:50.055805 (+1268602us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":792071,"Hive Metastore.run_cpu_time_us":205,"Hive Metastore.run_wall_time_us":30500}
I20250831 19:54:50.056332 2122 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:36958 (request call id 66) took 2389 ms. Trace:
I20250831 19:54:50.056427 2122 rpcz_store.cc:276] 0831 19:54:47.666669 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:48.183490 (+516821us) service_pool.cc:225] Handling call
0831 19:54:48.247472 (+ 63982us) spinlock_profiling.cc:243] Waited 63.6 ms on lock 0x616000040c54. stack: 00007f1e3b0dc7d6 00007f1e3b0dc590 00007f1e3a0cf3ad 0000000000972d94 0000000000972d5d 00007f1e49ea714d 00007f1e49ea7243 00007f1e46b66941 00007f1e4e6f1a5d 00007f1e4e87d126 00007f1e456b6126 00007f1e456b5e55 00007f1e41e8a2ce 00007f1e41e891ae 00007f1e41e8f3e5 00007f1e41e8fd0f
0831 19:54:48.786607 (+539135us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:50.055802 (+1269195us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:50.056030 (+ 228us) catalog_manager.cc:3683] Apply alter schema
0831 19:54:50.056276 (+ 246us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":258282,"Hive Metastore.run_cpu_time_us":661,"Hive Metastore.run_wall_time_us":227582,"spinlock_wait_cycles":146365696}
I20250831 19:54:50.057511 2119 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:36958 (request call id 70) took 2340 ms. Trace:
I20250831 19:54:50.057621 2119 rpcz_store.cc:276] 0831 19:54:47.717351 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:48.591831 (+874480us) service_pool.cc:225] Handling call
0831 19:54:48.789879 (+198048us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:50.057036 (+1267157us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:50.057243 (+ 207us) catalog_manager.cc:3683] Apply alter schema
0831 19:54:50.057476 (+ 233us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":861681,"Hive Metastore.run_cpu_time_us":582,"Hive Metastore.run_wall_time_us":91218}
I20250831 19:54:50.057927 2117 catalog_manager.cc:5582] T fe0a9178363d432f96eea9422293a2ed P 2441fafe1d62429386f4631ad423567d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2441fafe1d62429386f4631ad423567d (127.1.1.195). New cstate: current_term: 1 leader_uuid: "2441fafe1d62429386f4631ad423567d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: HEALTHY } } }
I20250831 19:54:50.058393 2117 catalog_manager.cc:5582] T 7e9810ebc28e4e07a83307c470ad92b3 P 2441fafe1d62429386f4631ad423567d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2441fafe1d62429386f4631ad423567d (127.1.1.195). New cstate: current_term: 1 leader_uuid: "2441fafe1d62429386f4631ad423567d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: HEALTHY } } }
I20250831 19:54:50.058712 2120 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:36958 (request call id 68) took 2365 ms. Trace:
I20250831 19:54:50.058787 2117 catalog_manager.cc:5674] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237) does not have the latest schema for tablet b6ef0e612b7e4b80af6fa5b2a66242c0 (table default.table_ca18962558654590b5d74892b4e00d0f [id=2cd4af6b415c4e3a92a3732fa145aa42]). Expected version 1 got 0
I20250831 19:54:50.059063 2125 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:36958 (request call id 74) took 1815 ms. Trace:
I20250831 19:54:50.059145 2125 rpcz_store.cc:276] 0831 19:54:48.243629 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:48.771816 (+528187us) service_pool.cc:225] Handling call
0831 19:54:48.801602 (+ 29786us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:50.059003 (+1257401us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":941238,"Hive Metastore.run_cpu_time_us":180,"Hive Metastore.run_wall_time_us":67903}
I20250831 19:54:50.059089 2117 catalog_manager.cc:5582] T de75786bcb5549149a81e52ac1a257db P 2441fafe1d62429386f4631ad423567d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2441fafe1d62429386f4631ad423567d (127.1.1.195). New cstate: current_term: 1 leader_uuid: "2441fafe1d62429386f4631ad423567d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: HEALTHY } } }
I20250831 19:54:50.059404 2125 master_service.cc:948] ReplaceTablet: received request to replace tablet 6eda2f28ef194cba81661fbf080c5883 from {username='slave'} at 127.0.0.1:36958
I20250831 19:54:50.058782 2120 rpcz_store.cc:276] 0831 19:54:47.692858 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:48.368375 (+675517us) service_pool.cc:225] Handling call
0831 19:54:48.787036 (+418661us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:50.058672 (+1271636us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":648131,"Hive Metastore.run_cpu_time_us":192,"Hive Metastore.run_wall_time_us":144032}
I20250831 19:54:50.060299 2121 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:36958 (request call id 67) took 2376 ms. Trace:
I20250831 19:54:50.060463 2120 master_service.cc:948] ReplaceTablet: received request to replace tablet 79a678e2a5ba495095865769a25ff68a from {username='slave'} at 127.0.0.1:36958
I20250831 19:54:50.065280 2715 ts_tablet_manager.cc:1918] T b6eee4e23718478cb107ddbcae2bbec2 P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:50.065498 2715 log.cc:1199] T b6eee4e23718478cb107ddbcae2bbec2 P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/b6eee4e23718478cb107ddbcae2bbec2
I20250831 19:54:50.065950 2715 ts_tablet_manager.cc:1939] T b6eee4e23718478cb107ddbcae2bbec2 P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
I20250831 19:54:50.066998 2715 tablet_replica.cc:331] T 6210e006966a4c1dbe3a2d0388efac30 P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:54:50.066993 2104 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet b6eee4e23718478cb107ddbcae2bbec2 (table default.table_1ca0a7f3c33945bd902a63ca09aa62ad [id=fe4053cd15a840d5b74f86e7894ea85e]) successfully deleted
I20250831 19:54:50.067229 2715 raft_consensus.cc:2241] T 6210e006966a4c1dbe3a2d0388efac30 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:50.067214 2121 rpcz_store.cc:276] 0831 19:54:47.683346 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:48.305342 (+621996us) service_pool.cc:225] Handling call
0831 19:54:48.786839 (+481497us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:50.058885 (+1272046us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:50.059112 (+ 227us) catalog_manager.cc:3683] Apply alter schema
0831 19:54:50.059311 (+ 199us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":485690,"Hive Metastore.run_cpu_time_us":680,"Hive Metastore.run_wall_time_us":162557}
I20250831 19:54:50.067452 2715 raft_consensus.cc:2270] T 6210e006966a4c1dbe3a2d0388efac30 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:50.068032 2715 ts_tablet_manager.cc:1905] T 6210e006966a4c1dbe3a2d0388efac30 P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:50.071382 2631 consensus_queue.cc:1035] T fe0a9178363d432f96eea9422293a2ed P 2441fafe1d62429386f4631ad423567d [LEADER]: Connected to new peer: Peer: permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:50.073410 2121 master_service.cc:948] ReplaceTablet: received request to replace tablet 114d1f10fa634e57b570568d83615f46 from {username='slave'} at 127.0.0.1:36958
I20250831 19:54:50.074533 2715 ts_tablet_manager.cc:1918] T 6210e006966a4c1dbe3a2d0388efac30 P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:50.074668 2715 log.cc:1199] T 6210e006966a4c1dbe3a2d0388efac30 P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/6210e006966a4c1dbe3a2d0388efac30
I20250831 19:54:50.075103 2715 ts_tablet_manager.cc:1939] T 6210e006966a4c1dbe3a2d0388efac30 P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
I20250831 19:54:50.076124 2104 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet 6210e006966a4c1dbe3a2d0388efac30 (table default.table_696724b65868432da5cd0914cbbf40a3 [id=5226b7f2958d4616b3fad9408fdd42cd]) successfully deleted
I20250831 19:54:50.076907 2120 catalog_manager.cc:5869] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Sending DeleteTablet for 3 replicas of tablet 79a678e2a5ba495095865769a25ff68a
I20250831 19:54:50.077698 1612 tablet_service.cc:1515] Processing DeleteTablet for tablet 79a678e2a5ba495095865769a25ff68a with delete_type TABLET_DATA_DELETED (replaced by tablet 4b3babfbfe394414b944bd53377edeb0) from {username='slave'} at 127.0.0.1:51022
I20250831 19:54:50.078002 2472 consensus_queue.cc:1035] T 76a46b9cd969481193f399c6fc229eec P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:50.078459 2120 catalog_manager.cc:6652] ReplaceTablet: tablet 79a678e2a5ba495095865769a25ff68a deleted and replaced by tablet 4b3babfbfe394414b944bd53377edeb0
I20250831 19:54:50.078579 2120 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:36958 (request call id 80) took 1783 ms. Trace:
I20250831 19:54:50.078858 1884 tablet_service.cc:1515] Processing DeleteTablet for tablet 79a678e2a5ba495095865769a25ff68a with delete_type TABLET_DATA_DELETED (replaced by tablet 4b3babfbfe394414b944bd53377edeb0) from {username='slave'} at 127.0.0.1:45906
I20250831 19:54:50.078673 2120 rpcz_store.cc:276] 0831 19:54:48.295157 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:50.059879 (+1764722us) service_pool.cc:225] Handling call
0831 19:54:50.078545 (+ 18666us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:50.061411 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:50.061530 (+ 119us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:50.061536 (+ 6us) write_op.cc:435] Acquired schema lock
0831 19:54:50.061539 (+ 3us) tablet.cc:660] Decoding operations
0831 19:54:50.061655 (+ 116us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:50.061668 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:50.061674 (+ 6us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:50.061747 (+ 73us) tablet.cc:699] Row locks acquired
0831 19:54:50.061750 (+ 3us) write_op.cc:260] PREPARE: finished
0831 19:54:50.061795 (+ 45us) write_op.cc:270] Start()
0831 19:54:50.061828 (+ 33us) write_op.cc:276] Timestamp: P: 1756670090061749 usec, L: 0
0831 19:54:50.061831 (+ 3us) op_driver.cc:348] REPLICATION: starting
0831 19:54:50.062001 (+ 170us) log.cc:844] Serialized 656 byte log entry
0831 19:54:50.068927 (+ 6926us) op_driver.cc:464] REPLICATION: finished
0831 19:54:50.069020 (+ 93us) write_op.cc:301] APPLY: starting
0831 19:54:50.069035 (+ 15us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:50.069080 (+ 45us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:50.069104 (+ 24us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:50.069193 (+ 89us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:50.073692 (+ 4499us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0831 19:54:50.073700 (+ 8us) write_op.cc:312] APPLY: finished
0831 19:54:50.073794 (+ 94us) log.cc:844] Serialized 29 byte log entry
0831 19:54:50.073848 (+ 54us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:50.073865 (+ 17us) write_op.cc:454] Released schema lock
0831 19:54:50.073871 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0831 19:54:50.073933 (+ 62us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:50.073936 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":52,"apply.run_cpu_time_us":480,"apply.run_wall_time_us":4903,"num_ops":2,"prepare.queue_time_us":48,"prepare.run_cpu_time_us":693,"prepare.run_wall_time_us":693,"raft.queue_time_us":1123,"raft.run_cpu_time_us":476,"raft.run_wall_time_us":476,"replication_time_us":7070}]]}
I20250831 19:54:50.079078 2715 tablet_replica.cc:331] T 79a678e2a5ba495095865769a25ff68a P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:54:50.079229 2120 master_service.cc:948] ReplaceTablet: received request to replace tablet 6eda2f28ef194cba81661fbf080c5883 from {username='slave'} at 127.0.0.1:36958
I20250831 19:54:50.079305 2715 raft_consensus.cc:2241] T 79a678e2a5ba495095865769a25ff68a P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:50.079460 2715 raft_consensus.cc:2270] T 79a678e2a5ba495095865769a25ff68a P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:50.080936 1750 tablet_service.cc:1515] Processing DeleteTablet for tablet 79a678e2a5ba495095865769a25ff68a with delete_type TABLET_DATA_DELETED (replaced by tablet 4b3babfbfe394414b944bd53377edeb0) from {username='slave'} at 127.0.0.1:50674
I20250831 19:54:50.081156 2713 tablet_replica.cc:331] T 79a678e2a5ba495095865769a25ff68a P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:54:50.081360 2713 raft_consensus.cc:2241] T 79a678e2a5ba495095865769a25ff68a P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:50.081878 2713 raft_consensus.cc:2270] T 79a678e2a5ba495095865769a25ff68a P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:50.082754 2713 ts_tablet_manager.cc:1905] T 79a678e2a5ba495095865769a25ff68a P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:50.082988 2714 ts_tablet_manager.cc:1918] T b6eee4e23718478cb107ddbcae2bbec2 P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:50.083063 2186 catalog_manager.cc:2747] Deleting table default.table_c8611581e59f4d8a94cd6f4da06917a4 [id=bd456415108d49989ef0bc2af91eb2f0] in response to Hive Metastore notification log event 84
I20250831 19:54:50.083113 2714 log.cc:1199] T b6eee4e23718478cb107ddbcae2bbec2 P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/b6eee4e23718478cb107ddbcae2bbec2
I20250831 19:54:50.083501 2714 ts_tablet_manager.cc:1939] T b6eee4e23718478cb107ddbcae2bbec2 P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:54:50.084805 2101 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet b6eee4e23718478cb107ddbcae2bbec2 (table default.table_1ca0a7f3c33945bd902a63ca09aa62ad [id=fe4053cd15a840d5b74f86e7894ea85e]) successfully deleted
I20250831 19:54:50.084991 2715 ts_tablet_manager.cc:1905] T 79a678e2a5ba495095865769a25ff68a P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:50.089394 2125 catalog_manager.cc:5869] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Sending DeleteTablet for 3 replicas of tablet 6eda2f28ef194cba81661fbf080c5883
I20250831 19:54:50.090204 2125 catalog_manager.cc:6652] ReplaceTablet: tablet 6eda2f28ef194cba81661fbf080c5883 deleted and replaced by tablet 6b61f7d06007437f803d400e73800415
I20250831 19:54:50.090301 2125 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:36958 (request call id 79) took 1797 ms. Trace:
I20250831 19:54:50.090507 1884 tablet_service.cc:1515] Processing DeleteTablet for tablet 6eda2f28ef194cba81661fbf080c5883 with delete_type TABLET_DATA_DELETED (replaced by tablet 6b61f7d06007437f803d400e73800415) from {username='slave'} at 127.0.0.1:45906
I20250831 19:54:50.090379 2125 rpcz_store.cc:276] 0831 19:54:48.292409 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:50.059314 (+1766905us) service_pool.cc:225] Handling call
0831 19:54:50.090273 (+ 30959us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:50.075035 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:50.075137 (+ 102us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:50.075143 (+ 6us) write_op.cc:435] Acquired schema lock
0831 19:54:50.075146 (+ 3us) tablet.cc:660] Decoding operations
0831 19:54:50.075251 (+ 105us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:50.075263 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:50.075270 (+ 7us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:50.075332 (+ 62us) tablet.cc:699] Row locks acquired
0831 19:54:50.075334 (+ 2us) write_op.cc:260] PREPARE: finished
0831 19:54:50.075359 (+ 25us) write_op.cc:270] Start()
0831 19:54:50.075383 (+ 24us) write_op.cc:276] Timestamp: P: 1756670090075316 usec, L: 0
0831 19:54:50.075386 (+ 3us) op_driver.cc:348] REPLICATION: starting
0831 19:54:50.075505 (+ 119us) log.cc:844] Serialized 656 byte log entry
0831 19:54:50.086808 (+ 11303us) op_driver.cc:464] REPLICATION: finished
0831 19:54:50.087088 (+ 280us) write_op.cc:301] APPLY: starting
0831 19:54:50.087106 (+ 18us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:50.087161 (+ 55us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:50.087191 (+ 30us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:50.087303 (+ 112us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:50.087411 (+ 108us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0831 19:54:50.087422 (+ 11us) write_op.cc:312] APPLY: finished
0831 19:54:50.087531 (+ 109us) log.cc:844] Serialized 29 byte log entry
0831 19:54:50.087593 (+ 62us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:50.087608 (+ 15us) write_op.cc:454] Released schema lock
0831 19:54:50.087613 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0831 19:54:50.087674 (+ 61us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:50.087678 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":222,"apply.run_cpu_time_us":583,"apply.run_wall_time_us":582,"num_ops":2,"prepare.queue_time_us":74,"prepare.run_cpu_time_us":576,"prepare.run_wall_time_us":576,"raft.queue_time_us":355,"raft.run_cpu_time_us":376,"raft.run_wall_time_us":374,"replication_time_us":11378}]]}
I20250831 19:54:50.090997 2125 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36958:
name: "default.Table_f6d2041746f14f4a84962c26b1df1118"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:50.089687 2120 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:36958 (request call id 82) took 1782 ms. Trace:
I20250831 19:54:50.091791 2120 rpcz_store.cc:276] 0831 19:54:48.306924 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:50.079167 (+1772243us) service_pool.cc:225] Handling call
0831 19:54:50.089637 (+ 10470us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250831 19:54:50.091904 1612 tablet_service.cc:1515] Processing DeleteTablet for tablet 6eda2f28ef194cba81661fbf080c5883 with delete_type TABLET_DATA_DELETED (replaced by tablet 6b61f7d06007437f803d400e73800415) from {username='slave'} at 127.0.0.1:51022
I20250831 19:54:50.092236 2120 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36958:
name: "default.Table_b7904c1a8762458ca114fc256fb84e5a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:50.093592 1750 tablet_service.cc:1515] Processing DeleteTablet for tablet 6eda2f28ef194cba81661fbf080c5883 with delete_type TABLET_DATA_DELETED (replaced by tablet 6b61f7d06007437f803d400e73800415) from {username='slave'} at 127.0.0.1:50674
I20250831 19:54:50.098757 2714 tablet_replica.cc:331] T 6210e006966a4c1dbe3a2d0388efac30 P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:54:50.098978 2714 raft_consensus.cc:2241] T 6210e006966a4c1dbe3a2d0388efac30 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:50.099164 2714 raft_consensus.cc:2270] T 6210e006966a4c1dbe3a2d0388efac30 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:50.099720 2714 ts_tablet_manager.cc:1905] T 6210e006966a4c1dbe3a2d0388efac30 P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:50.102665 2186 catalog_manager.cc:5869] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Sending DeleteTablet for 3 replicas of tablet a7a0312d22284f15a68d90f6e8cd7920
I20250831 19:54:50.103315 2594 consensus_queue.cc:1035] T fe0a9178363d432f96eea9422293a2ed P 2441fafe1d62429386f4631ad423567d [LEADER]: Connected to new peer: Peer: permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:50.103410 2124 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:36958 (request call id 75) took 1859 ms. Trace:
I20250831 19:54:50.103516 2124 rpcz_store.cc:276] 0831 19:54:48.243770 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:49.062861 (+819091us) service_pool.cc:225] Handling call
0831 19:54:50.011634 (+948773us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:50.103366 (+ 91732us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":2575,"Hive Metastore.run_cpu_time_us":167,"Hive Metastore.run_wall_time_us":34196}
I20250831 19:54:50.103935 2124 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36958:
name: "default.Table_28a8f98e8e534694b9e17ec734373e90"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:50.104946 1884 tablet_service.cc:1515] Processing DeleteTablet for tablet a7a0312d22284f15a68d90f6e8cd7920 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:50 UTC) from {username='slave'} at 127.0.0.1:45906
I20250831 19:54:50.105154 1612 tablet_service.cc:1515] Processing DeleteTablet for tablet a7a0312d22284f15a68d90f6e8cd7920 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:50 UTC) from {username='slave'} at 127.0.0.1:51022
I20250831 19:54:50.105968 2584 consensus_queue.cc:1035] T 76a46b9cd969481193f399c6fc229eec P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:50.107172 1750 tablet_service.cc:1515] Processing DeleteTablet for tablet a7a0312d22284f15a68d90f6e8cd7920 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:50 UTC) from {username='slave'} at 127.0.0.1:50674
I20250831 19:54:50.112577 2713 ts_tablet_manager.cc:1918] T 79a678e2a5ba495095865769a25ff68a P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.4
I20250831 19:54:50.112731 2713 log.cc:1199] T 79a678e2a5ba495095865769a25ff68a P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/79a678e2a5ba495095865769a25ff68a
I20250831 19:54:50.113122 2713 ts_tablet_manager.cc:1939] T 79a678e2a5ba495095865769a25ff68a P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
I20250831 19:54:50.114002 2105 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet 79a678e2a5ba495095865769a25ff68a (table default.table_fd98179fb4584ad6bde229ee78f7dfde [id=0850f2b0e9324dd0a210fa7b2609c769]) successfully deleted
I20250831 19:54:50.114276 2713 tablet_replica.cc:331] T 6eda2f28ef194cba81661fbf080c5883 P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:54:50.114259 2117 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36958:
name: "default.Table_692b305d0d9a402dbff897ae3fea5186"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:50.114423 2713 raft_consensus.cc:2241] T 6eda2f28ef194cba81661fbf080c5883 P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: Raft consensus shutting down.
I20250831 19:54:50.114701 2713 raft_consensus.cc:2270] T 6eda2f28ef194cba81661fbf080c5883 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:50.115497 2713 ts_tablet_manager.cc:1905] T 6eda2f28ef194cba81661fbf080c5883 P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:50.118212 2715 ts_tablet_manager.cc:1918] T 79a678e2a5ba495095865769a25ff68a P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.4
I20250831 19:54:50.120549 1612 tablet_service.cc:1468] Processing CreateTablet for tablet 4b3babfbfe394414b944bd53377edeb0 (DEFAULT_TABLE table=default.table_fd98179fb4584ad6bde229ee78f7dfde [id=0850f2b0e9324dd0a210fa7b2609c769]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:50.121023 1612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b3babfbfe394414b944bd53377edeb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:50.121305 1750 tablet_service.cc:1468] Processing CreateTablet for tablet 4b3babfbfe394414b944bd53377edeb0 (DEFAULT_TABLE table=default.table_fd98179fb4584ad6bde229ee78f7dfde [id=0850f2b0e9324dd0a210fa7b2609c769]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:50.121701 1750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b3babfbfe394414b944bd53377edeb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:50.127885 2282 tablet_bootstrap.cc:492] T 4b3babfbfe394414b944bd53377edeb0 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:50.129145 2284 tablet_bootstrap.cc:492] T 4b3babfbfe394414b944bd53377edeb0 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:50.129436 2282 tablet_bootstrap.cc:654] T 4b3babfbfe394414b944bd53377edeb0 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:50.130887 2284 tablet_bootstrap.cc:654] T 4b3babfbfe394414b944bd53377edeb0 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:50.132767 2713 ts_tablet_manager.cc:1918] T 6eda2f28ef194cba81661fbf080c5883 P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:50.132953 2713 log.cc:1199] T 6eda2f28ef194cba81661fbf080c5883 P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/6eda2f28ef194cba81661fbf080c5883
I20250831 19:54:50.133105 2122 catalog_manager.cc:5582] T 99d703eb7412458e95070fffe3cde91b P 89aa85d59c53436ebdf3074b13d14825 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193). New cstate: current_term: 1 leader_uuid: "89aa85d59c53436ebdf3074b13d14825" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: HEALTHY } } }
I20250831 19:54:50.133378 2713 ts_tablet_manager.cc:1939] T 6eda2f28ef194cba81661fbf080c5883 P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
I20250831 19:54:50.133716 2122 catalog_manager.cc:5674] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197) does not have the latest schema for tablet b6ef0e612b7e4b80af6fa5b2a66242c0 (table default.table_ca18962558654590b5d74892b4e00d0f [id=2cd4af6b415c4e3a92a3732fa145aa42]). Expected version 1 got 0
I20250831 19:54:50.134342 2105 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet 6eda2f28ef194cba81661fbf080c5883 (table default.table_5660fc6b1a9846a6bd36b56e553a8f35 [id=5ce6c4d5dcd34d73af61fd2c4bf28799]) successfully deleted
I20250831 19:54:50.134806 2713 tablet_replica.cc:331] T a7a0312d22284f15a68d90f6e8cd7920 P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:54:50.135146 2713 raft_consensus.cc:2241] T a7a0312d22284f15a68d90f6e8cd7920 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:50.135402 2713 raft_consensus.cc:2270] T a7a0312d22284f15a68d90f6e8cd7920 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:50.136062 2713 ts_tablet_manager.cc:1905] T a7a0312d22284f15a68d90f6e8cd7920 P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:50.137602 2715 log.cc:1199] T 79a678e2a5ba495095865769a25ff68a P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/79a678e2a5ba495095865769a25ff68a
I20250831 19:54:50.138209 2715 ts_tablet_manager.cc:1939] T 79a678e2a5ba495095865769a25ff68a P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
I20250831 19:54:50.144335 2284 tablet_bootstrap.cc:492] T 4b3babfbfe394414b944bd53377edeb0 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:50.144747 2284 ts_tablet_manager.cc:1397] T 4b3babfbfe394414b944bd53377edeb0 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.016s user 0.007s sys 0.002s
I20250831 19:54:50.145359 2715 tablet_replica.cc:331] T 6eda2f28ef194cba81661fbf080c5883 P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:54:50.145402 2104 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet 79a678e2a5ba495095865769a25ff68a (table default.table_fd98179fb4584ad6bde229ee78f7dfde [id=0850f2b0e9324dd0a210fa7b2609c769]) successfully deleted
I20250831 19:54:50.145607 2715 raft_consensus.cc:2241] T 6eda2f28ef194cba81661fbf080c5883 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:50.145617 2284 raft_consensus.cc:357] T 4b3babfbfe394414b944bd53377edeb0 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:50.145769 2715 raft_consensus.cc:2270] T 6eda2f28ef194cba81661fbf080c5883 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:50.145795 2284 raft_consensus.cc:383] T 4b3babfbfe394414b944bd53377edeb0 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:50.145895 2284 raft_consensus.cc:738] T 4b3babfbfe394414b944bd53377edeb0 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:50.146088 2713 ts_tablet_manager.cc:1918] T a7a0312d22284f15a68d90f6e8cd7920 P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250831 19:54:50.146202 2284 consensus_queue.cc:260] T 4b3babfbfe394414b944bd53377edeb0 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:50.146274 2715 ts_tablet_manager.cc:1905] T 6eda2f28ef194cba81661fbf080c5883 P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:50.146804 2284 ts_tablet_manager.cc:1428] T 4b3babfbfe394414b944bd53377edeb0 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250831 19:54:50.147068 2119 catalog_manager.cc:5674] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475) does not have the latest schema for tablet b6ef0e612b7e4b80af6fa5b2a66242c0 (table default.table_ca18962558654590b5d74892b4e00d0f [id=2cd4af6b415c4e3a92a3732fa145aa42]). Expected version 1 got 0
I20250831 19:54:50.146220 2713 log.cc:1199] T a7a0312d22284f15a68d90f6e8cd7920 P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/a7a0312d22284f15a68d90f6e8cd7920
I20250831 19:54:50.147655 2282 tablet_bootstrap.cc:492] T 4b3babfbfe394414b944bd53377edeb0 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:50.147667 2713 ts_tablet_manager.cc:1939] T a7a0312d22284f15a68d90f6e8cd7920 P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
I20250831 19:54:50.147421 2119 catalog_manager.cc:5582] T 76a46b9cd969481193f399c6fc229eec P de831f40fa1348a48a1f0260f4130197 reported cstate change: term changed from 0 to 1, leader changed from <none> to de831f40fa1348a48a1f0260f4130197 (127.1.1.194). New cstate: current_term: 1 leader_uuid: "de831f40fa1348a48a1f0260f4130197" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: UNKNOWN } } }
I20250831 19:54:50.147771 2282 ts_tablet_manager.cc:1397] T 4b3babfbfe394414b944bd53377edeb0 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.020s user 0.006s sys 0.000s
I20250831 19:54:50.148684 2282 raft_consensus.cc:357] T 4b3babfbfe394414b944bd53377edeb0 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:50.149256 2122 master_service.cc:948] ReplaceTablet: received request to replace tablet f8871812b0734f40b63bef0473e2a58d from {username='slave'} at 127.0.0.1:36958
I20250831 19:54:50.149609 2282 raft_consensus.cc:383] T 4b3babfbfe394414b944bd53377edeb0 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:50.149735 2282 raft_consensus.cc:738] T 4b3babfbfe394414b944bd53377edeb0 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:50.149957 2282 consensus_queue.cc:260] T 4b3babfbfe394414b944bd53377edeb0 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:50.150520 2282 ts_tablet_manager.cc:1428] T 4b3babfbfe394414b944bd53377edeb0 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.003s user 0.001s sys 0.002s
I20250831 19:54:50.152293 1885 tablet_service.cc:1468] Processing CreateTablet for tablet 6b61f7d06007437f803d400e73800415 (DEFAULT_TABLE table=default.table_5660fc6b1a9846a6bd36b56e553a8f35 [id=5ce6c4d5dcd34d73af61fd2c4bf28799]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:50.152681 1885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b61f7d06007437f803d400e73800415. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:50.153793 1884 tablet_service.cc:1468] Processing CreateTablet for tablet 4b3babfbfe394414b944bd53377edeb0 (DEFAULT_TABLE table=default.table_fd98179fb4584ad6bde229ee78f7dfde [id=0850f2b0e9324dd0a210fa7b2609c769]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:50.154297 1884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b3babfbfe394414b944bd53377edeb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:50.161746 2105 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet a7a0312d22284f15a68d90f6e8cd7920 (table default.table_c8611581e59f4d8a94cd6f4da06917a4 [id=bd456415108d49989ef0bc2af91eb2f0]) successfully deleted
I20250831 19:54:50.169252 2699 tablet_bootstrap.cc:492] T 6b61f7d06007437f803d400e73800415 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:50.169931 1750 tablet_service.cc:1468] Processing CreateTablet for tablet 6b61f7d06007437f803d400e73800415 (DEFAULT_TABLE table=default.table_5660fc6b1a9846a6bd36b56e553a8f35 [id=5ce6c4d5dcd34d73af61fd2c4bf28799]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:50.170378 1750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b61f7d06007437f803d400e73800415. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:50.170925 2699 tablet_bootstrap.cc:654] T 6b61f7d06007437f803d400e73800415 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:50.176465 2714 ts_tablet_manager.cc:1918] T 6210e006966a4c1dbe3a2d0388efac30 P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:50.176893 2714 log.cc:1199] T 6210e006966a4c1dbe3a2d0388efac30 P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/6210e006966a4c1dbe3a2d0388efac30
I20250831 19:54:50.177006 2284 tablet_bootstrap.cc:492] T 6b61f7d06007437f803d400e73800415 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:50.177409 2714 ts_tablet_manager.cc:1939] T 6210e006966a4c1dbe3a2d0388efac30 P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:54:50.179836 2101 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet 6210e006966a4c1dbe3a2d0388efac30 (table default.table_696724b65868432da5cd0914cbbf40a3 [id=5226b7f2958d4616b3fad9408fdd42cd]) successfully deleted
I20250831 19:54:50.180510 2714 tablet_replica.cc:331] T 79a678e2a5ba495095865769a25ff68a P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:54:50.181281 2714 raft_consensus.cc:2241] T 79a678e2a5ba495095865769a25ff68a P 2441fafe1d62429386f4631ad423567d [term 1 LEADER]: Raft consensus shutting down.
I20250831 19:54:50.181917 2714 raft_consensus.cc:2270] T 79a678e2a5ba495095865769a25ff68a P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:50.182902 1612 tablet_service.cc:1468] Processing CreateTablet for tablet 6b61f7d06007437f803d400e73800415 (DEFAULT_TABLE table=default.table_5660fc6b1a9846a6bd36b56e553a8f35 [id=5ce6c4d5dcd34d73af61fd2c4bf28799]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:50.183287 1612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b61f7d06007437f803d400e73800415. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:50.185808 2284 tablet_bootstrap.cc:654] T 6b61f7d06007437f803d400e73800415 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:50.192915 2715 ts_tablet_manager.cc:1918] T 6eda2f28ef194cba81661fbf080c5883 P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:50.204540 2121 catalog_manager.cc:5869] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Sending DeleteTablet for 3 replicas of tablet 114d1f10fa634e57b570568d83615f46
I20250831 19:54:50.204964 2121 catalog_manager.cc:6652] ReplaceTablet: tablet 114d1f10fa634e57b570568d83615f46 deleted and replaced by tablet 7a217324e97b43e5a7ec540e3b9f70a5
I20250831 19:54:50.205070 2121 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:36958 (request call id 81) took 1907 ms. Trace:
I20250831 19:54:50.206130 1884 tablet_service.cc:1515] Processing DeleteTablet for tablet 114d1f10fa634e57b570568d83615f46 with delete_type TABLET_DATA_DELETED (replaced by tablet 7a217324e97b43e5a7ec540e3b9f70a5) from {username='slave'} at 127.0.0.1:45906
I20250831 19:54:50.205179 2121 rpcz_store.cc:276] 0831 19:54:48.297864 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:50.067487 (+1769623us) service_pool.cc:225] Handling call
0831 19:54:50.205038 (+137551us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:50.189358 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:50.189525 (+ 167us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:50.189532 (+ 7us) write_op.cc:435] Acquired schema lock
0831 19:54:50.189535 (+ 3us) tablet.cc:660] Decoding operations
0831 19:54:50.189645 (+ 110us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:50.189656 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:50.189662 (+ 6us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:50.189726 (+ 64us) tablet.cc:699] Row locks acquired
0831 19:54:50.189729 (+ 3us) write_op.cc:260] PREPARE: finished
0831 19:54:50.189758 (+ 29us) write_op.cc:270] Start()
0831 19:54:50.189803 (+ 45us) write_op.cc:276] Timestamp: P: 1756670090189702 usec, L: 0
0831 19:54:50.189808 (+ 5us) op_driver.cc:348] REPLICATION: starting
0831 19:54:50.189981 (+ 173us) log.cc:844] Serialized 656 byte log entry
0831 19:54:50.203264 (+ 13283us) op_driver.cc:464] REPLICATION: finished
0831 19:54:50.203445 (+ 181us) write_op.cc:301] APPLY: starting
0831 19:54:50.203461 (+ 16us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:50.203494 (+ 33us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:50.203540 (+ 46us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:50.203622 (+ 82us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:50.203667 (+ 45us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0831 19:54:50.203674 (+ 7us) write_op.cc:312] APPLY: finished
0831 19:54:50.203729 (+ 55us) log.cc:844] Serialized 29 byte log entry
0831 19:54:50.203792 (+ 63us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:50.203806 (+ 14us) write_op.cc:454] Released schema lock
0831 19:54:50.203811 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0831 19:54:50.203871 (+ 60us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:50.203874 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":104,"apply.run_cpu_time_us":416,"apply.run_wall_time_us":416,"mutex_wait_us":26557,"num_ops":2,"prepare.queue_time_us":27151,"prepare.run_cpu_time_us":697,"prepare.run_wall_time_us":697,"replication_time_us":13432}]]}
I20250831 19:54:50.212409 2122 catalog_manager.cc:5869] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Sending DeleteTablet for 3 replicas of tablet f8871812b0734f40b63bef0473e2a58d
I20250831 19:54:50.212967 1884 tablet_service.cc:1515] Processing DeleteTablet for tablet f8871812b0734f40b63bef0473e2a58d with delete_type TABLET_DATA_DELETED (replaced by tablet 48c3872dbaee495fb80d1415b5631eaf) from {username='slave'} at 127.0.0.1:45906
I20250831 19:54:50.213156 2122 catalog_manager.cc:6652] ReplaceTablet: tablet f8871812b0734f40b63bef0473e2a58d deleted and replaced by tablet 48c3872dbaee495fb80d1415b5631eaf
I20250831 19:54:50.213282 2122 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:36958 (request call id 87) took 1358 ms. Trace:
I20250831 19:54:50.213375 2122 rpcz_store.cc:276] 0831 19:54:48.854450 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:50.149175 (+1294725us) service_pool.cc:225] Handling call
0831 19:54:50.213255 (+ 64080us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:50.192504 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:50.192580 (+ 76us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:50.192584 (+ 4us) write_op.cc:435] Acquired schema lock
0831 19:54:50.192586 (+ 2us) tablet.cc:660] Decoding operations
0831 19:54:50.192660 (+ 74us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:50.192668 (+ 8us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:50.192671 (+ 3us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:50.192736 (+ 65us) tablet.cc:699] Row locks acquired
0831 19:54:50.192738 (+ 2us) write_op.cc:260] PREPARE: finished
0831 19:54:50.192765 (+ 27us) write_op.cc:270] Start()
0831 19:54:50.192798 (+ 33us) write_op.cc:276] Timestamp: P: 1756670090192709 usec, L: 0
0831 19:54:50.192801 (+ 3us) op_driver.cc:348] REPLICATION: starting
0831 19:54:50.192926 (+ 125us) log.cc:844] Serialized 656 byte log entry
0831 19:54:50.203367 (+ 10441us) op_driver.cc:464] REPLICATION: finished
0831 19:54:50.203933 (+ 566us) write_op.cc:301] APPLY: starting
0831 19:54:50.203942 (+ 9us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:50.203972 (+ 30us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:50.203999 (+ 27us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:50.204093 (+ 94us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:50.204152 (+ 59us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0831 19:54:50.204158 (+ 6us) write_op.cc:312] APPLY: finished
0831 19:54:50.204205 (+ 47us) log.cc:844] Serialized 29 byte log entry
0831 19:54:50.204239 (+ 34us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:50.204253 (+ 14us) write_op.cc:454] Released schema lock
0831 19:54:50.204257 (+ 4us) write_op.cc:341] FINISH: Updating metrics
0831 19:54:50.204308 (+ 51us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:50.204311 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":537,"apply.run_cpu_time_us":369,"apply.run_wall_time_us":369,"mutex_wait_us":8900,"num_ops":2,"prepare.queue_time_us":8957,"prepare.run_cpu_time_us":493,"prepare.run_wall_time_us":493,"replication_time_us":10549}]]}
I20250831 19:54:50.214293 2122 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36958:
name: "default.Table_e3057132cbc4426e9fc52d84d5189d01"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:50.215106 1752 tablet_service.cc:1515] Processing DeleteTablet for tablet f8871812b0734f40b63bef0473e2a58d with delete_type TABLET_DATA_DELETED (replaced by tablet 48c3872dbaee495fb80d1415b5631eaf) from {username='slave'} at 127.0.0.1:50674
I20250831 19:54:50.215245 2121 catalog_manager.cc:5674] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475) does not have the latest schema for tablet 4b3babfbfe394414b944bd53377edeb0 (table default.table_fd98179fb4584ad6bde229ee78f7dfde [id=0850f2b0e9324dd0a210fa7b2609c769]). Expected version 3 got 0
I20250831 19:54:50.215349 2713 tablet_replica.cc:331] T f8871812b0734f40b63bef0473e2a58d P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:54:50.215545 2713 raft_consensus.cc:2241] T f8871812b0734f40b63bef0473e2a58d P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: Raft consensus shutting down.
I20250831 19:54:50.215502 2121 catalog_manager.cc:5582] T 3d3be834ca8642c584da4265819c14ab P de831f40fa1348a48a1f0260f4130197 reported cstate change: term changed from 0 to 1, leader changed from <none> to de831f40fa1348a48a1f0260f4130197 (127.1.1.194). New cstate: current_term: 1 leader_uuid: "de831f40fa1348a48a1f0260f4130197" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: HEALTHY } } }
I20250831 19:54:50.215871 2713 raft_consensus.cc:2270] T f8871812b0734f40b63bef0473e2a58d P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:50.216404 2713 ts_tablet_manager.cc:1905] T f8871812b0734f40b63bef0473e2a58d P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:50.216668 2714 ts_tablet_manager.cc:1905] T 79a678e2a5ba495095865769a25ff68a P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:50.222132 1750 tablet_service.cc:1515] Processing DeleteTablet for tablet 114d1f10fa634e57b570568d83615f46 with delete_type TABLET_DATA_DELETED (replaced by tablet 7a217324e97b43e5a7ec540e3b9f70a5) from {username='slave'} at 127.0.0.1:50674
I20250831 19:54:50.222580 2713 ts_tablet_manager.cc:1918] T f8871812b0734f40b63bef0473e2a58d P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250831 19:54:50.222682 2713 log.cc:1199] T f8871812b0734f40b63bef0473e2a58d P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/f8871812b0734f40b63bef0473e2a58d
I20250831 19:54:50.223037 2713 ts_tablet_manager.cc:1939] T f8871812b0734f40b63bef0473e2a58d P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
I20250831 19:54:50.223915 2105 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet f8871812b0734f40b63bef0473e2a58d (table default.table_bcc81e72ea324a389ebbcc6a6b4512ac [id=f63d391a9c824314bf6789cc7bbb5ffb]) successfully deleted
I20250831 19:54:50.224196 2713 tablet_replica.cc:331] T 114d1f10fa634e57b570568d83615f46 P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:54:50.224380 2713 raft_consensus.cc:2241] T 114d1f10fa634e57b570568d83615f46 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:50.224532 2713 raft_consensus.cc:2270] T 114d1f10fa634e57b570568d83615f46 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:50.209578 1614 tablet_service.cc:1515] Processing DeleteTablet for tablet 114d1f10fa634e57b570568d83615f46 with delete_type TABLET_DATA_DELETED (replaced by tablet 7a217324e97b43e5a7ec540e3b9f70a5) from {username='slave'} at 127.0.0.1:51022
I20250831 19:54:50.213456 1613 tablet_service.cc:1515] Processing DeleteTablet for tablet f8871812b0734f40b63bef0473e2a58d with delete_type TABLET_DATA_DELETED (replaced by tablet 48c3872dbaee495fb80d1415b5631eaf) from {username='slave'} at 127.0.0.1:51022
I20250831 19:54:50.224304 2282 tablet_bootstrap.cc:492] T 6b61f7d06007437f803d400e73800415 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:50.230603 2715 log.cc:1199] T 6eda2f28ef194cba81661fbf080c5883 P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/6eda2f28ef194cba81661fbf080c5883
I20250831 19:54:50.230890 2119 catalog_manager.cc:6127] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: default.table_ca18962558654590b5d74892b4e00d0f [id=2cd4af6b415c4e3a92a3732fa145aa42] alter complete (version 1)
I20250831 19:54:50.231041 2715 ts_tablet_manager.cc:1939] T 6eda2f28ef194cba81661fbf080c5883 P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
I20250831 19:54:50.231055 2699 tablet_bootstrap.cc:492] T 6b61f7d06007437f803d400e73800415 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:50.231204 2699 ts_tablet_manager.cc:1397] T 6b61f7d06007437f803d400e73800415 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.062s user 0.010s sys 0.008s
I20250831 19:54:50.231998 2715 tablet_replica.cc:331] T a7a0312d22284f15a68d90f6e8cd7920 P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:54:50.231937 2699 raft_consensus.cc:357] T 6b61f7d06007437f803d400e73800415 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:50.232123 2699 raft_consensus.cc:383] T 6b61f7d06007437f803d400e73800415 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:50.232208 2699 raft_consensus.cc:738] T 6b61f7d06007437f803d400e73800415 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:50.232228 2715 raft_consensus.cc:2241] T a7a0312d22284f15a68d90f6e8cd7920 P 89aa85d59c53436ebdf3074b13d14825 [term 1 LEADER]: Raft consensus shutting down.
I20250831 19:54:50.232317 2282 tablet_bootstrap.cc:654] T 6b61f7d06007437f803d400e73800415 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:50.232434 2699 consensus_queue.cc:260] T 6b61f7d06007437f803d400e73800415 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:50.232604 2715 raft_consensus.cc:2270] T a7a0312d22284f15a68d90f6e8cd7920 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:50.233000 2699 ts_tablet_manager.cc:1428] T 6b61f7d06007437f803d400e73800415 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250831 19:54:50.233147 2715 ts_tablet_manager.cc:1905] T a7a0312d22284f15a68d90f6e8cd7920 P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:50.233237 2699 tablet_bootstrap.cc:492] T 4b3babfbfe394414b944bd53377edeb0 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:50.233291 2104 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet 6eda2f28ef194cba81661fbf080c5883 (table default.table_5660fc6b1a9846a6bd36b56e553a8f35 [id=5ce6c4d5dcd34d73af61fd2c4bf28799]) successfully deleted
I20250831 19:54:50.235311 2699 tablet_bootstrap.cc:654] T 4b3babfbfe394414b944bd53377edeb0 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:50.237682 2714 ts_tablet_manager.cc:1918] T 79a678e2a5ba495095865769a25ff68a P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.4
I20250831 19:54:50.237814 2714 log.cc:1199] T 79a678e2a5ba495095865769a25ff68a P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/79a678e2a5ba495095865769a25ff68a
I20250831 19:54:50.238195 2714 ts_tablet_manager.cc:1939] T 79a678e2a5ba495095865769a25ff68a P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:54:50.240844 2713 ts_tablet_manager.cc:1905] T 114d1f10fa634e57b570568d83615f46 P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:50.244318 1884 tablet_service.cc:1468] Processing CreateTablet for tablet 7a217324e97b43e5a7ec540e3b9f70a5 (DEFAULT_TABLE table=default.table_9706596e6715417ebc8fb06420b56bde [id=aabaa79336954b3ab0450dcff3afa7bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:50.245102 1750 tablet_service.cc:1468] Processing CreateTablet for tablet 7a217324e97b43e5a7ec540e3b9f70a5 (DEFAULT_TABLE table=default.table_9706596e6715417ebc8fb06420b56bde [id=aabaa79336954b3ab0450dcff3afa7bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:50.245263 1613 tablet_service.cc:1468] Processing CreateTablet for tablet 7a217324e97b43e5a7ec540e3b9f70a5 (DEFAULT_TABLE table=default.table_9706596e6715417ebc8fb06420b56bde [id=aabaa79336954b3ab0450dcff3afa7bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:50.245714 1613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a217324e97b43e5a7ec540e3b9f70a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:50.247013 2715 ts_tablet_manager.cc:1918] T a7a0312d22284f15a68d90f6e8cd7920 P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250831 19:54:50.249105 1884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a217324e97b43e5a7ec540e3b9f70a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:50.252722 1750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a217324e97b43e5a7ec540e3b9f70a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:50.258469 2715 log.cc:1199] T a7a0312d22284f15a68d90f6e8cd7920 P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/a7a0312d22284f15a68d90f6e8cd7920
I20250831 19:54:50.258975 2715 ts_tablet_manager.cc:1939] T a7a0312d22284f15a68d90f6e8cd7920 P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
I20250831 19:54:50.259871 2284 tablet_bootstrap.cc:492] T 6b61f7d06007437f803d400e73800415 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:50.259855 2654 raft_consensus.cc:491] T 2c343954bf6e44d683310415da3c0e58 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20250831 19:54:50.259987 1570 consensus_peers.cc:489] T 114d1f10fa634e57b570568d83615f46 P 89aa85d59c53436ebdf3074b13d14825 -> Peer de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): Couldn't send request to peer de831f40fa1348a48a1f0260f4130197. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20250831 19:54:50.260033 2284 ts_tablet_manager.cc:1397] T 6b61f7d06007437f803d400e73800415 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.083s user 0.002s sys 0.001s
I20250831 19:54:50.260159 2282 tablet_bootstrap.cc:492] T 6b61f7d06007437f803d400e73800415 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:50.260003 2654 raft_consensus.cc:513] T 2c343954bf6e44d683310415da3c0e58 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:50.261642 1771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2c343954bf6e44d683310415da3c0e58" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:50.261816 1771 raft_consensus.cc:2466] T 2c343954bf6e44d683310415da3c0e58 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 0.
I20250831 19:54:50.262238 1570 leader_election.cc:304] T 2c343954bf6e44d683310415da3c0e58 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:50.262445 2284 raft_consensus.cc:357] T 6b61f7d06007437f803d400e73800415 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:50.262634 2284 raft_consensus.cc:383] T 6b61f7d06007437f803d400e73800415 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:50.262702 2284 raft_consensus.cc:738] T 6b61f7d06007437f803d400e73800415 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:50.262938 2284 consensus_queue.cc:260] T 6b61f7d06007437f803d400e73800415 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:50.263366 2284 ts_tablet_manager.cc:1428] T 6b61f7d06007437f803d400e73800415 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20250831 19:54:50.263597 2654 leader_election.cc:290] T 2c343954bf6e44d683310415da3c0e58 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237)
I20250831 19:54:50.263911 2654 raft_consensus.cc:2802] T 2c343954bf6e44d683310415da3c0e58 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:50.265347 2654 raft_consensus.cc:491] T 2c343954bf6e44d683310415da3c0e58 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:50.265713 2121 catalog_manager.cc:6127] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: default.table_6c2f9309b58643529114857aae0568f2 [id=ad7bb166843e423ea7e50a1d18710fa1] alter complete (version 2)
I20250831 19:54:50.265800 2654 raft_consensus.cc:3058] T 2c343954bf6e44d683310415da3c0e58 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:50.266731 1904 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2c343954bf6e44d683310415da3c0e58" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:50.267218 1904 raft_consensus.cc:2466] T 2c343954bf6e44d683310415da3c0e58 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 0.
I20250831 19:54:50.267724 2699 tablet_bootstrap.cc:492] T 4b3babfbfe394414b944bd53377edeb0 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:50.268131 2699 ts_tablet_manager.cc:1397] T 4b3babfbfe394414b944bd53377edeb0 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.035s user 0.004s sys 0.000s
I20250831 19:54:50.270056 2699 raft_consensus.cc:357] T 4b3babfbfe394414b944bd53377edeb0 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:50.270301 2699 raft_consensus.cc:383] T 4b3babfbfe394414b944bd53377edeb0 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:50.270390 2699 raft_consensus.cc:738] T 4b3babfbfe394414b944bd53377edeb0 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
W20250831 19:54:50.270376 2121 catalog_manager.cc:5774] Failed to send AlterTable RPC for tablet 4b3babfbfe394414b944bd53377edeb0 (table default.table_fd98179fb4584ad6bde229ee78f7dfde [id=0850f2b0e9324dd0a210fa7b2609c769], current schema version=3): Not found: failed to reset TS proxy: No leader found: Tablet 4b3babfbfe394414b944bd53377edeb0 consensus state has no leader
I20250831 19:54:50.270560 1752 tablet_service.cc:1468] Processing CreateTablet for tablet 48c3872dbaee495fb80d1415b5631eaf (DEFAULT_TABLE table=default.table_bcc81e72ea324a389ebbcc6a6b4512ac [id=f63d391a9c824314bf6789cc7bbb5ffb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:50.271042 2699 consensus_queue.cc:260] T 4b3babfbfe394414b944bd53377edeb0 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:50.271409 2101 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet 79a678e2a5ba495095865769a25ff68a (table default.table_fd98179fb4584ad6bde229ee78f7dfde [id=0850f2b0e9324dd0a210fa7b2609c769]) successfully deleted
I20250831 19:54:50.271521 2699 ts_tablet_manager.cc:1428] T 4b3babfbfe394414b944bd53377edeb0 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20250831 19:54:50.271848 2699 tablet_bootstrap.cc:492] T 7a217324e97b43e5a7ec540e3b9f70a5 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:50.272397 1884 tablet_service.cc:1468] Processing CreateTablet for tablet 48c3872dbaee495fb80d1415b5631eaf (DEFAULT_TABLE table=default.table_bcc81e72ea324a389ebbcc6a6b4512ac [id=f63d391a9c824314bf6789cc7bbb5ffb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:50.272665 2714 tablet_replica.cc:331] T 6eda2f28ef194cba81661fbf080c5883 P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:54:50.272979 2714 raft_consensus.cc:2241] T 6eda2f28ef194cba81661fbf080c5883 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:50.274410 2118 catalog_manager.cc:3460] renamed table default.table_2cfa6cbcf8244da6b6468895fd9e31cc [id=321a68b57ebf4e3a80670c3c862403f1] in HMS: new name default.table_6a83a43f21484b2ba465fe72560bb53f
I20250831 19:54:50.274830 2714 raft_consensus.cc:2270] T 6eda2f28ef194cba81661fbf080c5883 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:50.275600 2714 ts_tablet_manager.cc:1905] T 6eda2f28ef194cba81661fbf080c5883 P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:50.280385 1884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48c3872dbaee495fb80d1415b5631eaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:50.280546 2121 catalog_manager.cc:5674] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197) does not have the latest schema for tablet 4b3babfbfe394414b944bd53377edeb0 (table default.table_fd98179fb4584ad6bde229ee78f7dfde [id=0850f2b0e9324dd0a210fa7b2609c769]). Expected version 3 got 0
I20250831 19:54:50.260303 2282 ts_tablet_manager.cc:1397] T 6b61f7d06007437f803d400e73800415 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.036s user 0.004s sys 0.003s
I20250831 19:54:50.283358 2121 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36958:
name: "default.Table_ea8910dd3df74137a9832974c833f71e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:50.284173 2282 raft_consensus.cc:357] T 6b61f7d06007437f803d400e73800415 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:50.284353 2282 raft_consensus.cc:383] T 6b61f7d06007437f803d400e73800415 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:50.284413 2282 raft_consensus.cc:738] T 6b61f7d06007437f803d400e73800415 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:50.286155 1885 tablet_service.cc:1515] Processing DeleteTablet for tablet 79a678e2a5ba495095865769a25ff68a with delete_type TABLET_DATA_DELETED (replaced by tablet 4b3babfbfe394414b944bd53377edeb0) from {username='slave'} at 127.0.0.1:45906
I20250831 19:54:50.286090 2282 consensus_queue.cc:260] T 6b61f7d06007437f803d400e73800415 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:50.286535 2282 ts_tablet_manager.cc:1428] T 6b61f7d06007437f803d400e73800415 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20250831 19:54:50.290019 2119 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36958:
name: "default.Table_9ef01b3dfa2640dbbd4b622e06a1da94"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:50.290159 1752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48c3872dbaee495fb80d1415b5631eaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:50.303861 2699 tablet_bootstrap.cc:654] T 7a217324e97b43e5a7ec540e3b9f70a5 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:50.306829 2654 raft_consensus.cc:513] T 2c343954bf6e44d683310415da3c0e58 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:50.307962 1904 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2c343954bf6e44d683310415da3c0e58" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:54:50.308166 1904 raft_consensus.cc:3058] T 2c343954bf6e44d683310415da3c0e58 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:50.310801 1904 raft_consensus.cc:2466] T 2c343954bf6e44d683310415da3c0e58 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1.
W20250831 19:54:50.311587 2101 catalog_manager.cc:4726] Async tablet task AlterTable RPC for tablet 4b3babfbfe394414b944bd53377edeb0 (table default.table_fd98179fb4584ad6bde229ee78f7dfde [id=0850f2b0e9324dd0a210fa7b2609c769], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet 4b3babfbfe394414b944bd53377edeb0 consensus state has no leader
I20250831 19:54:50.311563 1568 leader_election.cc:304] T 2c343954bf6e44d683310415da3c0e58 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:54:50.311971 2713 ts_tablet_manager.cc:1918] T 114d1f10fa634e57b570568d83615f46 P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:50.312038 2654 leader_election.cc:290] T 2c343954bf6e44d683310415da3c0e58 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Requested vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237)
I20250831 19:54:50.312130 2713 log.cc:1199] T 114d1f10fa634e57b570568d83615f46 P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/114d1f10fa634e57b570568d83615f46
I20250831 19:54:50.312211 2654 raft_consensus.cc:2802] T 2c343954bf6e44d683310415da3c0e58 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:50.312274 2699 tablet_bootstrap.cc:492] T 7a217324e97b43e5a7ec540e3b9f70a5 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:50.312350 2654 raft_consensus.cc:695] T 2c343954bf6e44d683310415da3c0e58 P 89aa85d59c53436ebdf3074b13d14825 [term 1 LEADER]: Becoming Leader. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Running, Role: LEADER
I20250831 19:54:50.312466 2699 ts_tablet_manager.cc:1397] T 7a217324e97b43e5a7ec540e3b9f70a5 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.041s user 0.002s sys 0.003s
I20250831 19:54:50.312541 2713 ts_tablet_manager.cc:1939] T 114d1f10fa634e57b570568d83615f46 P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
I20250831 19:54:50.312708 2654 consensus_queue.cc:237] T 2c343954bf6e44d683310415da3c0e58 P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:50.313328 2699 raft_consensus.cc:357] T 7a217324e97b43e5a7ec540e3b9f70a5 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:50.313562 2105 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet 114d1f10fa634e57b570568d83615f46 (table default.table_9706596e6715417ebc8fb06420b56bde [id=aabaa79336954b3ab0450dcff3afa7bf]) successfully deleted
I20250831 19:54:50.313604 2699 raft_consensus.cc:383] T 7a217324e97b43e5a7ec540e3b9f70a5 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:50.313779 2699 raft_consensus.cc:738] T 7a217324e97b43e5a7ec540e3b9f70a5 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:50.314142 2699 consensus_queue.cc:260] T 7a217324e97b43e5a7ec540e3b9f70a5 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:50.316319 2699 ts_tablet_manager.cc:1428] T 7a217324e97b43e5a7ec540e3b9f70a5 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20250831 19:54:50.316591 2699 tablet_bootstrap.cc:492] T 48c3872dbaee495fb80d1415b5631eaf P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:50.318953 2284 tablet_bootstrap.cc:492] T 48c3872dbaee495fb80d1415b5631eaf P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:50.321492 2699 tablet_bootstrap.cc:654] T 48c3872dbaee495fb80d1415b5631eaf P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:50.321812 2282 tablet_bootstrap.cc:492] T 7a217324e97b43e5a7ec540e3b9f70a5 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:50.323668 2282 tablet_bootstrap.cc:654] T 7a217324e97b43e5a7ec540e3b9f70a5 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:50.313799 2715 tablet_replica.cc:331] T 114d1f10fa634e57b570568d83615f46 P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:54:50.329277 2715 raft_consensus.cc:2241] T 114d1f10fa634e57b570568d83615f46 P 89aa85d59c53436ebdf3074b13d14825 [term 1 LEADER]: Raft consensus shutting down.
I20250831 19:54:50.334272 2699 tablet_bootstrap.cc:492] T 48c3872dbaee495fb80d1415b5631eaf P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:50.334440 2699 ts_tablet_manager.cc:1397] T 48c3872dbaee495fb80d1415b5631eaf P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.000s
I20250831 19:54:50.335234 2715 raft_consensus.cc:2270] T 114d1f10fa634e57b570568d83615f46 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:50.335181 2699 raft_consensus.cc:357] T 48c3872dbaee495fb80d1415b5631eaf P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:50.335351 2699 raft_consensus.cc:383] T 48c3872dbaee495fb80d1415b5631eaf P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:50.335423 2699 raft_consensus.cc:738] T 48c3872dbaee495fb80d1415b5631eaf P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:50.335631 2699 consensus_queue.cc:260] T 48c3872dbaee495fb80d1415b5631eaf P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:50.336134 2699 ts_tablet_manager.cc:1428] T 48c3872dbaee495fb80d1415b5631eaf P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250831 19:54:50.337064 2715 ts_tablet_manager.cc:1905] T 114d1f10fa634e57b570568d83615f46 P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:50.337424 2284 tablet_bootstrap.cc:654] T 48c3872dbaee495fb80d1415b5631eaf P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:50.343556 2714 ts_tablet_manager.cc:1918] T 6eda2f28ef194cba81661fbf080c5883 P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:50.344517 2284 tablet_bootstrap.cc:492] T 48c3872dbaee495fb80d1415b5631eaf P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
W20250831 19:54:50.345010 1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.1.194:41475, user_credentials={real_user=slave}} blocked reactor thread for 82769.7us
I20250831 19:54:50.346040 2104 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet a7a0312d22284f15a68d90f6e8cd7920 (table default.table_c8611581e59f4d8a94cd6f4da06917a4 [id=bd456415108d49989ef0bc2af91eb2f0]) successfully deleted
I20250831 19:54:50.346170 1613 tablet_service.cc:1468] Processing CreateTablet for tablet 48c3872dbaee495fb80d1415b5631eaf (DEFAULT_TABLE table=default.table_bcc81e72ea324a389ebbcc6a6b4512ac [id=f63d391a9c824314bf6789cc7bbb5ffb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:50.346367 1771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2c343954bf6e44d683310415da3c0e58" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197"
I20250831 19:54:50.346534 1771 raft_consensus.cc:3058] T 2c343954bf6e44d683310415da3c0e58 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:50.346598 1613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48c3872dbaee495fb80d1415b5631eaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:50.349725 1771 raft_consensus.cc:2466] T 2c343954bf6e44d683310415da3c0e58 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1.
I20250831 19:54:50.350281 2282 tablet_bootstrap.cc:492] T 7a217324e97b43e5a7ec540e3b9f70a5 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:50.350425 2282 ts_tablet_manager.cc:1397] T 7a217324e97b43e5a7ec540e3b9f70a5 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.029s user 0.001s sys 0.002s
I20250831 19:54:50.351239 2282 raft_consensus.cc:357] T 7a217324e97b43e5a7ec540e3b9f70a5 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:50.351449 2282 raft_consensus.cc:383] T 7a217324e97b43e5a7ec540e3b9f70a5 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:50.351545 2282 raft_consensus.cc:738] T 7a217324e97b43e5a7ec540e3b9f70a5 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:50.351709 2284 ts_tablet_manager.cc:1397] T 48c3872dbaee495fb80d1415b5631eaf P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.027s user 0.001s sys 0.002s
I20250831 19:54:50.352500 2284 raft_consensus.cc:357] T 48c3872dbaee495fb80d1415b5631eaf P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:50.352676 2284 raft_consensus.cc:383] T 48c3872dbaee495fb80d1415b5631eaf P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:50.352782 2284 raft_consensus.cc:738] T 48c3872dbaee495fb80d1415b5631eaf P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:50.352985 2284 consensus_queue.cc:260] T 48c3872dbaee495fb80d1415b5631eaf P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:50.353477 2284 ts_tablet_manager.cc:1428] T 48c3872dbaee495fb80d1415b5631eaf P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20250831 19:54:50.353623 2714 log.cc:1199] T 6eda2f28ef194cba81661fbf080c5883 P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/6eda2f28ef194cba81661fbf080c5883
I20250831 19:54:50.354061 2714 ts_tablet_manager.cc:1939] T 6eda2f28ef194cba81661fbf080c5883 P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:54:50.355273 2101 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet 6eda2f28ef194cba81661fbf080c5883 (table default.table_5660fc6b1a9846a6bd36b56e553a8f35 [id=5ce6c4d5dcd34d73af61fd2c4bf28799]) successfully deleted
I20250831 19:54:50.355311 2282 consensus_queue.cc:260] T 7a217324e97b43e5a7ec540e3b9f70a5 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:50.355787 2282 ts_tablet_manager.cc:1428] T 7a217324e97b43e5a7ec540e3b9f70a5 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20250831 19:54:50.356060 2282 tablet_bootstrap.cc:492] T 48c3872dbaee495fb80d1415b5631eaf P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:50.357699 2714 tablet_replica.cc:331] T a7a0312d22284f15a68d90f6e8cd7920 P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:54:50.357918 2714 raft_consensus.cc:2241] T a7a0312d22284f15a68d90f6e8cd7920 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:50.358093 2714 raft_consensus.cc:2270] T a7a0312d22284f15a68d90f6e8cd7920 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:50.358603 2714 ts_tablet_manager.cc:1905] T a7a0312d22284f15a68d90f6e8cd7920 P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:50.360466 2239 raft_consensus.cc:491] T 6b61f7d06007437f803d400e73800415 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:50.360621 2239 raft_consensus.cc:513] T 6b61f7d06007437f803d400e73800415 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:50.361228 2239 leader_election.cc:290] T 6b61f7d06007437f803d400e73800415 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:50.361758 1771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6b61f7d06007437f803d400e73800415" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:50.361971 1771 raft_consensus.cc:2466] T 6b61f7d06007437f803d400e73800415 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 0.
I20250831 19:54:50.362459 1842 leader_election.cc:304] T 6b61f7d06007437f803d400e73800415 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:50.362689 2239 raft_consensus.cc:2802] T 6b61f7d06007437f803d400e73800415 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:50.362782 2239 raft_consensus.cc:491] T 6b61f7d06007437f803d400e73800415 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:50.362862 2239 raft_consensus.cc:3058] T 6b61f7d06007437f803d400e73800415 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:50.365216 2239 raft_consensus.cc:513] T 6b61f7d06007437f803d400e73800415 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:50.365828 2126 catalog_manager.cc:3460] renamed table default.table_9706596e6715417ebc8fb06420b56bde [id=aabaa79336954b3ab0450dcff3afa7bf] in HMS: new name default.table_f5e850536e8c40ccae5b78ae7e787b7d
I20250831 19:54:50.366060 2239 leader_election.cc:290] T 6b61f7d06007437f803d400e73800415 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 election: Requested vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:50.366281 1631 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6b61f7d06007437f803d400e73800415" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:50.366593 1631 raft_consensus.cc:2466] T 6b61f7d06007437f803d400e73800415 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 0.
I20250831 19:54:50.367457 1631 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6b61f7d06007437f803d400e73800415" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:54:50.367635 1631 raft_consensus.cc:3058] T 6b61f7d06007437f803d400e73800415 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:50.368176 1771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6b61f7d06007437f803d400e73800415" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197"
I20250831 19:54:50.368346 1771 raft_consensus.cc:3058] T 6b61f7d06007437f803d400e73800415 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:50.370008 2715 ts_tablet_manager.cc:1918] T 114d1f10fa634e57b570568d83615f46 P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:50.370105 2715 log.cc:1199] T 114d1f10fa634e57b570568d83615f46 P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/114d1f10fa634e57b570568d83615f46
I20250831 19:54:50.370419 2715 ts_tablet_manager.cc:1939] T 114d1f10fa634e57b570568d83615f46 P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
I20250831 19:54:50.370673 1771 raft_consensus.cc:2466] T 6b61f7d06007437f803d400e73800415 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 1.
I20250831 19:54:50.371140 1842 leader_election.cc:304] T 6b61f7d06007437f803d400e73800415 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:50.371290 2715 tablet_replica.cc:331] T f8871812b0734f40b63bef0473e2a58d P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:54:50.371498 2715 raft_consensus.cc:2241] T f8871812b0734f40b63bef0473e2a58d P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:50.371677 2715 raft_consensus.cc:2270] T f8871812b0734f40b63bef0473e2a58d P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:50.371843 2104 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet 114d1f10fa634e57b570568d83615f46 (table default.table_9706596e6715417ebc8fb06420b56bde [id=aabaa79336954b3ab0450dcff3afa7bf]) successfully deleted
I20250831 19:54:50.372220 2715 ts_tablet_manager.cc:1905] T f8871812b0734f40b63bef0473e2a58d P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:50.375499 1631 raft_consensus.cc:2466] T 6b61f7d06007437f803d400e73800415 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 1.
I20250831 19:54:50.376061 2239 raft_consensus.cc:2802] T 6b61f7d06007437f803d400e73800415 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:50.376631 2239 raft_consensus.cc:695] T 6b61f7d06007437f803d400e73800415 P 2441fafe1d62429386f4631ad423567d [term 1 LEADER]: Becoming Leader. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Running, Role: LEADER
I20250831 19:54:50.376904 2239 consensus_queue.cc:237] T 6b61f7d06007437f803d400e73800415 P 2441fafe1d62429386f4631ad423567d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:50.381520 2282 tablet_bootstrap.cc:654] T 48c3872dbaee495fb80d1415b5631eaf P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:50.384851 2715 ts_tablet_manager.cc:1918] T f8871812b0734f40b63bef0473e2a58d P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250831 19:54:50.390992 2715 log.cc:1199] T f8871812b0734f40b63bef0473e2a58d P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/f8871812b0734f40b63bef0473e2a58d
I20250831 19:54:50.391754 2715 ts_tablet_manager.cc:1939] T f8871812b0734f40b63bef0473e2a58d P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
I20250831 19:54:50.396714 2104 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet f8871812b0734f40b63bef0473e2a58d (table default.table_bcc81e72ea324a389ebbcc6a6b4512ac [id=f63d391a9c824314bf6789cc7bbb5ffb]) successfully deleted
I20250831 19:54:50.397625 2714 ts_tablet_manager.cc:1918] T a7a0312d22284f15a68d90f6e8cd7920 P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250831 19:54:50.397945 2284 tablet_bootstrap.cc:492] T 7a217324e97b43e5a7ec540e3b9f70a5 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:50.398367 2714 log.cc:1199] T a7a0312d22284f15a68d90f6e8cd7920 P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/a7a0312d22284f15a68d90f6e8cd7920
I20250831 19:54:50.400269 2284 tablet_bootstrap.cc:654] T 7a217324e97b43e5a7ec540e3b9f70a5 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:50.400666 2714 ts_tablet_manager.cc:1939] T a7a0312d22284f15a68d90f6e8cd7920 P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:54:50.401968 2101 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet a7a0312d22284f15a68d90f6e8cd7920 (table default.table_c8611581e59f4d8a94cd6f4da06917a4 [id=bd456415108d49989ef0bc2af91eb2f0]) successfully deleted
I20250831 19:54:50.402410 2282 tablet_bootstrap.cc:492] T 48c3872dbaee495fb80d1415b5631eaf P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:50.402875 2282 ts_tablet_manager.cc:1397] T 48c3872dbaee495fb80d1415b5631eaf P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.047s user 0.000s sys 0.007s
I20250831 19:54:50.403807 2282 raft_consensus.cc:357] T 48c3872dbaee495fb80d1415b5631eaf P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:50.407020 2714 tablet_replica.cc:331] T 114d1f10fa634e57b570568d83615f46 P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:54:50.407230 2714 raft_consensus.cc:2241] T 114d1f10fa634e57b570568d83615f46 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:50.407452 2714 raft_consensus.cc:2270] T 114d1f10fa634e57b570568d83615f46 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:50.407645 2282 raft_consensus.cc:383] T 48c3872dbaee495fb80d1415b5631eaf P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:50.407770 2282 raft_consensus.cc:738] T 48c3872dbaee495fb80d1415b5631eaf P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:50.408243 2282 consensus_queue.cc:260] T 48c3872dbaee495fb80d1415b5631eaf P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:50.408874 2714 ts_tablet_manager.cc:1905] T 114d1f10fa634e57b570568d83615f46 P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:50.410651 2282 ts_tablet_manager.cc:1428] T 48c3872dbaee495fb80d1415b5631eaf P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.007s user 0.000s sys 0.001s
I20250831 19:54:50.415284 2284 tablet_bootstrap.cc:492] T 7a217324e97b43e5a7ec540e3b9f70a5 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:50.415442 2284 ts_tablet_manager.cc:1397] T 7a217324e97b43e5a7ec540e3b9f70a5 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.018s user 0.001s sys 0.003s
I20250831 19:54:50.416181 2284 raft_consensus.cc:357] T 7a217324e97b43e5a7ec540e3b9f70a5 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:50.416373 2284 raft_consensus.cc:383] T 7a217324e97b43e5a7ec540e3b9f70a5 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:50.416455 2284 raft_consensus.cc:738] T 7a217324e97b43e5a7ec540e3b9f70a5 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:50.416703 2284 consensus_queue.cc:260] T 7a217324e97b43e5a7ec540e3b9f70a5 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:50.420953 2123 catalog_manager.cc:2706] deleted HMS catalog entry for table default.table_bced462d6a2a4c929f51cfe29e54fe75 [id=cd895a5e76c444838de76fc1f5160120]
I20250831 19:54:50.427388 2654 consensus_queue.cc:1035] T 99d703eb7412458e95070fffe3cde91b P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:50.427587 2714 ts_tablet_manager.cc:1918] T 114d1f10fa634e57b570568d83615f46 P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:50.427699 2714 log.cc:1199] T 114d1f10fa634e57b570568d83615f46 P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/114d1f10fa634e57b570568d83615f46
I20250831 19:54:50.428062 2714 ts_tablet_manager.cc:1939] T 114d1f10fa634e57b570568d83615f46 P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:54:50.428808 2594 raft_consensus.cc:491] T 7a217324e97b43e5a7ec540e3b9f70a5 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:50.428948 2594 raft_consensus.cc:513] T 7a217324e97b43e5a7ec540e3b9f70a5 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:50.429518 2594 leader_election.cc:290] T 7a217324e97b43e5a7ec540e3b9f70a5 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:50.429596 2101 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet 114d1f10fa634e57b570568d83615f46 (table default.table_9706596e6715417ebc8fb06420b56bde [id=aabaa79336954b3ab0450dcff3afa7bf]) successfully deleted
I20250831 19:54:50.429919 2714 tablet_replica.cc:331] T f8871812b0734f40b63bef0473e2a58d P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:54:50.430147 2714 raft_consensus.cc:2241] T f8871812b0734f40b63bef0473e2a58d P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:50.430471 1631 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7a217324e97b43e5a7ec540e3b9f70a5" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:50.430677 1631 raft_consensus.cc:2466] T 7a217324e97b43e5a7ec540e3b9f70a5 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 0.
I20250831 19:54:50.431078 1771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7a217324e97b43e5a7ec540e3b9f70a5" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:50.431121 1841 leader_election.cc:304] T 7a217324e97b43e5a7ec540e3b9f70a5 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:54:50.431264 1771 raft_consensus.cc:2466] T 7a217324e97b43e5a7ec540e3b9f70a5 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 0.
I20250831 19:54:50.431478 2594 raft_consensus.cc:2802] T 7a217324e97b43e5a7ec540e3b9f70a5 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:50.431568 2594 raft_consensus.cc:491] T 7a217324e97b43e5a7ec540e3b9f70a5 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:50.431674 2594 raft_consensus.cc:3058] T 7a217324e97b43e5a7ec540e3b9f70a5 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:50.434406 2594 raft_consensus.cc:513] T 7a217324e97b43e5a7ec540e3b9f70a5 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:50.437633 1771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7a217324e97b43e5a7ec540e3b9f70a5" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197"
I20250831 19:54:50.438354 1771 raft_consensus.cc:3058] T 7a217324e97b43e5a7ec540e3b9f70a5 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:50.440124 1631 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7a217324e97b43e5a7ec540e3b9f70a5" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:54:50.440297 1631 raft_consensus.cc:3058] T 7a217324e97b43e5a7ec540e3b9f70a5 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:50.441066 1771 raft_consensus.cc:2466] T 7a217324e97b43e5a7ec540e3b9f70a5 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 1.
I20250831 19:54:50.437470 2284 ts_tablet_manager.cc:1428] T 7a217324e97b43e5a7ec540e3b9f70a5 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.022s user 0.001s sys 0.001s
I20250831 19:54:50.442852 1631 raft_consensus.cc:2466] T 7a217324e97b43e5a7ec540e3b9f70a5 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 1.
I20250831 19:54:50.443378 1841 leader_election.cc:304] T 7a217324e97b43e5a7ec540e3b9f70a5 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:54:50.446777 2743 consensus_queue.cc:1035] T 99d703eb7412458e95070fffe3cde91b P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250831 19:54:50.449753 2186 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7a217324e97b43e5a7ec540e3b9f70a5 consensus state has no leader
I20250831 19:54:50.450451 2594 leader_election.cc:290] T 7a217324e97b43e5a7ec540e3b9f70a5 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 election: Requested vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:50.451218 2186 catalog_manager.cc:2747] Deleting table default.table_bced462d6a2a4c929f51cfe29e54fe75 [id=cd895a5e76c444838de76fc1f5160120] in response to Hive Metastore notification log event 87
I20250831 19:54:50.460144 2714 raft_consensus.cc:2270] T f8871812b0734f40b63bef0473e2a58d P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:50.461139 2714 ts_tablet_manager.cc:1905] T f8871812b0734f40b63bef0473e2a58d P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:50.462620 2186 catalog_manager.cc:5869] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Sending DeleteTablet for 3 replicas of tablet 5e8b8c83b1f445018f6a904bd430f736
I20250831 19:54:50.463385 1613 tablet_service.cc:1515] Processing DeleteTablet for tablet 5e8b8c83b1f445018f6a904bd430f736 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:50 UTC) from {username='slave'} at 127.0.0.1:51022
I20250831 19:54:50.464128 1750 tablet_service.cc:1515] Processing DeleteTablet for tablet 5e8b8c83b1f445018f6a904bd430f736 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:50 UTC) from {username='slave'} at 127.0.0.1:50674
W20250831 19:54:50.464306 2125 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_f6d2041746f14f4a84962c26b1df1118 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250831 19:54:50.464895 2754 raft_consensus.cc:2802] T 7a217324e97b43e5a7ec540e3b9f70a5 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:50.465484 2713 tablet_replica.cc:331] T 5e8b8c83b1f445018f6a904bd430f736 P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
W20250831 19:54:50.465606 2120 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_b7904c1a8762458ca114fc256fb84e5a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250831 19:54:50.465673 2713 raft_consensus.cc:2241] T 5e8b8c83b1f445018f6a904bd430f736 P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: Raft consensus shutting down.
I20250831 19:54:50.466004 2713 raft_consensus.cc:2270] T 5e8b8c83b1f445018f6a904bd430f736 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:50.466506 2713 ts_tablet_manager.cc:1905] T 5e8b8c83b1f445018f6a904bd430f736 P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:50.469715 2715 tablet_replica.cc:331] T 5e8b8c83b1f445018f6a904bd430f736 P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:54:50.469913 2715 raft_consensus.cc:2241] T 5e8b8c83b1f445018f6a904bd430f736 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:50.470099 2715 raft_consensus.cc:2270] T 5e8b8c83b1f445018f6a904bd430f736 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:50.470577 2715 ts_tablet_manager.cc:1905] T 5e8b8c83b1f445018f6a904bd430f736 P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:50.469552 1884 tablet_service.cc:1515] Processing DeleteTablet for tablet 5e8b8c83b1f445018f6a904bd430f736 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:50 UTC) from {username='slave'} at 127.0.0.1:45906
I20250831 19:54:50.471369 2754 raft_consensus.cc:695] T 7a217324e97b43e5a7ec540e3b9f70a5 P 2441fafe1d62429386f4631ad423567d [term 1 LEADER]: Becoming Leader. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Running, Role: LEADER
I20250831 19:54:50.471660 2754 consensus_queue.cc:237] T 7a217324e97b43e5a7ec540e3b9f70a5 P 2441fafe1d62429386f4631ad423567d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:50.489015 2715 ts_tablet_manager.cc:1918] T 5e8b8c83b1f445018f6a904bd430f736 P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:50.490100 2713 ts_tablet_manager.cc:1918] T 5e8b8c83b1f445018f6a904bd430f736 P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:50.490819 2713 log.cc:1199] T 5e8b8c83b1f445018f6a904bd430f736 P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/5e8b8c83b1f445018f6a904bd430f736
I20250831 19:54:50.491410 2713 ts_tablet_manager.cc:1939] T 5e8b8c83b1f445018f6a904bd430f736 P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
I20250831 19:54:50.491707 2715 log.cc:1199] T 5e8b8c83b1f445018f6a904bd430f736 P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/5e8b8c83b1f445018f6a904bd430f736
I20250831 19:54:50.492304 2715 ts_tablet_manager.cc:1939] T 5e8b8c83b1f445018f6a904bd430f736 P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
I20250831 19:54:50.493593 2105 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet 5e8b8c83b1f445018f6a904bd430f736 (table default.table_bced462d6a2a4c929f51cfe29e54fe75 [id=cd895a5e76c444838de76fc1f5160120]) successfully deleted
I20250831 19:54:50.495195 2104 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet 5e8b8c83b1f445018f6a904bd430f736 (table default.table_bced462d6a2a4c929f51cfe29e54fe75 [id=cd895a5e76c444838de76fc1f5160120]) successfully deleted
I20250831 19:54:50.504550 2684 catalog_manager.cc:1261] Loaded cluster ID: 003a9cb4df1f460dbfc9d2f57d96ced1
I20250831 19:54:50.504665 2684 catalog_manager.cc:1554] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3: loading cluster ID for follower catalog manager: success
I20250831 19:54:50.514336 2723 tablet.cc:1722] T d7551c6a0ebd493dba75b1f766c4db0f P de831f40fa1348a48a1f0260f4130197: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:50.515236 2594 consensus_queue.cc:1035] T 7e9810ebc28e4e07a83307c470ad92b3 P 2441fafe1d62429386f4631ad423567d [LEADER]: Connected to new peer: Peer: permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:50.520653 2125 catalog_manager.cc:2149] created HMS catalog entry for table [id=59220fba0aa647bca189db2218f3e28f]
I20250831 19:54:50.521044 2761 tablet.cc:1722] T d7551c6a0ebd493dba75b1f766c4db0f P 2441fafe1d62429386f4631ad423567d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:50.526523 2125 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:36958 (request call id 83) took 1969 ms. Trace:
I20250831 19:54:50.526636 2125 rpcz_store.cc:276] 0831 19:54:48.557298 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:50.090832 (+1533534us) service_pool.cc:225] Handling call
0831 19:54:50.464410 (+373578us) catalog_manager.cc:2076] Acquired catalog manager lock
0831 19:54:50.464897 (+ 487us) catalog_manager.cc:2122] Created new table and tablet info
0831 19:54:50.520625 (+ 55728us) catalog_manager.cc:2148] Created new table in HMS catalog
0831 19:54:50.526286 (+ 5661us) catalog_manager.cc:2182] Wrote table and tablets to system table
0831 19:54:50.526381 (+ 95us) catalog_manager.cc:2216] Inserted table and tablets into CatalogManager maps
0831 19:54:50.526472 (+ 91us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:50.521371 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:50.521509 (+ 138us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:50.521515 (+ 6us) write_op.cc:435] Acquired schema lock
0831 19:54:50.521518 (+ 3us) tablet.cc:660] Decoding operations
0831 19:54:50.521614 (+ 96us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:50.521628 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:50.521633 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:50.521713 (+ 80us) tablet.cc:699] Row locks acquired
0831 19:54:50.521715 (+ 2us) write_op.cc:260] PREPARE: finished
0831 19:54:50.521751 (+ 36us) write_op.cc:270] Start()
0831 19:54:50.521792 (+ 41us) write_op.cc:276] Timestamp: P: 1756670090521702 usec, L: 0
0831 19:54:50.521796 (+ 4us) op_driver.cc:348] REPLICATION: starting
0831 19:54:50.521959 (+ 163us) log.cc:844] Serialized 433 byte log entry
0831 19:54:50.525281 (+ 3322us) op_driver.cc:464] REPLICATION: finished
0831 19:54:50.525369 (+ 88us) write_op.cc:301] APPLY: starting
0831 19:54:50.525382 (+ 13us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:50.525424 (+ 42us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:50.525476 (+ 52us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:50.525568 (+ 92us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:50.525599 (+ 31us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0831 19:54:50.525605 (+ 6us) write_op.cc:312] APPLY: finished
0831 19:54:50.525664 (+ 59us) log.cc:844] Serialized 29 byte log entry
0831 19:54:50.525729 (+ 65us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:50.525745 (+ 16us) write_op.cc:454] Released schema lock
0831 19:54:50.525749 (+ 4us) write_op.cc:341] FINISH: Updating metrics
0831 19:54:50.525817 (+ 68us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:50.525820 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":32,"Hive Metastore.run_cpu_time_us":241,"Hive Metastore.run_wall_time_us":55352,"child_traces":[["op",{"apply.queue_time_us":47,"apply.run_cpu_time_us":440,"apply.run_wall_time_us":440,"num_ops":2,"prepare.queue_time_us":93,"prepare.run_cpu_time_us":690,"prepare.run_wall_time_us":689,"raft.queue_time_us":1148,"raft.run_cpu_time_us":468,"raft.run_wall_time_us":467,"replication_time_us":3461}]]}
I20250831 19:54:50.527586 2714 ts_tablet_manager.cc:1918] T f8871812b0734f40b63bef0473e2a58d P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250831 19:54:50.527714 2714 log.cc:1199] T f8871812b0734f40b63bef0473e2a58d P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/f8871812b0734f40b63bef0473e2a58d
I20250831 19:54:50.528136 2714 ts_tablet_manager.cc:1939] T f8871812b0734f40b63bef0473e2a58d P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
W20250831 19:54:50.529331 1841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.1.193:46197, user_credentials={real_user=slave}} blocked reactor thread for 85978.5us
I20250831 19:54:50.530866 2684 catalog_manager.cc:1576] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3: acquiring CA information for follower catalog manager: success
I20250831 19:54:50.532464 2724 tablet.cc:1722] T d7551c6a0ebd493dba75b1f766c4db0f P 89aa85d59c53436ebdf3074b13d14825: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:50.535681 2684 catalog_manager.cc:1604] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20250831 19:54:50.538707 2101 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet f8871812b0734f40b63bef0473e2a58d (table default.table_bcc81e72ea324a389ebbcc6a6b4512ac [id=f63d391a9c824314bf6789cc7bbb5ffb]) successfully deleted
W20250831 19:54:50.538991 2101 catalog_manager.cc:4895] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): delete failed for tablet 79a678e2a5ba495095865769a25ff68a because the tablet was not found. No further retry: Not found: Tablet not found: 79a678e2a5ba495095865769a25ff68a
I20250831 19:54:50.546841 2714 tablet_replica.cc:331] T 5e8b8c83b1f445018f6a904bd430f736 P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:54:50.547050 2714 raft_consensus.cc:2241] T 5e8b8c83b1f445018f6a904bd430f736 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:50.547233 2714 raft_consensus.cc:2270] T 5e8b8c83b1f445018f6a904bd430f736 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:50.547875 2714 ts_tablet_manager.cc:1905] T 5e8b8c83b1f445018f6a904bd430f736 P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:50.549546 2758 consensus_queue.cc:1035] T 7e9810ebc28e4e07a83307c470ad92b3 P 2441fafe1d62429386f4631ad423567d [LEADER]: Connected to new peer: Peer: permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:50.559643 2714 ts_tablet_manager.cc:1918] T 5e8b8c83b1f445018f6a904bd430f736 P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:50.559908 2714 log.cc:1199] T 5e8b8c83b1f445018f6a904bd430f736 P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/5e8b8c83b1f445018f6a904bd430f736
I20250831 19:54:50.560267 2714 ts_tablet_manager.cc:1939] T 5e8b8c83b1f445018f6a904bd430f736 P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:54:50.561908 2101 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet 5e8b8c83b1f445018f6a904bd430f736 (table default.table_bced462d6a2a4c929f51cfe29e54fe75 [id=cd895a5e76c444838de76fc1f5160120]) successfully deleted
I20250831 19:54:50.561959 1613 tablet_service.cc:1468] Processing CreateTablet for tablet bf30ba308d494e2880bb7fae5794d489 (DEFAULT_TABLE table=default.table_f6d2041746f14f4a84962c26b1df1118 [id=59220fba0aa647bca189db2218f3e28f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:50.562346 1613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf30ba308d494e2880bb7fae5794d489. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:50.562368 1884 tablet_service.cc:1468] Processing CreateTablet for tablet bf30ba308d494e2880bb7fae5794d489 (DEFAULT_TABLE table=default.table_f6d2041746f14f4a84962c26b1df1118 [id=59220fba0aa647bca189db2218f3e28f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:50.562798 1884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf30ba308d494e2880bb7fae5794d489. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:50.565948 1750 tablet_service.cc:1468] Processing CreateTablet for tablet bf30ba308d494e2880bb7fae5794d489 (DEFAULT_TABLE table=default.table_f6d2041746f14f4a84962c26b1df1118 [id=59220fba0aa647bca189db2218f3e28f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:50.566325 1750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf30ba308d494e2880bb7fae5794d489. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:50.568879 2699 tablet_bootstrap.cc:492] T bf30ba308d494e2880bb7fae5794d489 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:50.570385 2699 tablet_bootstrap.cc:654] T bf30ba308d494e2880bb7fae5794d489 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:50.572713 2284 tablet_bootstrap.cc:492] T bf30ba308d494e2880bb7fae5794d489 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:50.574210 2284 tablet_bootstrap.cc:654] T bf30ba308d494e2880bb7fae5794d489 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:50.576721 2120 catalog_manager.cc:2149] created HMS catalog entry for table [id=ba4c5ecf4ae94ede9bfb83af2ee894ab]
I20250831 19:54:50.577656 2125 catalog_manager.cc:5674] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237) does not have the latest schema for tablet 4b3babfbfe394414b944bd53377edeb0 (table default.table_fd98179fb4584ad6bde229ee78f7dfde [id=0850f2b0e9324dd0a210fa7b2609c769]). Expected version 3 got 0
I20250831 19:54:50.586197 2120 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:36958 (request call id 84) took 1910 ms. Trace:
I20250831 19:54:50.586329 2120 rpcz_store.cc:276] 0831 19:54:48.675289 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:50.092010 (+1416721us) service_pool.cc:225] Handling call
0831 19:54:50.465695 (+373685us) catalog_manager.cc:2076] Acquired catalog manager lock
0831 19:54:50.466061 (+ 366us) catalog_manager.cc:2122] Created new table and tablet info
0831 19:54:50.576677 (+110616us) catalog_manager.cc:2148] Created new table in HMS catalog
0831 19:54:50.585966 (+ 9289us) catalog_manager.cc:2182] Wrote table and tablets to system table
0831 19:54:50.586066 (+ 100us) catalog_manager.cc:2216] Inserted table and tablets into CatalogManager maps
0831 19:54:50.586162 (+ 96us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:50.577377 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:50.577566 (+ 189us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:50.577572 (+ 6us) write_op.cc:435] Acquired schema lock
0831 19:54:50.577574 (+ 2us) tablet.cc:660] Decoding operations
0831 19:54:50.577678 (+ 104us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:50.577692 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:50.577697 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:50.577771 (+ 74us) tablet.cc:699] Row locks acquired
0831 19:54:50.577774 (+ 3us) write_op.cc:260] PREPARE: finished
0831 19:54:50.577814 (+ 40us) write_op.cc:270] Start()
0831 19:54:50.577846 (+ 32us) write_op.cc:276] Timestamp: P: 1756670090577760 usec, L: 0
0831 19:54:50.577849 (+ 3us) op_driver.cc:348] REPLICATION: starting
0831 19:54:50.578033 (+ 184us) log.cc:844] Serialized 433 byte log entry
0831 19:54:50.584952 (+ 6919us) op_driver.cc:464] REPLICATION: finished
0831 19:54:50.585195 (+ 243us) write_op.cc:301] APPLY: starting
0831 19:54:50.585210 (+ 15us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:50.585255 (+ 45us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:50.585280 (+ 25us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:50.585375 (+ 95us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:50.585409 (+ 34us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0831 19:54:50.585416 (+ 7us) write_op.cc:312] APPLY: finished
0831 19:54:50.585709 (+ 293us) log.cc:844] Serialized 29 byte log entry
0831 19:54:50.585767 (+ 58us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:50.585792 (+ 25us) write_op.cc:454] Released schema lock
0831 19:54:50.585800 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0831 19:54:50.585869 (+ 69us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:50.585873 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":54292,"Hive Metastore.run_cpu_time_us":225,"Hive Metastore.run_wall_time_us":56073,"child_traces":[["op",{"apply.queue_time_us":192,"apply.run_cpu_time_us":477,"apply.run_wall_time_us":666,"num_ops":2,"prepare.queue_time_us":47,"prepare.run_cpu_time_us":771,"prepare.run_wall_time_us":771,"raft.queue_time_us":403,"raft.run_cpu_time_us":471,"raft.run_wall_time_us":471,"replication_time_us":7067}]]}
I20250831 19:54:50.594149 2284 tablet_bootstrap.cc:492] T bf30ba308d494e2880bb7fae5794d489 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:50.594352 2284 ts_tablet_manager.cc:1397] T bf30ba308d494e2880bb7fae5794d489 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.022s user 0.005s sys 0.006s
I20250831 19:54:50.595191 2284 raft_consensus.cc:357] T bf30ba308d494e2880bb7fae5794d489 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:50.595491 2284 raft_consensus.cc:383] T bf30ba308d494e2880bb7fae5794d489 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20250831 19:54:50.596020 2124 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_28a8f98e8e534694b9e17ec734373e90 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250831 19:54:50.596272 2118 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:36958 (request call id 77) took 2340 ms. Trace:
W20250831 19:54:50.596468 2117 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_692b305d0d9a402dbff897ae3fea5186 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250831 19:54:50.596374 2118 rpcz_store.cc:276] 0831 19:54:48.256183 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:49.666709 (+1410526us) service_pool.cc:225] Handling call
0831 19:54:50.055652 (+388943us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:50.595688 (+540036us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:50.595968 (+ 280us) catalog_manager.cc:3683] Apply alter schema
0831 19:54:50.596211 (+ 243us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":26365,"Hive Metastore.run_cpu_time_us":614,"Hive Metastore.run_wall_time_us":192052}
W20250831 19:54:50.596827 2122 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_e3057132cbc4426e9fc52d84d5189d01 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250831 19:54:50.597149 2121 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_ea8910dd3df74137a9832974c833f71e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250831 19:54:50.597605 2123 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:36958 (request call id 76) took 2353 ms. Trace:
I20250831 19:54:50.597700 2123 rpcz_store.cc:276] 0831 19:54:48.243866 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:49.105956 (+862090us) service_pool.cc:225] Handling call
0831 19:54:50.055602 (+949646us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:50.597547 (+541945us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":309770,"Hive Metastore.run_cpu_time_us":202,"Hive Metastore.run_wall_time_us":55231,"mutex_wait_us":3878}
I20250831 19:54:50.598073 2123 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36958:
name: "default.Table_265519e91af542d1836f224e15cd5e60"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250831 19:54:50.600330 2119 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_9ef01b3dfa2640dbbd4b622e06a1da94 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250831 19:54:50.600371 2284 raft_consensus.cc:738] T bf30ba308d494e2880bb7fae5794d489 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:50.600780 2284 consensus_queue.cc:260] T bf30ba308d494e2880bb7fae5794d489 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
W20250831 19:54:50.604573 2123 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_265519e91af542d1836f224e15cd5e60 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250831 19:54:50.605312 2284 ts_tablet_manager.cc:1428] T bf30ba308d494e2880bb7fae5794d489 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20250831 19:54:50.605464 2125 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36958:
name: "default.Table_4ab0ff6a6b0e49b0a8e0e9999f531e5b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:50.606128 2120 catalog_manager.cc:5582] T 2c343954bf6e44d683310415da3c0e58 P 89aa85d59c53436ebdf3074b13d14825 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193). New cstate: current_term: 1 leader_uuid: "89aa85d59c53436ebdf3074b13d14825" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } }
I20250831 19:54:50.608210 2758 consensus_queue.cc:1035] T de75786bcb5549149a81e52ac1a257db P 2441fafe1d62429386f4631ad423567d [LEADER]: Connected to new peer: Peer: permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:50.608489 2282 tablet_bootstrap.cc:492] T bf30ba308d494e2880bb7fae5794d489 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:50.610241 2282 tablet_bootstrap.cc:654] T bf30ba308d494e2880bb7fae5794d489 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:50.614006 2699 tablet_bootstrap.cc:492] T bf30ba308d494e2880bb7fae5794d489 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:50.614168 2699 ts_tablet_manager.cc:1397] T bf30ba308d494e2880bb7fae5794d489 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.045s user 0.004s sys 0.008s
I20250831 19:54:50.614970 2699 raft_consensus.cc:357] T bf30ba308d494e2880bb7fae5794d489 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:50.615154 2699 raft_consensus.cc:383] T bf30ba308d494e2880bb7fae5794d489 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:50.615243 2699 raft_consensus.cc:738] T bf30ba308d494e2880bb7fae5794d489 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:50.615448 2699 consensus_queue.cc:260] T bf30ba308d494e2880bb7fae5794d489 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:50.615907 2699 ts_tablet_manager.cc:1428] T bf30ba308d494e2880bb7fae5794d489 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20250831 19:54:50.615881 2126 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:36958 (request call id 78) took 2359 ms. Trace:
I20250831 19:54:50.615976 2126 rpcz_store.cc:276] 0831 19:54:48.256307 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:49.667177 (+1410870us) service_pool.cc:225] Handling call
0831 19:54:50.058834 (+391657us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:50.597503 (+538669us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:50.615587 (+ 18084us) catalog_manager.cc:3683] Apply alter schema
0831 19:54:50.615827 (+ 240us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":215328,"Hive Metastore.run_cpu_time_us":659,"Hive Metastore.run_wall_time_us":91174}
W20250831 19:54:50.623030 2125 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_4ab0ff6a6b0e49b0a8e0e9999f531e5b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250831 19:54:50.626276 2282 tablet_bootstrap.cc:492] T bf30ba308d494e2880bb7fae5794d489 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:50.626446 2282 ts_tablet_manager.cc:1397] T bf30ba308d494e2880bb7fae5794d489 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.003s
I20250831 19:54:50.627261 2282 raft_consensus.cc:357] T bf30ba308d494e2880bb7fae5794d489 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:50.627434 2282 raft_consensus.cc:383] T bf30ba308d494e2880bb7fae5794d489 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:50.627545 2282 raft_consensus.cc:738] T bf30ba308d494e2880bb7fae5794d489 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:50.627785 2282 consensus_queue.cc:260] T bf30ba308d494e2880bb7fae5794d489 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:50.628391 2282 ts_tablet_manager.cc:1428] T bf30ba308d494e2880bb7fae5794d489 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20250831 19:54:50.630370 2118 catalog_manager.cc:5674] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475) does not have the latest schema for tablet 48c3872dbaee495fb80d1415b5631eaf (table default.table_bcc81e72ea324a389ebbcc6a6b4512ac [id=f63d391a9c824314bf6789cc7bbb5ffb]). Expected version 1 got 0
I20250831 19:54:50.630563 2118 catalog_manager.cc:5674] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475) does not have the latest schema for tablet 7a217324e97b43e5a7ec540e3b9f70a5 (table default.table_f5e850536e8c40ccae5b78ae7e787b7d [id=aabaa79336954b3ab0450dcff3afa7bf]). Expected version 1 got 0
I20250831 19:54:50.637138 2126 catalog_manager.cc:5674] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237) does not have the latest schema for tablet 48c3872dbaee495fb80d1415b5631eaf (table default.table_bcc81e72ea324a389ebbcc6a6b4512ac [id=f63d391a9c824314bf6789cc7bbb5ffb]). Expected version 1 got 0
I20250831 19:54:50.637364 2126 catalog_manager.cc:5582] T 7a217324e97b43e5a7ec540e3b9f70a5 P 2441fafe1d62429386f4631ad423567d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2441fafe1d62429386f4631ad423567d (127.1.1.195). New cstate: current_term: 1 leader_uuid: "2441fafe1d62429386f4631ad423567d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: UNKNOWN } } }
I20250831 19:54:50.637794 2126 catalog_manager.cc:5674] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237) does not have the latest schema for tablet 7a217324e97b43e5a7ec540e3b9f70a5 (table default.table_f5e850536e8c40ccae5b78ae7e787b7d [id=aabaa79336954b3ab0450dcff3afa7bf]). Expected version 1 got 0
I20250831 19:54:50.638080 2126 catalog_manager.cc:5582] T 6b61f7d06007437f803d400e73800415 P 2441fafe1d62429386f4631ad423567d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2441fafe1d62429386f4631ad423567d (127.1.1.195). New cstate: current_term: 1 leader_uuid: "2441fafe1d62429386f4631ad423567d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: UNKNOWN } } }
I20250831 19:54:50.641920 2654 raft_consensus.cc:491] T 48c3872dbaee495fb80d1415b5631eaf P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:50.642086 2654 raft_consensus.cc:513] T 48c3872dbaee495fb80d1415b5631eaf P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:50.642627 2654 leader_election.cc:290] T 48c3872dbaee495fb80d1415b5631eaf P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:50.643388 1772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "48c3872dbaee495fb80d1415b5631eaf" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:50.643610 1772 raft_consensus.cc:2466] T 48c3872dbaee495fb80d1415b5631eaf P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 0.
I20250831 19:54:50.644200 1570 leader_election.cc:304] T 48c3872dbaee495fb80d1415b5631eaf P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:50.644517 2654 raft_consensus.cc:2802] T 48c3872dbaee495fb80d1415b5631eaf P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:50.644606 2654 raft_consensus.cc:491] T 48c3872dbaee495fb80d1415b5631eaf P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:50.644692 2654 raft_consensus.cc:3058] T 48c3872dbaee495fb80d1415b5631eaf P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:50.647151 2654 raft_consensus.cc:513] T 48c3872dbaee495fb80d1415b5631eaf P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:50.647969 2654 leader_election.cc:290] T 48c3872dbaee495fb80d1415b5631eaf P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Requested vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:50.648615 1772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "48c3872dbaee495fb80d1415b5631eaf" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197"
I20250831 19:54:50.648797 1772 raft_consensus.cc:3058] T 48c3872dbaee495fb80d1415b5631eaf P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:50.651506 1772 raft_consensus.cc:2466] T 48c3872dbaee495fb80d1415b5631eaf P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1.
I20250831 19:54:50.652022 1570 leader_election.cc:304] T 48c3872dbaee495fb80d1415b5631eaf P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:50.653074 1904 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "48c3872dbaee495fb80d1415b5631eaf" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:50.653107 1906 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "48c3872dbaee495fb80d1415b5631eaf" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:54:50.653259 1904 raft_consensus.cc:2466] T 48c3872dbaee495fb80d1415b5631eaf P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 0.
I20250831 19:54:50.655375 2124 catalog_manager.cc:2149] created HMS catalog entry for table [id=7963cab6b62d4957a18ed7af45c202c6]
I20250831 19:54:50.668546 2124 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:36958 (request call id 85) took 1965 ms. Trace:
I20250831 19:54:50.668702 2124 rpcz_store.cc:276] 0831 19:54:48.703134 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:50.103732 (+1400598us) service_pool.cc:225] Handling call
0831 19:54:50.614642 (+510910us) catalog_manager.cc:2076] Acquired catalog manager lock
0831 19:54:50.615148 (+ 506us) catalog_manager.cc:2122] Created new table and tablet info
0831 19:54:50.655329 (+ 40181us) catalog_manager.cc:2148] Created new table in HMS catalog
0831 19:54:50.668292 (+ 12963us) catalog_manager.cc:2182] Wrote table and tablets to system table
0831 19:54:50.668401 (+ 109us) catalog_manager.cc:2216] Inserted table and tablets into CatalogManager maps
0831 19:54:50.668507 (+ 106us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:50.658119 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:50.658234 (+ 115us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:50.658240 (+ 6us) write_op.cc:435] Acquired schema lock
0831 19:54:50.658242 (+ 2us) tablet.cc:660] Decoding operations
0831 19:54:50.658332 (+ 90us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:50.658342 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:50.658347 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:50.658421 (+ 74us) tablet.cc:699] Row locks acquired
0831 19:54:50.658423 (+ 2us) write_op.cc:260] PREPARE: finished
0831 19:54:50.658459 (+ 36us) write_op.cc:270] Start()
0831 19:54:50.658492 (+ 33us) write_op.cc:276] Timestamp: P: 1756670090658397 usec, L: 0
0831 19:54:50.658496 (+ 4us) op_driver.cc:348] REPLICATION: starting
0831 19:54:50.658663 (+ 167us) log.cc:844] Serialized 433 byte log entry
0831 19:54:50.666951 (+ 8288us) op_driver.cc:464] REPLICATION: finished
0831 19:54:50.667434 (+ 483us) write_op.cc:301] APPLY: starting
0831 19:54:50.667442 (+ 8us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:50.667469 (+ 27us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:50.667495 (+ 26us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:50.667652 (+ 157us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:50.667678 (+ 26us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0831 19:54:50.667685 (+ 7us) write_op.cc:312] APPLY: finished
0831 19:54:50.667735 (+ 50us) log.cc:844] Serialized 29 byte log entry
0831 19:54:50.667788 (+ 53us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:50.667805 (+ 17us) write_op.cc:454] Released schema lock
0831 19:54:50.667810 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0831 19:54:50.667868 (+ 58us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:50.667872 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":29,"Hive Metastore.run_cpu_time_us":237,"Hive Metastore.run_wall_time_us":38203,"child_traces":[["op",{"apply.queue_time_us":459,"apply.run_cpu_time_us":425,"apply.run_wall_time_us":425,"num_ops":2,"prepare.queue_time_us":2163,"prepare.run_cpu_time_us":627,"prepare.run_wall_time_us":627,"replication_time_us":8442}]]}
I20250831 19:54:50.672199 2758 consensus_queue.cc:1035] T de75786bcb5549149a81e52ac1a257db P 2441fafe1d62429386f4631ad423567d [LEADER]: Connected to new peer: Peer: permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:50.673501 2120 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36958:
name: "default.Table_13cea908832146dab4b8b794752b1a79"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:50.677001 2654 raft_consensus.cc:2802] T 48c3872dbaee495fb80d1415b5631eaf P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:50.677232 2654 raft_consensus.cc:695] T 48c3872dbaee495fb80d1415b5631eaf P 89aa85d59c53436ebdf3074b13d14825 [term 1 LEADER]: Becoming Leader. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Running, Role: LEADER
I20250831 19:54:50.677528 2654 consensus_queue.cc:237] T 48c3872dbaee495fb80d1415b5631eaf P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:50.693899 1750 tablet_service.cc:1468] Processing CreateTablet for tablet b67e0472244e4d79b8dfb7e7474b96b7 (DEFAULT_TABLE table=default.table_b7904c1a8762458ca114fc256fb84e5a [id=ba4c5ecf4ae94ede9bfb83af2ee894ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:50.694303 1750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b67e0472244e4d79b8dfb7e7474b96b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:50.696357 1884 tablet_service.cc:1468] Processing CreateTablet for tablet b67e0472244e4d79b8dfb7e7474b96b7 (DEFAULT_TABLE table=default.table_b7904c1a8762458ca114fc256fb84e5a [id=ba4c5ecf4ae94ede9bfb83af2ee894ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:50.696698 1884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b67e0472244e4d79b8dfb7e7474b96b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:50.699270 1613 tablet_service.cc:1468] Processing CreateTablet for tablet b67e0472244e4d79b8dfb7e7474b96b7 (DEFAULT_TABLE table=default.table_b7904c1a8762458ca114fc256fb84e5a [id=ba4c5ecf4ae94ede9bfb83af2ee894ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:50.699637 1613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b67e0472244e4d79b8dfb7e7474b96b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:50.699690 2119 catalog_manager.cc:2149] created HMS catalog entry for table [id=7e12dc19746647d790e1d0c465317f0d]
I20250831 19:54:50.703855 2284 tablet_bootstrap.cc:492] T b67e0472244e4d79b8dfb7e7474b96b7 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:50.704378 2699 tablet_bootstrap.cc:492] T b67e0472244e4d79b8dfb7e7474b96b7 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:50.706054 2284 tablet_bootstrap.cc:654] T b67e0472244e4d79b8dfb7e7474b96b7 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:50.706130 2699 tablet_bootstrap.cc:654] T b67e0472244e4d79b8dfb7e7474b96b7 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:50.706943 2282 tablet_bootstrap.cc:492] T b67e0472244e4d79b8dfb7e7474b96b7 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:50.708474 2282 tablet_bootstrap.cc:654] T b67e0472244e4d79b8dfb7e7474b96b7 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:50.711002 2124 catalog_manager.cc:5674] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197) does not have the latest schema for tablet 48c3872dbaee495fb80d1415b5631eaf (table default.table_bcc81e72ea324a389ebbcc6a6b4512ac [id=f63d391a9c824314bf6789cc7bbb5ffb]). Expected version 1 got 0
I20250831 19:54:50.711702 2124 catalog_manager.cc:5674] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197) does not have the latest schema for tablet 7a217324e97b43e5a7ec540e3b9f70a5 (table default.table_f5e850536e8c40ccae5b78ae7e787b7d [id=aabaa79336954b3ab0450dcff3afa7bf]). Expected version 1 got 0
I20250831 19:54:50.712097 1750 tablet_service.cc:1468] Processing CreateTablet for tablet 539e87d86bf7448c978743375bdb3a79 (DEFAULT_TABLE table=default.table_28a8f98e8e534694b9e17ec734373e90 [id=7963cab6b62d4957a18ed7af45c202c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:50.712603 1750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 539e87d86bf7448c978743375bdb3a79. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:50.713276 2118 catalog_manager.cc:6127] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: default.table_6a83a43f21484b2ba465fe72560bb53f [id=321a68b57ebf4e3a80670c3c862403f1] alter complete (version 1)
W20250831 19:54:50.714123 2118 catalog_manager.cc:5774] Failed to send AlterTable RPC for tablet 48c3872dbaee495fb80d1415b5631eaf (table default.table_bcc81e72ea324a389ebbcc6a6b4512ac [id=f63d391a9c824314bf6789cc7bbb5ffb], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 48c3872dbaee495fb80d1415b5631eaf consensus state has no leader
I20250831 19:54:50.714227 2119 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:36958 (request call id 90) took 1622 ms. Trace:
I20250831 19:54:50.714351 2119 rpcz_store.cc:276] 0831 19:54:49.091341 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:50.289830 (+1198489us) service_pool.cc:225] Handling call
0831 19:54:50.615505 (+325675us) catalog_manager.cc:2076] Acquired catalog manager lock
0831 19:54:50.615949 (+ 444us) catalog_manager.cc:2122] Created new table and tablet info
0831 19:54:50.699633 (+ 83684us) catalog_manager.cc:2148] Created new table in HMS catalog
0831 19:54:50.714020 (+ 14387us) catalog_manager.cc:2182] Wrote table and tablets to system table
0831 19:54:50.714114 (+ 94us) catalog_manager.cc:2216] Inserted table and tablets into CatalogManager maps
0831 19:54:50.714200 (+ 86us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:50.702012 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:50.702113 (+ 101us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:50.702118 (+ 5us) write_op.cc:435] Acquired schema lock
0831 19:54:50.702120 (+ 2us) tablet.cc:660] Decoding operations
0831 19:54:50.702202 (+ 82us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:50.702213 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:50.702217 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:50.702310 (+ 93us) tablet.cc:699] Row locks acquired
0831 19:54:50.702313 (+ 3us) write_op.cc:260] PREPARE: finished
0831 19:54:50.702344 (+ 31us) write_op.cc:270] Start()
0831 19:54:50.702372 (+ 28us) write_op.cc:276] Timestamp: P: 1756670090702280 usec, L: 0
0831 19:54:50.702375 (+ 3us) op_driver.cc:348] REPLICATION: starting
0831 19:54:50.702529 (+ 154us) log.cc:844] Serialized 433 byte log entry
0831 19:54:50.713309 (+ 10780us) op_driver.cc:464] REPLICATION: finished
0831 19:54:50.713561 (+ 252us) write_op.cc:301] APPLY: starting
0831 19:54:50.713578 (+ 17us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:50.713618 (+ 40us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:50.713646 (+ 28us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:50.713756 (+ 110us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:50.713788 (+ 32us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0831 19:54:50.713797 (+ 9us) write_op.cc:312] APPLY: finished
0831 19:54:50.713874 (+ 77us) log.cc:844] Serialized 29 byte log entry
0831 19:54:50.713933 (+ 59us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:50.713950 (+ 17us) write_op.cc:454] Released schema lock
0831 19:54:50.713955 (+ 5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"Hive Metastore.queue_time_us":37467,"Hive Metastore.run_cpu_time_us":246,"Hive Metastore.run_wall_time_us":45687,"child_traces":[["op",{"apply.queue_time_us":203,"num_ops":2,"prepare.queue_time_us":1849,"prepare.run_cpu_time_us":588,"prepare.run_wall_time_us":588,"replication_time_us":10908}]]}
I20250831 19:54:50.715073 2118 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_15260b732e8c4a32ab2c268a74a7dfb7" } new_table_name: "default.Table_207ac87518bc487184a89bb52cd204b3" modify_external_catalogs: true
I20250831 19:54:50.715713 2126 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_4db5965a988f4976ac4dfcb97cc013f0" } modify_external_catalogs: true
I20250831 19:54:50.715859 2126 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_4db5965a988f4976ac4dfcb97cc013f0" } modify_external_catalogs: true
I20250831 19:54:50.715039 2119 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_fd98179fb4584ad6bde229ee78f7dfde" } new_table_name: "default.Table_60746664f3ef4d82866e4bcd56d4fac5" modify_external_catalogs: true
I20250831 19:54:50.727124 1613 tablet_service.cc:1468] Processing CreateTablet for tablet 539e87d86bf7448c978743375bdb3a79 (DEFAULT_TABLE table=default.table_28a8f98e8e534694b9e17ec734373e90 [id=7963cab6b62d4957a18ed7af45c202c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:50.727521 1613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 539e87d86bf7448c978743375bdb3a79. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:50.729166 1884 tablet_service.cc:1468] Processing CreateTablet for tablet 539e87d86bf7448c978743375bdb3a79 (DEFAULT_TABLE table=default.table_28a8f98e8e534694b9e17ec734373e90 [id=7963cab6b62d4957a18ed7af45c202c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:50.729596 1884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 539e87d86bf7448c978743375bdb3a79. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:50.746862 2121 catalog_manager.cc:2149] created HMS catalog entry for table [id=fd551e0ec667492c86ff0aaed181366b]
I20250831 19:54:50.766105 2121 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:36958 (request call id 89) took 1793 ms. Trace:
I20250831 19:54:50.766290 2121 rpcz_store.cc:276] 0831 19:54:48.972551 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:50.283157 (+1310606us) service_pool.cc:225] Handling call
0831 19:54:50.616142 (+332985us) catalog_manager.cc:2076] Acquired catalog manager lock
0831 19:54:50.616521 (+ 379us) catalog_manager.cc:2122] Created new table and tablet info
0831 19:54:50.746794 (+130273us) catalog_manager.cc:2148] Created new table in HMS catalog
0831 19:54:50.765780 (+ 18986us) catalog_manager.cc:2182] Wrote table and tablets to system table
0831 19:54:50.765934 (+ 154us) catalog_manager.cc:2216] Inserted table and tablets into CatalogManager maps
0831 19:54:50.766051 (+ 117us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:50.747815 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:50.747905 (+ 90us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:50.747909 (+ 4us) write_op.cc:435] Acquired schema lock
0831 19:54:50.747911 (+ 2us) tablet.cc:660] Decoding operations
0831 19:54:50.747983 (+ 72us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:50.747992 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:50.747996 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:50.748053 (+ 57us) tablet.cc:699] Row locks acquired
0831 19:54:50.748055 (+ 2us) write_op.cc:260] PREPARE: finished
0831 19:54:50.748085 (+ 30us) write_op.cc:270] Start()
0831 19:54:50.748110 (+ 25us) write_op.cc:276] Timestamp: P: 1756670090748016 usec, L: 0
0831 19:54:50.748113 (+ 3us) op_driver.cc:348] REPLICATION: starting
0831 19:54:50.748240 (+ 127us) log.cc:844] Serialized 433 byte log entry
0831 19:54:50.758983 (+ 10743us) op_driver.cc:464] REPLICATION: finished
0831 19:54:50.764988 (+ 6005us) write_op.cc:301] APPLY: starting
0831 19:54:50.765006 (+ 18us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:50.765069 (+ 63us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:50.765102 (+ 33us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:50.765238 (+ 136us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:50.765280 (+ 42us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0831 19:54:50.765290 (+ 10us) write_op.cc:312] APPLY: finished
0831 19:54:50.765371 (+ 81us) log.cc:844] Serialized 29 byte log entry
0831 19:54:50.765656 (+ 285us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:50.765679 (+ 23us) write_op.cc:454] Released schema lock
0831 19:54:50.765688 (+ 9us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"Hive Metastore.queue_time_us":82645,"Hive Metastore.run_cpu_time_us":243,"Hive Metastore.run_wall_time_us":47197,"child_traces":[["op",{"apply.queue_time_us":5933,"num_ops":2,"prepare.queue_time_us":191,"prepare.run_cpu_time_us":505,"prepare.run_wall_time_us":506,"raft.queue_time_us":187,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":176,"replication_time_us":10823}]]}
I20250831 19:54:50.771261 1750 tablet_service.cc:1468] Processing CreateTablet for tablet 9dd77008323943ceaf515422255c8a23 (DEFAULT_TABLE table=default.table_9ef01b3dfa2640dbbd4b622e06a1da94 [id=7e12dc19746647d790e1d0c465317f0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:50.771564 1885 tablet_service.cc:1468] Processing CreateTablet for tablet 9dd77008323943ceaf515422255c8a23 (DEFAULT_TABLE table=default.table_9ef01b3dfa2640dbbd4b622e06a1da94 [id=7e12dc19746647d790e1d0c465317f0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:50.771749 1750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dd77008323943ceaf515422255c8a23. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:50.771958 1885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dd77008323943ceaf515422255c8a23. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:50.783224 2472 raft_consensus.cc:491] T 4b3babfbfe394414b944bd53377edeb0 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:50.783388 2472 raft_consensus.cc:513] T 4b3babfbfe394414b944bd53377edeb0 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:50.783991 2472 leader_election.cc:290] T 4b3babfbfe394414b944bd53377edeb0 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:50.784216 2121 catalog_manager.cc:5582] T 48c3872dbaee495fb80d1415b5631eaf P 89aa85d59c53436ebdf3074b13d14825 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193). New cstate: current_term: 1 leader_uuid: "89aa85d59c53436ebdf3074b13d14825" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: HEALTHY } } }
I20250831 19:54:50.784672 1632 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4b3babfbfe394414b944bd53377edeb0" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:50.784938 1632 raft_consensus.cc:2466] T 4b3babfbfe394414b944bd53377edeb0 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 0.
I20250831 19:54:50.784940 2121 catalog_manager.cc:5674] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197) does not have the latest schema for tablet 48c3872dbaee495fb80d1415b5631eaf (table default.table_bcc81e72ea324a389ebbcc6a6b4512ac [id=f63d391a9c824314bf6789cc7bbb5ffb]). Expected version 1 got 0
I20250831 19:54:50.785588 1904 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4b3babfbfe394414b944bd53377edeb0" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:50.785836 1904 raft_consensus.cc:2466] T 4b3babfbfe394414b944bd53377edeb0 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 0.
I20250831 19:54:50.786365 1705 leader_election.cc:304] T 4b3babfbfe394414b944bd53377edeb0 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:50.787762 1632 raft_consensus.cc:1273] T 7a217324e97b43e5a7ec540e3b9f70a5 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Refusing update from remote peer 2441fafe1d62429386f4631ad423567d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250831 19:54:50.787799 1772 raft_consensus.cc:1273] T 7a217324e97b43e5a7ec540e3b9f70a5 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Refusing update from remote peer 2441fafe1d62429386f4631ad423567d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250831 19:54:50.788791 2758 consensus_queue.cc:1035] T 7a217324e97b43e5a7ec540e3b9f70a5 P 2441fafe1d62429386f4631ad423567d [LEADER]: Connected to new peer: Peer: permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:50.790225 2445 raft_consensus.cc:2802] T 4b3babfbfe394414b944bd53377edeb0 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:50.790344 2445 raft_consensus.cc:491] T 4b3babfbfe394414b944bd53377edeb0 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:50.790421 2445 raft_consensus.cc:3058] T 4b3babfbfe394414b944bd53377edeb0 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:50.792956 2445 raft_consensus.cc:513] T 4b3babfbfe394414b944bd53377edeb0 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:50.795193 2758 consensus_queue.cc:1035] T 7a217324e97b43e5a7ec540e3b9f70a5 P 2441fafe1d62429386f4631ad423567d [LEADER]: Connected to new peer: Peer: permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:50.798010 1904 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4b3babfbfe394414b944bd53377edeb0" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:54:50.798197 1904 raft_consensus.cc:3058] T 4b3babfbfe394414b944bd53377edeb0 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:50.801311 1904 raft_consensus.cc:2466] T 4b3babfbfe394414b944bd53377edeb0 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:54:50.802052 1705 leader_election.cc:304] T 4b3babfbfe394414b944bd53377edeb0 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:50.802347 2584 raft_consensus.cc:2802] T 4b3babfbfe394414b944bd53377edeb0 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:50.803005 2584 raft_consensus.cc:695] T 4b3babfbfe394414b944bd53377edeb0 P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: Becoming Leader. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Running, Role: LEADER
I20250831 19:54:50.803287 2584 consensus_queue.cc:237] T 4b3babfbfe394414b944bd53377edeb0 P de831f40fa1348a48a1f0260f4130197 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:50.804386 2117 catalog_manager.cc:2149] created HMS catalog entry for table [id=f1801f35410d4e529900aa8dd86e1983]
I20250831 19:54:50.811276 2761 tablet.cc:1722] T 7a217324e97b43e5a7ec540e3b9f70a5 P 2441fafe1d62429386f4631ad423567d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:50.811524 2723 tablet.cc:1722] T 7a217324e97b43e5a7ec540e3b9f70a5 P de831f40fa1348a48a1f0260f4130197: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:50.814659 2472 consensus_queue.cc:1035] T 3d3be834ca8642c584da4265819c14ab P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:50.822894 1632 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4b3babfbfe394414b944bd53377edeb0" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:54:50.823062 1632 raft_consensus.cc:3058] T 4b3babfbfe394414b944bd53377edeb0 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:50.826818 1632 raft_consensus.cc:2466] T 4b3babfbfe394414b944bd53377edeb0 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:54:50.828167 2445 leader_election.cc:290] T 4b3babfbfe394414b944bd53377edeb0 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Requested vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:50.832190 2445 consensus_queue.cc:1035] T 3d3be834ca8642c584da4265819c14ab P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:50.844074 2117 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:36958 (request call id 86) took 2024 ms. Trace:
I20250831 19:54:50.844197 2117 rpcz_store.cc:276] 0831 19:54:48.819727 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:50.114097 (+1294370us) service_pool.cc:225] Handling call
0831 19:54:50.616750 (+502653us) catalog_manager.cc:2076] Acquired catalog manager lock
0831 19:54:50.617161 (+ 411us) catalog_manager.cc:2122] Created new table and tablet info
0831 19:54:50.804357 (+187196us) catalog_manager.cc:2148] Created new table in HMS catalog
0831 19:54:50.843729 (+ 39372us) catalog_manager.cc:2182] Wrote table and tablets to system table
0831 19:54:50.843884 (+ 155us) catalog_manager.cc:2216] Inserted table and tablets into CatalogManager maps
0831 19:54:50.844004 (+ 120us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:50.812375 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:50.812512 (+ 137us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:50.812537 (+ 25us) write_op.cc:435] Acquired schema lock
0831 19:54:50.812552 (+ 15us) tablet.cc:660] Decoding operations
0831 19:54:50.812683 (+ 131us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:50.812699 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:50.812706 (+ 7us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:50.812790 (+ 84us) tablet.cc:699] Row locks acquired
0831 19:54:50.812792 (+ 2us) write_op.cc:260] PREPARE: finished
0831 19:54:50.812823 (+ 31us) write_op.cc:270] Start()
0831 19:54:50.812851 (+ 28us) write_op.cc:276] Timestamp: P: 1756670090812804 usec, L: 0
0831 19:54:50.812854 (+ 3us) op_driver.cc:348] REPLICATION: starting
0831 19:54:50.813030 (+ 176us) log.cc:844] Serialized 433 byte log entry
0831 19:54:50.840450 (+ 27420us) op_driver.cc:464] REPLICATION: finished
0831 19:54:50.842939 (+ 2489us) write_op.cc:301] APPLY: starting
0831 19:54:50.842960 (+ 21us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:50.843011 (+ 51us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:50.843058 (+ 47us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:50.843183 (+ 125us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:50.843232 (+ 49us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0831 19:54:50.843242 (+ 10us) write_op.cc:312] APPLY: finished
0831 19:54:50.843330 (+ 88us) log.cc:844] Serialized 29 byte log entry
0831 19:54:50.843603 (+ 273us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:50.843626 (+ 23us) write_op.cc:454] Released schema lock
0831 19:54:50.843635 (+ 9us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"Hive Metastore.queue_time_us":129256,"Hive Metastore.run_cpu_time_us":269,"Hive Metastore.run_wall_time_us":57621,"child_traces":[["op",{"apply.queue_time_us":2413,"num_ops":2,"prepare.queue_time_us":7453,"prepare.run_cpu_time_us":748,"prepare.run_wall_time_us":747,"raft.queue_time_us":24010,"raft.run_cpu_time_us":322,"raft.run_wall_time_us":738,"replication_time_us":27558}]]}
I20250831 19:54:50.848840 2117 catalog_manager.cc:5674] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475) does not have the latest schema for tablet 7a217324e97b43e5a7ec540e3b9f70a5 (table default.table_f5e850536e8c40ccae5b78ae7e787b7d [id=aabaa79336954b3ab0450dcff3afa7bf]). Expected version 1 got 0
I20250831 19:54:50.857098 2121 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_2b373bd597c54990856bf4882d180dcd" } modify_external_catalogs: true
I20250831 19:54:50.857403 2121 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_2b373bd597c54990856bf4882d180dcd" } modify_external_catalogs: true
I20250831 19:54:50.868350 2117 catalog_manager.cc:6127] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: default.table_f5e850536e8c40ccae5b78ae7e787b7d [id=aabaa79336954b3ab0450dcff3afa7bf] alter complete (version 1)
I20250831 19:54:50.868525 2122 catalog_manager.cc:2149] created HMS catalog entry for table [id=29bd77e83ad04288b3edceffb562bd03]
I20250831 19:54:50.876725 2122 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:36958 (request call id 88) took 2012 ms. Trace:
I20250831 19:54:50.876868 2122 rpcz_store.cc:276] 0831 19:54:48.863974 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:50.214045 (+1350071us) service_pool.cc:225] Handling call
0831 19:54:50.617269 (+403224us) catalog_manager.cc:2076] Acquired catalog manager lock
0831 19:54:50.617664 (+ 395us) catalog_manager.cc:2122] Created new table and tablet info
0831 19:54:50.868485 (+250821us) catalog_manager.cc:2148] Created new table in HMS catalog
0831 19:54:50.876424 (+ 7939us) catalog_manager.cc:2182] Wrote table and tablets to system table
0831 19:54:50.876551 (+ 127us) catalog_manager.cc:2216] Inserted table and tablets into CatalogManager maps
0831 19:54:50.876653 (+ 102us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:50.869314 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:50.869468 (+ 154us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:50.869475 (+ 7us) write_op.cc:435] Acquired schema lock
0831 19:54:50.869479 (+ 4us) tablet.cc:660] Decoding operations
0831 19:54:50.869596 (+ 117us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:50.869610 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:50.869616 (+ 6us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:50.869702 (+ 86us) tablet.cc:699] Row locks acquired
0831 19:54:50.869705 (+ 3us) write_op.cc:260] PREPARE: finished
0831 19:54:50.869738 (+ 33us) write_op.cc:270] Start()
0831 19:54:50.869779 (+ 41us) write_op.cc:276] Timestamp: P: 1756670090869712 usec, L: 0
0831 19:54:50.869784 (+ 5us) op_driver.cc:348] REPLICATION: starting
0831 19:54:50.869956 (+ 172us) log.cc:844] Serialized 433 byte log entry
0831 19:54:50.875067 (+ 5111us) op_driver.cc:464] REPLICATION: finished
0831 19:54:50.875722 (+ 655us) write_op.cc:301] APPLY: starting
0831 19:54:50.875739 (+ 17us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:50.875788 (+ 49us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:50.875837 (+ 49us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:50.875954 (+ 117us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:50.875994 (+ 40us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0831 19:54:50.876004 (+ 10us) write_op.cc:312] APPLY: finished
0831 19:54:50.876080 (+ 76us) log.cc:844] Serialized 29 byte log entry
0831 19:54:50.876311 (+ 231us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:50.876333 (+ 22us) write_op.cc:454] Released schema lock
0831 19:54:50.876340 (+ 7us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"Hive Metastore.queue_time_us":186405,"Hive Metastore.run_cpu_time_us":240,"Hive Metastore.run_wall_time_us":64021,"child_traces":[["op",{"apply.queue_time_us":594,"num_ops":2,"prepare.queue_time_us":131,"prepare.run_cpu_time_us":739,"prepare.run_wall_time_us":740,"raft.queue_time_us":137,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":434,"replication_time_us":5251}]]}
I20250831 19:54:50.877892 2122 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_8adc00cc53274835bfe463ebf3bd3f45" } new_table_name: "default.Table_be31f59f9d014d278544a1c9deb8a41a" modify_external_catalogs: true
I20250831 19:54:50.885007 2124 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_a01df8e629084e9c988bca1b80c7d640" } modify_external_catalogs: true
I20250831 19:54:50.886157 2124 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_a01df8e629084e9c988bca1b80c7d640" } modify_external_catalogs: true
I20250831 19:54:50.886512 1613 tablet_service.cc:1468] Processing CreateTablet for tablet 9dd77008323943ceaf515422255c8a23 (DEFAULT_TABLE table=default.table_9ef01b3dfa2640dbbd4b622e06a1da94 [id=7e12dc19746647d790e1d0c465317f0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:50.886909 1613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dd77008323943ceaf515422255c8a23. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:50.887928 2117 master_service.cc:948] ReplaceTablet: received request to replace tablet 07a9cd92870045a7a3e5a8b007bf7f47 from {username='slave'} at 127.0.0.1:36958
I20250831 19:54:50.893363 1772 raft_consensus.cc:1273] T 48c3872dbaee495fb80d1415b5631eaf P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Refusing update from remote peer 89aa85d59c53436ebdf3074b13d14825: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250831 19:54:50.893915 1904 raft_consensus.cc:3058] T 48c3872dbaee495fb80d1415b5631eaf P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:50.894884 2699 tablet_bootstrap.cc:492] T b67e0472244e4d79b8dfb7e7474b96b7 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:50.895236 2699 ts_tablet_manager.cc:1397] T b67e0472244e4d79b8dfb7e7474b96b7 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.191s user 0.005s sys 0.005s
I20250831 19:54:50.896687 1904 raft_consensus.cc:1273] T 48c3872dbaee495fb80d1415b5631eaf P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Refusing update from remote peer 89aa85d59c53436ebdf3074b13d14825: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250831 19:54:50.899185 2654 consensus_queue.cc:1035] T 48c3872dbaee495fb80d1415b5631eaf P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:50.900913 2654 consensus_queue.cc:1035] T 48c3872dbaee495fb80d1415b5631eaf P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:50.902518 2282 tablet_bootstrap.cc:492] T b67e0472244e4d79b8dfb7e7474b96b7 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:50.902731 2282 ts_tablet_manager.cc:1397] T b67e0472244e4d79b8dfb7e7474b96b7 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.196s user 0.012s sys 0.046s
I20250831 19:54:50.903589 2282 raft_consensus.cc:357] T b67e0472244e4d79b8dfb7e7474b96b7 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:50.903872 2282 raft_consensus.cc:383] T b67e0472244e4d79b8dfb7e7474b96b7 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:50.903985 2282 raft_consensus.cc:738] T b67e0472244e4d79b8dfb7e7474b96b7 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:50.904299 2282 consensus_queue.cc:260] T b67e0472244e4d79b8dfb7e7474b96b7 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:50.904888 2282 ts_tablet_manager.cc:1428] T b67e0472244e4d79b8dfb7e7474b96b7 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250831 19:54:50.905190 2282 tablet_bootstrap.cc:492] T 539e87d86bf7448c978743375bdb3a79 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:50.906922 2282 tablet_bootstrap.cc:654] T 539e87d86bf7448c978743375bdb3a79 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:50.911005 2724 tablet.cc:1722] T 7a217324e97b43e5a7ec540e3b9f70a5 P 89aa85d59c53436ebdf3074b13d14825: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:50.913318 2699 raft_consensus.cc:357] T b67e0472244e4d79b8dfb7e7474b96b7 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:50.914614 2699 raft_consensus.cc:383] T b67e0472244e4d79b8dfb7e7474b96b7 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:50.916484 2699 raft_consensus.cc:738] T b67e0472244e4d79b8dfb7e7474b96b7 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:50.916960 2699 consensus_queue.cc:260] T b67e0472244e4d79b8dfb7e7474b96b7 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:50.917868 2699 ts_tablet_manager.cc:1428] T b67e0472244e4d79b8dfb7e7474b96b7 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.023s user 0.002s sys 0.000s
I20250831 19:54:50.918660 2699 tablet_bootstrap.cc:492] T 9dd77008323943ceaf515422255c8a23 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:50.919952 2123 catalog_manager.cc:2149] created HMS catalog entry for table [id=67d77a3f228b4f1da86b97cac2fc4aac]
I20250831 19:54:50.924117 2699 tablet_bootstrap.cc:654] T 9dd77008323943ceaf515422255c8a23 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:50.929054 1884 tablet_service.cc:1468] Processing CreateTablet for tablet 920c6fcdf1a44d07b132de6a08b3cbf8 (DEFAULT_TABLE table=default.table_692b305d0d9a402dbff897ae3fea5186 [id=f1801f35410d4e529900aa8dd86e1983]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:50.931033 1750 tablet_service.cc:1468] Processing CreateTablet for tablet 920c6fcdf1a44d07b132de6a08b3cbf8 (DEFAULT_TABLE table=default.table_692b305d0d9a402dbff897ae3fea5186 [id=f1801f35410d4e529900aa8dd86e1983]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:50.931514 1750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 920c6fcdf1a44d07b132de6a08b3cbf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:50.934078 1614 tablet_service.cc:1468] Processing CreateTablet for tablet 75a6a340faad4e46924b79adc8bcb867 (DEFAULT_TABLE table=default.table_e3057132cbc4426e9fc52d84d5189d01 [id=29bd77e83ad04288b3edceffb562bd03]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:50.934155 1885 tablet_service.cc:1468] Processing CreateTablet for tablet 75a6a340faad4e46924b79adc8bcb867 (DEFAULT_TABLE table=default.table_e3057132cbc4426e9fc52d84d5189d01 [id=29bd77e83ad04288b3edceffb562bd03]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:50.934490 1614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75a6a340faad4e46924b79adc8bcb867. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:50.934880 2724 tablet.cc:1722] T 48c3872dbaee495fb80d1415b5631eaf P 89aa85d59c53436ebdf3074b13d14825: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:50.936309 1886 tablet_service.cc:1468] Processing CreateTablet for tablet cb21c47c27ea4f34801e93bd647e41b5 (DEFAULT_TABLE table=default.table_ea8910dd3df74137a9832974c833f71e [id=fd551e0ec667492c86ff0aaed181366b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:50.937755 1752 tablet_service.cc:1468] Processing CreateTablet for tablet 75a6a340faad4e46924b79adc8bcb867 (DEFAULT_TABLE table=default.table_e3057132cbc4426e9fc52d84d5189d01 [id=29bd77e83ad04288b3edceffb562bd03]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:50.938069 1752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75a6a340faad4e46924b79adc8bcb867. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:50.943712 1884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 920c6fcdf1a44d07b132de6a08b3cbf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:50.943897 2123 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:36958 (request call id 91) took 1686 ms. Trace:
I20250831 19:54:50.944046 1885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75a6a340faad4e46924b79adc8bcb867. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:50.944300 1886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb21c47c27ea4f34801e93bd647e41b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:50.944015 2123 rpcz_store.cc:276] 0831 19:54:49.257068 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:50.597907 (+1340839us) service_pool.cc:225] Handling call
0831 19:54:50.617811 (+ 19904us) catalog_manager.cc:2076] Acquired catalog manager lock
0831 19:54:50.618214 (+ 403us) catalog_manager.cc:2122] Created new table and tablet info
0831 19:54:50.919915 (+301701us) catalog_manager.cc:2148] Created new table in HMS catalog
0831 19:54:50.943635 (+ 23720us) catalog_manager.cc:2182] Wrote table and tablets to system table
0831 19:54:50.943742 (+ 107us) catalog_manager.cc:2216] Inserted table and tablets into CatalogManager maps
0831 19:54:50.943833 (+ 91us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:50.920683 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:50.920790 (+ 107us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:50.920795 (+ 5us) write_op.cc:435] Acquired schema lock
0831 19:54:50.920798 (+ 3us) tablet.cc:660] Decoding operations
0831 19:54:50.920885 (+ 87us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:50.920895 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:50.920899 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:50.920966 (+ 67us) tablet.cc:699] Row locks acquired
0831 19:54:50.920968 (+ 2us) write_op.cc:260] PREPARE: finished
0831 19:54:50.921003 (+ 35us) write_op.cc:270] Start()
0831 19:54:50.921034 (+ 31us) write_op.cc:276] Timestamp: P: 1756670090920970 usec, L: 0
0831 19:54:50.921037 (+ 3us) op_driver.cc:348] REPLICATION: starting
0831 19:54:50.921211 (+ 174us) log.cc:844] Serialized 433 byte log entry
0831 19:54:50.942952 (+ 21741us) op_driver.cc:464] REPLICATION: finished
0831 19:54:50.943108 (+ 156us) write_op.cc:301] APPLY: starting
0831 19:54:50.943124 (+ 16us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:50.943165 (+ 41us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:50.943203 (+ 38us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:50.943318 (+ 115us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:50.943352 (+ 34us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0831 19:54:50.943360 (+ 8us) write_op.cc:312] APPLY: finished
0831 19:54:50.943433 (+ 73us) log.cc:844] Serialized 29 byte log entry
0831 19:54:50.943498 (+ 65us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:50.943517 (+ 19us) write_op.cc:454] Released schema lock
0831 19:54:50.943524 (+ 7us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"Hive Metastore.queue_time_us":249921,"Hive Metastore.run_cpu_time_us":306,"Hive Metastore.run_wall_time_us":51572,"child_traces":[["op",{"apply.queue_time_us":63,"apply.run_cpu_time_us":490,"apply.run_wall_time_us":489,"num_ops":2,"prepare.queue_time_us":173,"prepare.run_cpu_time_us":607,"prepare.run_wall_time_us":607,"replication_time_us":21880}]]}
I20250831 19:54:50.952988 2117 catalog_manager.cc:5869] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Sending DeleteTablet for 3 replicas of tablet 07a9cd92870045a7a3e5a8b007bf7f47
I20250831 19:54:50.953588 2117 catalog_manager.cc:6652] ReplaceTablet: tablet 07a9cd92870045a7a3e5a8b007bf7f47 deleted and replaced by tablet 05cda604dad041cfaad94d1b43d6b14d
I20250831 19:54:50.953711 1886 tablet_service.cc:1515] Processing DeleteTablet for tablet 07a9cd92870045a7a3e5a8b007bf7f47 with delete_type TABLET_DATA_DELETED (replaced by tablet 05cda604dad041cfaad94d1b43d6b14d) from {username='slave'} at 127.0.0.1:45906
I20250831 19:54:50.953883 1751 tablet_service.cc:1515] Processing DeleteTablet for tablet 07a9cd92870045a7a3e5a8b007bf7f47 with delete_type TABLET_DATA_DELETED (replaced by tablet 05cda604dad041cfaad94d1b43d6b14d) from {username='slave'} at 127.0.0.1:50674
I20250831 19:54:50.954003 1612 tablet_service.cc:1515] Processing DeleteTablet for tablet 07a9cd92870045a7a3e5a8b007bf7f47 with delete_type TABLET_DATA_DELETED (replaced by tablet 05cda604dad041cfaad94d1b43d6b14d) from {username='slave'} at 127.0.0.1:51022
I20250831 19:54:50.954130 2714 tablet_replica.cc:331] T 07a9cd92870045a7a3e5a8b007bf7f47 P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:54:50.954222 2715 tablet_replica.cc:331] T 07a9cd92870045a7a3e5a8b007bf7f47 P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:54:50.954340 2714 raft_consensus.cc:2241] T 07a9cd92870045a7a3e5a8b007bf7f47 P 2441fafe1d62429386f4631ad423567d [term 1 LEADER]: Raft consensus shutting down.
I20250831 19:54:50.954417 2715 raft_consensus.cc:2241] T 07a9cd92870045a7a3e5a8b007bf7f47 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:50.954593 2715 raft_consensus.cc:2270] T 07a9cd92870045a7a3e5a8b007bf7f47 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:50.954660 2714 raft_consensus.cc:2270] T 07a9cd92870045a7a3e5a8b007bf7f47 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:50.954850 2713 tablet_replica.cc:331] T 07a9cd92870045a7a3e5a8b007bf7f47 P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:54:50.955075 2713 raft_consensus.cc:2241] T 07a9cd92870045a7a3e5a8b007bf7f47 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:50.955242 2713 raft_consensus.cc:2270] T 07a9cd92870045a7a3e5a8b007bf7f47 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:50.955298 2714 ts_tablet_manager.cc:1905] T 07a9cd92870045a7a3e5a8b007bf7f47 P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:50.955457 2715 ts_tablet_manager.cc:1905] T 07a9cd92870045a7a3e5a8b007bf7f47 P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:50.956904 2713 ts_tablet_manager.cc:1905] T 07a9cd92870045a7a3e5a8b007bf7f47 P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:50.961108 2714 ts_tablet_manager.cc:1918] T 07a9cd92870045a7a3e5a8b007bf7f47 P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20250831 19:54:50.962073 2714 log.cc:1199] T 07a9cd92870045a7a3e5a8b007bf7f47 P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/07a9cd92870045a7a3e5a8b007bf7f47
I20250831 19:54:50.963133 2713 ts_tablet_manager.cc:1918] T 07a9cd92870045a7a3e5a8b007bf7f47 P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20250831 19:54:50.963258 2713 log.cc:1199] T 07a9cd92870045a7a3e5a8b007bf7f47 P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/07a9cd92870045a7a3e5a8b007bf7f47
I20250831 19:54:50.963624 2713 ts_tablet_manager.cc:1939] T 07a9cd92870045a7a3e5a8b007bf7f47 P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
I20250831 19:54:50.964597 2105 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet 07a9cd92870045a7a3e5a8b007bf7f47 (table default.table_6c2f9309b58643529114857aae0568f2 [id=ad7bb166843e423ea7e50a1d18710fa1]) successfully deleted
I20250831 19:54:50.965641 2284 tablet_bootstrap.cc:492] T b67e0472244e4d79b8dfb7e7474b96b7 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:50.965785 2284 ts_tablet_manager.cc:1397] T b67e0472244e4d79b8dfb7e7474b96b7 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.262s user 0.035s sys 0.112s
I20250831 19:54:50.966496 2284 raft_consensus.cc:357] T b67e0472244e4d79b8dfb7e7474b96b7 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:50.966588 2123 catalog_manager.cc:5674] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197) does not have the latest schema for tablet 7a217324e97b43e5a7ec540e3b9f70a5 (table default.table_f5e850536e8c40ccae5b78ae7e787b7d [id=aabaa79336954b3ab0450dcff3afa7bf]). Expected version 1 got 0
I20250831 19:54:50.966696 2284 raft_consensus.cc:383] T b67e0472244e4d79b8dfb7e7474b96b7 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:50.966759 2284 raft_consensus.cc:738] T b67e0472244e4d79b8dfb7e7474b96b7 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:50.966980 2284 consensus_queue.cc:260] T b67e0472244e4d79b8dfb7e7474b96b7 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:50.967478 2284 ts_tablet_manager.cc:1428] T b67e0472244e4d79b8dfb7e7474b96b7 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20250831 19:54:50.967811 2284 tablet_bootstrap.cc:492] T 539e87d86bf7448c978743375bdb3a79 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:50.969295 2284 tablet_bootstrap.cc:654] T 539e87d86bf7448c978743375bdb3a79 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:50.970393 2123 master_service.cc:948] ReplaceTablet: received request to replace tablet f318ccc4400f4830b6a80e27b002b562 from {username='slave'} at 127.0.0.1:36958
I20250831 19:54:50.972693 1612 tablet_service.cc:1468] Processing CreateTablet for tablet cb21c47c27ea4f34801e93bd647e41b5 (DEFAULT_TABLE table=default.table_ea8910dd3df74137a9832974c833f71e [id=fd551e0ec667492c86ff0aaed181366b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:50.973084 1612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb21c47c27ea4f34801e93bd647e41b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:50.980006 2715 ts_tablet_manager.cc:1918] T 07a9cd92870045a7a3e5a8b007bf7f47 P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20250831 19:54:50.989764 1751 tablet_service.cc:1468] Processing CreateTablet for tablet cb21c47c27ea4f34801e93bd647e41b5 (DEFAULT_TABLE table=default.table_ea8910dd3df74137a9832974c833f71e [id=fd551e0ec667492c86ff0aaed181366b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:50.993772 2714 ts_tablet_manager.cc:1939] T 07a9cd92870045a7a3e5a8b007bf7f47 P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:54:50.985776 1886 tablet_service.cc:1468] Processing CreateTablet for tablet 05cda604dad041cfaad94d1b43d6b14d (DEFAULT_TABLE table=default.table_6c2f9309b58643529114857aae0568f2 [id=ad7bb166843e423ea7e50a1d18710fa1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:50.994170 1886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05cda604dad041cfaad94d1b43d6b14d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:50.994652 2101 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet 07a9cd92870045a7a3e5a8b007bf7f47 (table default.table_6c2f9309b58643529114857aae0568f2 [id=ad7bb166843e423ea7e50a1d18710fa1]) successfully deleted
I20250831 19:54:50.988206 1885 tablet_service.cc:1468] Processing CreateTablet for tablet 2c03497e3cb4480d88d99dde5d6ea22b (DEFAULT_TABLE table=default.table_265519e91af542d1836f224e15cd5e60 [id=67d77a3f228b4f1da86b97cac2fc4aac]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:50.990134 2761 tablet.cc:1722] T 48c3872dbaee495fb80d1415b5631eaf P 2441fafe1d62429386f4631ad423567d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:51.001021 1885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c03497e3cb4480d88d99dde5d6ea22b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:51.005127 2715 log.cc:1199] T 07a9cd92870045a7a3e5a8b007bf7f47 P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/07a9cd92870045a7a3e5a8b007bf7f47
I20250831 19:54:51.005592 2715 ts_tablet_manager.cc:1939] T 07a9cd92870045a7a3e5a8b007bf7f47 P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
I20250831 19:54:51.006034 2117 catalog_manager.cc:5582] T 4b3babfbfe394414b944bd53377edeb0 P de831f40fa1348a48a1f0260f4130197 reported cstate change: term changed from 0 to 1, leader changed from <none> to de831f40fa1348a48a1f0260f4130197 (127.1.1.194). New cstate: current_term: 1 leader_uuid: "de831f40fa1348a48a1f0260f4130197" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: UNKNOWN } } }
I20250831 19:54:50.990248 1611 tablet_service.cc:1468] Processing CreateTablet for tablet 2c03497e3cb4480d88d99dde5d6ea22b (DEFAULT_TABLE table=default.table_265519e91af542d1836f224e15cd5e60 [id=67d77a3f228b4f1da86b97cac2fc4aac]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:51.007398 1611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c03497e3cb4480d88d99dde5d6ea22b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:50.993342 1612 tablet_service.cc:1468] Processing CreateTablet for tablet 05cda604dad041cfaad94d1b43d6b14d (DEFAULT_TABLE table=default.table_6c2f9309b58643529114857aae0568f2 [id=ad7bb166843e423ea7e50a1d18710fa1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:51.013564 1612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05cda604dad041cfaad94d1b43d6b14d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:51.014555 2282 tablet_bootstrap.cc:492] T 539e87d86bf7448c978743375bdb3a79 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:51.014719 2282 ts_tablet_manager.cc:1397] T 539e87d86bf7448c978743375bdb3a79 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.110s user 0.006s sys 0.016s
I20250831 19:54:50.985827 1613 tablet_service.cc:1468] Processing CreateTablet for tablet 920c6fcdf1a44d07b132de6a08b3cbf8 (DEFAULT_TABLE table=default.table_692b305d0d9a402dbff897ae3fea5186 [id=f1801f35410d4e529900aa8dd86e1983]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:51.015107 1613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 920c6fcdf1a44d07b132de6a08b3cbf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:51.015457 2282 raft_consensus.cc:357] T 539e87d86bf7448c978743375bdb3a79 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.015661 2282 raft_consensus.cc:383] T 539e87d86bf7448c978743375bdb3a79 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:51.016336 2282 raft_consensus.cc:738] T 539e87d86bf7448c978743375bdb3a79 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:51.016600 2282 consensus_queue.cc:260] T 539e87d86bf7448c978743375bdb3a79 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.017149 2282 ts_tablet_manager.cc:1428] T 539e87d86bf7448c978743375bdb3a79 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.002s user 0.001s sys 0.002s
I20250831 19:54:51.017391 2282 tablet_bootstrap.cc:492] T 9dd77008323943ceaf515422255c8a23 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:51.018105 1748 tablet_service.cc:1468] Processing CreateTablet for tablet 2c03497e3cb4480d88d99dde5d6ea22b (DEFAULT_TABLE table=default.table_265519e91af542d1836f224e15cd5e60 [id=67d77a3f228b4f1da86b97cac2fc4aac]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:51.019022 1751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb21c47c27ea4f34801e93bd647e41b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:51.019785 1749 tablet_service.cc:1468] Processing CreateTablet for tablet 05cda604dad041cfaad94d1b43d6b14d (DEFAULT_TABLE table=default.table_6c2f9309b58643529114857aae0568f2 [id=ad7bb166843e423ea7e50a1d18710fa1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:51.021135 1748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c03497e3cb4480d88d99dde5d6ea22b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:51.006860 2117 catalog_manager.cc:5674] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475) does not have the latest schema for tablet 4b3babfbfe394414b944bd53377edeb0 (table default.table_fd98179fb4584ad6bde229ee78f7dfde [id=0850f2b0e9324dd0a210fa7b2609c769]). Expected version 3 got 0
I20250831 19:54:51.018462 2104 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet 07a9cd92870045a7a3e5a8b007bf7f47 (table default.table_6c2f9309b58643529114857aae0568f2 [id=ad7bb166843e423ea7e50a1d18710fa1]) successfully deleted
I20250831 19:54:51.022974 2125 catalog_manager.cc:2149] created HMS catalog entry for table [id=ee93396a22b546038473cc2df15fdc87]
I20250831 19:54:51.025056 1749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05cda604dad041cfaad94d1b43d6b14d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:51.013413 2123 catalog_manager.cc:5869] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Sending DeleteTablet for 3 replicas of tablet f318ccc4400f4830b6a80e27b002b562
I20250831 19:54:51.029688 2123 catalog_manager.cc:6652] ReplaceTablet: tablet f318ccc4400f4830b6a80e27b002b562 deleted and replaced by tablet 7dbfbe9b2b024f699c52046e09aa3301
I20250831 19:54:51.030440 2125 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:36958 (request call id 92) took 1175 ms. Trace:
I20250831 19:54:51.030576 1611 tablet_service.cc:1515] Processing DeleteTablet for tablet f318ccc4400f4830b6a80e27b002b562 with delete_type TABLET_DATA_DELETED (replaced by tablet 7dbfbe9b2b024f699c52046e09aa3301) from {username='slave'} at 127.0.0.1:51022
I20250831 19:54:51.030535 2125 rpcz_store.cc:276] 0831 19:54:49.854605 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:50.605282 (+750677us) service_pool.cc:225] Handling call
0831 19:54:50.623372 (+ 18090us) catalog_manager.cc:2076] Acquired catalog manager lock
0831 19:54:50.623774 (+ 402us) catalog_manager.cc:2122] Created new table and tablet info
0831 19:54:51.022951 (+399177us) catalog_manager.cc:2148] Created new table in HMS catalog
0831 19:54:51.030218 (+ 7267us) catalog_manager.cc:2182] Wrote table and tablets to system table
0831 19:54:51.030312 (+ 94us) catalog_manager.cc:2216] Inserted table and tablets into CatalogManager maps
0831 19:54:51.030386 (+ 74us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:51.024660 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:51.024753 (+ 93us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:51.024758 (+ 5us) write_op.cc:435] Acquired schema lock
0831 19:54:51.024760 (+ 2us) tablet.cc:660] Decoding operations
0831 19:54:51.024843 (+ 83us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:51.024855 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:51.024860 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:51.024923 (+ 63us) tablet.cc:699] Row locks acquired
0831 19:54:51.024925 (+ 2us) write_op.cc:260] PREPARE: finished
0831 19:54:51.024952 (+ 27us) write_op.cc:270] Start()
0831 19:54:51.024979 (+ 27us) write_op.cc:276] Timestamp: P: 1756670091024913 usec, L: 0
0831 19:54:51.024983 (+ 4us) op_driver.cc:348] REPLICATION: starting
0831 19:54:51.025134 (+ 151us) log.cc:844] Serialized 433 byte log entry
0831 19:54:51.028588 (+ 3454us) op_driver.cc:464] REPLICATION: finished
0831 19:54:51.028666 (+ 78us) write_op.cc:301] APPLY: starting
0831 19:54:51.028690 (+ 24us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:51.028727 (+ 37us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:51.028768 (+ 41us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:51.028880 (+ 112us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:51.028910 (+ 30us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0831 19:54:51.028916 (+ 6us) write_op.cc:312] APPLY: finished
0831 19:54:51.028980 (+ 64us) log.cc:844] Serialized 29 byte log entry
0831 19:54:51.029032 (+ 52us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:51.029048 (+ 16us) write_op.cc:454] Released schema lock
0831 19:54:51.029054 (+ 6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"Hive Metastore.queue_time_us":295976,"Hive Metastore.run_cpu_time_us":283,"Hive Metastore.run_wall_time_us":102943,"child_traces":[["op",{"apply.queue_time_us":32,"apply.run_cpu_time_us":439,"apply.run_wall_time_us":440,"num_ops":2,"prepare.queue_time_us":130,"prepare.run_cpu_time_us":588,"prepare.run_wall_time_us":2595,"raft.queue_time_us":399,"raft.run_cpu_time_us":513,"raft.run_wall_time_us":513,"replication_time_us":3580,"spinlock_wait_cycles":7552}]]}
I20250831 19:54:51.031186 2125 master_service.cc:948] ReplaceTablet: received request to replace tablet f94f30794d6143b1877dd45e589cfe76 from {username='slave'} at 127.0.0.1:36958
I20250831 19:54:51.032123 1885 tablet_service.cc:1515] Processing DeleteTablet for tablet f318ccc4400f4830b6a80e27b002b562 with delete_type TABLET_DATA_DELETED (replaced by tablet 7dbfbe9b2b024f699c52046e09aa3301) from {username='slave'} at 127.0.0.1:45906
I20250831 19:54:51.032377 2715 tablet_replica.cc:331] T f318ccc4400f4830b6a80e27b002b562 P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:54:51.033794 2715 raft_consensus.cc:2241] T f318ccc4400f4830b6a80e27b002b562 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:51.033927 2714 tablet_replica.cc:331] T f318ccc4400f4830b6a80e27b002b562 P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:54:51.034129 2714 raft_consensus.cc:2241] T f318ccc4400f4830b6a80e27b002b562 P 2441fafe1d62429386f4631ad423567d [term 1 LEADER]: Raft consensus shutting down.
I20250831 19:54:51.034502 2715 raft_consensus.cc:2270] T f318ccc4400f4830b6a80e27b002b562 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:51.034993 2714 raft_consensus.cc:2270] T f318ccc4400f4830b6a80e27b002b562 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:51.032557 2282 tablet_bootstrap.cc:654] T 9dd77008323943ceaf515422255c8a23 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:51.035526 2714 ts_tablet_manager.cc:1905] T f318ccc4400f4830b6a80e27b002b562 P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:51.036177 2715 ts_tablet_manager.cc:1905] T f318ccc4400f4830b6a80e27b002b562 P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:51.041230 2125 catalog_manager.cc:5869] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Sending DeleteTablet for 3 replicas of tablet f94f30794d6143b1877dd45e589cfe76
I20250831 19:54:51.041973 2125 catalog_manager.cc:6652] ReplaceTablet: tablet f94f30794d6143b1877dd45e589cfe76 deleted and replaced by tablet 4be6edd110374d2bb941e26defc7302f
I20250831 19:54:51.042104 1885 tablet_service.cc:1515] Processing DeleteTablet for tablet f94f30794d6143b1877dd45e589cfe76 with delete_type TABLET_DATA_DELETED (replaced by tablet 4be6edd110374d2bb941e26defc7302f) from {username='slave'} at 127.0.0.1:45906
I20250831 19:54:51.042505 2125 master_service.cc:948] ReplaceTablet: received request to replace tablet 00926e7f9fc74f1e9094fdfec9a1115f from {username='slave'} at 127.0.0.1:36958
I20250831 19:54:51.043193 1750 tablet_service.cc:1515] Processing DeleteTablet for tablet f318ccc4400f4830b6a80e27b002b562 with delete_type TABLET_DATA_DELETED (replaced by tablet 7dbfbe9b2b024f699c52046e09aa3301) from {username='slave'} at 127.0.0.1:50674
I20250831 19:54:51.043586 2713 tablet_replica.cc:331] T f318ccc4400f4830b6a80e27b002b562 P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:54:51.043807 2713 raft_consensus.cc:2241] T f318ccc4400f4830b6a80e27b002b562 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:51.044224 2713 raft_consensus.cc:2270] T f318ccc4400f4830b6a80e27b002b562 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:51.045022 2713 ts_tablet_manager.cc:1905] T f318ccc4400f4830b6a80e27b002b562 P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:51.047441 2117 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_4b100a5c91f9467497d138af9f82f726" } modify_external_catalogs: true
I20250831 19:54:51.052634 2713 ts_tablet_manager.cc:1918] T f318ccc4400f4830b6a80e27b002b562 P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.4
I20250831 19:54:51.052744 2713 log.cc:1199] T f318ccc4400f4830b6a80e27b002b562 P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/f318ccc4400f4830b6a80e27b002b562
W20250831 19:54:51.047983 2120 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_13cea908832146dab4b8b794752b1a79 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250831 19:54:51.053953 2117 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_4b100a5c91f9467497d138af9f82f726" } modify_external_catalogs: true
I20250831 19:54:51.056952 2713 ts_tablet_manager.cc:1939] T f318ccc4400f4830b6a80e27b002b562 P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
I20250831 19:54:51.043104 1611 tablet_service.cc:1515] Processing DeleteTablet for tablet f94f30794d6143b1877dd45e589cfe76 with delete_type TABLET_DATA_DELETED (replaced by tablet 4be6edd110374d2bb941e26defc7302f) from {username='slave'} at 127.0.0.1:51022
I20250831 19:54:51.050046 2282 tablet_bootstrap.cc:492] T 9dd77008323943ceaf515422255c8a23 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:51.060469 2282 ts_tablet_manager.cc:1397] T 9dd77008323943ceaf515422255c8a23 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.043s user 0.002s sys 0.007s
I20250831 19:54:51.061272 2282 raft_consensus.cc:357] T 9dd77008323943ceaf515422255c8a23 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.061473 2282 raft_consensus.cc:383] T 9dd77008323943ceaf515422255c8a23 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:51.061579 2282 raft_consensus.cc:738] T 9dd77008323943ceaf515422255c8a23 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:51.061797 2282 consensus_queue.cc:260] T 9dd77008323943ceaf515422255c8a23 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.062284 2282 ts_tablet_manager.cc:1428] T 9dd77008323943ceaf515422255c8a23 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250831 19:54:51.062573 2723 tablet.cc:1722] T 48c3872dbaee495fb80d1415b5631eaf P de831f40fa1348a48a1f0260f4130197: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:51.065611 2282 tablet_bootstrap.cc:492] T cb21c47c27ea4f34801e93bd647e41b5 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:51.067180 2282 tablet_bootstrap.cc:654] T cb21c47c27ea4f34801e93bd647e41b5 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:51.068702 1885 tablet_service.cc:1468] Processing CreateTablet for tablet d3a587be468b4b7c8b90f4374af25e08 (DEFAULT_TABLE table=default.table_4ab0ff6a6b0e49b0a8e0e9999f531e5b [id=ee93396a22b546038473cc2df15fdc87]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:51.069147 1885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3a587be468b4b7c8b90f4374af25e08. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:51.070663 1614 tablet_service.cc:1468] Processing CreateTablet for tablet d3a587be468b4b7c8b90f4374af25e08 (DEFAULT_TABLE table=default.table_4ab0ff6a6b0e49b0a8e0e9999f531e5b [id=ee93396a22b546038473cc2df15fdc87]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:51.071072 1614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3a587be468b4b7c8b90f4374af25e08. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:51.072403 1883 tablet_service.cc:1468] Processing CreateTablet for tablet 7dbfbe9b2b024f699c52046e09aa3301 (DEFAULT_TABLE table=default.table_d3002519e6964bb484d995d871e766c9 [id=1137b2754d104964bbe5bbaa4a0578b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:51.072793 1883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dbfbe9b2b024f699c52046e09aa3301. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:51.072978 1886 tablet_service.cc:1468] Processing CreateTablet for tablet 4be6edd110374d2bb941e26defc7302f (DEFAULT_TABLE table=default.table_8adc00cc53274835bfe463ebf3bd3f45 [id=0fc929ad819b48a9af984f8c301bad2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:51.073285 1886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4be6edd110374d2bb941e26defc7302f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:51.073865 1611 tablet_service.cc:1468] Processing CreateTablet for tablet 4be6edd110374d2bb941e26defc7302f (DEFAULT_TABLE table=default.table_8adc00cc53274835bfe463ebf3bd3f45 [id=0fc929ad819b48a9af984f8c301bad2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:51.074165 1611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4be6edd110374d2bb941e26defc7302f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:51.079758 1610 tablet_service.cc:1468] Processing CreateTablet for tablet 7dbfbe9b2b024f699c52046e09aa3301 (DEFAULT_TABLE table=default.table_d3002519e6964bb484d995d871e766c9 [id=1137b2754d104964bbe5bbaa4a0578b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:51.080161 1610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dbfbe9b2b024f699c52046e09aa3301. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:51.084405 1748 tablet_service.cc:1515] Processing DeleteTablet for tablet f94f30794d6143b1877dd45e589cfe76 with delete_type TABLET_DATA_DELETED (replaced by tablet 4be6edd110374d2bb941e26defc7302f) from {username='slave'} at 127.0.0.1:50674
I20250831 19:54:51.084728 2713 tablet_replica.cc:331] T f94f30794d6143b1877dd45e589cfe76 P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:54:51.084960 2713 raft_consensus.cc:2241] T f94f30794d6143b1877dd45e589cfe76 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:51.085129 2713 raft_consensus.cc:2270] T f94f30794d6143b1877dd45e589cfe76 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:51.085979 2713 ts_tablet_manager.cc:1905] T f94f30794d6143b1877dd45e589cfe76 P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:51.094393 2282 tablet_bootstrap.cc:492] T cb21c47c27ea4f34801e93bd647e41b5 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:51.094630 2282 ts_tablet_manager.cc:1397] T cb21c47c27ea4f34801e93bd647e41b5 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.029s user 0.004s sys 0.002s
I20250831 19:54:51.095607 2282 raft_consensus.cc:357] T cb21c47c27ea4f34801e93bd647e41b5 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.095825 2282 raft_consensus.cc:383] T cb21c47c27ea4f34801e93bd647e41b5 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:51.095932 2282 raft_consensus.cc:738] T cb21c47c27ea4f34801e93bd647e41b5 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:51.096199 2282 consensus_queue.cc:260] T cb21c47c27ea4f34801e93bd647e41b5 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.096697 2282 ts_tablet_manager.cc:1428] T cb21c47c27ea4f34801e93bd647e41b5 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250831 19:54:51.096998 2282 tablet_bootstrap.cc:492] T 75a6a340faad4e46924b79adc8bcb867 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:51.098850 2282 tablet_bootstrap.cc:654] T 75a6a340faad4e46924b79adc8bcb867 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:51.060278 2105 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet f318ccc4400f4830b6a80e27b002b562 (table default.table_d3002519e6964bb484d995d871e766c9 [id=1137b2754d104964bbe5bbaa4a0578b8]) successfully deleted
I20250831 19:54:51.067536 2125 catalog_manager.cc:5869] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Sending DeleteTablet for 3 replicas of tablet 00926e7f9fc74f1e9094fdfec9a1115f
I20250831 19:54:51.071520 2123 catalog_manager.cc:5674] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237) does not have the latest schema for tablet 48c3872dbaee495fb80d1415b5631eaf (table default.table_bcc81e72ea324a389ebbcc6a6b4512ac [id=f63d391a9c824314bf6789cc7bbb5ffb]). Expected version 1 got 0
I20250831 19:54:51.100194 2125 catalog_manager.cc:6652] ReplaceTablet: tablet 00926e7f9fc74f1e9094fdfec9a1115f deleted and replaced by tablet eb9df294c5924116a9d26c0b254e6fe5
I20250831 19:54:51.101224 2123 master_service.cc:948] ReplaceTablet: received request to replace tablet 07a9cd92870045a7a3e5a8b007bf7f47 from {username='slave'} at 127.0.0.1:36958
I20250831 19:54:51.101572 2714 ts_tablet_manager.cc:1918] T f318ccc4400f4830b6a80e27b002b562 P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.4
I20250831 19:54:51.101701 2714 log.cc:1199] T f318ccc4400f4830b6a80e27b002b562 P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/f318ccc4400f4830b6a80e27b002b562
I20250831 19:54:51.102114 2714 ts_tablet_manager.cc:1939] T f318ccc4400f4830b6a80e27b002b562 P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:54:51.102718 1884 tablet_service.cc:1515] Processing DeleteTablet for tablet 00926e7f9fc74f1e9094fdfec9a1115f with delete_type TABLET_DATA_DELETED (replaced by tablet eb9df294c5924116a9d26c0b254e6fe5) from {username='slave'} at 127.0.0.1:45906
I20250831 19:54:51.103295 1751 tablet_service.cc:1468] Processing CreateTablet for tablet 4be6edd110374d2bb941e26defc7302f (DEFAULT_TABLE table=default.table_8adc00cc53274835bfe463ebf3bd3f45 [id=0fc929ad819b48a9af984f8c301bad2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:51.103700 1751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4be6edd110374d2bb941e26defc7302f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:51.104041 1749 tablet_service.cc:1468] Processing CreateTablet for tablet 7dbfbe9b2b024f699c52046e09aa3301 (DEFAULT_TABLE table=default.table_d3002519e6964bb484d995d871e766c9 [id=1137b2754d104964bbe5bbaa4a0578b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:51.104351 1749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dbfbe9b2b024f699c52046e09aa3301. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:51.108851 1750 tablet_service.cc:1515] Processing DeleteTablet for tablet 00926e7f9fc74f1e9094fdfec9a1115f with delete_type TABLET_DATA_DELETED (replaced by tablet eb9df294c5924116a9d26c0b254e6fe5) from {username='slave'} at 127.0.0.1:50674
I20250831 19:54:51.109586 1748 tablet_service.cc:1468] Processing CreateTablet for tablet d3a587be468b4b7c8b90f4374af25e08 (DEFAULT_TABLE table=default.table_4ab0ff6a6b0e49b0a8e0e9999f531e5b [id=ee93396a22b546038473cc2df15fdc87]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:51.109977 1748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3a587be468b4b7c8b90f4374af25e08. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:51.110294 2284 tablet_bootstrap.cc:492] T 539e87d86bf7448c978743375bdb3a79 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:51.110450 2284 ts_tablet_manager.cc:1397] T 539e87d86bf7448c978743375bdb3a79 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.143s user 0.000s sys 0.003s
I20250831 19:54:51.111238 2284 raft_consensus.cc:357] T 539e87d86bf7448c978743375bdb3a79 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.111419 2284 raft_consensus.cc:383] T 539e87d86bf7448c978743375bdb3a79 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:51.111531 2284 raft_consensus.cc:738] T 539e87d86bf7448c978743375bdb3a79 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:51.111778 2101 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet f318ccc4400f4830b6a80e27b002b562 (table default.table_d3002519e6964bb484d995d871e766c9 [id=1137b2754d104964bbe5bbaa4a0578b8]) successfully deleted
I20250831 19:54:51.111742 2284 consensus_queue.cc:260] T 539e87d86bf7448c978743375bdb3a79 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.112290 2284 ts_tablet_manager.cc:1428] T 539e87d86bf7448c978743375bdb3a79 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20250831 19:54:51.117668 2714 tablet_replica.cc:331] T f94f30794d6143b1877dd45e589cfe76 P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:54:51.117887 2714 raft_consensus.cc:2241] T f94f30794d6143b1877dd45e589cfe76 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:51.118052 2714 raft_consensus.cc:2270] T f94f30794d6143b1877dd45e589cfe76 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:51.119086 1884 tablet_service.cc:1468] Processing CreateTablet for tablet eb9df294c5924116a9d26c0b254e6fe5 (DEFAULT_TABLE table=default.table_2b373bd597c54990856bf4882d180dcd [id=ed77a92cc1114d2398722bc6269e3a4d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:51.119189 2125 catalog_manager.cc:5674] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475) does not have the latest schema for tablet 48c3872dbaee495fb80d1415b5631eaf (table default.table_bcc81e72ea324a389ebbcc6a6b4512ac [id=f63d391a9c824314bf6789cc7bbb5ffb]). Expected version 1 got 0
I20250831 19:54:51.119431 1884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb9df294c5924116a9d26c0b254e6fe5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:51.119892 2713 ts_tablet_manager.cc:1918] T f94f30794d6143b1877dd45e589cfe76 P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:51.120565 2713 log.cc:1199] T f94f30794d6143b1877dd45e589cfe76 P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/f94f30794d6143b1877dd45e589cfe76
I20250831 19:54:51.120462 2125 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36958:
name: "default.Table_0bd3ac197d96497390258988a7c498f4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:51.120916 2713 ts_tablet_manager.cc:1939] T f94f30794d6143b1877dd45e589cfe76 P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
I20250831 19:54:51.121732 1751 tablet_service.cc:1468] Processing CreateTablet for tablet eb9df294c5924116a9d26c0b254e6fe5 (DEFAULT_TABLE table=default.table_2b373bd597c54990856bf4882d180dcd [id=ed77a92cc1114d2398722bc6269e3a4d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:51.121891 2123 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36958:
name: "default.Table_82715a1a3cf44ab586f6ab0f19723f2b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:51.125555 2714 ts_tablet_manager.cc:1905] T f94f30794d6143b1877dd45e589cfe76 P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:51.132853 2699 tablet_bootstrap.cc:492] T 9dd77008323943ceaf515422255c8a23 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:51.132863 1751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb9df294c5924116a9d26c0b254e6fe5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:51.137035 2105 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet f94f30794d6143b1877dd45e589cfe76 (table default.table_8adc00cc53274835bfe463ebf3bd3f45 [id=0fc929ad819b48a9af984f8c301bad2b]) successfully deleted
I20250831 19:54:51.137351 2713 tablet_replica.cc:331] T 00926e7f9fc74f1e9094fdfec9a1115f P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:54:51.137545 2713 raft_consensus.cc:2241] T 00926e7f9fc74f1e9094fdfec9a1115f P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: Raft consensus shutting down.
I20250831 19:54:51.137864 2713 raft_consensus.cc:2270] T 00926e7f9fc74f1e9094fdfec9a1115f P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:51.118695 1609 tablet_service.cc:1468] Processing CreateTablet for tablet eb9df294c5924116a9d26c0b254e6fe5 (DEFAULT_TABLE table=default.table_2b373bd597c54990856bf4882d180dcd [id=ed77a92cc1114d2398722bc6269e3a4d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:51.125041 1610 tablet_service.cc:1515] Processing DeleteTablet for tablet 00926e7f9fc74f1e9094fdfec9a1115f with delete_type TABLET_DATA_DELETED (replaced by tablet eb9df294c5924116a9d26c0b254e6fe5) from {username='slave'} at 127.0.0.1:51022
I20250831 19:54:51.127151 2740 raft_consensus.cc:491] T b67e0472244e4d79b8dfb7e7474b96b7 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:51.132392 2743 consensus_queue.cc:1035] T 2c343954bf6e44d683310415da3c0e58 P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:51.140944 2699 ts_tablet_manager.cc:1397] T 9dd77008323943ceaf515422255c8a23 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.222s user 0.012s sys 0.015s
I20250831 19:54:51.142295 2699 raft_consensus.cc:357] T 9dd77008323943ceaf515422255c8a23 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.145498 2699 raft_consensus.cc:383] T 9dd77008323943ceaf515422255c8a23 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:51.145685 2699 raft_consensus.cc:738] T 9dd77008323943ceaf515422255c8a23 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:51.146008 2699 consensus_queue.cc:260] T 9dd77008323943ceaf515422255c8a23 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.138665 2284 tablet_bootstrap.cc:492] T 9dd77008323943ceaf515422255c8a23 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:51.138729 2713 ts_tablet_manager.cc:1905] T 00926e7f9fc74f1e9094fdfec9a1115f P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:51.149982 2699 ts_tablet_manager.cc:1428] T 9dd77008323943ceaf515422255c8a23 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.009s user 0.000s sys 0.002s
I20250831 19:54:51.150276 2699 tablet_bootstrap.cc:492] T 539e87d86bf7448c978743375bdb3a79 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:51.150492 2740 raft_consensus.cc:513] T b67e0472244e4d79b8dfb7e7474b96b7 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.154407 2740 leader_election.cc:290] T b67e0472244e4d79b8dfb7e7474b96b7 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237)
I20250831 19:54:51.154574 2699 tablet_bootstrap.cc:654] T 539e87d86bf7448c978743375bdb3a79 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:51.156159 2755 raft_consensus.cc:491] T 9dd77008323943ceaf515422255c8a23 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:51.156348 1903 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b67e0472244e4d79b8dfb7e7474b96b7" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:51.156301 2755 raft_consensus.cc:513] T 9dd77008323943ceaf515422255c8a23 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.156489 1903 raft_consensus.cc:2466] T b67e0472244e4d79b8dfb7e7474b96b7 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 0.
I20250831 19:54:51.156883 2755 leader_election.cc:290] T 9dd77008323943ceaf515422255c8a23 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:51.157881 1771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b67e0472244e4d79b8dfb7e7474b96b7" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:51.158078 1771 raft_consensus.cc:2466] T b67e0472244e4d79b8dfb7e7474b96b7 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 0.
I20250831 19:54:51.158939 1772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9dd77008323943ceaf515422255c8a23" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
W20250831 19:54:51.159384 1842 leader_election.cc:343] T 9dd77008323943ceaf515422255c8a23 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): Illegal state: must be running to vote when last-logged opid is not known
I20250831 19:54:51.161603 1609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb9df294c5924116a9d26c0b254e6fe5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:51.163019 2284 tablet_bootstrap.cc:654] T 9dd77008323943ceaf515422255c8a23 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:51.164034 2740 consensus_queue.cc:1035] T 2c343954bf6e44d683310415da3c0e58 P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250831 19:54:51.164393 1570 leader_election.cc:304] T b67e0472244e4d79b8dfb7e7474b96b7 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:51.165115 2743 raft_consensus.cc:2802] T b67e0472244e4d79b8dfb7e7474b96b7 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:51.165236 2743 raft_consensus.cc:491] T b67e0472244e4d79b8dfb7e7474b96b7 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:51.165782 2743 raft_consensus.cc:3058] T b67e0472244e4d79b8dfb7e7474b96b7 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:51.169749 2713 ts_tablet_manager.cc:1918] T 00926e7f9fc74f1e9094fdfec9a1115f P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:51.169901 2713 log.cc:1199] T 00926e7f9fc74f1e9094fdfec9a1115f P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/00926e7f9fc74f1e9094fdfec9a1115f
I20250831 19:54:51.170279 2713 ts_tablet_manager.cc:1939] T 00926e7f9fc74f1e9094fdfec9a1115f P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
I20250831 19:54:51.170269 2743 raft_consensus.cc:513] T b67e0472244e4d79b8dfb7e7474b96b7 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.171196 2105 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet 00926e7f9fc74f1e9094fdfec9a1115f (table default.table_2b373bd597c54990856bf4882d180dcd [id=ed77a92cc1114d2398722bc6269e3a4d]) successfully deleted
I20250831 19:54:51.172348 2743 leader_election.cc:290] T b67e0472244e4d79b8dfb7e7474b96b7 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Requested vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237)
I20250831 19:54:51.173189 1906 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b67e0472244e4d79b8dfb7e7474b96b7" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:54:51.173355 1906 raft_consensus.cc:3058] T b67e0472244e4d79b8dfb7e7474b96b7 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:51.176337 1906 raft_consensus.cc:2466] T b67e0472244e4d79b8dfb7e7474b96b7 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1.
I20250831 19:54:51.174180 1631 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9dd77008323943ceaf515422255c8a23" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:51.177289 1631 raft_consensus.cc:2466] T 9dd77008323943ceaf515422255c8a23 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 0.
I20250831 19:54:51.176816 1568 leader_election.cc:304] T b67e0472244e4d79b8dfb7e7474b96b7 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:54:51.177857 1841 leader_election.cc:304] T 9dd77008323943ceaf515422255c8a23 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters: de831f40fa1348a48a1f0260f4130197
I20250831 19:54:51.178207 2755 raft_consensus.cc:2802] T 9dd77008323943ceaf515422255c8a23 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:51.178300 2755 raft_consensus.cc:491] T 9dd77008323943ceaf515422255c8a23 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:51.178371 2755 raft_consensus.cc:3058] T 9dd77008323943ceaf515422255c8a23 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:51.179087 2714 ts_tablet_manager.cc:1918] T f94f30794d6143b1877dd45e589cfe76 P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:51.179225 2714 log.cc:1199] T f94f30794d6143b1877dd45e589cfe76 P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/f94f30794d6143b1877dd45e589cfe76
I20250831 19:54:51.179673 2714 ts_tablet_manager.cc:1939] T f94f30794d6143b1877dd45e589cfe76 P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:54:51.180595 2101 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet f94f30794d6143b1877dd45e589cfe76 (table default.table_8adc00cc53274835bfe463ebf3bd3f45 [id=0fc929ad819b48a9af984f8c301bad2b]) successfully deleted
I20250831 19:54:51.180873 2755 raft_consensus.cc:513] T 9dd77008323943ceaf515422255c8a23 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.181747 2740 raft_consensus.cc:2802] T b67e0472244e4d79b8dfb7e7474b96b7 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:51.181903 2740 raft_consensus.cc:695] T b67e0472244e4d79b8dfb7e7474b96b7 P 89aa85d59c53436ebdf3074b13d14825 [term 1 LEADER]: Becoming Leader. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Running, Role: LEADER
I20250831 19:54:51.182233 2740 consensus_queue.cc:237] T b67e0472244e4d79b8dfb7e7474b96b7 P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.183892 1771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9dd77008323943ceaf515422255c8a23" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197"
W20250831 19:54:51.184419 1842 leader_election.cc:343] T 9dd77008323943ceaf515422255c8a23 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): Illegal state: must be running to vote when last-logged opid is not known
I20250831 19:54:51.185487 2284 tablet_bootstrap.cc:492] T 9dd77008323943ceaf515422255c8a23 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:51.185642 2284 ts_tablet_manager.cc:1397] T 9dd77008323943ceaf515422255c8a23 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.047s user 0.001s sys 0.002s
I20250831 19:54:51.186296 2284 raft_consensus.cc:357] T 9dd77008323943ceaf515422255c8a23 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.186498 2284 raft_consensus.cc:383] T 9dd77008323943ceaf515422255c8a23 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:51.186560 2284 raft_consensus.cc:738] T 9dd77008323943ceaf515422255c8a23 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:51.186797 2284 consensus_queue.cc:260] T 9dd77008323943ceaf515422255c8a23 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.187748 2755 leader_election.cc:290] T 9dd77008323943ceaf515422255c8a23 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 election: Requested vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:51.188220 1631 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9dd77008323943ceaf515422255c8a23" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:54:51.188370 1631 raft_consensus.cc:3058] T 9dd77008323943ceaf515422255c8a23 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:51.190295 2284 ts_tablet_manager.cc:1428] T 9dd77008323943ceaf515422255c8a23 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20250831 19:54:51.190778 1631 raft_consensus.cc:2466] T 9dd77008323943ceaf515422255c8a23 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 1.
I20250831 19:54:51.191224 1841 leader_election.cc:304] T 9dd77008323943ceaf515422255c8a23 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters: de831f40fa1348a48a1f0260f4130197
I20250831 19:54:51.192353 2755 raft_consensus.cc:2802] T 9dd77008323943ceaf515422255c8a23 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:51.192610 2755 raft_consensus.cc:695] T 9dd77008323943ceaf515422255c8a23 P 2441fafe1d62429386f4631ad423567d [term 1 LEADER]: Becoming Leader. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Running, Role: LEADER
I20250831 19:54:51.193138 2284 tablet_bootstrap.cc:492] T 920c6fcdf1a44d07b132de6a08b3cbf8 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:51.193091 2755 consensus_queue.cc:237] T 9dd77008323943ceaf515422255c8a23 P 2441fafe1d62429386f4631ad423567d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.194940 2284 tablet_bootstrap.cc:654] T 920c6fcdf1a44d07b132de6a08b3cbf8 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:51.195827 2714 tablet_replica.cc:331] T 00926e7f9fc74f1e9094fdfec9a1115f P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:54:51.202757 1772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b67e0472244e4d79b8dfb7e7474b96b7" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197"
I20250831 19:54:51.203022 1772 raft_consensus.cc:3058] T b67e0472244e4d79b8dfb7e7474b96b7 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:51.205416 1772 raft_consensus.cc:2466] T b67e0472244e4d79b8dfb7e7474b96b7 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1.
I20250831 19:54:51.209628 2714 raft_consensus.cc:2241] T 00926e7f9fc74f1e9094fdfec9a1115f P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:51.209743 2239 raft_consensus.cc:491] T bf30ba308d494e2880bb7fae5794d489 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:51.209869 2714 raft_consensus.cc:2270] T 00926e7f9fc74f1e9094fdfec9a1115f P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:51.209976 2239 raft_consensus.cc:513] T bf30ba308d494e2880bb7fae5794d489 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:51.210371 2714 ts_tablet_manager.cc:1905] T 00926e7f9fc74f1e9094fdfec9a1115f P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:51.210675 2239 leader_election.cc:290] T bf30ba308d494e2880bb7fae5794d489 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:51.211637 1631 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bf30ba308d494e2880bb7fae5794d489" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:51.211830 1631 raft_consensus.cc:2466] T bf30ba308d494e2880bb7fae5794d489 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 0.
I20250831 19:54:51.212247 1841 leader_election.cc:304] T bf30ba308d494e2880bb7fae5794d489 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:54:51.212538 2239 raft_consensus.cc:2802] T bf30ba308d494e2880bb7fae5794d489 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:51.212626 2239 raft_consensus.cc:491] T bf30ba308d494e2880bb7fae5794d489 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:51.212715 2239 raft_consensus.cc:3058] T bf30ba308d494e2880bb7fae5794d489 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:51.215167 2239 raft_consensus.cc:513] T bf30ba308d494e2880bb7fae5794d489 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:51.215955 1771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bf30ba308d494e2880bb7fae5794d489" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197"
I20250831 19:54:51.216104 1771 raft_consensus.cc:3058] T bf30ba308d494e2880bb7fae5794d489 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:51.216302 2714 ts_tablet_manager.cc:1918] T 00926e7f9fc74f1e9094fdfec9a1115f P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:51.216419 2714 log.cc:1199] T 00926e7f9fc74f1e9094fdfec9a1115f P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/00926e7f9fc74f1e9094fdfec9a1115f
I20250831 19:54:51.216828 2714 ts_tablet_manager.cc:1939] T 00926e7f9fc74f1e9094fdfec9a1115f P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:54:51.218956 1771 raft_consensus.cc:2466] T bf30ba308d494e2880bb7fae5794d489 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 1.
I20250831 19:54:51.219709 2239 leader_election.cc:290] T bf30ba308d494e2880bb7fae5794d489 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 election: Requested vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:51.219985 1842 leader_election.cc:304] T bf30ba308d494e2880bb7fae5794d489 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:51.220469 2758 raft_consensus.cc:2802] T bf30ba308d494e2880bb7fae5794d489 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:51.221383 2284 tablet_bootstrap.cc:492] T 920c6fcdf1a44d07b132de6a08b3cbf8 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:51.221421 2101 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet 00926e7f9fc74f1e9094fdfec9a1115f (table default.table_2b373bd597c54990856bf4882d180dcd [id=ed77a92cc1114d2398722bc6269e3a4d]) successfully deleted
I20250831 19:54:51.221571 2284 ts_tablet_manager.cc:1397] T 920c6fcdf1a44d07b132de6a08b3cbf8 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.029s user 0.002s sys 0.001s
I20250831 19:54:51.221729 1631 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bf30ba308d494e2880bb7fae5794d489" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:54:51.222229 2284 raft_consensus.cc:357] T 920c6fcdf1a44d07b132de6a08b3cbf8 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.222384 2284 raft_consensus.cc:383] T 920c6fcdf1a44d07b132de6a08b3cbf8 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:51.222477 2284 raft_consensus.cc:738] T 920c6fcdf1a44d07b132de6a08b3cbf8 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:51.222689 2284 consensus_queue.cc:260] T 920c6fcdf1a44d07b132de6a08b3cbf8 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.221992 1631 raft_consensus.cc:3058] T bf30ba308d494e2880bb7fae5794d489 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:51.223094 2284 ts_tablet_manager.cc:1428] T 920c6fcdf1a44d07b132de6a08b3cbf8 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250831 19:54:51.227200 2284 tablet_bootstrap.cc:492] T 75a6a340faad4e46924b79adc8bcb867 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:51.228405 1631 raft_consensus.cc:2466] T bf30ba308d494e2880bb7fae5794d489 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 1.
I20250831 19:54:51.228760 2284 tablet_bootstrap.cc:654] T 75a6a340faad4e46924b79adc8bcb867 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:51.241076 1772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bf30ba308d494e2880bb7fae5794d489" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:51.241307 1772 raft_consensus.cc:2374] T bf30ba308d494e2880bb7fae5794d489 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 1. Re-sending same reply.
I20250831 19:54:51.245106 2239 consensus_queue.cc:1035] T 6b61f7d06007437f803d400e73800415 P 2441fafe1d62429386f4631ad423567d [LEADER]: Connected to new peer: Peer: permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:51.249997 2284 tablet_bootstrap.cc:492] T 75a6a340faad4e46924b79adc8bcb867 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:51.250164 2284 ts_tablet_manager.cc:1397] T 75a6a340faad4e46924b79adc8bcb867 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.023s user 0.000s sys 0.002s
I20250831 19:54:51.250939 2284 raft_consensus.cc:357] T 75a6a340faad4e46924b79adc8bcb867 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.251137 2284 raft_consensus.cc:383] T 75a6a340faad4e46924b79adc8bcb867 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:51.251220 2284 raft_consensus.cc:738] T 75a6a340faad4e46924b79adc8bcb867 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:51.251466 2284 consensus_queue.cc:260] T 75a6a340faad4e46924b79adc8bcb867 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.251940 2284 ts_tablet_manager.cc:1428] T 75a6a340faad4e46924b79adc8bcb867 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250831 19:54:51.252251 2284 tablet_bootstrap.cc:492] T 05cda604dad041cfaad94d1b43d6b14d P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:51.255237 2284 tablet_bootstrap.cc:654] T 05cda604dad041cfaad94d1b43d6b14d P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:51.255275 2715 ts_tablet_manager.cc:1918] T f318ccc4400f4830b6a80e27b002b562 P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.4
I20250831 19:54:51.255599 2715 log.cc:1199] T f318ccc4400f4830b6a80e27b002b562 P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/f318ccc4400f4830b6a80e27b002b562
I20250831 19:54:51.256042 2715 ts_tablet_manager.cc:1939] T f318ccc4400f4830b6a80e27b002b562 P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
I20250831 19:54:51.257236 2104 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet f318ccc4400f4830b6a80e27b002b562 (table default.table_d3002519e6964bb484d995d871e766c9 [id=1137b2754d104964bbe5bbaa4a0578b8]) successfully deleted
I20250831 19:54:51.268622 2119 catalog_manager.cc:3460] renamed table default.table_fd98179fb4584ad6bde229ee78f7dfde [id=0850f2b0e9324dd0a210fa7b2609c769] in HMS: new name default.table_60746664f3ef4d82866e4bcd56d4fac5
I20250831 19:54:51.274624 2284 tablet_bootstrap.cc:492] T 05cda604dad041cfaad94d1b43d6b14d P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:51.274852 2284 ts_tablet_manager.cc:1397] T 05cda604dad041cfaad94d1b43d6b14d P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.023s user 0.004s sys 0.004s
I20250831 19:54:51.275573 2284 raft_consensus.cc:357] T 05cda604dad041cfaad94d1b43d6b14d P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.275777 2284 raft_consensus.cc:383] T 05cda604dad041cfaad94d1b43d6b14d P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:51.275941 2284 raft_consensus.cc:738] T 05cda604dad041cfaad94d1b43d6b14d P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:51.276155 2284 consensus_queue.cc:260] T 05cda604dad041cfaad94d1b43d6b14d P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.276630 2284 ts_tablet_manager.cc:1428] T 05cda604dad041cfaad94d1b43d6b14d P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250831 19:54:51.278204 2284 tablet_bootstrap.cc:492] T cb21c47c27ea4f34801e93bd647e41b5 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:51.279719 2284 tablet_bootstrap.cc:654] T cb21c47c27ea4f34801e93bd647e41b5 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:51.284227 2758 raft_consensus.cc:695] T bf30ba308d494e2880bb7fae5794d489 P 2441fafe1d62429386f4631ad423567d [term 1 LEADER]: Becoming Leader. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Running, Role: LEADER
I20250831 19:54:51.284466 2758 consensus_queue.cc:237] T bf30ba308d494e2880bb7fae5794d489 P 2441fafe1d62429386f4631ad423567d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:51.295670 2584 raft_consensus.cc:491] T 920c6fcdf1a44d07b132de6a08b3cbf8 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:51.295850 2584 raft_consensus.cc:513] T 920c6fcdf1a44d07b132de6a08b3cbf8 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.296427 2584 leader_election.cc:290] T 920c6fcdf1a44d07b132de6a08b3cbf8 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:51.297364 2284 tablet_bootstrap.cc:492] T cb21c47c27ea4f34801e93bd647e41b5 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:51.297379 1906 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "920c6fcdf1a44d07b132de6a08b3cbf8" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:51.297556 2284 ts_tablet_manager.cc:1397] T cb21c47c27ea4f34801e93bd647e41b5 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.019s user 0.002s sys 0.002s
W20250831 19:54:51.298033 1705 leader_election.cc:343] T 920c6fcdf1a44d07b132de6a08b3cbf8 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): Illegal state: must be running to vote when last-logged opid is not known
I20250831 19:54:51.298659 2284 raft_consensus.cc:357] T cb21c47c27ea4f34801e93bd647e41b5 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.298877 2284 raft_consensus.cc:383] T cb21c47c27ea4f34801e93bd647e41b5 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:51.298815 2239 consensus_queue.cc:1035] T 6b61f7d06007437f803d400e73800415 P 2441fafe1d62429386f4631ad423567d [LEADER]: Connected to new peer: Peer: permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:51.298946 2284 raft_consensus.cc:738] T cb21c47c27ea4f34801e93bd647e41b5 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:51.299240 2284 consensus_queue.cc:260] T cb21c47c27ea4f34801e93bd647e41b5 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.301018 2284 ts_tablet_manager.cc:1428] T cb21c47c27ea4f34801e93bd647e41b5 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20250831 19:54:51.301306 2284 tablet_bootstrap.cc:492] T 2c03497e3cb4480d88d99dde5d6ea22b P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:51.303135 1631 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "920c6fcdf1a44d07b132de6a08b3cbf8" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
W20250831 19:54:51.303702 1706 leader_election.cc:343] T 920c6fcdf1a44d07b132de6a08b3cbf8 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): Illegal state: must be running to vote when last-logged opid is not known
I20250831 19:54:51.303825 1706 leader_election.cc:304] T 920c6fcdf1a44d07b132de6a08b3cbf8 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: de831f40fa1348a48a1f0260f4130197; no voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825
I20250831 19:54:51.304204 2584 raft_consensus.cc:2747] T 920c6fcdf1a44d07b132de6a08b3cbf8 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250831 19:54:51.309690 2284 tablet_bootstrap.cc:654] T 2c03497e3cb4480d88d99dde5d6ea22b P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:51.313200 2120 catalog_manager.cc:2149] created HMS catalog entry for table [id=61032a0c11594321b1e4cb5ba3394c18]
I20250831 19:54:51.314150 2282 tablet_bootstrap.cc:492] T 75a6a340faad4e46924b79adc8bcb867 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:51.314316 2282 ts_tablet_manager.cc:1397] T 75a6a340faad4e46924b79adc8bcb867 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.217s user 0.005s sys 0.000s
I20250831 19:54:51.315083 2282 raft_consensus.cc:357] T 75a6a340faad4e46924b79adc8bcb867 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.315258 2282 raft_consensus.cc:383] T 75a6a340faad4e46924b79adc8bcb867 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:51.315331 2282 raft_consensus.cc:738] T 75a6a340faad4e46924b79adc8bcb867 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:51.318670 2715 tablet_replica.cc:331] T f94f30794d6143b1877dd45e589cfe76 P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:54:51.318881 2715 raft_consensus.cc:2241] T f94f30794d6143b1877dd45e589cfe76 P 89aa85d59c53436ebdf3074b13d14825 [term 1 LEADER]: Raft consensus shutting down.
I20250831 19:54:51.320358 2282 consensus_queue.cc:260] T 75a6a340faad4e46924b79adc8bcb867 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.320935 2282 ts_tablet_manager.cc:1428] T 75a6a340faad4e46924b79adc8bcb867 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20250831 19:54:51.323230 2284 tablet_bootstrap.cc:492] T 2c03497e3cb4480d88d99dde5d6ea22b P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:51.323347 2715 raft_consensus.cc:2270] T f94f30794d6143b1877dd45e589cfe76 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:51.323370 2284 ts_tablet_manager.cc:1397] T 2c03497e3cb4480d88d99dde5d6ea22b P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.022s user 0.003s sys 0.001s
I20250831 19:54:51.324174 2284 raft_consensus.cc:357] T 2c03497e3cb4480d88d99dde5d6ea22b P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.324362 2284 raft_consensus.cc:383] T 2c03497e3cb4480d88d99dde5d6ea22b P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:51.324447 2284 raft_consensus.cc:738] T 2c03497e3cb4480d88d99dde5d6ea22b P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:51.324648 2284 consensus_queue.cc:260] T 2c03497e3cb4480d88d99dde5d6ea22b P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.325347 2284 ts_tablet_manager.cc:1428] T 2c03497e3cb4480d88d99dde5d6ea22b P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250831 19:54:51.325676 2284 tablet_bootstrap.cc:492] T 4be6edd110374d2bb941e26defc7302f P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:51.326658 2120 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:36958 (request call id 93) took 1448 ms. Trace:
I20250831 19:54:51.326792 2120 rpcz_store.cc:276] 0831 19:54:49.878638 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:50.673288 (+794650us) service_pool.cc:225] Handling call
0831 19:54:51.052946 (+379658us) catalog_manager.cc:2076] Acquired catalog manager lock
0831 19:54:51.053364 (+ 418us) catalog_manager.cc:2122] Created new table and tablet info
0831 19:54:51.313149 (+259785us) catalog_manager.cc:2148] Created new table in HMS catalog
0831 19:54:51.326379 (+ 13230us) catalog_manager.cc:2182] Wrote table and tablets to system table
0831 19:54:51.326500 (+ 121us) catalog_manager.cc:2216] Inserted table and tablets into CatalogManager maps
0831 19:54:51.326612 (+ 112us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:51.314025 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:51.314140 (+ 115us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:51.314148 (+ 8us) write_op.cc:435] Acquired schema lock
0831 19:54:51.314150 (+ 2us) tablet.cc:660] Decoding operations
0831 19:54:51.314247 (+ 97us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:51.314261 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:51.314266 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:51.314352 (+ 86us) tablet.cc:699] Row locks acquired
0831 19:54:51.314355 (+ 3us) write_op.cc:260] PREPARE: finished
0831 19:54:51.314394 (+ 39us) write_op.cc:270] Start()
0831 19:54:51.314430 (+ 36us) write_op.cc:276] Timestamp: P: 1756670091314373 usec, L: 0
0831 19:54:51.314436 (+ 6us) op_driver.cc:348] REPLICATION: starting
0831 19:54:51.314625 (+ 189us) log.cc:844] Serialized 433 byte log entry
0831 19:54:51.323335 (+ 8710us) op_driver.cc:464] REPLICATION: finished
0831 19:54:51.323447 (+ 112us) write_op.cc:301] APPLY: starting
0831 19:54:51.323464 (+ 17us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:51.323511 (+ 47us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:51.323592 (+ 81us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:51.323719 (+ 127us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:51.323766 (+ 47us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0831 19:54:51.323776 (+ 10us) write_op.cc:312] APPLY: finished
0831 19:54:51.323895 (+ 119us) log.cc:844] Serialized 29 byte log entry
0831 19:54:51.323965 (+ 70us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:51.323986 (+ 21us) write_op.cc:454] Released schema lock
0831 19:54:51.323994 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0831 19:54:51.324064 (+ 70us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:51.324068 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":215069,"Hive Metastore.run_cpu_time_us":306,"Hive Metastore.run_wall_time_us":44394,"child_traces":[["op",{"apply.queue_time_us":60,"apply.run_cpu_time_us":609,"apply.run_wall_time_us":608,"num_ops":2,"prepare.queue_time_us":85,"prepare.run_cpu_time_us":727,"prepare.run_wall_time_us":728,"raft.queue_time_us":1150,"raft.run_cpu_time_us":410,"raft.run_wall_time_us":410,"replication_time_us":8866}]]}
I20250831 19:54:51.327610 2284 tablet_bootstrap.cc:654] T 4be6edd110374d2bb941e26defc7302f P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:51.327597 2715 ts_tablet_manager.cc:1905] T f94f30794d6143b1877dd45e589cfe76 P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:51.343417 1884 tablet_service.cc:1468] Processing CreateTablet for tablet 769d6c67c8184282b90bda6c16a93dde (DEFAULT_TABLE table=default.table_13cea908832146dab4b8b794752b1a79 [id=61032a0c11594321b1e4cb5ba3394c18]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:51.343900 1751 tablet_service.cc:1468] Processing CreateTablet for tablet 769d6c67c8184282b90bda6c16a93dde (DEFAULT_TABLE table=default.table_13cea908832146dab4b8b794752b1a79 [id=61032a0c11594321b1e4cb5ba3394c18]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:51.344238 1751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 769d6c67c8184282b90bda6c16a93dde. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:51.345279 1609 tablet_service.cc:1468] Processing CreateTablet for tablet 769d6c67c8184282b90bda6c16a93dde (DEFAULT_TABLE table=default.table_13cea908832146dab4b8b794752b1a79 [id=61032a0c11594321b1e4cb5ba3394c18]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:51.345649 1609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 769d6c67c8184282b90bda6c16a93dde. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:51.347847 2284 tablet_bootstrap.cc:492] T 4be6edd110374d2bb941e26defc7302f P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:51.347991 2284 ts_tablet_manager.cc:1397] T 4be6edd110374d2bb941e26defc7302f P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.022s user 0.004s sys 0.001s
I20250831 19:54:51.348775 2284 raft_consensus.cc:357] T 4be6edd110374d2bb941e26defc7302f P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.348963 2284 raft_consensus.cc:383] T 4be6edd110374d2bb941e26defc7302f P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:51.349025 2284 raft_consensus.cc:738] T 4be6edd110374d2bb941e26defc7302f P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:51.349254 2284 consensus_queue.cc:260] T 4be6edd110374d2bb941e26defc7302f P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.352399 2284 ts_tablet_manager.cc:1428] T 4be6edd110374d2bb941e26defc7302f P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20250831 19:54:51.352686 2284 tablet_bootstrap.cc:492] T d3a587be468b4b7c8b90f4374af25e08 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:51.354359 2284 tablet_bootstrap.cc:654] T d3a587be468b4b7c8b90f4374af25e08 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:51.356668 2282 tablet_bootstrap.cc:492] T 2c03497e3cb4480d88d99dde5d6ea22b P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:51.358847 2120 catalog_manager.cc:5582] T b67e0472244e4d79b8dfb7e7474b96b7 P 89aa85d59c53436ebdf3074b13d14825 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193). New cstate: current_term: 1 leader_uuid: "89aa85d59c53436ebdf3074b13d14825" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: HEALTHY } } }
I20250831 19:54:51.363019 2282 tablet_bootstrap.cc:654] T 2c03497e3cb4480d88d99dde5d6ea22b P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:51.373659 2120 catalog_manager.cc:5674] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475) does not have the latest schema for tablet 05cda604dad041cfaad94d1b43d6b14d (table default.table_6c2f9309b58643529114857aae0568f2 [id=ad7bb166843e423ea7e50a1d18710fa1]). Expected version 2 got 0
I20250831 19:54:51.373852 2284 tablet_bootstrap.cc:492] T d3a587be468b4b7c8b90f4374af25e08 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:51.374027 2284 ts_tablet_manager.cc:1397] T d3a587be468b4b7c8b90f4374af25e08 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.021s user 0.003s sys 0.001s
I20250831 19:54:51.374837 2284 raft_consensus.cc:357] T d3a587be468b4b7c8b90f4374af25e08 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.375038 2284 raft_consensus.cc:383] T d3a587be468b4b7c8b90f4374af25e08 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:51.375139 2284 raft_consensus.cc:738] T d3a587be468b4b7c8b90f4374af25e08 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:51.375344 2284 consensus_queue.cc:260] T d3a587be468b4b7c8b90f4374af25e08 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
W20250831 19:54:51.375746 2120 catalog_manager.cc:5774] Failed to send AlterTable RPC for tablet 05cda604dad041cfaad94d1b43d6b14d (table default.table_6c2f9309b58643529114857aae0568f2 [id=ad7bb166843e423ea7e50a1d18710fa1], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet 05cda604dad041cfaad94d1b43d6b14d consensus state has no leader
I20250831 19:54:51.378156 2284 ts_tablet_manager.cc:1428] T d3a587be468b4b7c8b90f4374af25e08 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20250831 19:54:51.378433 2284 tablet_bootstrap.cc:492] T 7dbfbe9b2b024f699c52046e09aa3301 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:51.380077 2284 tablet_bootstrap.cc:654] T 7dbfbe9b2b024f699c52046e09aa3301 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:51.381138 2699 tablet_bootstrap.cc:492] T 539e87d86bf7448c978743375bdb3a79 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:51.383738 1884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 769d6c67c8184282b90bda6c16a93dde. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:51.392300 2121 catalog_manager.cc:2706] deleted HMS catalog entry for table default.table_2b373bd597c54990856bf4882d180dcd [id=ed77a92cc1114d2398722bc6269e3a4d]
I20250831 19:54:51.396373 2120 catalog_manager.cc:5582] T bf30ba308d494e2880bb7fae5794d489 P 2441fafe1d62429386f4631ad423567d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2441fafe1d62429386f4631ad423567d (127.1.1.195). New cstate: current_term: 1 leader_uuid: "2441fafe1d62429386f4631ad423567d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: HEALTHY } } }
I20250831 19:54:51.396864 2120 catalog_manager.cc:5582] T 9dd77008323943ceaf515422255c8a23 P 2441fafe1d62429386f4631ad423567d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2441fafe1d62429386f4631ad423567d (127.1.1.195). New cstate: current_term: 1 leader_uuid: "2441fafe1d62429386f4631ad423567d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: UNKNOWN } } }
I20250831 19:54:51.381315 2699 ts_tablet_manager.cc:1397] T 539e87d86bf7448c978743375bdb3a79 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.231s user 0.012s sys 0.029s
I20250831 19:54:51.400738 2699 raft_consensus.cc:357] T 539e87d86bf7448c978743375bdb3a79 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.400938 2699 raft_consensus.cc:383] T 539e87d86bf7448c978743375bdb3a79 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:51.401010 2699 raft_consensus.cc:738] T 539e87d86bf7448c978743375bdb3a79 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:51.401234 2699 consensus_queue.cc:260] T 539e87d86bf7448c978743375bdb3a79 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.401760 2699 ts_tablet_manager.cc:1428] T 539e87d86bf7448c978743375bdb3a79 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
W20250831 19:54:51.404377 2104 catalog_manager.cc:4726] Async tablet task AlterTable RPC for tablet 05cda604dad041cfaad94d1b43d6b14d (table default.table_6c2f9309b58643529114857aae0568f2 [id=ad7bb166843e423ea7e50a1d18710fa1], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 05cda604dad041cfaad94d1b43d6b14d consensus state has no leader
I20250831 19:54:51.406049 2699 tablet_bootstrap.cc:492] T 75a6a340faad4e46924b79adc8bcb867 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:51.414073 2584 raft_consensus.cc:491] T 05cda604dad041cfaad94d1b43d6b14d P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:51.414642 2120 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_5660fc6b1a9846a6bd36b56e553a8f35" } new_table_name: "default.Table_af003c3f30c04853bc025b34d543d0e0" modify_external_catalogs: true
I20250831 19:54:51.414800 2584 raft_consensus.cc:513] T 05cda604dad041cfaad94d1b43d6b14d P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.415479 2699 tablet_bootstrap.cc:654] T 75a6a340faad4e46924b79adc8bcb867 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:51.415594 2584 leader_election.cc:290] T 05cda604dad041cfaad94d1b43d6b14d P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:51.419293 1903 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "05cda604dad041cfaad94d1b43d6b14d" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
W20250831 19:54:51.419939 1705 leader_election.cc:343] T 05cda604dad041cfaad94d1b43d6b14d P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): Illegal state: must be running to vote when last-logged opid is not known
I20250831 19:54:51.423807 2715 ts_tablet_manager.cc:1918] T f94f30794d6143b1877dd45e589cfe76 P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:51.423944 2715 log.cc:1199] T f94f30794d6143b1877dd45e589cfe76 P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/f94f30794d6143b1877dd45e589cfe76
I20250831 19:54:51.424312 2715 ts_tablet_manager.cc:1939] T f94f30794d6143b1877dd45e589cfe76 P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
I20250831 19:54:51.427326 2104 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet f94f30794d6143b1877dd45e589cfe76 (table default.table_8adc00cc53274835bfe463ebf3bd3f45 [id=0fc929ad819b48a9af984f8c301bad2b]) successfully deleted
I20250831 19:54:51.429668 2282 tablet_bootstrap.cc:492] T 2c03497e3cb4480d88d99dde5d6ea22b P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:51.429813 2282 ts_tablet_manager.cc:1397] T 2c03497e3cb4480d88d99dde5d6ea22b P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.088s user 0.005s sys 0.001s
I20250831 19:54:51.430555 2282 raft_consensus.cc:357] T 2c03497e3cb4480d88d99dde5d6ea22b P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.430712 2282 raft_consensus.cc:383] T 2c03497e3cb4480d88d99dde5d6ea22b P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:51.430799 2282 raft_consensus.cc:738] T 2c03497e3cb4480d88d99dde5d6ea22b P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:51.416702 1631 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "05cda604dad041cfaad94d1b43d6b14d" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:51.433629 2282 consensus_queue.cc:260] T 2c03497e3cb4480d88d99dde5d6ea22b P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.433910 1903 raft_consensus.cc:1273] T 4b3babfbfe394414b944bd53377edeb0 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Refusing update from remote peer de831f40fa1348a48a1f0260f4130197: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250831 19:54:51.434567 2778 consensus_queue.cc:1035] T 4b3babfbfe394414b944bd53377edeb0 P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250831 19:54:51.435817 1706 leader_election.cc:343] T 05cda604dad041cfaad94d1b43d6b14d P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): Illegal state: must be running to vote when last-logged opid is not known
I20250831 19:54:51.435943 1706 leader_election.cc:304] T 05cda604dad041cfaad94d1b43d6b14d P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: de831f40fa1348a48a1f0260f4130197; no voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825
I20250831 19:54:51.438232 1631 raft_consensus.cc:1273] T 4b3babfbfe394414b944bd53377edeb0 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Refusing update from remote peer de831f40fa1348a48a1f0260f4130197: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250831 19:54:51.439992 2778 raft_consensus.cc:2747] T 05cda604dad041cfaad94d1b43d6b14d P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250831 19:54:51.440070 2284 tablet_bootstrap.cc:492] T 7dbfbe9b2b024f699c52046e09aa3301 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:51.440214 2284 ts_tablet_manager.cc:1397] T 7dbfbe9b2b024f699c52046e09aa3301 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.062s user 0.004s sys 0.009s
I20250831 19:54:51.440902 2284 raft_consensus.cc:357] T 7dbfbe9b2b024f699c52046e09aa3301 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.441071 2284 raft_consensus.cc:383] T 7dbfbe9b2b024f699c52046e09aa3301 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:51.441129 2284 raft_consensus.cc:738] T 7dbfbe9b2b024f699c52046e09aa3301 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:51.441354 2284 consensus_queue.cc:260] T 7dbfbe9b2b024f699c52046e09aa3301 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.441560 2778 raft_consensus.cc:491] T 4be6edd110374d2bb941e26defc7302f P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:51.441701 2282 ts_tablet_manager.cc:1428] T 2c03497e3cb4480d88d99dde5d6ea22b P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
I20250831 19:54:51.441706 2778 raft_consensus.cc:513] T 4be6edd110374d2bb941e26defc7302f P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.441876 2284 ts_tablet_manager.cc:1428] T 7dbfbe9b2b024f699c52046e09aa3301 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250831 19:54:51.441963 2715 tablet_replica.cc:331] T 00926e7f9fc74f1e9094fdfec9a1115f P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:54:51.442118 2715 raft_consensus.cc:2241] T 00926e7f9fc74f1e9094fdfec9a1115f P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:51.442183 2284 tablet_bootstrap.cc:492] T eb9df294c5924116a9d26c0b254e6fe5 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:51.442293 2715 raft_consensus.cc:2270] T 00926e7f9fc74f1e9094fdfec9a1115f P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:51.442399 2778 leader_election.cc:290] T 4be6edd110374d2bb941e26defc7302f P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:51.442857 2715 ts_tablet_manager.cc:1905] T 00926e7f9fc74f1e9094fdfec9a1115f P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:51.443181 1906 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4be6edd110374d2bb941e26defc7302f" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
W20250831 19:54:51.443660 1705 leader_election.cc:343] T 4be6edd110374d2bb941e26defc7302f P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): Illegal state: must be running to vote when last-logged opid is not known
I20250831 19:54:51.443859 2284 tablet_bootstrap.cc:654] T eb9df294c5924116a9d26c0b254e6fe5 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:51.444202 2584 consensus_queue.cc:1035] T 4b3babfbfe394414b944bd53377edeb0 P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:51.453855 2723 tablet.cc:1722] T 4b3babfbfe394414b944bd53377edeb0 P de831f40fa1348a48a1f0260f4130197: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250831 19:54:51.462124 2761 tablet.cc:1722] T 4b3babfbfe394414b944bd53377edeb0 P 2441fafe1d62429386f4631ad423567d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250831 19:54:51.445142 1631 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4be6edd110374d2bb941e26defc7302f" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
W20250831 19:54:51.463034 1706 leader_election.cc:343] T 4be6edd110374d2bb941e26defc7302f P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): Illegal state: must be running to vote when last-logged opid is not known
I20250831 19:54:51.463164 1706 leader_election.cc:304] T 4be6edd110374d2bb941e26defc7302f P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: de831f40fa1348a48a1f0260f4130197; no voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825
I20250831 19:54:51.463402 2584 raft_consensus.cc:2747] T 4be6edd110374d2bb941e26defc7302f P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250831 19:54:51.446327 2282 tablet_bootstrap.cc:492] T 7dbfbe9b2b024f699c52046e09aa3301 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:51.465159 2282 tablet_bootstrap.cc:654] T 7dbfbe9b2b024f699c52046e09aa3301 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:51.465200 2786 tablet.cc:1722] T 4b3babfbfe394414b944bd53377edeb0 P 89aa85d59c53436ebdf3074b13d14825: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250831 19:54:51.470181 2284 tablet_bootstrap.cc:492] T eb9df294c5924116a9d26c0b254e6fe5 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:51.470343 2284 ts_tablet_manager.cc:1397] T eb9df294c5924116a9d26c0b254e6fe5 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.028s user 0.002s sys 0.001s
I20250831 19:54:51.471055 2284 raft_consensus.cc:357] T eb9df294c5924116a9d26c0b254e6fe5 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.471210 2284 raft_consensus.cc:383] T eb9df294c5924116a9d26c0b254e6fe5 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:51.471278 2284 raft_consensus.cc:738] T eb9df294c5924116a9d26c0b254e6fe5 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:51.471518 2284 consensus_queue.cc:260] T eb9df294c5924116a9d26c0b254e6fe5 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.472069 2284 ts_tablet_manager.cc:1428] T eb9df294c5924116a9d26c0b254e6fe5 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20250831 19:54:51.472316 2284 tablet_bootstrap.cc:492] T 769d6c67c8184282b90bda6c16a93dde P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:51.473861 2284 tablet_bootstrap.cc:654] T 769d6c67c8184282b90bda6c16a93dde P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:51.479836 2778 raft_consensus.cc:491] T 2c03497e3cb4480d88d99dde5d6ea22b P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:51.479995 2778 raft_consensus.cc:513] T 2c03497e3cb4480d88d99dde5d6ea22b P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.480581 2778 leader_election.cc:290] T 2c03497e3cb4480d88d99dde5d6ea22b P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:51.480965 1632 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2c03497e3cb4480d88d99dde5d6ea22b" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:51.481151 1632 raft_consensus.cc:2466] T 2c03497e3cb4480d88d99dde5d6ea22b P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 0.
I20250831 19:54:51.482081 1706 leader_election.cc:304] T 2c03497e3cb4480d88d99dde5d6ea22b P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:51.482430 2778 raft_consensus.cc:2802] T 2c03497e3cb4480d88d99dde5d6ea22b P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:51.482407 1903 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2c03497e3cb4480d88d99dde5d6ea22b" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:51.482509 2778 raft_consensus.cc:491] T 2c03497e3cb4480d88d99dde5d6ea22b P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:51.482600 2778 raft_consensus.cc:3058] T 2c03497e3cb4480d88d99dde5d6ea22b P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
W20250831 19:54:51.483073 1705 leader_election.cc:343] T 2c03497e3cb4480d88d99dde5d6ea22b P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): Illegal state: must be running to vote when last-logged opid is not known
I20250831 19:54:51.484956 2778 raft_consensus.cc:513] T 2c03497e3cb4480d88d99dde5d6ea22b P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.487133 1903 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2c03497e3cb4480d88d99dde5d6ea22b" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
W20250831 19:54:51.487735 1705 leader_election.cc:343] T 2c03497e3cb4480d88d99dde5d6ea22b P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): Illegal state: must be running to vote when last-logged opid is not known
I20250831 19:54:51.490056 1632 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2c03497e3cb4480d88d99dde5d6ea22b" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:54:51.490238 1632 raft_consensus.cc:3058] T 2c03497e3cb4480d88d99dde5d6ea22b P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:51.492895 1632 raft_consensus.cc:2466] T 2c03497e3cb4480d88d99dde5d6ea22b P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:54:51.493369 1706 leader_election.cc:304] T 2c03497e3cb4480d88d99dde5d6ea22b P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197; no voters: 2441fafe1d62429386f4631ad423567d
I20250831 19:54:51.493470 2699 tablet_bootstrap.cc:492] T 75a6a340faad4e46924b79adc8bcb867 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:51.493619 2699 ts_tablet_manager.cc:1397] T 75a6a340faad4e46924b79adc8bcb867 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.088s user 0.002s sys 0.005s
I20250831 19:54:51.493673 2472 raft_consensus.cc:2802] T 2c03497e3cb4480d88d99dde5d6ea22b P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:51.493813 2472 raft_consensus.cc:695] T 2c03497e3cb4480d88d99dde5d6ea22b P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: Becoming Leader. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Running, Role: LEADER
I20250831 19:54:51.494057 2472 consensus_queue.cc:237] T 2c03497e3cb4480d88d99dde5d6ea22b P de831f40fa1348a48a1f0260f4130197 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.495591 2699 raft_consensus.cc:357] T 75a6a340faad4e46924b79adc8bcb867 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.495791 2699 raft_consensus.cc:383] T 75a6a340faad4e46924b79adc8bcb867 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:51.495887 2699 raft_consensus.cc:738] T 75a6a340faad4e46924b79adc8bcb867 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:51.496140 2699 consensus_queue.cc:260] T 75a6a340faad4e46924b79adc8bcb867 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.497200 2778 leader_election.cc:290] T 2c03497e3cb4480d88d99dde5d6ea22b P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Requested vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:51.501768 2699 ts_tablet_manager.cc:1428] T 75a6a340faad4e46924b79adc8bcb867 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20250831 19:54:51.503454 2284 tablet_bootstrap.cc:492] T 769d6c67c8184282b90bda6c16a93dde P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:51.503635 2284 ts_tablet_manager.cc:1397] T 769d6c67c8184282b90bda6c16a93dde P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.031s user 0.007s sys 0.003s
I20250831 19:54:51.504386 2284 raft_consensus.cc:357] T 769d6c67c8184282b90bda6c16a93dde P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.504567 2284 raft_consensus.cc:383] T 769d6c67c8184282b90bda6c16a93dde P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:51.504650 2284 raft_consensus.cc:738] T 769d6c67c8184282b90bda6c16a93dde P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:51.504920 2758 raft_consensus.cc:491] T 75a6a340faad4e46924b79adc8bcb867 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:51.504974 2284 consensus_queue.cc:260] T 769d6c67c8184282b90bda6c16a93dde P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.505056 2758 raft_consensus.cc:513] T 75a6a340faad4e46924b79adc8bcb867 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.505663 2758 leader_election.cc:290] T 75a6a340faad4e46924b79adc8bcb867 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:51.506125 1632 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "75a6a340faad4e46924b79adc8bcb867" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:51.506237 1771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "75a6a340faad4e46924b79adc8bcb867" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:51.506318 1632 raft_consensus.cc:2466] T 75a6a340faad4e46924b79adc8bcb867 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 0.
I20250831 19:54:51.506420 1771 raft_consensus.cc:2466] T 75a6a340faad4e46924b79adc8bcb867 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 0.
I20250831 19:54:51.506717 1841 leader_election.cc:304] T 75a6a340faad4e46924b79adc8bcb867 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:54:51.507238 2758 raft_consensus.cc:2802] T 75a6a340faad4e46924b79adc8bcb867 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:51.507371 2758 raft_consensus.cc:491] T 75a6a340faad4e46924b79adc8bcb867 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:51.507458 2758 raft_consensus.cc:3058] T 75a6a340faad4e46924b79adc8bcb867 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:51.508354 2699 tablet_bootstrap.cc:492] T cb21c47c27ea4f34801e93bd647e41b5 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:51.510150 2699 tablet_bootstrap.cc:654] T cb21c47c27ea4f34801e93bd647e41b5 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:51.510298 2758 raft_consensus.cc:513] T 75a6a340faad4e46924b79adc8bcb867 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.516441 1632 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "75a6a340faad4e46924b79adc8bcb867" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:54:51.516433 1771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "75a6a340faad4e46924b79adc8bcb867" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197"
I20250831 19:54:51.516621 1771 raft_consensus.cc:3058] T 75a6a340faad4e46924b79adc8bcb867 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:51.516654 1632 raft_consensus.cc:3058] T 75a6a340faad4e46924b79adc8bcb867 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:51.517056 2778 raft_consensus.cc:491] T cb21c47c27ea4f34801e93bd647e41b5 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:51.517208 2778 raft_consensus.cc:513] T cb21c47c27ea4f34801e93bd647e41b5 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.518307 2758 leader_election.cc:290] T 75a6a340faad4e46924b79adc8bcb867 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 election: Requested vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:51.505604 2284 ts_tablet_manager.cc:1428] T 769d6c67c8184282b90bda6c16a93dde P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20250831 19:54:51.519352 2118 catalog_manager.cc:3460] renamed table default.table_15260b732e8c4a32ab2c268a74a7dfb7 [id=f48af5bc3eff4c819be4aeeff4128c2a] in HMS: new name default.table_207ac87518bc487184a89bb52cd204b3
I20250831 19:54:51.520946 1632 raft_consensus.cc:2466] T 75a6a340faad4e46924b79adc8bcb867 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 1.
I20250831 19:54:51.521325 1841 leader_election.cc:304] T 75a6a340faad4e46924b79adc8bcb867 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:54:51.521642 2758 raft_consensus.cc:2802] T 75a6a340faad4e46924b79adc8bcb867 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:51.521782 2758 raft_consensus.cc:695] T 75a6a340faad4e46924b79adc8bcb867 P 2441fafe1d62429386f4631ad423567d [term 1 LEADER]: Becoming Leader. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Running, Role: LEADER
I20250831 19:54:51.522073 2758 consensus_queue.cc:237] T 75a6a340faad4e46924b79adc8bcb867 P 2441fafe1d62429386f4631ad423567d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.523026 2282 tablet_bootstrap.cc:492] T 7dbfbe9b2b024f699c52046e09aa3301 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:51.523183 2282 ts_tablet_manager.cc:1397] T 7dbfbe9b2b024f699c52046e09aa3301 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.077s user 0.003s sys 0.000s
I20250831 19:54:51.523960 2282 raft_consensus.cc:357] T 7dbfbe9b2b024f699c52046e09aa3301 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.524151 2282 raft_consensus.cc:383] T 7dbfbe9b2b024f699c52046e09aa3301 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:51.524224 2282 raft_consensus.cc:738] T 7dbfbe9b2b024f699c52046e09aa3301 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:51.525961 2778 leader_election.cc:290] T cb21c47c27ea4f34801e93bd647e41b5 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:51.526775 1632 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "cb21c47c27ea4f34801e93bd647e41b5" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:51.526938 1903 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "cb21c47c27ea4f34801e93bd647e41b5" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:51.527002 1632 raft_consensus.cc:2466] T cb21c47c27ea4f34801e93bd647e41b5 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 0.
I20250831 19:54:51.527349 1706 leader_election.cc:304] T cb21c47c27ea4f34801e93bd647e41b5 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197; no voters:
W20250831 19:54:51.527544 1705 leader_election.cc:343] T cb21c47c27ea4f34801e93bd647e41b5 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): Illegal state: must be running to vote when last-logged opid is not known
I20250831 19:54:51.527707 2778 raft_consensus.cc:2802] T cb21c47c27ea4f34801e93bd647e41b5 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:51.527782 2778 raft_consensus.cc:491] T cb21c47c27ea4f34801e93bd647e41b5 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:51.527885 2778 raft_consensus.cc:3058] T cb21c47c27ea4f34801e93bd647e41b5 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:51.527987 2282 consensus_queue.cc:260] T 7dbfbe9b2b024f699c52046e09aa3301 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.530503 2778 raft_consensus.cc:513] T cb21c47c27ea4f34801e93bd647e41b5 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.527664 1771 raft_consensus.cc:2466] T 75a6a340faad4e46924b79adc8bcb867 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 1.
I20250831 19:54:51.531752 1903 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "cb21c47c27ea4f34801e93bd647e41b5" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
W20250831 19:54:51.532315 1705 leader_election.cc:343] T cb21c47c27ea4f34801e93bd647e41b5 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): Illegal state: must be running to vote when last-logged opid is not known
I20250831 19:54:51.533093 1631 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "cb21c47c27ea4f34801e93bd647e41b5" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:54:51.533254 1631 raft_consensus.cc:3058] T cb21c47c27ea4f34801e93bd647e41b5 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:51.535503 2715 ts_tablet_manager.cc:1918] T 00926e7f9fc74f1e9094fdfec9a1115f P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:51.535606 2715 log.cc:1199] T 00926e7f9fc74f1e9094fdfec9a1115f P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/00926e7f9fc74f1e9094fdfec9a1115f
I20250831 19:54:51.535948 1631 raft_consensus.cc:2466] T cb21c47c27ea4f34801e93bd647e41b5 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:54:51.536013 2715 ts_tablet_manager.cc:1939] T 00926e7f9fc74f1e9094fdfec9a1115f P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
I20250831 19:54:51.536511 1706 leader_election.cc:304] T cb21c47c27ea4f34801e93bd647e41b5 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197; no voters: 2441fafe1d62429386f4631ad423567d
I20250831 19:54:51.536859 2472 raft_consensus.cc:2802] T cb21c47c27ea4f34801e93bd647e41b5 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:51.536964 2104 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet 00926e7f9fc74f1e9094fdfec9a1115f (table default.table_2b373bd597c54990856bf4882d180dcd [id=ed77a92cc1114d2398722bc6269e3a4d]) successfully deleted
I20250831 19:54:51.537137 2472 raft_consensus.cc:695] T cb21c47c27ea4f34801e93bd647e41b5 P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: Becoming Leader. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Running, Role: LEADER
I20250831 19:54:51.537287 2282 ts_tablet_manager.cc:1428] T 7dbfbe9b2b024f699c52046e09aa3301 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.014s user 0.001s sys 0.001s
I20250831 19:54:51.537393 2472 consensus_queue.cc:237] T cb21c47c27ea4f34801e93bd647e41b5 P de831f40fa1348a48a1f0260f4130197 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.537539 2584 raft_consensus.cc:491] T eb9df294c5924116a9d26c0b254e6fe5 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:51.537659 2584 raft_consensus.cc:513] T eb9df294c5924116a9d26c0b254e6fe5 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.538213 2584 leader_election.cc:290] T eb9df294c5924116a9d26c0b254e6fe5 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:51.538949 1903 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "eb9df294c5924116a9d26c0b254e6fe5" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
W20250831 19:54:51.539551 1705 leader_election.cc:343] T eb9df294c5924116a9d26c0b254e6fe5 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): Illegal state: must be running to vote when last-logged opid is not known
I20250831 19:54:51.539834 1631 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "eb9df294c5924116a9d26c0b254e6fe5" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
W20250831 19:54:51.540328 1706 leader_election.cc:343] T eb9df294c5924116a9d26c0b254e6fe5 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): Illegal state: must be running to vote when last-logged opid is not known
I20250831 19:54:51.540429 1706 leader_election.cc:304] T eb9df294c5924116a9d26c0b254e6fe5 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: de831f40fa1348a48a1f0260f4130197; no voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825
I20250831 19:54:51.541134 2584 raft_consensus.cc:2747] T eb9df294c5924116a9d26c0b254e6fe5 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250831 19:54:51.541337 2778 leader_election.cc:290] T cb21c47c27ea4f34801e93bd647e41b5 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Requested vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:51.542651 2282 tablet_bootstrap.cc:492] T 4be6edd110374d2bb941e26defc7302f P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:51.544354 2282 tablet_bootstrap.cc:654] T 4be6edd110374d2bb941e26defc7302f P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:51.548046 2699 tablet_bootstrap.cc:492] T cb21c47c27ea4f34801e93bd647e41b5 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:51.548233 2699 ts_tablet_manager.cc:1397] T cb21c47c27ea4f34801e93bd647e41b5 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.040s user 0.003s sys 0.000s
I20250831 19:54:51.549054 2699 raft_consensus.cc:357] T cb21c47c27ea4f34801e93bd647e41b5 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.549245 2699 raft_consensus.cc:383] T cb21c47c27ea4f34801e93bd647e41b5 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:51.549328 2699 raft_consensus.cc:738] T cb21c47c27ea4f34801e93bd647e41b5 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:51.549834 2699 consensus_queue.cc:260] T cb21c47c27ea4f34801e93bd647e41b5 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.550455 2699 ts_tablet_manager.cc:1428] T cb21c47c27ea4f34801e93bd647e41b5 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250831 19:54:51.550734 2699 tablet_bootstrap.cc:492] T 05cda604dad041cfaad94d1b43d6b14d P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:51.555619 2699 tablet_bootstrap.cc:654] T 05cda604dad041cfaad94d1b43d6b14d P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:51.573385 2282 tablet_bootstrap.cc:492] T 4be6edd110374d2bb941e26defc7302f P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:51.573563 2282 ts_tablet_manager.cc:1397] T 4be6edd110374d2bb941e26defc7302f P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.031s user 0.001s sys 0.008s
I20250831 19:54:51.574469 2282 raft_consensus.cc:357] T 4be6edd110374d2bb941e26defc7302f P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.574656 2282 raft_consensus.cc:383] T 4be6edd110374d2bb941e26defc7302f P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:51.574750 2282 raft_consensus.cc:738] T 4be6edd110374d2bb941e26defc7302f P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:51.574999 2282 consensus_queue.cc:260] T 4be6edd110374d2bb941e26defc7302f P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.578891 2699 tablet_bootstrap.cc:492] T 05cda604dad041cfaad94d1b43d6b14d P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:51.579082 2699 ts_tablet_manager.cc:1397] T 05cda604dad041cfaad94d1b43d6b14d P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.028s user 0.001s sys 0.002s
I20250831 19:54:51.579674 2282 ts_tablet_manager.cc:1428] T 4be6edd110374d2bb941e26defc7302f P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20250831 19:54:51.579973 2699 raft_consensus.cc:357] T 05cda604dad041cfaad94d1b43d6b14d P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.580195 2699 raft_consensus.cc:383] T 05cda604dad041cfaad94d1b43d6b14d P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:51.580315 2699 raft_consensus.cc:738] T 05cda604dad041cfaad94d1b43d6b14d P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:51.580606 2699 consensus_queue.cc:260] T 05cda604dad041cfaad94d1b43d6b14d P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.582453 2699 ts_tablet_manager.cc:1428] T 05cda604dad041cfaad94d1b43d6b14d P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20250831 19:54:51.582789 2699 tablet_bootstrap.cc:492] T 2c03497e3cb4480d88d99dde5d6ea22b P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:51.584523 2699 tablet_bootstrap.cc:654] T 2c03497e3cb4480d88d99dde5d6ea22b P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:51.588093 2282 tablet_bootstrap.cc:492] T 05cda604dad041cfaad94d1b43d6b14d P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:51.589985 2282 tablet_bootstrap.cc:654] T 05cda604dad041cfaad94d1b43d6b14d P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:51.602349 2282 tablet_bootstrap.cc:492] T 05cda604dad041cfaad94d1b43d6b14d P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:51.602543 2282 ts_tablet_manager.cc:1397] T 05cda604dad041cfaad94d1b43d6b14d P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.000s
I20250831 19:54:51.603215 2699 tablet_bootstrap.cc:492] T 2c03497e3cb4480d88d99dde5d6ea22b P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:51.603380 2699 ts_tablet_manager.cc:1397] T 2c03497e3cb4480d88d99dde5d6ea22b P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.021s user 0.001s sys 0.004s
I20250831 19:54:51.603374 2282 raft_consensus.cc:357] T 05cda604dad041cfaad94d1b43d6b14d P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.603570 2282 raft_consensus.cc:383] T 05cda604dad041cfaad94d1b43d6b14d P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:51.603657 2282 raft_consensus.cc:738] T 05cda604dad041cfaad94d1b43d6b14d P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:51.603899 2282 consensus_queue.cc:260] T 05cda604dad041cfaad94d1b43d6b14d P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.604100 2699 raft_consensus.cc:357] T 2c03497e3cb4480d88d99dde5d6ea22b P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.604275 2699 raft_consensus.cc:383] T 2c03497e3cb4480d88d99dde5d6ea22b P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:51.604337 2699 raft_consensus.cc:738] T 2c03497e3cb4480d88d99dde5d6ea22b P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:51.604382 2282 ts_tablet_manager.cc:1428] T 05cda604dad041cfaad94d1b43d6b14d P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250831 19:54:51.604585 2699 consensus_queue.cc:260] T 2c03497e3cb4480d88d99dde5d6ea22b P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.604681 2282 tablet_bootstrap.cc:492] T 920c6fcdf1a44d07b132de6a08b3cbf8 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:51.605033 2699 ts_tablet_manager.cc:1428] T 2c03497e3cb4480d88d99dde5d6ea22b P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20250831 19:54:51.605345 2699 tablet_bootstrap.cc:492] T d3a587be468b4b7c8b90f4374af25e08 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:51.606992 2699 tablet_bootstrap.cc:654] T d3a587be468b4b7c8b90f4374af25e08 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:51.608493 2282 tablet_bootstrap.cc:654] T 920c6fcdf1a44d07b132de6a08b3cbf8 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:51.630529 2282 tablet_bootstrap.cc:492] T 920c6fcdf1a44d07b132de6a08b3cbf8 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:51.630728 2282 ts_tablet_manager.cc:1397] T 920c6fcdf1a44d07b132de6a08b3cbf8 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.026s user 0.001s sys 0.002s
I20250831 19:54:51.631680 2282 raft_consensus.cc:357] T 920c6fcdf1a44d07b132de6a08b3cbf8 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.631896 2282 raft_consensus.cc:383] T 920c6fcdf1a44d07b132de6a08b3cbf8 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:51.631989 2282 raft_consensus.cc:738] T 920c6fcdf1a44d07b132de6a08b3cbf8 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:51.632259 2282 consensus_queue.cc:260] T 920c6fcdf1a44d07b132de6a08b3cbf8 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.632634 2699 tablet_bootstrap.cc:492] T d3a587be468b4b7c8b90f4374af25e08 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:51.632807 2699 ts_tablet_manager.cc:1397] T d3a587be468b4b7c8b90f4374af25e08 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.028s user 0.004s sys 0.000s
I20250831 19:54:51.633575 2699 raft_consensus.cc:357] T d3a587be468b4b7c8b90f4374af25e08 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.633760 2699 raft_consensus.cc:383] T d3a587be468b4b7c8b90f4374af25e08 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:51.633857 2699 raft_consensus.cc:738] T d3a587be468b4b7c8b90f4374af25e08 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:51.634076 2699 consensus_queue.cc:260] T d3a587be468b4b7c8b90f4374af25e08 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.634583 2699 ts_tablet_manager.cc:1428] T d3a587be468b4b7c8b90f4374af25e08 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250831 19:54:51.634905 2699 tablet_bootstrap.cc:492] T 4be6edd110374d2bb941e26defc7302f P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:51.636637 2699 tablet_bootstrap.cc:654] T 4be6edd110374d2bb941e26defc7302f P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:51.636674 2282 ts_tablet_manager.cc:1428] T 920c6fcdf1a44d07b132de6a08b3cbf8 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.005s user 0.001s sys 0.002s
I20250831 19:54:51.636981 2282 tablet_bootstrap.cc:492] T d3a587be468b4b7c8b90f4374af25e08 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:51.639964 2282 tablet_bootstrap.cc:654] T d3a587be468b4b7c8b90f4374af25e08 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:51.647333 2699 tablet_bootstrap.cc:492] T 4be6edd110374d2bb941e26defc7302f P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:51.647894 2699 ts_tablet_manager.cc:1397] T 4be6edd110374d2bb941e26defc7302f P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.013s user 0.006s sys 0.000s
I20250831 19:54:51.648869 2699 raft_consensus.cc:357] T 4be6edd110374d2bb941e26defc7302f P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.649063 2699 raft_consensus.cc:383] T 4be6edd110374d2bb941e26defc7302f P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:51.649147 2699 raft_consensus.cc:738] T 4be6edd110374d2bb941e26defc7302f P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:51.649457 2699 consensus_queue.cc:260] T 4be6edd110374d2bb941e26defc7302f P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.651134 2122 catalog_manager.cc:3460] renamed table default.table_8adc00cc53274835bfe463ebf3bd3f45 [id=0fc929ad819b48a9af984f8c301bad2b] in HMS: new name default.table_be31f59f9d014d278544a1c9deb8a41a
I20250831 19:54:51.653474 2699 ts_tablet_manager.cc:1428] T 4be6edd110374d2bb941e26defc7302f P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20250831 19:54:51.655886 2472 raft_consensus.cc:491] T 539e87d86bf7448c978743375bdb3a79 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:51.656070 2472 raft_consensus.cc:513] T 539e87d86bf7448c978743375bdb3a79 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.656663 2472 leader_election.cc:290] T 539e87d86bf7448c978743375bdb3a79 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:51.656889 2699 tablet_bootstrap.cc:492] T 7dbfbe9b2b024f699c52046e09aa3301 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:51.657678 1903 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "539e87d86bf7448c978743375bdb3a79" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:51.657874 1903 raft_consensus.cc:2466] T 539e87d86bf7448c978743375bdb3a79 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 0.
I20250831 19:54:51.658965 2699 tablet_bootstrap.cc:654] T 7dbfbe9b2b024f699c52046e09aa3301 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:51.660308 1705 leader_election.cc:304] T 539e87d86bf7448c978743375bdb3a79 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:51.660920 1632 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "539e87d86bf7448c978743375bdb3a79" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:51.661119 1632 raft_consensus.cc:2466] T 539e87d86bf7448c978743375bdb3a79 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 0.
I20250831 19:54:51.661793 2472 raft_consensus.cc:2802] T 539e87d86bf7448c978743375bdb3a79 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:51.661909 2472 raft_consensus.cc:491] T 539e87d86bf7448c978743375bdb3a79 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:51.662017 2472 raft_consensus.cc:3058] T 539e87d86bf7448c978743375bdb3a79 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:51.662879 2758 raft_consensus.cc:491] T 2c03497e3cb4480d88d99dde5d6ea22b P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:51.663642 2758 raft_consensus.cc:513] T 2c03497e3cb4480d88d99dde5d6ea22b P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.664254 2758 leader_election.cc:290] T 2c03497e3cb4480d88d99dde5d6ea22b P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:51.664641 2472 raft_consensus.cc:513] T 539e87d86bf7448c978743375bdb3a79 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.665190 1632 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2c03497e3cb4480d88d99dde5d6ea22b" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:51.665503 1632 raft_consensus.cc:2391] T 2c03497e3cb4480d88d99dde5d6ea22b P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2441fafe1d62429386f4631ad423567d in current term 1: Already voted for candidate de831f40fa1348a48a1f0260f4130197 in this term.
I20250831 19:54:51.666028 1771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2c03497e3cb4480d88d99dde5d6ea22b" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:51.666467 1903 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "539e87d86bf7448c978743375bdb3a79" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:54:51.666644 1903 raft_consensus.cc:3058] T 539e87d86bf7448c978743375bdb3a79 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:51.669292 1903 raft_consensus.cc:2466] T 539e87d86bf7448c978743375bdb3a79 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:54:51.669854 1705 leader_election.cc:304] T 539e87d86bf7448c978743375bdb3a79 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:51.670117 2778 raft_consensus.cc:491] T 9dd77008323943ceaf515422255c8a23 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:51.670356 2699 tablet_bootstrap.cc:492] T 7dbfbe9b2b024f699c52046e09aa3301 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:51.670265 2778 raft_consensus.cc:513] T 9dd77008323943ceaf515422255c8a23 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.670488 2699 ts_tablet_manager.cc:1397] T 7dbfbe9b2b024f699c52046e09aa3301 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.001s
I20250831 19:54:51.670864 2778 leader_election.cc:290] T 9dd77008323943ceaf515422255c8a23 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:51.671025 2778 raft_consensus.cc:2802] T 539e87d86bf7448c978743375bdb3a79 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:51.671144 2778 raft_consensus.cc:695] T 539e87d86bf7448c978743375bdb3a79 P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: Becoming Leader. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Running, Role: LEADER
I20250831 19:54:51.671298 2699 raft_consensus.cc:357] T 7dbfbe9b2b024f699c52046e09aa3301 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.671463 2699 raft_consensus.cc:383] T 7dbfbe9b2b024f699c52046e09aa3301 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:51.671536 2699 raft_consensus.cc:738] T 7dbfbe9b2b024f699c52046e09aa3301 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:51.671411 2778 consensus_queue.cc:237] T 539e87d86bf7448c978743375bdb3a79 P de831f40fa1348a48a1f0260f4130197 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.671762 2699 consensus_queue.cc:260] T 7dbfbe9b2b024f699c52046e09aa3301 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.673460 1632 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9dd77008323943ceaf515422255c8a23" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:51.673581 1842 leader_election.cc:304] T 2c03497e3cb4480d88d99dde5d6ea22b P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2441fafe1d62429386f4631ad423567d; no voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197
I20250831 19:54:51.673678 1632 raft_consensus.cc:2391] T 9dd77008323943ceaf515422255c8a23 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate de831f40fa1348a48a1f0260f4130197 in current term 1: Already voted for candidate 2441fafe1d62429386f4631ad423567d in this term.
I20250831 19:54:51.674583 1906 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9dd77008323943ceaf515422255c8a23" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:51.674816 2282 tablet_bootstrap.cc:492] T d3a587be468b4b7c8b90f4374af25e08 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:51.674995 2282 ts_tablet_manager.cc:1397] T d3a587be468b4b7c8b90f4374af25e08 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.038s user 0.000s sys 0.004s
I20250831 19:54:51.675100 1705 leader_election.cc:304] T 9dd77008323943ceaf515422255c8a23 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: de831f40fa1348a48a1f0260f4130197; no voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825
I20250831 19:54:51.675370 2699 ts_tablet_manager.cc:1428] T 7dbfbe9b2b024f699c52046e09aa3301 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20250831 19:54:51.675439 2584 raft_consensus.cc:3058] T 9dd77008323943ceaf515422255c8a23 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:51.675725 2282 raft_consensus.cc:357] T d3a587be468b4b7c8b90f4374af25e08 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.675920 2282 raft_consensus.cc:383] T d3a587be468b4b7c8b90f4374af25e08 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:51.675993 2282 raft_consensus.cc:738] T d3a587be468b4b7c8b90f4374af25e08 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:51.676240 2282 consensus_queue.cc:260] T d3a587be468b4b7c8b90f4374af25e08 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.678764 2584 raft_consensus.cc:2747] T 9dd77008323943ceaf515422255c8a23 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250831 19:54:51.678990 2282 ts_tablet_manager.cc:1428] T d3a587be468b4b7c8b90f4374af25e08 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20250831 19:54:51.679301 2282 tablet_bootstrap.cc:492] T eb9df294c5924116a9d26c0b254e6fe5 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:51.680141 2699 tablet_bootstrap.cc:492] T 920c6fcdf1a44d07b132de6a08b3cbf8 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:51.681675 2699 tablet_bootstrap.cc:654] T 920c6fcdf1a44d07b132de6a08b3cbf8 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:51.682736 2758 raft_consensus.cc:3058] T 2c03497e3cb4480d88d99dde5d6ea22b P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:51.686157 2282 tablet_bootstrap.cc:654] T eb9df294c5924116a9d26c0b254e6fe5 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:51.686230 2758 raft_consensus.cc:2747] T 2c03497e3cb4480d88d99dde5d6ea22b P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250831 19:54:51.690743 2472 leader_election.cc:290] T 539e87d86bf7448c978743375bdb3a79 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Requested vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:51.691006 1632 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "539e87d86bf7448c978743375bdb3a79" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:54:51.691181 1632 raft_consensus.cc:3058] T 539e87d86bf7448c978743375bdb3a79 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:51.693814 1632 raft_consensus.cc:2466] T 539e87d86bf7448c978743375bdb3a79 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:54:51.697256 2699 tablet_bootstrap.cc:492] T 920c6fcdf1a44d07b132de6a08b3cbf8 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:51.697461 2699 ts_tablet_manager.cc:1397] T 920c6fcdf1a44d07b132de6a08b3cbf8 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.017s user 0.000s sys 0.005s
I20250831 19:54:51.698348 2699 raft_consensus.cc:357] T 920c6fcdf1a44d07b132de6a08b3cbf8 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.698545 2699 raft_consensus.cc:383] T 920c6fcdf1a44d07b132de6a08b3cbf8 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:51.698632 2699 raft_consensus.cc:738] T 920c6fcdf1a44d07b132de6a08b3cbf8 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:51.698920 2699 consensus_queue.cc:260] T 920c6fcdf1a44d07b132de6a08b3cbf8 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.700515 2282 tablet_bootstrap.cc:492] T eb9df294c5924116a9d26c0b254e6fe5 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:51.700649 2282 ts_tablet_manager.cc:1397] T eb9df294c5924116a9d26c0b254e6fe5 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.021s user 0.001s sys 0.003s
I20250831 19:54:51.701274 2282 raft_consensus.cc:357] T eb9df294c5924116a9d26c0b254e6fe5 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.701467 2282 raft_consensus.cc:383] T eb9df294c5924116a9d26c0b254e6fe5 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:51.701581 2282 raft_consensus.cc:738] T eb9df294c5924116a9d26c0b254e6fe5 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:51.701792 2282 consensus_queue.cc:260] T eb9df294c5924116a9d26c0b254e6fe5 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.702754 2699 ts_tablet_manager.cc:1428] T 920c6fcdf1a44d07b132de6a08b3cbf8 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20250831 19:54:51.703219 2699 tablet_bootstrap.cc:492] T eb9df294c5924116a9d26c0b254e6fe5 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:51.705380 2699 tablet_bootstrap.cc:654] T eb9df294c5924116a9d26c0b254e6fe5 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:51.705385 2282 ts_tablet_manager.cc:1428] T eb9df294c5924116a9d26c0b254e6fe5 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20250831 19:54:51.705683 2282 tablet_bootstrap.cc:492] T 769d6c67c8184282b90bda6c16a93dde P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:51.707211 2282 tablet_bootstrap.cc:654] T 769d6c67c8184282b90bda6c16a93dde P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:51.709832 2126 catalog_manager.cc:2706] deleted HMS catalog entry for table default.table_4db5965a988f4976ac4dfcb97cc013f0 [id=7deae0a4a0124436a9a1f7b5acd6bd70]
I20250831 19:54:51.720634 2699 tablet_bootstrap.cc:492] T eb9df294c5924116a9d26c0b254e6fe5 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:51.720896 2699 ts_tablet_manager.cc:1397] T eb9df294c5924116a9d26c0b254e6fe5 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.018s user 0.004s sys 0.003s
I20250831 19:54:51.721331 2282 tablet_bootstrap.cc:492] T 769d6c67c8184282b90bda6c16a93dde P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:51.721621 2282 ts_tablet_manager.cc:1397] T 769d6c67c8184282b90bda6c16a93dde P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.000s
I20250831 19:54:51.721860 2699 raft_consensus.cc:357] T eb9df294c5924116a9d26c0b254e6fe5 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.722043 2699 raft_consensus.cc:383] T eb9df294c5924116a9d26c0b254e6fe5 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:51.722133 2699 raft_consensus.cc:738] T eb9df294c5924116a9d26c0b254e6fe5 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:51.722343 2699 consensus_queue.cc:260] T eb9df294c5924116a9d26c0b254e6fe5 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.722738 2282 raft_consensus.cc:357] T 769d6c67c8184282b90bda6c16a93dde P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.722860 2699 ts_tablet_manager.cc:1428] T eb9df294c5924116a9d26c0b254e6fe5 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20250831 19:54:51.722986 2282 raft_consensus.cc:383] T 769d6c67c8184282b90bda6c16a93dde P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:51.723099 2282 raft_consensus.cc:738] T 769d6c67c8184282b90bda6c16a93dde P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:51.723376 2282 consensus_queue.cc:260] T 769d6c67c8184282b90bda6c16a93dde P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.727288 2282 ts_tablet_manager.cc:1428] T 769d6c67c8184282b90bda6c16a93dde P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20250831 19:54:51.730000 2699 tablet_bootstrap.cc:492] T 769d6c67c8184282b90bda6c16a93dde P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:51.735874 2699 tablet_bootstrap.cc:654] T 769d6c67c8184282b90bda6c16a93dde P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:51.751488 2699 tablet_bootstrap.cc:492] T 769d6c67c8184282b90bda6c16a93dde P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:51.751761 2699 ts_tablet_manager.cc:1397] T 769d6c67c8184282b90bda6c16a93dde P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.022s user 0.007s sys 0.000s
I20250831 19:54:51.752641 2699 raft_consensus.cc:357] T 769d6c67c8184282b90bda6c16a93dde P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.752938 2699 raft_consensus.cc:383] T 769d6c67c8184282b90bda6c16a93dde P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:51.753057 2699 raft_consensus.cc:738] T 769d6c67c8184282b90bda6c16a93dde P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:51.753374 2699 consensus_queue.cc:260] T 769d6c67c8184282b90bda6c16a93dde P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.753974 2699 ts_tablet_manager.cc:1428] T 769d6c67c8184282b90bda6c16a93dde P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250831 19:54:51.763836 2124 catalog_manager.cc:2706] deleted HMS catalog entry for table default.table_a01df8e629084e9c988bca1b80c7d640 [id=5acaabe7b54f4abd8885a01190afef85]
I20250831 19:54:51.777665 2186 catalog_manager.cc:2747] Deleting table default.table_2b373bd597c54990856bf4882d180dcd [id=ed77a92cc1114d2398722bc6269e3a4d] in response to Hive Metastore notification log event 99
I20250831 19:54:51.779628 2723 tablet.cc:1722] T 4b3babfbfe394414b944bd53377edeb0 P de831f40fa1348a48a1f0260f4130197: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20250831 19:54:51.780141 2761 tablet.cc:1722] T 4b3babfbfe394414b944bd53377edeb0 P 2441fafe1d62429386f4631ad423567d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20250831 19:54:51.780146 2786 tablet.cc:1722] T 4b3babfbfe394414b944bd53377edeb0 P 89aa85d59c53436ebdf3074b13d14825: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20250831 19:54:51.785231 2758 raft_consensus.cc:491] T 05cda604dad041cfaad94d1b43d6b14d P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:51.785374 2758 raft_consensus.cc:513] T 05cda604dad041cfaad94d1b43d6b14d P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.786072 2758 leader_election.cc:290] T 05cda604dad041cfaad94d1b43d6b14d P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:51.787307 1771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "05cda604dad041cfaad94d1b43d6b14d" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:51.787530 1771 raft_consensus.cc:2466] T 05cda604dad041cfaad94d1b43d6b14d P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 0.
I20250831 19:54:51.787925 1842 leader_election.cc:304] T 05cda604dad041cfaad94d1b43d6b14d P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:51.788142 1632 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "05cda604dad041cfaad94d1b43d6b14d" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:51.788275 1632 raft_consensus.cc:2466] T 05cda604dad041cfaad94d1b43d6b14d P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 0.
I20250831 19:54:51.788586 2758 raft_consensus.cc:2802] T 05cda604dad041cfaad94d1b43d6b14d P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:51.788689 2758 raft_consensus.cc:491] T 05cda604dad041cfaad94d1b43d6b14d P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:51.788762 2758 raft_consensus.cc:3058] T 05cda604dad041cfaad94d1b43d6b14d P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:51.790683 2758 raft_consensus.cc:513] T 05cda604dad041cfaad94d1b43d6b14d P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.791890 1771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "05cda604dad041cfaad94d1b43d6b14d" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197"
I20250831 19:54:51.792078 1771 raft_consensus.cc:3058] T 05cda604dad041cfaad94d1b43d6b14d P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:51.794330 1771 raft_consensus.cc:2466] T 05cda604dad041cfaad94d1b43d6b14d P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 1.
I20250831 19:54:51.794732 1842 leader_election.cc:304] T 05cda604dad041cfaad94d1b43d6b14d P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:51.794986 2799 raft_consensus.cc:2802] T 05cda604dad041cfaad94d1b43d6b14d P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:51.795024 1632 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "05cda604dad041cfaad94d1b43d6b14d" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:54:51.795086 2799 raft_consensus.cc:695] T 05cda604dad041cfaad94d1b43d6b14d P 2441fafe1d62429386f4631ad423567d [term 1 LEADER]: Becoming Leader. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Running, Role: LEADER
I20250831 19:54:51.795187 1632 raft_consensus.cc:3058] T 05cda604dad041cfaad94d1b43d6b14d P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:51.795336 2799 consensus_queue.cc:237] T 05cda604dad041cfaad94d1b43d6b14d P 2441fafe1d62429386f4631ad423567d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.795444 2758 leader_election.cc:290] T 05cda604dad041cfaad94d1b43d6b14d P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 election: Requested vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:51.797559 1632 raft_consensus.cc:2466] T 05cda604dad041cfaad94d1b43d6b14d P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 1.
I20250831 19:54:51.802217 2186 catalog_manager.cc:5869] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Sending DeleteTablet for 3 replicas of tablet eb9df294c5924116a9d26c0b254e6fe5
I20250831 19:54:51.803663 1609 tablet_service.cc:1515] Processing DeleteTablet for tablet eb9df294c5924116a9d26c0b254e6fe5 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:51 UTC) from {username='slave'} at 127.0.0.1:51022
I20250831 19:54:51.804106 1884 tablet_service.cc:1515] Processing DeleteTablet for tablet eb9df294c5924116a9d26c0b254e6fe5 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:51 UTC) from {username='slave'} at 127.0.0.1:45906
I20250831 19:54:51.805346 2715 tablet_replica.cc:331] T eb9df294c5924116a9d26c0b254e6fe5 P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:54:51.805575 2715 raft_consensus.cc:2241] T eb9df294c5924116a9d26c0b254e6fe5 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:51.805688 1751 tablet_service.cc:1515] Processing DeleteTablet for tablet eb9df294c5924116a9d26c0b254e6fe5 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:51 UTC) from {username='slave'} at 127.0.0.1:50674
I20250831 19:54:51.805732 2715 raft_consensus.cc:2270] T eb9df294c5924116a9d26c0b254e6fe5 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:51.806618 2715 ts_tablet_manager.cc:1905] T eb9df294c5924116a9d26c0b254e6fe5 P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:51.825237 2715 ts_tablet_manager.cc:1918] T eb9df294c5924116a9d26c0b254e6fe5 P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20250831 19:54:51.828377 2186 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4be6edd110374d2bb941e26defc7302f consensus state has no leader
I20250831 19:54:51.830677 2186 catalog_manager.cc:2747] Deleting table default.table_4db5965a988f4976ac4dfcb97cc013f0 [id=7deae0a4a0124436a9a1f7b5acd6bd70] in response to Hive Metastore notification log event 102
I20250831 19:54:51.827720 2740 raft_consensus.cc:491] T 7dbfbe9b2b024f699c52046e09aa3301 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:51.830977 2740 raft_consensus.cc:513] T 7dbfbe9b2b024f699c52046e09aa3301 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.831670 2740 leader_election.cc:290] T 7dbfbe9b2b024f699c52046e09aa3301 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:51.833329 1903 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7dbfbe9b2b024f699c52046e09aa3301" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:51.833560 1903 raft_consensus.cc:2466] T 7dbfbe9b2b024f699c52046e09aa3301 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 0.
I20250831 19:54:51.834132 1568 leader_election.cc:304] T 7dbfbe9b2b024f699c52046e09aa3301 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:54:51.834493 2740 raft_consensus.cc:2802] T 7dbfbe9b2b024f699c52046e09aa3301 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:51.834578 2740 raft_consensus.cc:491] T 7dbfbe9b2b024f699c52046e09aa3301 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:51.834673 2740 raft_consensus.cc:3058] T 7dbfbe9b2b024f699c52046e09aa3301 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:51.837740 1771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7dbfbe9b2b024f699c52046e09aa3301" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:51.837975 1771 raft_consensus.cc:2466] T 7dbfbe9b2b024f699c52046e09aa3301 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 0.
I20250831 19:54:51.838922 2740 raft_consensus.cc:513] T 7dbfbe9b2b024f699c52046e09aa3301 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.840061 1903 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7dbfbe9b2b024f699c52046e09aa3301" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:54:51.840272 1903 raft_consensus.cc:3058] T 7dbfbe9b2b024f699c52046e09aa3301 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:51.844436 1903 raft_consensus.cc:2466] T 7dbfbe9b2b024f699c52046e09aa3301 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1.
I20250831 19:54:51.845088 1568 leader_election.cc:304] T 7dbfbe9b2b024f699c52046e09aa3301 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:54:51.845724 2740 leader_election.cc:290] T 7dbfbe9b2b024f699c52046e09aa3301 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Requested vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:51.846175 1771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7dbfbe9b2b024f699c52046e09aa3301" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197"
I20250831 19:54:51.846380 1771 raft_consensus.cc:3058] T 7dbfbe9b2b024f699c52046e09aa3301 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:51.849254 2740 raft_consensus.cc:2802] T 7dbfbe9b2b024f699c52046e09aa3301 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:51.849552 2740 raft_consensus.cc:695] T 7dbfbe9b2b024f699c52046e09aa3301 P 89aa85d59c53436ebdf3074b13d14825 [term 1 LEADER]: Becoming Leader. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Running, Role: LEADER
I20250831 19:54:51.850119 2740 consensus_queue.cc:237] T 7dbfbe9b2b024f699c52046e09aa3301 P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.855901 1771 raft_consensus.cc:2466] T 7dbfbe9b2b024f699c52046e09aa3301 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1.
I20250831 19:54:51.868335 2715 log.cc:1199] T eb9df294c5924116a9d26c0b254e6fe5 P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/eb9df294c5924116a9d26c0b254e6fe5
I20250831 19:54:51.868803 2715 ts_tablet_manager.cc:1939] T eb9df294c5924116a9d26c0b254e6fe5 P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
I20250831 19:54:51.879763 2840 tablet_replica.cc:331] T eb9df294c5924116a9d26c0b254e6fe5 P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:54:51.880300 2799 raft_consensus.cc:491] T eb9df294c5924116a9d26c0b254e6fe5 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:51.880483 2799 raft_consensus.cc:513] T eb9df294c5924116a9d26c0b254e6fe5 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.881064 2799 leader_election.cc:290] T eb9df294c5924116a9d26c0b254e6fe5 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:51.883168 2840 raft_consensus.cc:2241] T eb9df294c5924116a9d26c0b254e6fe5 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:51.884490 2840 raft_consensus.cc:2270] T eb9df294c5924116a9d26c0b254e6fe5 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:51.886147 1771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "eb9df294c5924116a9d26c0b254e6fe5" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
W20250831 19:54:51.886734 1842 leader_election.cc:343] T eb9df294c5924116a9d26c0b254e6fe5 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): Illegal state: must be running to vote when last-logged opid is not known
I20250831 19:54:51.891247 2723 tablet.cc:1722] T 81293470431c4deda5efbc30a03ce0ed P de831f40fa1348a48a1f0260f4130197: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:51.892939 2786 tablet.cc:1722] T 81293470431c4deda5efbc30a03ce0ed P 89aa85d59c53436ebdf3074b13d14825: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:51.894635 2186 catalog_manager.cc:5869] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Sending DeleteTablet for 3 replicas of tablet c8300924480443bcbad8345cf743bb58
I20250831 19:54:51.896253 1031 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-taskfwTdIj/build/asan/bin/kudu pid 2437
I20250831 19:54:51.896417 2186 catalog_manager.cc:2747] Deleting table default.table_a01df8e629084e9c988bca1b80c7d640 [id=5acaabe7b54f4abd8885a01190afef85] in response to Hive Metastore notification log event 103
I20250831 19:54:51.897063 2840 ts_tablet_manager.cc:1905] T eb9df294c5924116a9d26c0b254e6fe5 P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:51.897306 1883 tablet_service.cc:1515] Processing DeleteTablet for tablet c8300924480443bcbad8345cf743bb58 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:51 UTC) from {username='slave'} at 127.0.0.1:45906
I20250831 19:54:51.905875 2839 tablet_replica.cc:331] T eb9df294c5924116a9d26c0b254e6fe5 P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:54:51.906474 1751 tablet_service.cc:1515] Processing DeleteTablet for tablet c8300924480443bcbad8345cf743bb58 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:51 UTC) from {username='slave'} at 127.0.0.1:50674
I20250831 19:54:51.906817 2839 raft_consensus.cc:2241] T eb9df294c5924116a9d26c0b254e6fe5 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:51.909106 2472 raft_consensus.cc:491] T 769d6c67c8184282b90bda6c16a93dde P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:51.909238 2472 raft_consensus.cc:513] T 769d6c67c8184282b90bda6c16a93dde P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.909857 2472 leader_election.cc:290] T 769d6c67c8184282b90bda6c16a93dde P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
W20250831 19:54:51.910287 1568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.1.195:43237, user_credentials={real_user=slave}} blocked reactor thread for 58565.1us
I20250831 19:54:51.911132 1633 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "769d6c67c8184282b90bda6c16a93dde" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:51.911427 1633 raft_consensus.cc:2466] T 769d6c67c8184282b90bda6c16a93dde P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 0.
I20250831 19:54:51.911948 1706 leader_election.cc:304] T 769d6c67c8184282b90bda6c16a93dde P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:51.912233 2472 raft_consensus.cc:2802] T 769d6c67c8184282b90bda6c16a93dde P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:51.912334 2472 raft_consensus.cc:491] T 769d6c67c8184282b90bda6c16a93dde P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:51.912446 2472 raft_consensus.cc:3058] T 769d6c67c8184282b90bda6c16a93dde P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:51.908759 2761 tablet.cc:1722] T 81293470431c4deda5efbc30a03ce0ed P 2441fafe1d62429386f4631ad423567d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:51.914310 2839 raft_consensus.cc:2270] T eb9df294c5924116a9d26c0b254e6fe5 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:51.910601 1906 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "769d6c67c8184282b90bda6c16a93dde" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:51.915129 1906 raft_consensus.cc:2466] T 769d6c67c8184282b90bda6c16a93dde P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 0.
W20250831 19:54:51.911509 1841 leader_election.cc:343] T eb9df294c5924116a9d26c0b254e6fe5 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): Not found: Tablet not found: eb9df294c5924116a9d26c0b254e6fe5
I20250831 19:54:51.915403 1841 leader_election.cc:304] T eb9df294c5924116a9d26c0b254e6fe5 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2441fafe1d62429386f4631ad423567d; no voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197
W20250831 19:54:51.915581 1841 raft_consensus.cc:2684] T eb9df294c5924116a9d26c0b254e6fe5 P 2441fafe1d62429386f4631ad423567d: unable to run election callback: Service unavailable: Thread pool token was shut down
I20250831 19:54:51.920118 2472 raft_consensus.cc:513] T 769d6c67c8184282b90bda6c16a93dde P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.920997 1906 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "769d6c67c8184282b90bda6c16a93dde" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:54:51.921142 1906 raft_consensus.cc:3058] T 769d6c67c8184282b90bda6c16a93dde P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:51.923406 2840 ts_tablet_manager.cc:1918] T eb9df294c5924116a9d26c0b254e6fe5 P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250831 19:54:51.923568 2840 log.cc:1199] T eb9df294c5924116a9d26c0b254e6fe5 P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/eb9df294c5924116a9d26c0b254e6fe5
I20250831 19:54:51.923650 1906 raft_consensus.cc:2466] T 769d6c67c8184282b90bda6c16a93dde P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:54:51.924111 2840 ts_tablet_manager.cc:1939] T eb9df294c5924116a9d26c0b254e6fe5 P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
I20250831 19:54:51.924085 1705 leader_election.cc:304] T 769d6c67c8184282b90bda6c16a93dde P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:51.924463 2778 raft_consensus.cc:2802] T 769d6c67c8184282b90bda6c16a93dde P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:51.924613 2778 raft_consensus.cc:695] T 769d6c67c8184282b90bda6c16a93dde P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: Becoming Leader. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Running, Role: LEADER
I20250831 19:54:51.924976 2472 leader_election.cc:290] T 769d6c67c8184282b90bda6c16a93dde P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Requested vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:51.924892 2778 consensus_queue.cc:237] T 769d6c67c8184282b90bda6c16a93dde P de831f40fa1348a48a1f0260f4130197 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:51.931036 2840 tablet_replica.cc:331] T c8300924480443bcbad8345cf743bb58 P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:54:51.931170 2105 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet eb9df294c5924116a9d26c0b254e6fe5 (table default.table_2b373bd597c54990856bf4882d180dcd [id=ed77a92cc1114d2398722bc6269e3a4d]) successfully deleted
I20250831 19:54:51.932075 2840 raft_consensus.cc:2241] T c8300924480443bcbad8345cf743bb58 P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: Raft consensus shutting down.
I20250831 19:54:51.932668 2840 raft_consensus.cc:2270] T c8300924480443bcbad8345cf743bb58 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:51.933640 2840 ts_tablet_manager.cc:1905] T c8300924480443bcbad8345cf743bb58 P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:51.941249 2186 catalog_manager.cc:5869] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Sending DeleteTablet for 3 replicas of tablet 7e9810ebc28e4e07a83307c470ad92b3
I20250831 19:54:51.941928 1632 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "769d6c67c8184282b90bda6c16a93dde" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:54:51.942214 1632 raft_consensus.cc:3058] T 769d6c67c8184282b90bda6c16a93dde P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:51.944181 1751 tablet_service.cc:1515] Processing DeleteTablet for tablet 7e9810ebc28e4e07a83307c470ad92b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:51 UTC) from {username='slave'} at 127.0.0.1:50674
I20250831 19:54:51.944315 2620 generic_service.cc:196] Checking for leaks (request via RPC)
I20250831 19:54:51.944891 2839 ts_tablet_manager.cc:1905] T eb9df294c5924116a9d26c0b254e6fe5 P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:51.945333 1632 raft_consensus.cc:2466] T 769d6c67c8184282b90bda6c16a93dde P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:54:51.946672 1884 tablet_service.cc:1515] Processing DeleteTablet for tablet 7e9810ebc28e4e07a83307c470ad92b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:51 UTC) from {username='slave'} at 127.0.0.1:45906
W20250831 19:54:51.946990 2125 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_0bd3ac197d96497390258988a7c498f4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250831 19:54:51.948275 2104 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet eb9df294c5924116a9d26c0b254e6fe5 (table default.table_2b373bd597c54990856bf4882d180dcd [id=ed77a92cc1114d2398722bc6269e3a4d]) successfully deleted
I20250831 19:54:51.950461 1609 tablet_service.cc:1515] Processing DeleteTablet for tablet c8300924480443bcbad8345cf743bb58 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:51 UTC) from {username='slave'} at 127.0.0.1:51022
I20250831 19:54:51.950709 1614 tablet_service.cc:1515] Processing DeleteTablet for tablet 7e9810ebc28e4e07a83307c470ad92b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:51 UTC) from {username='slave'} at 127.0.0.1:51022
I20250831 19:54:51.952570 2840 ts_tablet_manager.cc:1918] T c8300924480443bcbad8345cf743bb58 P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:51.954324 2840 log.cc:1199] T c8300924480443bcbad8345cf743bb58 P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/c8300924480443bcbad8345cf743bb58
I20250831 19:54:51.954787 2840 ts_tablet_manager.cc:1939] T c8300924480443bcbad8345cf743bb58 P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
I20250831 19:54:51.955930 2105 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet c8300924480443bcbad8345cf743bb58 (table default.table_4db5965a988f4976ac4dfcb97cc013f0 [id=7deae0a4a0124436a9a1f7b5acd6bd70]) successfully deleted
I20250831 19:54:51.957644 2840 tablet_replica.cc:331] T 7e9810ebc28e4e07a83307c470ad92b3 P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:54:51.957893 2840 raft_consensus.cc:2241] T 7e9810ebc28e4e07a83307c470ad92b3 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:51.958129 2840 raft_consensus.cc:2270] T 7e9810ebc28e4e07a83307c470ad92b3 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:51.958684 2840 ts_tablet_manager.cc:1905] T 7e9810ebc28e4e07a83307c470ad92b3 P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:51.961477 2715 tablet_replica.cc:331] T c8300924480443bcbad8345cf743bb58 P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:54:51.961745 2715 raft_consensus.cc:2241] T c8300924480443bcbad8345cf743bb58 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:51.962061 2715 raft_consensus.cc:2270] T c8300924480443bcbad8345cf743bb58 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:51.962661 2715 ts_tablet_manager.cc:1905] T c8300924480443bcbad8345cf743bb58 P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:51.964948 2842 consensus_queue.cc:1035] T b67e0472244e4d79b8dfb7e7474b96b7 P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:51.970880 2840 ts_tablet_manager.cc:1918] T 7e9810ebc28e4e07a83307c470ad92b3 P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:51.971031 2840 log.cc:1199] T 7e9810ebc28e4e07a83307c470ad92b3 P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/7e9810ebc28e4e07a83307c470ad92b3
I20250831 19:54:51.971414 2840 ts_tablet_manager.cc:1939] T 7e9810ebc28e4e07a83307c470ad92b3 P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
I20250831 19:54:51.972577 2105 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet 7e9810ebc28e4e07a83307c470ad92b3 (table default.table_a01df8e629084e9c988bca1b80c7d640 [id=5acaabe7b54f4abd8885a01190afef85]) successfully deleted
I20250831 19:54:51.973559 2799 consensus_queue.cc:1035] T 9dd77008323943ceaf515422255c8a23 P 2441fafe1d62429386f4631ad423567d [LEADER]: Connected to new peer: Peer: permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:51.973942 2839 ts_tablet_manager.cc:1918] T eb9df294c5924116a9d26c0b254e6fe5 P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250831 19:54:51.974058 2839 log.cc:1199] T eb9df294c5924116a9d26c0b254e6fe5 P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/eb9df294c5924116a9d26c0b254e6fe5
I20250831 19:54:51.978637 2715 ts_tablet_manager.cc:1918] T c8300924480443bcbad8345cf743bb58 P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:51.978760 2715 log.cc:1199] T c8300924480443bcbad8345cf743bb58 P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/c8300924480443bcbad8345cf743bb58
I20250831 19:54:51.979182 2715 ts_tablet_manager.cc:1939] T c8300924480443bcbad8345cf743bb58 P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
I20250831 19:54:51.980167 2104 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet c8300924480443bcbad8345cf743bb58 (table default.table_4db5965a988f4976ac4dfcb97cc013f0 [id=7deae0a4a0124436a9a1f7b5acd6bd70]) successfully deleted
I20250831 19:54:51.994829 2839 ts_tablet_manager.cc:1939] T eb9df294c5924116a9d26c0b254e6fe5 P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:54:51.995988 2101 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet eb9df294c5924116a9d26c0b254e6fe5 (table default.table_2b373bd597c54990856bf4882d180dcd [id=ed77a92cc1114d2398722bc6269e3a4d]) successfully deleted
I20250831 19:54:51.996055 2839 tablet_replica.cc:331] T c8300924480443bcbad8345cf743bb58 P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:54:51.996259 2839 raft_consensus.cc:2241] T c8300924480443bcbad8345cf743bb58 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:51.996434 2839 raft_consensus.cc:2270] T c8300924480443bcbad8345cf743bb58 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:51.996536 2715 tablet_replica.cc:331] T 7e9810ebc28e4e07a83307c470ad92b3 P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:54:51.996809 2715 raft_consensus.cc:2241] T 7e9810ebc28e4e07a83307c470ad92b3 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:51.997211 2715 raft_consensus.cc:2270] T 7e9810ebc28e4e07a83307c470ad92b3 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:51.997812 2715 ts_tablet_manager.cc:1905] T 7e9810ebc28e4e07a83307c470ad92b3 P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:51.998356 2839 ts_tablet_manager.cc:1905] T c8300924480443bcbad8345cf743bb58 P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:52.005414 2125 catalog_manager.cc:2149] created HMS catalog entry for table [id=7d4c018fcf534133bcf67cf6c12e3607]
I20250831 19:54:52.013456 2125 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:36958 (request call id 106) took 1279 ms. Trace:
I20250831 19:54:52.013562 2125 rpcz_store.cc:276] 0831 19:54:50.733953 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:51.120298 (+386345us) service_pool.cc:225] Handling call
0831 19:54:51.947119 (+826821us) catalog_manager.cc:2076] Acquired catalog manager lock
0831 19:54:51.947638 (+ 519us) catalog_manager.cc:2122] Created new table and tablet info
0831 19:54:52.005384 (+ 57746us) catalog_manager.cc:2148] Created new table in HMS catalog
0831 19:54:52.013192 (+ 7808us) catalog_manager.cc:2182] Wrote table and tablets to system table
0831 19:54:52.013289 (+ 97us) catalog_manager.cc:2216] Inserted table and tablets into CatalogManager maps
0831 19:54:52.013382 (+ 93us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:52.006108 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:52.006224 (+ 116us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:52.006231 (+ 7us) write_op.cc:435] Acquired schema lock
0831 19:54:52.006233 (+ 2us) tablet.cc:660] Decoding operations
0831 19:54:52.006319 (+ 86us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:52.006331 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:52.006336 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:52.006406 (+ 70us) tablet.cc:699] Row locks acquired
0831 19:54:52.006408 (+ 2us) write_op.cc:260] PREPARE: finished
0831 19:54:52.006442 (+ 34us) write_op.cc:270] Start()
0831 19:54:52.006473 (+ 31us) write_op.cc:276] Timestamp: P: 1756670092006398 usec, L: 0
0831 19:54:52.006477 (+ 4us) op_driver.cc:348] REPLICATION: starting
0831 19:54:52.006640 (+ 163us) log.cc:844] Serialized 433 byte log entry
0831 19:54:52.012552 (+ 5912us) op_driver.cc:464] REPLICATION: finished
0831 19:54:52.012655 (+ 103us) write_op.cc:301] APPLY: starting
0831 19:54:52.012680 (+ 25us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:52.012721 (+ 41us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:52.012753 (+ 32us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:52.012857 (+ 104us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:52.012890 (+ 33us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0831 19:54:52.012896 (+ 6us) write_op.cc:312] APPLY: finished
0831 19:54:52.012960 (+ 64us) log.cc:844] Serialized 29 byte log entry
0831 19:54:52.013015 (+ 55us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:52.013033 (+ 18us) write_op.cc:454] Released schema lock
0831 19:54:52.013040 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0831 19:54:52.013113 (+ 73us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:52.013116 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":58,"Hive Metastore.run_cpu_time_us":272,"Hive Metastore.run_wall_time_us":57384,"child_traces":[["op",{"apply.queue_time_us":58,"apply.run_cpu_time_us":448,"apply.run_wall_time_us":447,"num_ops":2,"prepare.queue_time_us":62,"prepare.run_cpu_time_us":640,"prepare.run_wall_time_us":640,"raft.queue_time_us":1075,"raft.run_cpu_time_us":468,"raft.run_wall_time_us":467,"replication_time_us":6047}]]}
I20250831 19:54:52.024417 2755 consensus_queue.cc:1035] T 9dd77008323943ceaf515422255c8a23 P 2441fafe1d62429386f4631ad423567d [LEADER]: Connected to new peer: Peer: permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:52.025377 2839 ts_tablet_manager.cc:1918] T c8300924480443bcbad8345cf743bb58 P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:52.025642 2839 log.cc:1199] T c8300924480443bcbad8345cf743bb58 P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/c8300924480443bcbad8345cf743bb58
I20250831 19:54:52.026281 2839 ts_tablet_manager.cc:1939] T c8300924480443bcbad8345cf743bb58 P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:54:52.027318 2839 tablet_replica.cc:331] T 7e9810ebc28e4e07a83307c470ad92b3 P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:54:52.027580 2839 raft_consensus.cc:2241] T 7e9810ebc28e4e07a83307c470ad92b3 P 2441fafe1d62429386f4631ad423567d [term 1 LEADER]: Raft consensus shutting down.
I20250831 19:54:52.027908 2839 raft_consensus.cc:2270] T 7e9810ebc28e4e07a83307c470ad92b3 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:52.028360 2101 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet c8300924480443bcbad8345cf743bb58 (table default.table_4db5965a988f4976ac4dfcb97cc013f0 [id=7deae0a4a0124436a9a1f7b5acd6bd70]) successfully deleted
I20250831 19:54:52.030246 2740 consensus_queue.cc:1035] T b67e0472244e4d79b8dfb7e7474b96b7 P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:52.037823 2126 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:36958 (request call id 96) took 1776 ms. Trace:
I20250831 19:54:52.038038 2121 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:36958 (request call id 98) took 1776 ms. Trace:
I20250831 19:54:52.037948 2126 rpcz_store.cc:276] 0831 19:54:50.261515 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:50.715578 (+454063us) service_pool.cc:225] Handling call
0831 19:54:51.053699 (+338121us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:52.037760 (+984061us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":597253,"Hive Metastore.run_cpu_time_us":176,"Hive Metastore.run_wall_time_us":58610}
I20250831 19:54:52.038110 2121 rpcz_store.cc:276] 0831 19:54:50.261754 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:50.856931 (+595177us) service_pool.cc:225] Handling call
0831 19:54:51.053412 (+196481us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:52.037987 (+984575us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":259465,"Hive Metastore.run_cpu_time_us":171,"Hive Metastore.run_wall_time_us":79200}
I20250831 19:54:52.038203 2119 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:36958 (request call id 94) took 1776 ms. Trace:
I20250831 19:54:52.038322 2119 rpcz_store.cc:276] 0831 19:54:50.261275 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:50.714886 (+453611us) service_pool.cc:225] Handling call
0831 19:54:51.053238 (+338352us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:52.037617 (+984379us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:52.037896 (+ 279us) catalog_manager.cc:3683] Apply alter schema
0831 19:54:52.038150 (+ 254us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":443,"Hive Metastore.run_cpu_time_us":657,"Hive Metastore.run_wall_time_us":214680,"spinlock_wait_cycles":768}
I20250831 19:54:52.038755 2119 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_0c22133a9af24fe3b029fc31f3c63625" } modify_external_catalogs: true
I20250831 19:54:52.038954 2119 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_0c22133a9af24fe3b029fc31f3c63625" } modify_external_catalogs: true
I20250831 19:54:52.039628 2118 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:36958 (request call id 95) took 1778 ms. Trace:
I20250831 19:54:52.039709 2118 rpcz_store.cc:276] 0831 19:54:50.261406 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:50.714890 (+453484us) service_pool.cc:225] Handling call
0831 19:54:51.053539 (+338649us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:52.039131 (+985592us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:52.039331 (+ 200us) catalog_manager.cc:3683] Apply alter schema
0831 19:54:52.039571 (+ 240us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":338578,"Hive Metastore.run_cpu_time_us":643,"Hive Metastore.run_wall_time_us":126915,"spinlock_wait_cycles":68608}
I20250831 19:54:52.040062 2118 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_31929d9da7554974b50e28cd094fd2df" } new_table_name: "default.Table_371cc4850a3443e09f9541001b3bbb0c" modify_external_catalogs: true
I20250831 19:54:52.040313 2122 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:36958 (request call id 99) took 1771 ms. Trace:
I20250831 19:54:52.040408 2122 rpcz_store.cc:276] 0831 19:54:50.268738 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:50.877680 (+608942us) service_pool.cc:225] Handling call
0831 19:54:51.053573 (+175893us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:52.039890 (+986317us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:52.040090 (+ 200us) catalog_manager.cc:3683] Apply alter schema
0831 19:54:52.040252 (+ 162us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":465520,"Hive Metastore.run_cpu_time_us":618,"Hive Metastore.run_wall_time_us":131766}
I20250831 19:54:52.040851 2122 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36958:
name: "default.Table_b4399bb161024e3eb0b69c23e3f9af47"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:52.041213 2124 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:36958 (request call id 97) took 1779 ms. Trace:
I20250831 19:54:52.041296 2124 rpcz_store.cc:276] 0831 19:54:50.261651 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:50.788396 (+526745us) service_pool.cc:225] Handling call
0831 19:54:51.053717 (+265321us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:52.041161 (+987444us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":655887,"Hive Metastore.run_cpu_time_us":178,"Hive Metastore.run_wall_time_us":53959}
I20250831 19:54:52.042441 2124 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36958:
name: "default.Table_4e905daf26a044c38517f550bf5157f7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:52.042546 2839 ts_tablet_manager.cc:1905] T 7e9810ebc28e4e07a83307c470ad92b3 P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250831 19:54:52.045960 2123 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_82715a1a3cf44ab586f6ab0f19723f2b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250831 19:54:52.049208 2755 consensus_queue.cc:1035] T bf30ba308d494e2880bb7fae5794d489 P 2441fafe1d62429386f4631ad423567d [LEADER]: Connected to new peer: Peer: permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:52.055760 1751 tablet_service.cc:1468] Processing CreateTablet for tablet c6db2a319cbf4359846c5f930ce8f0de (DEFAULT_TABLE table=default.table_0bd3ac197d96497390258988a7c498f4 [id=7d4c018fcf534133bcf67cf6c12e3607]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:52.055779 1614 tablet_service.cc:1468] Processing CreateTablet for tablet c6db2a319cbf4359846c5f930ce8f0de (DEFAULT_TABLE table=default.table_0bd3ac197d96497390258988a7c498f4 [id=7d4c018fcf534133bcf67cf6c12e3607]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:52.056152 1614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6db2a319cbf4359846c5f930ce8f0de. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:52.056169 1751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6db2a319cbf4359846c5f930ce8f0de. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:52.060808 1884 tablet_service.cc:1468] Processing CreateTablet for tablet c6db2a319cbf4359846c5f930ce8f0de (DEFAULT_TABLE table=default.table_0bd3ac197d96497390258988a7c498f4 [id=7d4c018fcf534133bcf67cf6c12e3607]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:52.063030 2755 raft_consensus.cc:491] T d3a587be468b4b7c8b90f4374af25e08 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:52.063176 2755 raft_consensus.cc:513] T d3a587be468b4b7c8b90f4374af25e08 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:52.063722 2755 leader_election.cc:290] T d3a587be468b4b7c8b90f4374af25e08 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:52.063930 2121 catalog_manager.cc:5674] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475) does not have the latest schema for tablet 7dbfbe9b2b024f699c52046e09aa3301 (table default.table_d3002519e6964bb484d995d871e766c9 [id=1137b2754d104964bbe5bbaa4a0578b8]). Expected version 3 got 0
I20250831 19:54:52.064157 2121 catalog_manager.cc:5582] T 2c03497e3cb4480d88d99dde5d6ea22b P de831f40fa1348a48a1f0260f4130197 reported cstate change: term changed from 0 to 1, leader changed from <none> to de831f40fa1348a48a1f0260f4130197 (127.1.1.194). New cstate: current_term: 1 leader_uuid: "de831f40fa1348a48a1f0260f4130197" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: UNKNOWN } } }
I20250831 19:54:52.064373 1633 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d3a587be468b4b7c8b90f4374af25e08" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:52.064561 1633 raft_consensus.cc:2466] T d3a587be468b4b7c8b90f4374af25e08 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 0.
I20250831 19:54:52.065203 1841 leader_election.cc:304] T d3a587be468b4b7c8b90f4374af25e08 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:54:52.066027 2755 raft_consensus.cc:2802] T d3a587be468b4b7c8b90f4374af25e08 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:52.066104 2755 raft_consensus.cc:491] T d3a587be468b4b7c8b90f4374af25e08 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:52.066077 1769 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d3a587be468b4b7c8b90f4374af25e08" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:52.066185 2755 raft_consensus.cc:3058] T d3a587be468b4b7c8b90f4374af25e08 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:52.066273 1769 raft_consensus.cc:2466] T d3a587be468b4b7c8b90f4374af25e08 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 0.
I20250831 19:54:52.069370 2755 raft_consensus.cc:513] T d3a587be468b4b7c8b90f4374af25e08 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:52.072731 2121 catalog_manager.cc:5582] T 539e87d86bf7448c978743375bdb3a79 P de831f40fa1348a48a1f0260f4130197 reported cstate change: term changed from 0 to 1, leader changed from <none> to de831f40fa1348a48a1f0260f4130197 (127.1.1.194). New cstate: current_term: 1 leader_uuid: "de831f40fa1348a48a1f0260f4130197" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: UNKNOWN } } }
I20250831 19:54:52.073850 2121 catalog_manager.cc:5582] T cb21c47c27ea4f34801e93bd647e41b5 P de831f40fa1348a48a1f0260f4130197 reported cstate change: term changed from 0 to 1, leader changed from <none> to de831f40fa1348a48a1f0260f4130197 (127.1.1.194). New cstate: current_term: 1 leader_uuid: "de831f40fa1348a48a1f0260f4130197" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: UNKNOWN } } }
I20250831 19:54:52.074908 2121 catalog_manager.cc:5582] T 769d6c67c8184282b90bda6c16a93dde P de831f40fa1348a48a1f0260f4130197 reported cstate change: term changed from 0 to 1, leader changed from <none> to de831f40fa1348a48a1f0260f4130197 (127.1.1.194). New cstate: current_term: 1 leader_uuid: "de831f40fa1348a48a1f0260f4130197" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: UNKNOWN } } }
I20250831 19:54:52.079438 1769 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d3a587be468b4b7c8b90f4374af25e08" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197"
I20250831 19:54:52.079725 1769 raft_consensus.cc:3058] T d3a587be468b4b7c8b90f4374af25e08 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:52.080060 2755 leader_election.cc:290] T d3a587be468b4b7c8b90f4374af25e08 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 election: Requested vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:52.080232 1632 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d3a587be468b4b7c8b90f4374af25e08" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:54:52.080379 1632 raft_consensus.cc:3058] T d3a587be468b4b7c8b90f4374af25e08 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:52.080729 2282 tablet_bootstrap.cc:492] T c6db2a319cbf4359846c5f930ce8f0de P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:52.081509 2856 tablet_bootstrap.cc:492] T c6db2a319cbf4359846c5f930ce8f0de P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:52.081799 1884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6db2a319cbf4359846c5f930ce8f0de. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:52.082594 2282 tablet_bootstrap.cc:654] T c6db2a319cbf4359846c5f930ce8f0de P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:52.086884 2126 catalog_manager.cc:5674] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237) does not have the latest schema for tablet 4be6edd110374d2bb941e26defc7302f (table default.table_be31f59f9d014d278544a1c9deb8a41a [id=0fc929ad819b48a9af984f8c301bad2b]). Expected version 1 got 0
I20250831 19:54:52.087215 2126 catalog_manager.cc:5582] T 75a6a340faad4e46924b79adc8bcb867 P 2441fafe1d62429386f4631ad423567d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2441fafe1d62429386f4631ad423567d (127.1.1.195). New cstate: current_term: 1 leader_uuid: "2441fafe1d62429386f4631ad423567d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: UNKNOWN } } }
I20250831 19:54:52.087580 2699 tablet_bootstrap.cc:492] T c6db2a319cbf4359846c5f930ce8f0de P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:52.083072 1769 raft_consensus.cc:2466] T d3a587be468b4b7c8b90f4374af25e08 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 1.
I20250831 19:54:52.088038 1842 leader_election.cc:304] T d3a587be468b4b7c8b90f4374af25e08 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:52.088354 2755 raft_consensus.cc:2802] T d3a587be468b4b7c8b90f4374af25e08 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:52.088331 2126 catalog_manager.cc:5582] T 05cda604dad041cfaad94d1b43d6b14d P 2441fafe1d62429386f4631ad423567d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2441fafe1d62429386f4631ad423567d (127.1.1.195). New cstate: current_term: 1 leader_uuid: "2441fafe1d62429386f4631ad423567d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: UNKNOWN } } }
I20250831 19:54:52.088727 2126 catalog_manager.cc:5674] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237) does not have the latest schema for tablet 05cda604dad041cfaad94d1b43d6b14d (table default.table_6c2f9309b58643529114857aae0568f2 [id=ad7bb166843e423ea7e50a1d18710fa1]). Expected version 2 got 0
I20250831 19:54:52.088858 2755 raft_consensus.cc:695] T d3a587be468b4b7c8b90f4374af25e08 P 2441fafe1d62429386f4631ad423567d [term 1 LEADER]: Becoming Leader. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Running, Role: LEADER
I20250831 19:54:52.089075 2126 catalog_manager.cc:5674] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237) does not have the latest schema for tablet 7dbfbe9b2b024f699c52046e09aa3301 (table default.table_d3002519e6964bb484d995d871e766c9 [id=1137b2754d104964bbe5bbaa4a0578b8]). Expected version 3 got 0
I20250831 19:54:52.089116 2755 consensus_queue.cc:237] T d3a587be468b4b7c8b90f4374af25e08 P 2441fafe1d62429386f4631ad423567d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:52.089663 2699 tablet_bootstrap.cc:654] T c6db2a319cbf4359846c5f930ce8f0de P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:52.094539 1632 raft_consensus.cc:2466] T d3a587be468b4b7c8b90f4374af25e08 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 1.
I20250831 19:54:52.097132 2856 tablet_bootstrap.cc:654] T c6db2a319cbf4359846c5f930ce8f0de P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:52.099161 2715 ts_tablet_manager.cc:1918] T 7e9810ebc28e4e07a83307c470ad92b3 P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:52.099921 2839 ts_tablet_manager.cc:1918] T 7e9810ebc28e4e07a83307c470ad92b3 P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:52.100419 2839 log.cc:1199] T 7e9810ebc28e4e07a83307c470ad92b3 P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/7e9810ebc28e4e07a83307c470ad92b3
I20250831 19:54:52.101240 2282 tablet_bootstrap.cc:492] T c6db2a319cbf4359846c5f930ce8f0de P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:52.101395 2282 ts_tablet_manager.cc:1397] T c6db2a319cbf4359846c5f930ce8f0de P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.021s user 0.006s sys 0.004s
I20250831 19:54:52.102382 2282 raft_consensus.cc:357] T c6db2a319cbf4359846c5f930ce8f0de P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:52.102596 2282 raft_consensus.cc:383] T c6db2a319cbf4359846c5f930ce8f0de P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:52.102706 2282 raft_consensus.cc:738] T c6db2a319cbf4359846c5f930ce8f0de P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:52.102977 2282 consensus_queue.cc:260] T c6db2a319cbf4359846c5f930ce8f0de P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:52.103891 2282 ts_tablet_manager.cc:1428] T c6db2a319cbf4359846c5f930ce8f0de P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250831 19:54:52.105860 2839 ts_tablet_manager.cc:1939] T 7e9810ebc28e4e07a83307c470ad92b3 P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:54:52.106587 2699 tablet_bootstrap.cc:492] T c6db2a319cbf4359846c5f930ce8f0de P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:52.106726 2699 ts_tablet_manager.cc:1397] T c6db2a319cbf4359846c5f930ce8f0de P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.019s user 0.002s sys 0.004s
I20250831 19:54:52.104629 2121 catalog_manager.cc:6127] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: default.table_60746664f3ef4d82866e4bcd56d4fac5 [id=0850f2b0e9324dd0a210fa7b2609c769] alter complete (version 4)
I20250831 19:54:52.107889 2699 raft_consensus.cc:357] T c6db2a319cbf4359846c5f930ce8f0de P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:52.108042 2699 raft_consensus.cc:383] T c6db2a319cbf4359846c5f930ce8f0de P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:52.108119 2699 raft_consensus.cc:738] T c6db2a319cbf4359846c5f930ce8f0de P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:52.108209 2125 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36958:
name: "default.Table_b90139c92a0d426db7ba39ca376bd8e2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:52.108348 2699 consensus_queue.cc:260] T c6db2a319cbf4359846c5f930ce8f0de P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:52.109015 2699 ts_tablet_manager.cc:1428] T c6db2a319cbf4359846c5f930ce8f0de P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250831 19:54:52.109802 2101 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet 7e9810ebc28e4e07a83307c470ad92b3 (table default.table_a01df8e629084e9c988bca1b80c7d640 [id=5acaabe7b54f4abd8885a01190afef85]) successfully deleted
I20250831 19:54:52.099308 2715 log.cc:1199] T 7e9810ebc28e4e07a83307c470ad92b3 P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/7e9810ebc28e4e07a83307c470ad92b3
I20250831 19:54:52.110877 2715 ts_tablet_manager.cc:1939] T 7e9810ebc28e4e07a83307c470ad92b3 P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
I20250831 19:54:52.117210 2856 tablet_bootstrap.cc:492] T c6db2a319cbf4359846c5f930ce8f0de P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:52.117517 2856 ts_tablet_manager.cc:1397] T c6db2a319cbf4359846c5f930ce8f0de P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.036s user 0.002s sys 0.002s
I20250831 19:54:52.117555 2104 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet 7e9810ebc28e4e07a83307c470ad92b3 (table default.table_a01df8e629084e9c988bca1b80c7d640 [id=5acaabe7b54f4abd8885a01190afef85]) successfully deleted
I20250831 19:54:52.118309 2856 raft_consensus.cc:357] T c6db2a319cbf4359846c5f930ce8f0de P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:52.118537 2856 raft_consensus.cc:383] T c6db2a319cbf4359846c5f930ce8f0de P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:52.118667 2856 raft_consensus.cc:738] T c6db2a319cbf4359846c5f930ce8f0de P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:52.118947 2856 consensus_queue.cc:260] T c6db2a319cbf4359846c5f930ce8f0de P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:52.119534 2856 ts_tablet_manager.cc:1428] T c6db2a319cbf4359846c5f930ce8f0de P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250831 19:54:52.120855 2126 catalog_manager.cc:6127] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: default.table_207ac87518bc487184a89bb52cd204b3 [id=f48af5bc3eff4c819be4aeeff4128c2a] alter complete (version 1)
W20250831 19:54:52.121595 2126 catalog_manager.cc:5774] Failed to send AlterTable RPC for tablet 7dbfbe9b2b024f699c52046e09aa3301 (table default.table_d3002519e6964bb484d995d871e766c9 [id=1137b2754d104964bbe5bbaa4a0578b8], current schema version=3): Not found: failed to reset TS proxy: No leader found: Tablet 7dbfbe9b2b024f699c52046e09aa3301 consensus state has no leader
I20250831 19:54:52.122042 1884 tablet_service.cc:1515] Processing DeleteTablet for tablet 7e9810ebc28e4e07a83307c470ad92b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:51 UTC) from {username='slave'} at 127.0.0.1:45906
I20250831 19:54:52.122917 2121 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36958:
name: "default.Table_ca70026c55be4e7a9db72440e0205619"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:52.125052 2126 catalog_manager.cc:5582] T 7dbfbe9b2b024f699c52046e09aa3301 P 89aa85d59c53436ebdf3074b13d14825 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193). New cstate: current_term: 1 leader_uuid: "89aa85d59c53436ebdf3074b13d14825" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: HEALTHY } } }
I20250831 19:54:52.125486 2126 catalog_manager.cc:5674] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197) does not have the latest schema for tablet 7dbfbe9b2b024f699c52046e09aa3301 (table default.table_d3002519e6964bb484d995d871e766c9 [id=1137b2754d104964bbe5bbaa4a0578b8]). Expected version 3 got 0
I20250831 19:54:52.125761 2126 catalog_manager.cc:5674] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197) does not have the latest schema for tablet 4be6edd110374d2bb941e26defc7302f (table default.table_be31f59f9d014d278544a1c9deb8a41a [id=0fc929ad819b48a9af984f8c301bad2b]). Expected version 1 got 0
W20250831 19:54:52.126240 2101 catalog_manager.cc:4895] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): delete failed for tablet 7e9810ebc28e4e07a83307c470ad92b3 because the tablet was not found. No further retry: Not found: Tablet not found: 7e9810ebc28e4e07a83307c470ad92b3
I20250831 19:54:52.126781 2126 catalog_manager.cc:5674] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197) does not have the latest schema for tablet 05cda604dad041cfaad94d1b43d6b14d (table default.table_6c2f9309b58643529114857aae0568f2 [id=ad7bb166843e423ea7e50a1d18710fa1]). Expected version 2 got 0
I20250831 19:54:52.134224 2117 catalog_manager.cc:2706] deleted HMS catalog entry for table default.table_4b100a5c91f9467497d138af9f82f726 [id=ecc3359620c94491ac39b0f7dc2f88c8]
I20250831 19:54:52.148782 2844 raft_consensus.cc:491] T 920c6fcdf1a44d07b132de6a08b3cbf8 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:52.148926 2844 raft_consensus.cc:513] T 920c6fcdf1a44d07b132de6a08b3cbf8 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:52.149535 2844 leader_election.cc:290] T 920c6fcdf1a44d07b132de6a08b3cbf8 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:52.150437 1770 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "920c6fcdf1a44d07b132de6a08b3cbf8" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:52.150687 1770 raft_consensus.cc:2466] T 920c6fcdf1a44d07b132de6a08b3cbf8 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 0.
I20250831 19:54:52.150806 1906 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "920c6fcdf1a44d07b132de6a08b3cbf8" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:52.150856 2799 consensus_queue.cc:1035] T bf30ba308d494e2880bb7fae5794d489 P 2441fafe1d62429386f4631ad423567d [LEADER]: Connected to new peer: Peer: permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:52.151005 1906 raft_consensus.cc:2466] T 920c6fcdf1a44d07b132de6a08b3cbf8 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 0.
I20250831 19:54:52.152009 1570 leader_election.cc:304] T 920c6fcdf1a44d07b132de6a08b3cbf8 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:52.153640 2740 raft_consensus.cc:2802] T 920c6fcdf1a44d07b132de6a08b3cbf8 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:52.153741 2740 raft_consensus.cc:491] T 920c6fcdf1a44d07b132de6a08b3cbf8 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:52.153818 2740 raft_consensus.cc:3058] T 920c6fcdf1a44d07b132de6a08b3cbf8 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:52.157202 2740 raft_consensus.cc:513] T 920c6fcdf1a44d07b132de6a08b3cbf8 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:52.157768 2740 leader_election.cc:290] T 920c6fcdf1a44d07b132de6a08b3cbf8 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Requested vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:52.158696 1770 raft_consensus.cc:1273] T 7dbfbe9b2b024f699c52046e09aa3301 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Refusing update from remote peer 89aa85d59c53436ebdf3074b13d14825: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250831 19:54:52.158861 1903 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "920c6fcdf1a44d07b132de6a08b3cbf8" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:54:52.159053 1903 raft_consensus.cc:3058] T 920c6fcdf1a44d07b132de6a08b3cbf8 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:52.161952 1906 raft_consensus.cc:1273] T 7dbfbe9b2b024f699c52046e09aa3301 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Refusing update from remote peer 89aa85d59c53436ebdf3074b13d14825: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250831 19:54:52.163116 2842 consensus_queue.cc:1035] T 7dbfbe9b2b024f699c52046e09aa3301 P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:52.163460 2842 consensus_queue.cc:1035] T 7dbfbe9b2b024f699c52046e09aa3301 P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:52.161374 1903 raft_consensus.cc:2466] T 920c6fcdf1a44d07b132de6a08b3cbf8 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1.
I20250831 19:54:52.166219 1568 leader_election.cc:304] T 920c6fcdf1a44d07b132de6a08b3cbf8 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:54:52.166473 2844 raft_consensus.cc:2802] T 920c6fcdf1a44d07b132de6a08b3cbf8 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:52.166589 2844 raft_consensus.cc:695] T 920c6fcdf1a44d07b132de6a08b3cbf8 P 89aa85d59c53436ebdf3074b13d14825 [term 1 LEADER]: Becoming Leader. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Running, Role: LEADER
I20250831 19:54:52.166819 2844 consensus_queue.cc:237] T 920c6fcdf1a44d07b132de6a08b3cbf8 P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:52.167620 2799 raft_consensus.cc:491] T c6db2a319cbf4359846c5f930ce8f0de P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:52.167732 2799 raft_consensus.cc:513] T c6db2a319cbf4359846c5f930ce8f0de P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:52.168206 2799 leader_election.cc:290] T c6db2a319cbf4359846c5f930ce8f0de P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:52.168896 1769 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c6db2a319cbf4359846c5f930ce8f0de" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:52.169081 1769 raft_consensus.cc:2466] T c6db2a319cbf4359846c5f930ce8f0de P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 0.
I20250831 19:54:52.169065 1633 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c6db2a319cbf4359846c5f930ce8f0de" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:52.169221 1633 raft_consensus.cc:2466] T c6db2a319cbf4359846c5f930ce8f0de P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 0.
I20250831 19:54:52.169627 1842 leader_election.cc:304] T c6db2a319cbf4359846c5f930ce8f0de P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:52.170029 2799 raft_consensus.cc:2802] T c6db2a319cbf4359846c5f930ce8f0de P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:52.170115 2799 raft_consensus.cc:491] T c6db2a319cbf4359846c5f930ce8f0de P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:52.170177 2799 raft_consensus.cc:3058] T c6db2a319cbf4359846c5f930ce8f0de P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:52.173244 2799 raft_consensus.cc:513] T c6db2a319cbf4359846c5f930ce8f0de P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:52.174217 2799 leader_election.cc:290] T c6db2a319cbf4359846c5f930ce8f0de P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 election: Requested vote from peers 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:52.175077 2786 tablet.cc:1722] T 7dbfbe9b2b024f699c52046e09aa3301 P 89aa85d59c53436ebdf3074b13d14825: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250831 19:54:52.180248 1632 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c6db2a319cbf4359846c5f930ce8f0de" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:54:52.180418 1632 raft_consensus.cc:3058] T c6db2a319cbf4359846c5f930ce8f0de P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:52.182880 1632 raft_consensus.cc:2466] T c6db2a319cbf4359846c5f930ce8f0de P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 1.
I20250831 19:54:52.185575 2723 tablet.cc:1722] T 7dbfbe9b2b024f699c52046e09aa3301 P de831f40fa1348a48a1f0260f4130197: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250831 19:54:52.189256 1770 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c6db2a319cbf4359846c5f930ce8f0de" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197"
I20250831 19:54:52.189417 1770 raft_consensus.cc:3058] T c6db2a319cbf4359846c5f930ce8f0de P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:52.192512 1770 raft_consensus.cc:2466] T c6db2a319cbf4359846c5f930ce8f0de P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 1.
I20250831 19:54:52.193701 1771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "920c6fcdf1a44d07b132de6a08b3cbf8" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197"
I20250831 19:54:52.193892 1771 raft_consensus.cc:3058] T 920c6fcdf1a44d07b132de6a08b3cbf8 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:52.187013 1841 leader_election.cc:304] T c6db2a319cbf4359846c5f930ce8f0de P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:54:52.188215 2761 tablet.cc:1722] T 7dbfbe9b2b024f699c52046e09aa3301 P 2441fafe1d62429386f4631ad423567d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250831 19:54:52.193243 2239 raft_consensus.cc:491] T cb21c47c27ea4f34801e93bd647e41b5 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:52.202324 2239 raft_consensus.cc:513] T cb21c47c27ea4f34801e93bd647e41b5 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:52.202943 2239 leader_election.cc:290] T cb21c47c27ea4f34801e93bd647e41b5 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:52.203109 2239 raft_consensus.cc:2802] T c6db2a319cbf4359846c5f930ce8f0de P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:52.203199 2239 raft_consensus.cc:695] T c6db2a319cbf4359846c5f930ce8f0de P 2441fafe1d62429386f4631ad423567d [term 1 LEADER]: Becoming Leader. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Running, Role: LEADER
I20250831 19:54:52.203439 2239 consensus_queue.cc:237] T c6db2a319cbf4359846c5f930ce8f0de P 2441fafe1d62429386f4631ad423567d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:52.205897 1770 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "cb21c47c27ea4f34801e93bd647e41b5" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:52.208070 1632 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "cb21c47c27ea4f34801e93bd647e41b5" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:52.208302 1632 raft_consensus.cc:2391] T cb21c47c27ea4f34801e93bd647e41b5 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2441fafe1d62429386f4631ad423567d in current term 1: Already voted for candidate de831f40fa1348a48a1f0260f4130197 in this term.
I20250831 19:54:52.208724 1841 leader_election.cc:304] T cb21c47c27ea4f34801e93bd647e41b5 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2441fafe1d62429386f4631ad423567d; no voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197
I20250831 19:54:52.209710 2239 raft_consensus.cc:3058] T cb21c47c27ea4f34801e93bd647e41b5 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:52.211813 2239 raft_consensus.cc:2747] T cb21c47c27ea4f34801e93bd647e41b5 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250831 19:54:52.214849 1771 raft_consensus.cc:2466] T 920c6fcdf1a44d07b132de6a08b3cbf8 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1.
I20250831 19:54:52.220965 2126 catalog_manager.cc:5582] T d3a587be468b4b7c8b90f4374af25e08 P 2441fafe1d62429386f4631ad423567d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2441fafe1d62429386f4631ad423567d (127.1.1.195). New cstate: current_term: 1 leader_uuid: "2441fafe1d62429386f4631ad423567d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: UNKNOWN } } }
I20250831 19:54:52.240228 2120 catalog_manager.cc:3460] renamed table default.table_5660fc6b1a9846a6bd36b56e553a8f35 [id=5ce6c4d5dcd34d73af61fd2c4bf28799] in HMS: new name default.table_af003c3f30c04853bc025b34d543d0e0
I20250831 19:54:52.247182 2126 catalog_manager.cc:5582] T c6db2a319cbf4359846c5f930ce8f0de P 2441fafe1d62429386f4631ad423567d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2441fafe1d62429386f4631ad423567d (127.1.1.195). New cstate: current_term: 1 leader_uuid: "2441fafe1d62429386f4631ad423567d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: HEALTHY } } }
I20250831 19:54:52.250984 2186 catalog_manager.cc:2747] Deleting table default.table_4b100a5c91f9467497d138af9f82f726 [id=ecc3359620c94491ac39b0f7dc2f88c8] in response to Hive Metastore notification log event 105
I20250831 19:54:52.257716 2186 catalog_manager.cc:5869] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Sending DeleteTablet for 3 replicas of tablet de75786bcb5549149a81e52ac1a257db
I20250831 19:54:52.259088 1884 tablet_service.cc:1515] Processing DeleteTablet for tablet de75786bcb5549149a81e52ac1a257db with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:52 UTC) from {username='slave'} at 127.0.0.1:45906
I20250831 19:54:52.259361 2839 tablet_replica.cc:331] T de75786bcb5549149a81e52ac1a257db P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:54:52.259593 2839 raft_consensus.cc:2241] T de75786bcb5549149a81e52ac1a257db P 2441fafe1d62429386f4631ad423567d [term 1 LEADER]: Raft consensus shutting down.
I20250831 19:54:52.259902 2839 raft_consensus.cc:2270] T de75786bcb5549149a81e52ac1a257db P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:52.260475 2839 ts_tablet_manager.cc:1905] T de75786bcb5549149a81e52ac1a257db P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:52.261183 1751 tablet_service.cc:1515] Processing DeleteTablet for tablet de75786bcb5549149a81e52ac1a257db with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:52 UTC) from {username='slave'} at 127.0.0.1:50674
I20250831 19:54:52.261471 2840 tablet_replica.cc:331] T de75786bcb5549149a81e52ac1a257db P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:54:52.261708 2840 raft_consensus.cc:2241] T de75786bcb5549149a81e52ac1a257db P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:52.261917 2840 raft_consensus.cc:2270] T de75786bcb5549149a81e52ac1a257db P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:52.262513 2840 ts_tablet_manager.cc:1905] T de75786bcb5549149a81e52ac1a257db P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:52.262619 1614 tablet_service.cc:1515] Processing DeleteTablet for tablet de75786bcb5549149a81e52ac1a257db with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:52 UTC) from {username='slave'} at 127.0.0.1:51022
I20250831 19:54:52.262979 2715 tablet_replica.cc:331] T de75786bcb5549149a81e52ac1a257db P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:54:52.263155 2715 raft_consensus.cc:2241] T de75786bcb5549149a81e52ac1a257db P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:52.263334 2715 raft_consensus.cc:2270] T de75786bcb5549149a81e52ac1a257db P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:52.263859 2715 ts_tablet_manager.cc:1905] T de75786bcb5549149a81e52ac1a257db P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:52.266204 2839 ts_tablet_manager.cc:1918] T de75786bcb5549149a81e52ac1a257db P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:52.266314 2839 log.cc:1199] T de75786bcb5549149a81e52ac1a257db P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/de75786bcb5549149a81e52ac1a257db
I20250831 19:54:52.266669 2839 ts_tablet_manager.cc:1939] T de75786bcb5549149a81e52ac1a257db P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:54:52.270735 1031 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskfwTdIj/build/asan/bin/kudu with pid 2437
I20250831 19:54:52.275182 2126 catalog_manager.cc:5582] T 920c6fcdf1a44d07b132de6a08b3cbf8 P 89aa85d59c53436ebdf3074b13d14825 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193). New cstate: current_term: 1 leader_uuid: "89aa85d59c53436ebdf3074b13d14825" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: HEALTHY } } }
I20250831 19:54:52.280613 2123 catalog_manager.cc:2149] created HMS catalog entry for table [id=79e1655e710d4e6ebb6a25f871ba8eeb]
I20250831 19:54:52.281500 2715 ts_tablet_manager.cc:1918] T de75786bcb5549149a81e52ac1a257db P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:52.281642 2715 log.cc:1199] T de75786bcb5549149a81e52ac1a257db P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/de75786bcb5549149a81e52ac1a257db
W20250831 19:54:52.281872 2122 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_b4399bb161024e3eb0b69c23e3f9af47 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250831 19:54:52.282037 2715 ts_tablet_manager.cc:1939] T de75786bcb5549149a81e52ac1a257db P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
W20250831 19:54:52.282280 2124 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_4e905daf26a044c38517f550bf5157f7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250831 19:54:52.283074 2104 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet de75786bcb5549149a81e52ac1a257db (table default.table_4b100a5c91f9467497d138af9f82f726 [id=ecc3359620c94491ac39b0f7dc2f88c8]) successfully deleted
I20250831 19:54:52.283918 2101 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet de75786bcb5549149a81e52ac1a257db (table default.table_4b100a5c91f9467497d138af9f82f726 [id=ecc3359620c94491ac39b0f7dc2f88c8]) successfully deleted
I20250831 19:54:52.285087 2761 tablet.cc:1722] T 6b61f7d06007437f803d400e73800415 P 2441fafe1d62429386f4631ad423567d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:52.286341 2786 tablet.cc:1722] T 6b61f7d06007437f803d400e73800415 P 89aa85d59c53436ebdf3074b13d14825: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:52.289516 2723 tablet.cc:1722] T 6b61f7d06007437f803d400e73800415 P de831f40fa1348a48a1f0260f4130197: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:52.290244 2123 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:36958 (request call id 107) took 1500 ms. Trace:
I20250831 19:54:52.290360 2123 rpcz_store.cc:276] 0831 19:54:50.789534 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:51.121732 (+332198us) service_pool.cc:225] Handling call
0831 19:54:52.046088 (+924356us) catalog_manager.cc:2076] Acquired catalog manager lock
0831 19:54:52.046637 (+ 549us) catalog_manager.cc:2122] Created new table and tablet info
0831 19:54:52.280571 (+233934us) catalog_manager.cc:2148] Created new table in HMS catalog
0831 19:54:52.289979 (+ 9408us) catalog_manager.cc:2182] Wrote table and tablets to system table
0831 19:54:52.290099 (+ 120us) catalog_manager.cc:2216] Inserted table and tablets into CatalogManager maps
0831 19:54:52.290199 (+ 100us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:52.284488 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:52.284580 (+ 92us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:52.284583 (+ 3us) write_op.cc:435] Acquired schema lock
0831 19:54:52.284585 (+ 2us) tablet.cc:660] Decoding operations
0831 19:54:52.284656 (+ 71us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:52.284664 (+ 8us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:52.284668 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:52.284724 (+ 56us) tablet.cc:699] Row locks acquired
0831 19:54:52.284726 (+ 2us) write_op.cc:260] PREPARE: finished
0831 19:54:52.284754 (+ 28us) write_op.cc:270] Start()
0831 19:54:52.284780 (+ 26us) write_op.cc:276] Timestamp: P: 1756670092284684 usec, L: 0
0831 19:54:52.284783 (+ 3us) op_driver.cc:348] REPLICATION: starting
0831 19:54:52.284940 (+ 157us) log.cc:844] Serialized 433 byte log entry
0831 19:54:52.288930 (+ 3990us) op_driver.cc:464] REPLICATION: finished
0831 19:54:52.289481 (+ 551us) write_op.cc:301] APPLY: starting
0831 19:54:52.289493 (+ 12us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:52.289546 (+ 53us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:52.289573 (+ 27us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:52.289658 (+ 85us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:52.289685 (+ 27us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0831 19:54:52.289691 (+ 6us) write_op.cc:312] APPLY: finished
0831 19:54:52.289759 (+ 68us) log.cc:844] Serialized 29 byte log entry
0831 19:54:52.289809 (+ 50us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:52.289824 (+ 15us) write_op.cc:454] Released schema lock
0831 19:54:52.289829 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0831 19:54:52.289887 (+ 58us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:52.289890 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":202726,"Hive Metastore.run_cpu_time_us":253,"Hive Metastore.run_wall_time_us":30341,"child_traces":[["op",{"apply.queue_time_us":497,"apply.run_cpu_time_us":415,"apply.run_wall_time_us":416,"num_ops":2,"prepare.queue_time_us":3366,"prepare.run_cpu_time_us":515,"prepare.run_wall_time_us":516,"replication_time_us":4124}]]}
I20250831 19:54:52.292171 2123 catalog_manager.cc:5674] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237) does not have the latest schema for tablet 6b61f7d06007437f803d400e73800415 (table default.table_af003c3f30c04853bc025b34d543d0e0 [id=5ce6c4d5dcd34d73af61fd2c4bf28799]). Expected version 1 got 0
I20250831 19:54:52.295198 2123 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36958:
name: "default.Table_dbd9b94e2d224171acd87195ab912666"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:52.303050 2840 ts_tablet_manager.cc:1918] T de75786bcb5549149a81e52ac1a257db P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:52.303316 2840 log.cc:1199] T de75786bcb5549149a81e52ac1a257db P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/de75786bcb5549149a81e52ac1a257db
W20250831 19:54:52.303359 2125 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_b90139c92a0d426db7ba39ca376bd8e2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250831 19:54:52.303874 2840 ts_tablet_manager.cc:1939] T de75786bcb5549149a81e52ac1a257db P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
W20250831 19:54:52.303892 2121 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_ca70026c55be4e7a9db72440e0205619 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250831 19:54:52.304528 2117 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:36958 (request call id 103) took 1992 ms. Trace:
I20250831 19:54:52.304634 2117 rpcz_store.cc:276] 0831 19:54:50.311938 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:51.039678 (+727740us) service_pool.cc:225] Handling call
0831 19:54:51.047395 (+ 7717us) spinlock_profiling.cc:243] Waited 3.44 ms on lock 0x616000040c54. stack: 00007f1e3b0dc7d6 00007f1e3b0dc590 00007f1e3a0cf3ad 0000000000972d94 0000000000972d5d 00007f1e49ea714d 00007f1e49ea7243 00007f1e46b66941 00007f1e4e6f1a5d 00007f1e4e87be86 00007f1e456b4466 00007f1e456b4195 00007f1e41e8a2ce 00007f1e41e891ae 00007f1e41e8f3e5 00007f1e41e8fd0f
0831 19:54:52.037542 (+990147us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:52.304480 (+266938us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":2097,"Hive Metastore.run_cpu_time_us":146,"Hive Metastore.run_wall_time_us":94272,"spinlock_wait_cycles":7908096}
I20250831 19:54:52.305833 2105 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet de75786bcb5549149a81e52ac1a257db (table default.table_4b100a5c91f9467497d138af9f82f726 [id=ecc3359620c94491ac39b0f7dc2f88c8]) successfully deleted
I20250831 19:54:52.307392 2778 consensus_queue.cc:1035] T 2c03497e3cb4480d88d99dde5d6ea22b P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:52.310005 1884 tablet_service.cc:1468] Processing CreateTablet for tablet c5cfcb0956e44a1c9e64acc4d1ed568c (DEFAULT_TABLE table=default.table_82715a1a3cf44ab586f6ab0f19723f2b [id=79e1655e710d4e6ebb6a25f871ba8eeb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:52.310397 1884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5cfcb0956e44a1c9e64acc4d1ed568c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:52.310400 1751 tablet_service.cc:1468] Processing CreateTablet for tablet c5cfcb0956e44a1c9e64acc4d1ed568c (DEFAULT_TABLE table=default.table_82715a1a3cf44ab586f6ab0f19723f2b [id=79e1655e710d4e6ebb6a25f871ba8eeb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:52.310415 1614 tablet_service.cc:1468] Processing CreateTablet for tablet c5cfcb0956e44a1c9e64acc4d1ed568c (DEFAULT_TABLE table=default.table_82715a1a3cf44ab586f6ab0f19723f2b [id=79e1655e710d4e6ebb6a25f871ba8eeb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:52.310740 1751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5cfcb0956e44a1c9e64acc4d1ed568c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:52.310885 1614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5cfcb0956e44a1c9e64acc4d1ed568c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:52.316322 2856 tablet_bootstrap.cc:492] T c5cfcb0956e44a1c9e64acc4d1ed568c P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:52.317898 2856 tablet_bootstrap.cc:654] T c5cfcb0956e44a1c9e64acc4d1ed568c P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:52.318755 2282 tablet_bootstrap.cc:492] T c5cfcb0956e44a1c9e64acc4d1ed568c P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:52.320355 2282 tablet_bootstrap.cc:654] T c5cfcb0956e44a1c9e64acc4d1ed568c P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:52.320993 2126 catalog_manager.cc:6127] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: default.table_af003c3f30c04853bc025b34d543d0e0 [id=5ce6c4d5dcd34d73af61fd2c4bf28799] alter complete (version 1)
I20250831 19:54:52.323376 2755 raft_consensus.cc:491] T 4be6edd110374d2bb941e26defc7302f P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:52.323514 2120 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:36958 (request call id 108) took 1523 ms. Trace:
I20250831 19:54:52.323515 2755 raft_consensus.cc:513] T 4be6edd110374d2bb941e26defc7302f P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:52.323616 2120 rpcz_store.cc:276] 0831 19:54:50.799971 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:51.414478 (+614507us) service_pool.cc:225] Handling call
0831 19:54:52.039705 (+625227us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:52.304261 (+264556us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:52.323221 (+ 18960us) catalog_manager.cc:3683] Apply alter schema
0831 19:54:52.323465 (+ 244us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":94257,"Hive Metastore.run_cpu_time_us":639,"Hive Metastore.run_wall_time_us":106068}
I20250831 19:54:52.324105 2755 leader_election.cc:290] T 4be6edd110374d2bb941e26defc7302f P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:52.324041 2120 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36958:
name: "default.Table_1dc7d3d86ed047bd8c86e21d7b38f477"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:52.324668 1632 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4be6edd110374d2bb941e26defc7302f" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:52.324699 1771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4be6edd110374d2bb941e26defc7302f" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:52.324828 2126 master_service.cc:948] ReplaceTablet: received request to replace tablet 81293470431c4deda5efbc30a03ce0ed from {username='slave'} at 127.0.0.1:36958
I20250831 19:54:52.324836 1632 raft_consensus.cc:2466] T 4be6edd110374d2bb941e26defc7302f P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 0.
I20250831 19:54:52.324887 1771 raft_consensus.cc:2466] T 4be6edd110374d2bb941e26defc7302f P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 0.
I20250831 19:54:52.325227 1841 leader_election.cc:304] T 4be6edd110374d2bb941e26defc7302f P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:54:52.325731 2755 raft_consensus.cc:2802] T 4be6edd110374d2bb941e26defc7302f P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:52.325822 2755 raft_consensus.cc:491] T 4be6edd110374d2bb941e26defc7302f P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:52.325896 2755 raft_consensus.cc:3058] T 4be6edd110374d2bb941e26defc7302f P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:52.326102 2117 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36958:
name: "default.Table_0409d51b133145c5b7e7d4d407a471b2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:52.328835 2755 raft_consensus.cc:513] T 4be6edd110374d2bb941e26defc7302f P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:52.329166 2699 tablet_bootstrap.cc:492] T c5cfcb0956e44a1c9e64acc4d1ed568c P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:52.329699 1771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4be6edd110374d2bb941e26defc7302f" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197"
I20250831 19:54:52.329876 1771 raft_consensus.cc:3058] T 4be6edd110374d2bb941e26defc7302f P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:52.330763 2699 tablet_bootstrap.cc:654] T c5cfcb0956e44a1c9e64acc4d1ed568c P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:52.331281 1632 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4be6edd110374d2bb941e26defc7302f" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:54:52.331459 1632 raft_consensus.cc:3058] T 4be6edd110374d2bb941e26defc7302f P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:52.332391 1771 raft_consensus.cc:2466] T 4be6edd110374d2bb941e26defc7302f P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 1.
I20250831 19:54:52.332898 1842 leader_election.cc:304] T 4be6edd110374d2bb941e26defc7302f P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:52.333139 2239 raft_consensus.cc:2802] T 4be6edd110374d2bb941e26defc7302f P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:52.333302 2239 raft_consensus.cc:695] T 4be6edd110374d2bb941e26defc7302f P 2441fafe1d62429386f4631ad423567d [term 1 LEADER]: Becoming Leader. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Running, Role: LEADER
I20250831 19:54:52.333545 2239 consensus_queue.cc:237] T 4be6edd110374d2bb941e26defc7302f P 2441fafe1d62429386f4631ad423567d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:52.335501 2755 leader_election.cc:290] T 4be6edd110374d2bb941e26defc7302f P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 election: Requested vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:52.336421 1632 raft_consensus.cc:2466] T 4be6edd110374d2bb941e26defc7302f P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 1.
I20250831 19:54:52.338711 2282 tablet_bootstrap.cc:492] T c5cfcb0956e44a1c9e64acc4d1ed568c P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:52.338894 2282 ts_tablet_manager.cc:1397] T c5cfcb0956e44a1c9e64acc4d1ed568c P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.020s user 0.001s sys 0.007s
I20250831 19:54:52.339747 2282 raft_consensus.cc:357] T c5cfcb0956e44a1c9e64acc4d1ed568c P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:52.339946 2282 raft_consensus.cc:383] T c5cfcb0956e44a1c9e64acc4d1ed568c P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:52.340023 2282 raft_consensus.cc:738] T c5cfcb0956e44a1c9e64acc4d1ed568c P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:52.340297 2282 consensus_queue.cc:260] T c5cfcb0956e44a1c9e64acc4d1ed568c P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:52.342275 2856 tablet_bootstrap.cc:492] T c5cfcb0956e44a1c9e64acc4d1ed568c P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:52.343328 2856 ts_tablet_manager.cc:1397] T c5cfcb0956e44a1c9e64acc4d1ed568c P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.027s user 0.005s sys 0.001s
I20250831 19:54:52.343755 2799 consensus_queue.cc:1035] T 75a6a340faad4e46924b79adc8bcb867 P 2441fafe1d62429386f4631ad423567d [LEADER]: Connected to new peer: Peer: permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:52.344043 2282 ts_tablet_manager.cc:1428] T c5cfcb0956e44a1c9e64acc4d1ed568c P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20250831 19:54:52.347438 2126 catalog_manager.cc:5869] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Sending DeleteTablet for 3 replicas of tablet 81293470431c4deda5efbc30a03ce0ed
I20250831 19:54:52.348304 2856 raft_consensus.cc:357] T c5cfcb0956e44a1c9e64acc4d1ed568c P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:52.349234 1883 tablet_service.cc:1515] Processing DeleteTablet for tablet 81293470431c4deda5efbc30a03ce0ed with delete_type TABLET_DATA_DELETED (replaced by tablet 5b948d8301e343b3a5ea1cf90b841513) from {username='slave'} at 127.0.0.1:45906
I20250831 19:54:52.349637 2839 tablet_replica.cc:331] T 81293470431c4deda5efbc30a03ce0ed P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:54:52.349875 2839 raft_consensus.cc:2241] T 81293470431c4deda5efbc30a03ce0ed P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:52.350106 2839 raft_consensus.cc:2270] T 81293470431c4deda5efbc30a03ce0ed P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:52.350744 1614 tablet_service.cc:1515] Processing DeleteTablet for tablet 81293470431c4deda5efbc30a03ce0ed with delete_type TABLET_DATA_DELETED (replaced by tablet 5b948d8301e343b3a5ea1cf90b841513) from {username='slave'} at 127.0.0.1:51022
I20250831 19:54:52.351013 2715 tablet_replica.cc:331] T 81293470431c4deda5efbc30a03ce0ed P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:54:52.351246 2715 raft_consensus.cc:2241] T 81293470431c4deda5efbc30a03ce0ed P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:52.351460 2715 raft_consensus.cc:2270] T 81293470431c4deda5efbc30a03ce0ed P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:52.351651 2699 tablet_bootstrap.cc:492] T c5cfcb0956e44a1c9e64acc4d1ed568c P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:52.351805 2699 ts_tablet_manager.cc:1397] T c5cfcb0956e44a1c9e64acc4d1ed568c P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.023s user 0.006s sys 0.000s
I20250831 19:54:52.352443 2699 raft_consensus.cc:357] T c5cfcb0956e44a1c9e64acc4d1ed568c P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:52.352685 2699 raft_consensus.cc:383] T c5cfcb0956e44a1c9e64acc4d1ed568c P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:52.352775 2699 raft_consensus.cc:738] T c5cfcb0956e44a1c9e64acc4d1ed568c P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:52.353015 2699 consensus_queue.cc:260] T c5cfcb0956e44a1c9e64acc4d1ed568c P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:52.353574 2699 ts_tablet_manager.cc:1428] T c5cfcb0956e44a1c9e64acc4d1ed568c P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250831 19:54:52.359663 2758 consensus_queue.cc:1035] T 75a6a340faad4e46924b79adc8bcb867 P 2441fafe1d62429386f4631ad423567d [LEADER]: Connected to new peer: Peer: permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:52.359831 1614 tablet_service.cc:1468] Processing CreateTablet for tablet 5b948d8301e343b3a5ea1cf90b841513 (DEFAULT_TABLE table=default.table_207ac87518bc487184a89bb52cd204b3 [id=f48af5bc3eff4c819be4aeeff4128c2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:52.360239 1614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b948d8301e343b3a5ea1cf90b841513. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:52.360196 1883 tablet_service.cc:1468] Processing CreateTablet for tablet 5b948d8301e343b3a5ea1cf90b841513 (DEFAULT_TABLE table=default.table_207ac87518bc487184a89bb52cd204b3 [id=f48af5bc3eff4c819be4aeeff4128c2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:52.360527 1883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b948d8301e343b3a5ea1cf90b841513. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:52.361024 2715 ts_tablet_manager.cc:1905] T 81293470431c4deda5efbc30a03ce0ed P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:52.365507 2126 catalog_manager.cc:6652] ReplaceTablet: tablet 81293470431c4deda5efbc30a03ce0ed deleted and replaced by tablet 5b948d8301e343b3a5ea1cf90b841513
I20250831 19:54:52.365649 2126 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:36958 (request call id 117) took 1202 ms. Trace:
I20250831 19:54:52.365753 2126 rpcz_store.cc:276] 0831 19:54:51.163356 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:52.324756 (+1161400us) service_pool.cc:225] Handling call
0831 19:54:52.365619 (+ 40863us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:52.327892 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:52.328023 (+ 131us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:52.328030 (+ 7us) write_op.cc:435] Acquired schema lock
0831 19:54:52.328034 (+ 4us) tablet.cc:660] Decoding operations
0831 19:54:52.328176 (+ 142us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:52.328192 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:52.328199 (+ 7us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:52.328293 (+ 94us) tablet.cc:699] Row locks acquired
0831 19:54:52.328296 (+ 3us) write_op.cc:260] PREPARE: finished
0831 19:54:52.328333 (+ 37us) write_op.cc:270] Start()
0831 19:54:52.328369 (+ 36us) write_op.cc:276] Timestamp: P: 1756670092328314 usec, L: 0
0831 19:54:52.328374 (+ 5us) op_driver.cc:348] REPLICATION: starting
0831 19:54:52.328563 (+ 189us) log.cc:844] Serialized 656 byte log entry
0831 19:54:52.330890 (+ 2327us) op_driver.cc:464] REPLICATION: finished
0831 19:54:52.331299 (+ 409us) write_op.cc:301] APPLY: starting
0831 19:54:52.331311 (+ 12us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:52.331351 (+ 40us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:52.331378 (+ 27us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:52.331464 (+ 86us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:52.331549 (+ 85us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0831 19:54:52.331556 (+ 7us) write_op.cc:312] APPLY: finished
0831 19:54:52.331632 (+ 76us) log.cc:844] Serialized 29 byte log entry
0831 19:54:52.331686 (+ 54us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:52.331703 (+ 17us) write_op.cc:454] Released schema lock
0831 19:54:52.331708 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0831 19:54:52.331767 (+ 59us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:52.331772 (+ 5us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":354,"apply.run_cpu_time_us":464,"apply.run_wall_time_us":464,"num_ops":2,"prepare.queue_time_us":56,"prepare.run_cpu_time_us":765,"prepare.run_wall_time_us":766,"raft.queue_time_us":53,"raft.run_cpu_time_us":221,"raft.run_wall_time_us":220,"replication_time_us":2488}]]}
I20250831 19:54:52.367311 2282 tablet_bootstrap.cc:492] T 5b948d8301e343b3a5ea1cf90b841513 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:52.368985 2282 tablet_bootstrap.cc:654] T 5b948d8301e343b3a5ea1cf90b841513 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:52.369565 2839 ts_tablet_manager.cc:1905] T 81293470431c4deda5efbc30a03ce0ed P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:52.369661 2699 tablet_bootstrap.cc:492] T 5b948d8301e343b3a5ea1cf90b841513 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:52.371474 2699 tablet_bootstrap.cc:654] T 5b948d8301e343b3a5ea1cf90b841513 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:52.348552 2778 consensus_queue.cc:1035] T 2c03497e3cb4480d88d99dde5d6ea22b P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:52.349572 1751 tablet_service.cc:1515] Processing DeleteTablet for tablet 81293470431c4deda5efbc30a03ce0ed with delete_type TABLET_DATA_DELETED (replaced by tablet 5b948d8301e343b3a5ea1cf90b841513) from {username='slave'} at 127.0.0.1:50674
I20250831 19:54:52.360486 1749 tablet_service.cc:1468] Processing CreateTablet for tablet 5b948d8301e343b3a5ea1cf90b841513 (DEFAULT_TABLE table=default.table_207ac87518bc487184a89bb52cd204b3 [id=f48af5bc3eff4c819be4aeeff4128c2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:52.375144 1749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b948d8301e343b3a5ea1cf90b841513. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:52.377581 2840 tablet_replica.cc:331] T 81293470431c4deda5efbc30a03ce0ed P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:54:52.377775 2840 raft_consensus.cc:2241] T 81293470431c4deda5efbc30a03ce0ed P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: Raft consensus shutting down.
I20250831 19:54:52.378087 2840 raft_consensus.cc:2270] T 81293470431c4deda5efbc30a03ce0ed P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:52.380035 2840 ts_tablet_manager.cc:1905] T 81293470431c4deda5efbc30a03ce0ed P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:52.382632 2856 raft_consensus.cc:383] T c5cfcb0956e44a1c9e64acc4d1ed568c P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:52.382825 2856 raft_consensus.cc:738] T c5cfcb0956e44a1c9e64acc4d1ed568c P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:52.383105 2856 consensus_queue.cc:260] T c5cfcb0956e44a1c9e64acc4d1ed568c P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:52.383875 2856 ts_tablet_manager.cc:1428] T c5cfcb0956e44a1c9e64acc4d1ed568c P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.036s user 0.001s sys 0.000s
I20250831 19:54:52.384269 2856 tablet_bootstrap.cc:492] T 5b948d8301e343b3a5ea1cf90b841513 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:52.386871 2856 tablet_bootstrap.cc:654] T 5b948d8301e343b3a5ea1cf90b841513 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:52.390533 2840 ts_tablet_manager.cc:1918] T 81293470431c4deda5efbc30a03ce0ed P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250831 19:54:52.393847 2840 log.cc:1199] T 81293470431c4deda5efbc30a03ce0ed P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/81293470431c4deda5efbc30a03ce0ed
I20250831 19:54:52.394407 2840 ts_tablet_manager.cc:1939] T 81293470431c4deda5efbc30a03ce0ed P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
I20250831 19:54:52.395663 2105 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet 81293470431c4deda5efbc30a03ce0ed (table default.table_207ac87518bc487184a89bb52cd204b3 [id=f48af5bc3eff4c819be4aeeff4128c2a]) successfully deleted
I20250831 19:54:52.399207 2699 tablet_bootstrap.cc:492] T 5b948d8301e343b3a5ea1cf90b841513 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:52.399395 2699 ts_tablet_manager.cc:1397] T 5b948d8301e343b3a5ea1cf90b841513 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.030s user 0.006s sys 0.001s
I20250831 19:54:52.400203 2699 raft_consensus.cc:357] T 5b948d8301e343b3a5ea1cf90b841513 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:52.400399 2699 raft_consensus.cc:383] T 5b948d8301e343b3a5ea1cf90b841513 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:52.400470 2699 raft_consensus.cc:738] T 5b948d8301e343b3a5ea1cf90b841513 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:52.400667 2119 catalog_manager.cc:2706] deleted HMS catalog entry for table default.table_0c22133a9af24fe3b029fc31f3c63625 [id=c3969aded3a64f8c9707c760286a4312]
I20250831 19:54:52.400710 2699 consensus_queue.cc:260] T 5b948d8301e343b3a5ea1cf90b841513 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:52.401242 2699 ts_tablet_manager.cc:1428] T 5b948d8301e343b3a5ea1cf90b841513 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
W20250831 19:54:52.406606 2105 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.1.1.254:34259 (error 108) [suppressed 6 similar messages]
I20250831 19:54:52.414680 2856 tablet_bootstrap.cc:492] T 5b948d8301e343b3a5ea1cf90b841513 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:52.414741 2715 ts_tablet_manager.cc:1918] T 81293470431c4deda5efbc30a03ce0ed P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250831 19:54:52.414971 2856 ts_tablet_manager.cc:1397] T 5b948d8301e343b3a5ea1cf90b841513 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.031s user 0.003s sys 0.001s
I20250831 19:54:52.415333 2839 ts_tablet_manager.cc:1918] T 81293470431c4deda5efbc30a03ce0ed P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250831 19:54:52.415527 2715 log.cc:1199] T 81293470431c4deda5efbc30a03ce0ed P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/81293470431c4deda5efbc30a03ce0ed
I20250831 19:54:52.415817 2856 raft_consensus.cc:357] T 5b948d8301e343b3a5ea1cf90b841513 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:52.415978 2715 ts_tablet_manager.cc:1939] T 81293470431c4deda5efbc30a03ce0ed P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
I20250831 19:54:52.416107 2839 log.cc:1199] T 81293470431c4deda5efbc30a03ce0ed P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/81293470431c4deda5efbc30a03ce0ed
I20250831 19:54:52.416106 2856 raft_consensus.cc:383] T 5b948d8301e343b3a5ea1cf90b841513 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20250831 19:54:52.416008 1570 connection.cc:537] client connection to 127.1.1.254:34259 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20250831 19:54:52.416195 2856 raft_consensus.cc:738] T 5b948d8301e343b3a5ea1cf90b841513 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:52.416489 2856 consensus_queue.cc:260] T 5b948d8301e343b3a5ea1cf90b841513 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:52.416772 2282 tablet_bootstrap.cc:492] T 5b948d8301e343b3a5ea1cf90b841513 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:52.416903 2282 ts_tablet_manager.cc:1397] T 5b948d8301e343b3a5ea1cf90b841513 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.050s user 0.000s sys 0.011s
I20250831 19:54:52.417649 2282 raft_consensus.cc:357] T 5b948d8301e343b3a5ea1cf90b841513 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:52.417801 2282 raft_consensus.cc:383] T 5b948d8301e343b3a5ea1cf90b841513 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:52.417901 2282 raft_consensus.cc:738] T 5b948d8301e343b3a5ea1cf90b841513 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:52.418067 2282 consensus_queue.cc:260] T 5b948d8301e343b3a5ea1cf90b841513 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:52.418557 2282 ts_tablet_manager.cc:1428] T 5b948d8301e343b3a5ea1cf90b841513 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
W20250831 19:54:52.418792 1707 connection.cc:537] client connection to 127.1.1.254:34259 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20250831 19:54:52.423657 2839 ts_tablet_manager.cc:1939] T 81293470431c4deda5efbc30a03ce0ed P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:54:52.425336 2101 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet 81293470431c4deda5efbc30a03ce0ed (table default.table_207ac87518bc487184a89bb52cd204b3 [id=f48af5bc3eff4c819be4aeeff4128c2a]) successfully deleted
W20250831 19:54:52.425558 1842 connection.cc:537] client connection to 127.1.1.254:34259 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20250831 19:54:52.426074 2856 ts_tablet_manager.cc:1428] T 5b948d8301e343b3a5ea1cf90b841513 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.011s user 0.001s sys 0.000s
I20250831 19:54:52.428315 2126 catalog_manager.cc:5582] T 4be6edd110374d2bb941e26defc7302f P 2441fafe1d62429386f4631ad423567d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2441fafe1d62429386f4631ad423567d (127.1.1.195). New cstate: current_term: 1 leader_uuid: "2441fafe1d62429386f4631ad423567d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: UNKNOWN } } }
W20250831 19:54:52.432185 2880 negotiation.cc:337] Failed RPC negotiation. Trace:
0831 19:54:52.417133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.1.254:34259 (local address 127.1.1.193:49997)
0831 19:54:52.430952 (+ 13819us) negotiation.cc:107] Waiting for socket to connect
0831 19:54:52.431117 (+ 165us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":13672,"threads_started":1}
I20250831 19:54:52.432682 2126 catalog_manager.cc:5674] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237) does not have the latest schema for tablet 4be6edd110374d2bb941e26defc7302f (table default.table_be31f59f9d014d278544a1c9deb8a41a [id=0fc929ad819b48a9af984f8c301bad2b]). Expected version 1 got 0
I20250831 19:54:52.434540 2104 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet 81293470431c4deda5efbc30a03ce0ed (table default.table_207ac87518bc487184a89bb52cd204b3 [id=f48af5bc3eff4c819be4aeeff4128c2a]) successfully deleted
W20250831 19:54:52.438911 2105 consensus_peers.cc:489] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 -> Peer 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259): Couldn't send request to peer 6c830f6055d64a3b8a9f78b405ad8aa3. Status: Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250831 19:54:52.454192 2126 catalog_manager.cc:5674] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475) does not have the latest schema for tablet 5b948d8301e343b3a5ea1cf90b841513 (table default.table_207ac87518bc487184a89bb52cd204b3 [id=f48af5bc3eff4c819be4aeeff4128c2a]). Expected version 1 got 0
W20250831 19:54:52.457782 2126 catalog_manager.cc:5774] Failed to send AlterTable RPC for tablet 5b948d8301e343b3a5ea1cf90b841513 (table default.table_207ac87518bc487184a89bb52cd204b3 [id=f48af5bc3eff4c819be4aeeff4128c2a], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 5b948d8301e343b3a5ea1cf90b841513 consensus state has no leader
I20250831 19:54:52.460662 2126 catalog_manager.cc:5674] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237) does not have the latest schema for tablet 5b948d8301e343b3a5ea1cf90b841513 (table default.table_207ac87518bc487184a89bb52cd204b3 [id=f48af5bc3eff4c819be4aeeff4128c2a]). Expected version 1 got 0
I20250831 19:54:52.461987 1771 raft_consensus.cc:1273] T 4be6edd110374d2bb941e26defc7302f P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Refusing update from remote peer 2441fafe1d62429386f4631ad423567d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250831 19:54:52.463020 1633 raft_consensus.cc:1273] T 4be6edd110374d2bb941e26defc7302f P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Refusing update from remote peer 2441fafe1d62429386f4631ad423567d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250831 19:54:52.463212 2126 catalog_manager.cc:5674] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197) does not have the latest schema for tablet 5b948d8301e343b3a5ea1cf90b841513 (table default.table_207ac87518bc487184a89bb52cd204b3 [id=f48af5bc3eff4c819be4aeeff4128c2a]). Expected version 1 got 0
I20250831 19:54:52.463325 2239 consensus_queue.cc:1035] T 4be6edd110374d2bb941e26defc7302f P 2441fafe1d62429386f4631ad423567d [LEADER]: Connected to new peer: Peer: permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:52.464219 2126 master_service.cc:948] ReplaceTablet: received request to replace tablet 3d3be834ca8642c584da4265819c14ab from {username='slave'} at 127.0.0.1:36958
I20250831 19:54:52.465703 2239 consensus_queue.cc:1035] T 4be6edd110374d2bb941e26defc7302f P 2441fafe1d62429386f4631ad423567d [LEADER]: Connected to new peer: Peer: permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:52.473583 2126 catalog_manager.cc:5869] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Sending DeleteTablet for 3 replicas of tablet 3d3be834ca8642c584da4265819c14ab
I20250831 19:54:52.474201 1614 tablet_service.cc:1515] Processing DeleteTablet for tablet 3d3be834ca8642c584da4265819c14ab with delete_type TABLET_DATA_DELETED (replaced by tablet d1f811715ac64ca591a84b52be6e2621) from {username='slave'} at 127.0.0.1:51022
I20250831 19:54:52.474496 2715 tablet_replica.cc:331] T 3d3be834ca8642c584da4265819c14ab P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:54:52.474607 1884 tablet_service.cc:1515] Processing DeleteTablet for tablet 3d3be834ca8642c584da4265819c14ab with delete_type TABLET_DATA_DELETED (replaced by tablet d1f811715ac64ca591a84b52be6e2621) from {username='slave'} at 127.0.0.1:45906
I20250831 19:54:52.474685 2715 raft_consensus.cc:2241] T 3d3be834ca8642c584da4265819c14ab P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:52.474808 2839 tablet_replica.cc:331] T 3d3be834ca8642c584da4265819c14ab P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:54:52.474876 2715 raft_consensus.cc:2270] T 3d3be834ca8642c584da4265819c14ab P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:52.474979 2839 raft_consensus.cc:2241] T 3d3be834ca8642c584da4265819c14ab P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:52.475113 2839 raft_consensus.cc:2270] T 3d3be834ca8642c584da4265819c14ab P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:52.475385 2715 ts_tablet_manager.cc:1905] T 3d3be834ca8642c584da4265819c14ab P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:52.475598 2839 ts_tablet_manager.cc:1905] T 3d3be834ca8642c584da4265819c14ab P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:52.481192 2839 ts_tablet_manager.cc:1918] T 3d3be834ca8642c584da4265819c14ab P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:52.481207 2715 ts_tablet_manager.cc:1918] T 3d3be834ca8642c584da4265819c14ab P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:52.481318 2715 log.cc:1199] T 3d3be834ca8642c584da4265819c14ab P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/3d3be834ca8642c584da4265819c14ab
I20250831 19:54:52.481506 2839 log.cc:1199] T 3d3be834ca8642c584da4265819c14ab P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/3d3be834ca8642c584da4265819c14ab
I20250831 19:54:52.481918 2839 ts_tablet_manager.cc:1939] T 3d3be834ca8642c584da4265819c14ab P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:54:52.481936 2715 ts_tablet_manager.cc:1939] T 3d3be834ca8642c584da4265819c14ab P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
I20250831 19:54:52.482913 2101 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet 3d3be834ca8642c584da4265819c14ab (table default.table_c3cffc1117c341b0b3a7d4f82c01763a [id=da5a81d8cada4041bd31e0bb6369d108]) successfully deleted
I20250831 19:54:52.483343 2104 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet 3d3be834ca8642c584da4265819c14ab (table default.table_c3cffc1117c341b0b3a7d4f82c01763a [id=da5a81d8cada4041bd31e0bb6369d108]) successfully deleted
I20250831 19:54:52.484196 1749 tablet_service.cc:1515] Processing DeleteTablet for tablet 3d3be834ca8642c584da4265819c14ab with delete_type TABLET_DATA_DELETED (replaced by tablet d1f811715ac64ca591a84b52be6e2621) from {username='slave'} at 127.0.0.1:50674
I20250831 19:54:52.484423 2840 tablet_replica.cc:331] T 3d3be834ca8642c584da4265819c14ab P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:54:52.484637 2840 raft_consensus.cc:2241] T 3d3be834ca8642c584da4265819c14ab P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: Raft consensus shutting down.
I20250831 19:54:52.484927 2840 raft_consensus.cc:2270] T 3d3be834ca8642c584da4265819c14ab P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:52.485500 2840 ts_tablet_manager.cc:1905] T 3d3be834ca8642c584da4265819c14ab P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:52.492754 2840 ts_tablet_manager.cc:1918] T 3d3be834ca8642c584da4265819c14ab P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:52.492931 2840 log.cc:1199] T 3d3be834ca8642c584da4265819c14ab P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/3d3be834ca8642c584da4265819c14ab
I20250831 19:54:52.493350 2840 ts_tablet_manager.cc:1939] T 3d3be834ca8642c584da4265819c14ab P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
I20250831 19:54:52.494915 2674 mvcc.cc:204] Tried to move back new op lower bound from 7195320698718306304 to 7195320698200293376. Current Snapshot: MvccSnapshot[applied={T|T < 7195320698718306304}]
I20250831 19:54:52.495290 2761 tablet.cc:1722] T 4be6edd110374d2bb941e26defc7302f P 2441fafe1d62429386f4631ad423567d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:52.497426 2786 tablet.cc:1722] T 4be6edd110374d2bb941e26defc7302f P 89aa85d59c53436ebdf3074b13d14825: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:52.498242 2656 mvcc.cc:204] Tried to move back new op lower bound from 7195320698718306304 to 7195320698200293376. Current Snapshot: MvccSnapshot[applied={T|T < 7195320698718306304}]
I20250831 19:54:52.510705 2105 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet 3d3be834ca8642c584da4265819c14ab (table default.table_c3cffc1117c341b0b3a7d4f82c01763a [id=da5a81d8cada4041bd31e0bb6369d108]) successfully deleted
I20250831 19:54:52.518664 2584 consensus_queue.cc:1035] T cb21c47c27ea4f34801e93bd647e41b5 P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250831 19:54:52.519276 2104 catalog_manager.cc:4726] Async tablet task AlterTable RPC for tablet 5b948d8301e343b3a5ea1cf90b841513 (table default.table_207ac87518bc487184a89bb52cd204b3 [id=f48af5bc3eff4c819be4aeeff4128c2a], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 5b948d8301e343b3a5ea1cf90b841513 consensus state has no leader
I20250831 19:54:52.520438 1749 tablet_service.cc:1468] Processing CreateTablet for tablet d1f811715ac64ca591a84b52be6e2621 (DEFAULT_TABLE table=default.table_c3cffc1117c341b0b3a7d4f82c01763a [id=da5a81d8cada4041bd31e0bb6369d108]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:52.520833 1749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1f811715ac64ca591a84b52be6e2621. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:52.525991 1884 tablet_service.cc:1468] Processing CreateTablet for tablet d1f811715ac64ca591a84b52be6e2621 (DEFAULT_TABLE table=default.table_c3cffc1117c341b0b3a7d4f82c01763a [id=da5a81d8cada4041bd31e0bb6369d108]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:52.526360 1884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1f811715ac64ca591a84b52be6e2621. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:52.530514 1614 tablet_service.cc:1468] Processing CreateTablet for tablet d1f811715ac64ca591a84b52be6e2621 (DEFAULT_TABLE table=default.table_c3cffc1117c341b0b3a7d4f82c01763a [id=da5a81d8cada4041bd31e0bb6369d108]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:52.530886 1614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1f811715ac64ca591a84b52be6e2621. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:52.536923 2699 tablet_bootstrap.cc:492] T d1f811715ac64ca591a84b52be6e2621 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:52.537811 2856 tablet_bootstrap.cc:492] T d1f811715ac64ca591a84b52be6e2621 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:52.538542 2699 tablet_bootstrap.cc:654] T d1f811715ac64ca591a84b52be6e2621 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:52.539417 2856 tablet_bootstrap.cc:654] T d1f811715ac64ca591a84b52be6e2621 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:52.540797 2778 consensus_queue.cc:1035] T cb21c47c27ea4f34801e93bd647e41b5 P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:52.545166 2126 catalog_manager.cc:6652] ReplaceTablet: tablet 3d3be834ca8642c584da4265819c14ab deleted and replaced by tablet d1f811715ac64ca591a84b52be6e2621
I20250831 19:54:52.545678 2126 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:36958 (request call id 119) took 1306 ms. Trace:
I20250831 19:54:52.547111 2126 rpcz_store.cc:276] 0831 19:54:51.238895 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:52.464165 (+1225270us) service_pool.cc:225] Handling call
0831 19:54:52.473225 (+ 9060us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:52.473230 (+ 5us) write_op.cc:454] Released schema lock
0831 19:54:52.545612 (+ 72382us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:52.465156 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:52.465251 (+ 95us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:52.465256 (+ 5us) write_op.cc:435] Acquired schema lock
0831 19:54:52.465258 (+ 2us) tablet.cc:660] Decoding operations
0831 19:54:52.465374 (+ 116us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:52.465387 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:52.465391 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:52.465482 (+ 91us) tablet.cc:699] Row locks acquired
0831 19:54:52.465484 (+ 2us) write_op.cc:260] PREPARE: finished
0831 19:54:52.465520 (+ 36us) write_op.cc:270] Start()
0831 19:54:52.465562 (+ 42us) write_op.cc:276] Timestamp: P: 1756670092465487 usec, L: 0
0831 19:54:52.465566 (+ 4us) op_driver.cc:348] REPLICATION: starting
0831 19:54:52.465724 (+ 158us) log.cc:844] Serialized 656 byte log entry
0831 19:54:52.469251 (+ 3527us) op_driver.cc:464] REPLICATION: finished
0831 19:54:52.469390 (+ 139us) write_op.cc:301] APPLY: starting
0831 19:54:52.469408 (+ 18us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:52.469479 (+ 71us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:52.469521 (+ 42us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:52.469648 (+ 127us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:52.469719 (+ 71us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0831 19:54:52.469730 (+ 11us) write_op.cc:312] APPLY: finished
0831 19:54:52.469812 (+ 82us) log.cc:844] Serialized 29 byte log entry
0831 19:54:52.469880 (+ 68us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:52.469903 (+ 23us) write_op.cc:454] Released schema lock
0831 19:54:52.469911 (+ 8us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":87,"apply.run_cpu_time_us":576,"apply.run_wall_time_us":576,"num_ops":2,"prepare.queue_time_us":43,"prepare.run_cpu_time_us":660,"prepare.run_wall_time_us":661,"raft.queue_time_us":928,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":183,"replication_time_us":3653}]]}
I20250831 19:54:52.554332 2126 catalog_manager.cc:5674] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197) does not have the latest schema for tablet 4be6edd110374d2bb941e26defc7302f (table default.table_be31f59f9d014d278544a1c9deb8a41a [id=0fc929ad819b48a9af984f8c301bad2b]). Expected version 1 got 0
I20250831 19:54:52.554656 2699 tablet_bootstrap.cc:492] T d1f811715ac64ca591a84b52be6e2621 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:52.554852 2699 ts_tablet_manager.cc:1397] T d1f811715ac64ca591a84b52be6e2621 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.018s user 0.008s sys 0.004s
I20250831 19:54:52.555533 2723 tablet.cc:1722] T 4be6edd110374d2bb941e26defc7302f P de831f40fa1348a48a1f0260f4130197: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:52.556078 2699 raft_consensus.cc:357] T d1f811715ac64ca591a84b52be6e2621 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:52.556262 2699 raft_consensus.cc:383] T d1f811715ac64ca591a84b52be6e2621 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:52.556330 2699 raft_consensus.cc:738] T d1f811715ac64ca591a84b52be6e2621 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:52.556542 2699 consensus_queue.cc:260] T d1f811715ac64ca591a84b52be6e2621 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:52.557063 2699 ts_tablet_manager.cc:1428] T d1f811715ac64ca591a84b52be6e2621 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250831 19:54:52.559235 2282 tablet_bootstrap.cc:492] T d1f811715ac64ca591a84b52be6e2621 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:52.560834 2282 tablet_bootstrap.cc:654] T d1f811715ac64ca591a84b52be6e2621 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:52.561180 2856 tablet_bootstrap.cc:492] T d1f811715ac64ca591a84b52be6e2621 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:52.561379 2856 ts_tablet_manager.cc:1397] T d1f811715ac64ca591a84b52be6e2621 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.024s user 0.004s sys 0.005s
I20250831 19:54:52.561983 1633 raft_consensus.cc:1273] T 05cda604dad041cfaad94d1b43d6b14d P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Refusing update from remote peer 2441fafe1d62429386f4631ad423567d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250831 19:54:52.562283 2856 raft_consensus.cc:357] T d1f811715ac64ca591a84b52be6e2621 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:52.562626 2856 raft_consensus.cc:383] T d1f811715ac64ca591a84b52be6e2621 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:52.562657 1771 raft_consensus.cc:1273] T 05cda604dad041cfaad94d1b43d6b14d P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Refusing update from remote peer 2441fafe1d62429386f4631ad423567d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250831 19:54:52.562711 2755 consensus_queue.cc:1035] T 05cda604dad041cfaad94d1b43d6b14d P 2441fafe1d62429386f4631ad423567d [LEADER]: Connected to new peer: Peer: permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:52.562783 2856 raft_consensus.cc:738] T d1f811715ac64ca591a84b52be6e2621 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:52.562988 2856 consensus_queue.cc:260] T d1f811715ac64ca591a84b52be6e2621 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:52.563427 2755 consensus_queue.cc:1035] T 05cda604dad041cfaad94d1b43d6b14d P 2441fafe1d62429386f4631ad423567d [LEADER]: Connected to new peer: Peer: permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:52.564090 2126 catalog_manager.cc:5674] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237) does not have the latest schema for tablet 4be6edd110374d2bb941e26defc7302f (table default.table_be31f59f9d014d278544a1c9deb8a41a [id=0fc929ad819b48a9af984f8c301bad2b]). Expected version 1 got 0
I20250831 19:54:52.564718 2856 ts_tablet_manager.cc:1428] T d1f811715ac64ca591a84b52be6e2621 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20250831 19:54:52.568264 2778 consensus_queue.cc:1035] T 539e87d86bf7448c978743375bdb3a79 P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:52.570478 2126 catalog_manager.cc:5674] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475) does not have the latest schema for tablet 4be6edd110374d2bb941e26defc7302f (table default.table_be31f59f9d014d278544a1c9deb8a41a [id=0fc929ad819b48a9af984f8c301bad2b]). Expected version 1 got 0
I20250831 19:54:52.571659 2755 raft_consensus.cc:491] T 5b948d8301e343b3a5ea1cf90b841513 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:52.571807 2755 raft_consensus.cc:513] T 5b948d8301e343b3a5ea1cf90b841513 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:52.572474 2755 leader_election.cc:290] T 5b948d8301e343b3a5ea1cf90b841513 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:52.573174 1632 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5b948d8301e343b3a5ea1cf90b841513" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:52.573426 1632 raft_consensus.cc:2466] T 5b948d8301e343b3a5ea1cf90b841513 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 0.
I20250831 19:54:52.573639 2126 master_service.cc:948] ReplaceTablet: received request to replace tablet 4b3babfbfe394414b944bd53377edeb0 from {username='slave'} at 127.0.0.1:36958
I20250831 19:54:52.574344 1770 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5b948d8301e343b3a5ea1cf90b841513" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:52.574476 1841 leader_election.cc:304] T 5b948d8301e343b3a5ea1cf90b841513 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:54:52.574556 1770 raft_consensus.cc:2466] T 5b948d8301e343b3a5ea1cf90b841513 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 0.
I20250831 19:54:52.576133 2118 catalog_manager.cc:3460] renamed table default.table_31929d9da7554974b50e28cd094fd2df [id=1df66f6230794e939a25c0f2254d6e17] in HMS: new name default.table_371cc4850a3443e09f9541001b3bbb0c
I20250831 19:54:52.578963 2758 raft_consensus.cc:2802] T 5b948d8301e343b3a5ea1cf90b841513 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:52.579071 2758 raft_consensus.cc:491] T 5b948d8301e343b3a5ea1cf90b841513 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:52.579154 2758 raft_consensus.cc:3058] T 5b948d8301e343b3a5ea1cf90b841513 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:52.588321 2758 raft_consensus.cc:513] T 5b948d8301e343b3a5ea1cf90b841513 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:52.589231 2758 leader_election.cc:290] T 5b948d8301e343b3a5ea1cf90b841513 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 election: Requested vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:52.589847 1632 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5b948d8301e343b3a5ea1cf90b841513" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:54:52.590063 1632 raft_consensus.cc:3058] T 5b948d8301e343b3a5ea1cf90b841513 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:52.591759 2761 tablet.cc:1722] T 05cda604dad041cfaad94d1b43d6b14d P 2441fafe1d62429386f4631ad423567d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250831 19:54:52.592561 1632 raft_consensus.cc:2466] T 5b948d8301e343b3a5ea1cf90b841513 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 1.
I20250831 19:54:52.594684 1841 leader_election.cc:304] T 5b948d8301e343b3a5ea1cf90b841513 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:54:52.595790 2755 raft_consensus.cc:2802] T 5b948d8301e343b3a5ea1cf90b841513 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:52.596077 2122 catalog_manager.cc:2149] created HMS catalog entry for table [id=b3f794b4f5384662a4cdff8f76f56a66]
I20250831 19:54:52.597769 1770 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5b948d8301e343b3a5ea1cf90b841513" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197"
I20250831 19:54:52.597993 1770 raft_consensus.cc:3058] T 5b948d8301e343b3a5ea1cf90b841513 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:52.600438 1770 raft_consensus.cc:2466] T 5b948d8301e343b3a5ea1cf90b841513 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 1.
I20250831 19:54:52.609093 2282 tablet_bootstrap.cc:492] T d1f811715ac64ca591a84b52be6e2621 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:52.609320 2282 ts_tablet_manager.cc:1397] T d1f811715ac64ca591a84b52be6e2621 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.050s user 0.014s sys 0.006s
I20250831 19:54:52.610212 2282 raft_consensus.cc:357] T d1f811715ac64ca591a84b52be6e2621 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:52.610508 2282 raft_consensus.cc:383] T d1f811715ac64ca591a84b52be6e2621 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:52.610635 2282 raft_consensus.cc:738] T d1f811715ac64ca591a84b52be6e2621 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:52.610920 2282 consensus_queue.cc:260] T d1f811715ac64ca591a84b52be6e2621 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:52.611595 2282 ts_tablet_manager.cc:1428] T d1f811715ac64ca591a84b52be6e2621 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250831 19:54:52.612174 2122 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:36958 (request call id 111) took 1740 ms. Trace:
I20250831 19:54:52.612318 2122 rpcz_store.cc:276] 0831 19:54:50.871890 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:52.040668 (+1168778us) service_pool.cc:225] Handling call
0831 19:54:52.283425 (+242757us) catalog_manager.cc:2076] Acquired catalog manager lock
0831 19:54:52.283907 (+ 482us) catalog_manager.cc:2122] Created new table and tablet info
0831 19:54:52.596032 (+312125us) catalog_manager.cc:2148] Created new table in HMS catalog
0831 19:54:52.611905 (+ 15873us) catalog_manager.cc:2182] Wrote table and tablets to system table
0831 19:54:52.612018 (+ 113us) catalog_manager.cc:2216] Inserted table and tablets into CatalogManager maps
0831 19:54:52.612125 (+ 107us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:52.597661 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:52.597807 (+ 146us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:52.597815 (+ 8us) write_op.cc:435] Acquired schema lock
0831 19:54:52.597819 (+ 4us) tablet.cc:660] Decoding operations
0831 19:54:52.597942 (+ 123us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:52.597960 (+ 18us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:52.597967 (+ 7us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:52.598079 (+ 112us) tablet.cc:699] Row locks acquired
0831 19:54:52.598081 (+ 2us) write_op.cc:260] PREPARE: finished
0831 19:54:52.598125 (+ 44us) write_op.cc:270] Start()
0831 19:54:52.598155 (+ 30us) write_op.cc:276] Timestamp: P: 1756670092598081 usec, L: 0
0831 19:54:52.598159 (+ 4us) op_driver.cc:348] REPLICATION: starting
0831 19:54:52.598346 (+ 187us) log.cc:844] Serialized 433 byte log entry
0831 19:54:52.611201 (+ 12855us) op_driver.cc:464] REPLICATION: finished
0831 19:54:52.611316 (+ 115us) write_op.cc:301] APPLY: starting
0831 19:54:52.611331 (+ 15us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:52.611376 (+ 45us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:52.611406 (+ 30us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:52.611523 (+ 117us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:52.611603 (+ 80us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0831 19:54:52.611615 (+ 12us) write_op.cc:312] APPLY: finished
0831 19:54:52.611706 (+ 91us) log.cc:844] Serialized 29 byte log entry
0831 19:54:52.611774 (+ 68us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:52.611800 (+ 26us) write_op.cc:454] Released schema lock
0831 19:54:52.611806 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0831 19:54:52.611895 (+ 89us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:52.611901 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":291487,"Hive Metastore.run_cpu_time_us":240,"Hive Metastore.run_wall_time_us":20258,"child_traces":[["op",{"apply.queue_time_us":67,"apply.run_cpu_time_us":563,"apply.run_wall_time_us":561,"num_ops":2,"prepare.queue_time_us":973,"prepare.run_cpu_time_us":821,"prepare.run_wall_time_us":822,"raft.queue_time_us":454,"raft.run_cpu_time_us":288,"raft.run_wall_time_us":287,"replication_time_us":13009}]]}
I20250831 19:54:52.613304 2799 raft_consensus.cc:491] T c5cfcb0956e44a1c9e64acc4d1ed568c P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:52.613476 2799 raft_consensus.cc:513] T c5cfcb0956e44a1c9e64acc4d1ed568c P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:52.614089 2799 leader_election.cc:290] T c5cfcb0956e44a1c9e64acc4d1ed568c P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:52.614403 2122 catalog_manager.cc:5674] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197) does not have the latest schema for tablet 05cda604dad041cfaad94d1b43d6b14d (table default.table_6c2f9309b58643529114857aae0568f2 [id=ad7bb166843e423ea7e50a1d18710fa1]). Expected version 2 got 0
I20250831 19:54:52.615187 1770 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c5cfcb0956e44a1c9e64acc4d1ed568c" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:52.615377 1770 raft_consensus.cc:2466] T c5cfcb0956e44a1c9e64acc4d1ed568c P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 0.
I20250831 19:54:52.615772 1631 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c5cfcb0956e44a1c9e64acc4d1ed568c" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:52.615935 1631 raft_consensus.cc:2466] T c5cfcb0956e44a1c9e64acc4d1ed568c P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 0.
I20250831 19:54:52.616672 1841 leader_election.cc:304] T c5cfcb0956e44a1c9e64acc4d1ed568c P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:54:52.617377 2799 raft_consensus.cc:2802] T c5cfcb0956e44a1c9e64acc4d1ed568c P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:52.617486 2799 raft_consensus.cc:491] T c5cfcb0956e44a1c9e64acc4d1ed568c P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:52.617614 2799 raft_consensus.cc:3058] T c5cfcb0956e44a1c9e64acc4d1ed568c P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:52.620085 2799 raft_consensus.cc:513] T c5cfcb0956e44a1c9e64acc4d1ed568c P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:52.620926 1770 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c5cfcb0956e44a1c9e64acc4d1ed568c" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197"
I20250831 19:54:52.621112 1770 raft_consensus.cc:3058] T c5cfcb0956e44a1c9e64acc4d1ed568c P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:52.621215 1631 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c5cfcb0956e44a1c9e64acc4d1ed568c" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:54:52.621376 1631 raft_consensus.cc:3058] T c5cfcb0956e44a1c9e64acc4d1ed568c P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:52.621428 2786 tablet.cc:1722] T 05cda604dad041cfaad94d1b43d6b14d P 89aa85d59c53436ebdf3074b13d14825: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250831 19:54:52.623850 1770 raft_consensus.cc:2466] T c5cfcb0956e44a1c9e64acc4d1ed568c P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 1.
I20250831 19:54:52.624255 1631 raft_consensus.cc:2466] T c5cfcb0956e44a1c9e64acc4d1ed568c P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 1.
I20250831 19:54:52.624635 1841 leader_election.cc:304] T c5cfcb0956e44a1c9e64acc4d1ed568c P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:54:52.627238 2122 catalog_manager.cc:6127] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: default.table_be31f59f9d014d278544a1c9deb8a41a [id=0fc929ad819b48a9af984f8c301bad2b] alter complete (version 1)
I20250831 19:54:52.628032 2122 master_service.cc:948] ReplaceTablet: received request to replace tablet 4b3babfbfe394414b944bd53377edeb0 from {username='slave'} at 127.0.0.1:36958
I20250831 19:54:52.632969 2264 sys_catalog.cc:455] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } } }
I20250831 19:54:52.633155 2264 sys_catalog.cc:458] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [sys.catalog]: This master's current role is: LEADER
I20250831 19:54:52.635525 1749 tablet_service.cc:1468] Processing CreateTablet for tablet 9525ea0cb58146d6851936d749447c3f (DEFAULT_TABLE table=default.table_b4399bb161024e3eb0b69c23e3f9af47 [id=b3f794b4f5384662a4cdff8f76f56a66]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:52.635633 1614 tablet_service.cc:1468] Processing CreateTablet for tablet 9525ea0cb58146d6851936d749447c3f (DEFAULT_TABLE table=default.table_b4399bb161024e3eb0b69c23e3f9af47 [id=b3f794b4f5384662a4cdff8f76f56a66]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:52.635972 1614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9525ea0cb58146d6851936d749447c3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:52.635970 1749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9525ea0cb58146d6851936d749447c3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:52.641496 2282 tablet_bootstrap.cc:492] T 9525ea0cb58146d6851936d749447c3f P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:52.641785 2856 tablet_bootstrap.cc:492] T 9525ea0cb58146d6851936d749447c3f P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:52.642174 1884 tablet_service.cc:1468] Processing CreateTablet for tablet 9525ea0cb58146d6851936d749447c3f (DEFAULT_TABLE table=default.table_b4399bb161024e3eb0b69c23e3f9af47 [id=b3f794b4f5384662a4cdff8f76f56a66]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:52.642566 1884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9525ea0cb58146d6851936d749447c3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:52.643092 2282 tablet_bootstrap.cc:654] T 9525ea0cb58146d6851936d749447c3f P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:52.643282 2856 tablet_bootstrap.cc:654] T 9525ea0cb58146d6851936d749447c3f P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:52.645941 2758 raft_consensus.cc:2802] T c5cfcb0956e44a1c9e64acc4d1ed568c P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:52.646070 2758 raft_consensus.cc:695] T c5cfcb0956e44a1c9e64acc4d1ed568c P 2441fafe1d62429386f4631ad423567d [term 1 LEADER]: Becoming Leader. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Running, Role: LEADER
I20250831 19:54:52.646363 2758 consensus_queue.cc:237] T c5cfcb0956e44a1c9e64acc4d1ed568c P 2441fafe1d62429386f4631ad423567d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:52.651350 2699 tablet_bootstrap.cc:492] T 9525ea0cb58146d6851936d749447c3f P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:52.624640 2799 leader_election.cc:290] T c5cfcb0956e44a1c9e64acc4d1ed568c P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 election: Requested vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:52.653002 2699 tablet_bootstrap.cc:654] T 9525ea0cb58146d6851936d749447c3f P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:52.654443 2282 tablet_bootstrap.cc:492] T 9525ea0cb58146d6851936d749447c3f P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:52.654667 2282 ts_tablet_manager.cc:1397] T 9525ea0cb58146d6851936d749447c3f P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.005s
I20250831 19:54:52.655639 2856 tablet_bootstrap.cc:492] T 9525ea0cb58146d6851936d749447c3f P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:52.655841 2856 ts_tablet_manager.cc:1397] T 9525ea0cb58146d6851936d749447c3f P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.005s
I20250831 19:54:52.655864 2282 raft_consensus.cc:357] T 9525ea0cb58146d6851936d749447c3f P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:52.656097 2282 raft_consensus.cc:383] T 9525ea0cb58146d6851936d749447c3f P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:52.656221 2282 raft_consensus.cc:738] T 9525ea0cb58146d6851936d749447c3f P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:52.656586 2282 consensus_queue.cc:260] T 9525ea0cb58146d6851936d749447c3f P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:52.656813 2856 raft_consensus.cc:357] T 9525ea0cb58146d6851936d749447c3f P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:52.657209 2856 raft_consensus.cc:383] T 9525ea0cb58146d6851936d749447c3f P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:52.657450 2856 raft_consensus.cc:738] T 9525ea0cb58146d6851936d749447c3f P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:52.657784 2282 ts_tablet_manager.cc:1428] T 9525ea0cb58146d6851936d749447c3f P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20250831 19:54:52.657738 2856 consensus_queue.cc:260] T 9525ea0cb58146d6851936d749447c3f P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:52.659366 2856 ts_tablet_manager.cc:1428] T 9525ea0cb58146d6851936d749447c3f P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
I20250831 19:54:52.661307 2124 catalog_manager.cc:2149] created HMS catalog entry for table [id=29dc63d23c10406db017e396faefbe4c]
I20250831 19:54:52.668255 2124 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:36958 (request call id 112) took 1748 ms. Trace:
I20250831 19:54:52.668373 2124 rpcz_store.cc:276] 0831 19:54:50.919657 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:52.041562 (+1121905us) service_pool.cc:225] Handling call
0831 19:54:52.284108 (+242546us) catalog_manager.cc:2076] Acquired catalog manager lock
0831 19:54:52.284524 (+ 416us) catalog_manager.cc:2122] Created new table and tablet info
0831 19:54:52.661239 (+376715us) catalog_manager.cc:2148] Created new table in HMS catalog
0831 19:54:52.668020 (+ 6781us) catalog_manager.cc:2182] Wrote table and tablets to system table
0831 19:54:52.668122 (+ 102us) catalog_manager.cc:2216] Inserted table and tablets into CatalogManager maps
0831 19:54:52.668219 (+ 97us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:52.662178 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:52.662291 (+ 113us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:52.662298 (+ 7us) write_op.cc:435] Acquired schema lock
0831 19:54:52.662300 (+ 2us) tablet.cc:660] Decoding operations
0831 19:54:52.662388 (+ 88us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:52.662401 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:52.662405 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:52.662477 (+ 72us) tablet.cc:699] Row locks acquired
0831 19:54:52.662480 (+ 3us) write_op.cc:260] PREPARE: finished
0831 19:54:52.662517 (+ 37us) write_op.cc:270] Start()
0831 19:54:52.662549 (+ 32us) write_op.cc:276] Timestamp: P: 1756670092662464 usec, L: 0
0831 19:54:52.662553 (+ 4us) op_driver.cc:348] REPLICATION: starting
0831 19:54:52.662751 (+ 198us) log.cc:844] Serialized 433 byte log entry
0831 19:54:52.667013 (+ 4262us) op_driver.cc:464] REPLICATION: finished
0831 19:54:52.667125 (+ 112us) write_op.cc:301] APPLY: starting
0831 19:54:52.667147 (+ 22us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:52.667204 (+ 57us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:52.667255 (+ 51us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:52.667379 (+ 124us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:52.667423 (+ 44us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0831 19:54:52.667433 (+ 10us) write_op.cc:312] APPLY: finished
0831 19:54:52.667541 (+ 108us) log.cc:844] Serialized 29 byte log entry
0831 19:54:52.667643 (+ 102us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:52.667667 (+ 24us) write_op.cc:454] Released schema lock
0831 19:54:52.667676 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0831 19:54:52.667753 (+ 77us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:52.667759 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":311196,"Hive Metastore.run_cpu_time_us":295,"Hive Metastore.run_wall_time_us":65080,"child_traces":[["op",{"apply.queue_time_us":32,"apply.run_cpu_time_us":628,"apply.run_wall_time_us":628,"num_ops":2,"prepare.queue_time_us":118,"prepare.run_cpu_time_us":674,"prepare.run_wall_time_us":674,"raft.queue_time_us":340,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":206,"replication_time_us":4423}]]}
I20250831 19:54:52.674793 2699 tablet_bootstrap.cc:492] T 9525ea0cb58146d6851936d749447c3f P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:52.675035 2699 ts_tablet_manager.cc:1397] T 9525ea0cb58146d6851936d749447c3f P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.024s user 0.011s sys 0.002s
I20250831 19:54:52.675812 2699 raft_consensus.cc:357] T 9525ea0cb58146d6851936d749447c3f P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:52.676029 2699 raft_consensus.cc:383] T 9525ea0cb58146d6851936d749447c3f P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:52.676136 2699 raft_consensus.cc:738] T 9525ea0cb58146d6851936d749447c3f P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:52.676383 2699 consensus_queue.cc:260] T 9525ea0cb58146d6851936d749447c3f P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:52.676867 2699 ts_tablet_manager.cc:1428] T 9525ea0cb58146d6851936d749447c3f P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250831 19:54:52.679031 2124 master_service.cc:948] ReplaceTablet: received request to replace tablet 4b3babfbfe394414b944bd53377edeb0 from {username='slave'} at 127.0.0.1:36958
I20250831 19:54:52.681013 1749 tablet_service.cc:1468] Processing CreateTablet for tablet 026b3c38d6ae4f3492e7d26a19c155d9 (DEFAULT_TABLE table=default.table_4e905daf26a044c38517f550bf5157f7 [id=29dc63d23c10406db017e396faefbe4c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:52.681535 1749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 026b3c38d6ae4f3492e7d26a19c155d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:52.687808 1614 tablet_service.cc:1468] Processing CreateTablet for tablet 026b3c38d6ae4f3492e7d26a19c155d9 (DEFAULT_TABLE table=default.table_4e905daf26a044c38517f550bf5157f7 [id=29dc63d23c10406db017e396faefbe4c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:52.688270 1614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 026b3c38d6ae4f3492e7d26a19c155d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:52.692263 2856 tablet_bootstrap.cc:492] T 026b3c38d6ae4f3492e7d26a19c155d9 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:52.693893 2282 tablet_bootstrap.cc:492] T 026b3c38d6ae4f3492e7d26a19c155d9 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:52.694239 2856 tablet_bootstrap.cc:654] T 026b3c38d6ae4f3492e7d26a19c155d9 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:52.695312 2282 tablet_bootstrap.cc:654] T 026b3c38d6ae4f3492e7d26a19c155d9 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:52.697618 1884 tablet_service.cc:1468] Processing CreateTablet for tablet 026b3c38d6ae4f3492e7d26a19c155d9 (DEFAULT_TABLE table=default.table_4e905daf26a044c38517f550bf5157f7 [id=29dc63d23c10406db017e396faefbe4c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:52.698093 1884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 026b3c38d6ae4f3492e7d26a19c155d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:52.703969 2282 tablet_bootstrap.cc:492] T 026b3c38d6ae4f3492e7d26a19c155d9 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:52.704123 2282 ts_tablet_manager.cc:1397] T 026b3c38d6ae4f3492e7d26a19c155d9 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.009s
I20250831 19:54:52.704806 2282 raft_consensus.cc:357] T 026b3c38d6ae4f3492e7d26a19c155d9 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:52.705015 2282 raft_consensus.cc:383] T 026b3c38d6ae4f3492e7d26a19c155d9 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:52.705085 2282 raft_consensus.cc:738] T 026b3c38d6ae4f3492e7d26a19c155d9 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:52.705322 2282 consensus_queue.cc:260] T 026b3c38d6ae4f3492e7d26a19c155d9 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:52.707741 2282 ts_tablet_manager.cc:1428] T 026b3c38d6ae4f3492e7d26a19c155d9 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20250831 19:54:52.709045 2122 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:36958 (request call id 121) took 1353 ms. Trace:
I20250831 19:54:52.709141 2122 rpcz_store.cc:276] 0831 19:54:51.356052 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:52.627967 (+1271915us) service_pool.cc:225] Handling call
0831 19:54:52.708987 (+ 81020us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250831 19:54:52.711138 2122 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36958:
name: "default.Table_afb8eb0248714122aa74efa2d6fcfce4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:52.711975 2124 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:36958 (request call id 122) took 1355 ms. Trace:
I20250831 19:54:52.712062 2124 rpcz_store.cc:276] 0831 19:54:51.356180 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:52.678959 (+1322779us) service_pool.cc:225] Handling call
0831 19:54:52.711925 (+ 32966us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250831 19:54:52.712358 2124 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36958:
name: "default.Table_9e76b4c3909b459c812cb7fbddc11988"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:52.715442 2125 catalog_manager.cc:2149] created HMS catalog entry for table [id=690a54011d784c13992fd596584eadb8]
I20250831 19:54:52.716176 2126 catalog_manager.cc:5869] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Sending DeleteTablet for 3 replicas of tablet 4b3babfbfe394414b944bd53377edeb0
I20250831 19:54:52.716812 1883 tablet_service.cc:1515] Processing DeleteTablet for tablet 4b3babfbfe394414b944bd53377edeb0 with delete_type TABLET_DATA_DELETED (replaced by tablet c5ea4587e33644fca784e1fb8720d354) from {username='slave'} at 127.0.0.1:45906
I20250831 19:54:52.717607 2839 tablet_replica.cc:331] T 4b3babfbfe394414b944bd53377edeb0 P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:54:52.717711 1614 tablet_service.cc:1515] Processing DeleteTablet for tablet 4b3babfbfe394414b944bd53377edeb0 with delete_type TABLET_DATA_DELETED (replaced by tablet c5ea4587e33644fca784e1fb8720d354) from {username='slave'} at 127.0.0.1:51022
I20250831 19:54:52.717801 2839 raft_consensus.cc:2241] T 4b3babfbfe394414b944bd53377edeb0 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:52.717931 2715 tablet_replica.cc:331] T 4b3babfbfe394414b944bd53377edeb0 P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:54:52.718003 2839 raft_consensus.cc:2270] T 4b3babfbfe394414b944bd53377edeb0 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:52.718104 2715 raft_consensus.cc:2241] T 4b3babfbfe394414b944bd53377edeb0 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:52.718254 2715 raft_consensus.cc:2270] T 4b3babfbfe394414b944bd53377edeb0 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:52.718799 2839 ts_tablet_manager.cc:1905] T 4b3babfbfe394414b944bd53377edeb0 P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:52.719015 2715 ts_tablet_manager.cc:1905] T 4b3babfbfe394414b944bd53377edeb0 P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:52.721026 2125 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:36958 (request call id 113) took 1750 ms. Trace:
I20250831 19:54:52.721129 2125 rpcz_store.cc:276] 0831 19:54:50.970351 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:52.101066 (+1130715us) service_pool.cc:225] Handling call
0831 19:54:52.107996 (+ 6930us) spinlock_profiling.cc:243] Waited 6.57 ms on lock 0x616000040c54. stack: 00007f1e3b0dc7d6 00007f1e3b0dc590 00007f1e3a0cf3ad 0000000000972d94 0000000000972d5d 00007f1e49ea714d 00007f1e49ea7243 00007f1e46b66941 00007f1e4e6f1a5d 00007f1e4e87ae93 00007f1e456b27a6 00007f1e456b24d5 00007f1e41e8a2ce 00007f1e41e891ae 00007f1e41e8f3e5 00007f1e41e8fd0f
0831 19:54:52.303463 (+195467us) catalog_manager.cc:2076] Acquired catalog manager lock
0831 19:54:52.303907 (+ 444us) catalog_manager.cc:2122] Created new table and tablet info
0831 19:54:52.715396 (+411489us) catalog_manager.cc:2148] Created new table in HMS catalog
0831 19:54:52.720808 (+ 5412us) catalog_manager.cc:2182] Wrote table and tablets to system table
0831 19:54:52.720903 (+ 95us) catalog_manager.cc:2216] Inserted table and tablets into CatalogManager maps
0831 19:54:52.720991 (+ 88us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:52.716121 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:52.716262 (+ 141us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:52.716270 (+ 8us) write_op.cc:435] Acquired schema lock
0831 19:54:52.716274 (+ 4us) tablet.cc:660] Decoding operations
0831 19:54:52.716386 (+ 112us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:52.716403 (+ 17us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:52.716409 (+ 6us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:52.716505 (+ 96us) tablet.cc:699] Row locks acquired
0831 19:54:52.716508 (+ 3us) write_op.cc:260] PREPARE: finished
0831 19:54:52.716548 (+ 40us) write_op.cc:270] Start()
0831 19:54:52.716604 (+ 56us) write_op.cc:276] Timestamp: P: 1756670092716490 usec, L: 0
0831 19:54:52.716609 (+ 5us) op_driver.cc:348] REPLICATION: starting
0831 19:54:52.716849 (+ 240us) log.cc:844] Serialized 433 byte log entry
0831 19:54:52.720155 (+ 3306us) op_driver.cc:464] REPLICATION: finished
0831 19:54:52.720258 (+ 103us) write_op.cc:301] APPLY: starting
0831 19:54:52.720274 (+ 16us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:52.720320 (+ 46us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:52.720343 (+ 23us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:52.720433 (+ 90us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:52.720463 (+ 30us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0831 19:54:52.720469 (+ 6us) write_op.cc:312] APPLY: finished
0831 19:54:52.720545 (+ 76us) log.cc:844] Serialized 29 byte log entry
0831 19:54:52.720616 (+ 71us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:52.720636 (+ 20us) write_op.cc:454] Released schema lock
0831 19:54:52.720641 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0831 19:54:52.720705 (+ 64us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:52.720709 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":356773,"Hive Metastore.run_cpu_time_us":302,"Hive Metastore.run_wall_time_us":54365,"spinlock_wait_cycles":15120768,"child_traces":[["op",{"apply.queue_time_us":36,"apply.run_cpu_time_us":449,"apply.run_wall_time_us":449,"num_ops":2,"prepare.queue_time_us":55,"prepare.run_cpu_time_us":857,"prepare.run_wall_time_us":858,"raft.queue_time_us":530,"raft.run_cpu_time_us":341,"raft.run_wall_time_us":342,"replication_time_us":3519}]]}
I20250831 19:54:52.722649 2856 tablet_bootstrap.cc:492] T 026b3c38d6ae4f3492e7d26a19c155d9 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:52.722824 2856 ts_tablet_manager.cc:1397] T 026b3c38d6ae4f3492e7d26a19c155d9 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.031s user 0.009s sys 0.004s
I20250831 19:54:52.723485 2856 raft_consensus.cc:357] T 026b3c38d6ae4f3492e7d26a19c155d9 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:52.723665 2856 raft_consensus.cc:383] T 026b3c38d6ae4f3492e7d26a19c155d9 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:52.723737 2856 raft_consensus.cc:738] T 026b3c38d6ae4f3492e7d26a19c155d9 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:52.724645 2715 ts_tablet_manager.cc:1918] T 4b3babfbfe394414b944bd53377edeb0 P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20250831 19:54:52.724779 2715 log.cc:1199] T 4b3babfbfe394414b944bd53377edeb0 P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/4b3babfbfe394414b944bd53377edeb0
I20250831 19:54:52.725152 2715 ts_tablet_manager.cc:1939] T 4b3babfbfe394414b944bd53377edeb0 P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
I20250831 19:54:52.726086 2104 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet 4b3babfbfe394414b944bd53377edeb0 (table default.table_60746664f3ef4d82866e4bcd56d4fac5 [id=0850f2b0e9324dd0a210fa7b2609c769]) successfully deleted
I20250831 19:54:52.726408 2126 catalog_manager.cc:6652] ReplaceTablet: tablet 4b3babfbfe394414b944bd53377edeb0 deleted and replaced by tablet c5ea4587e33644fca784e1fb8720d354
I20250831 19:54:52.726560 2126 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:36958 (request call id 120) took 1477 ms. Trace:
I20250831 19:54:52.726640 2126 rpcz_store.cc:276] 0831 19:54:51.248642 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:52.573584 (+1324942us) service_pool.cc:225] Handling call
0831 19:54:52.726500 (+152916us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:52.575426 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:52.575565 (+ 139us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:52.575572 (+ 7us) write_op.cc:435] Acquired schema lock
0831 19:54:52.575576 (+ 4us) tablet.cc:660] Decoding operations
0831 19:54:52.575709 (+ 133us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:52.575725 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:52.575731 (+ 6us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:52.575823 (+ 92us) tablet.cc:699] Row locks acquired
0831 19:54:52.575826 (+ 3us) write_op.cc:260] PREPARE: finished
0831 19:54:52.575865 (+ 39us) write_op.cc:270] Start()
0831 19:54:52.575901 (+ 36us) write_op.cc:276] Timestamp: P: 1756670092575821 usec, L: 0
0831 19:54:52.575906 (+ 5us) op_driver.cc:348] REPLICATION: starting
0831 19:54:52.576092 (+ 186us) log.cc:844] Serialized 656 byte log entry
0831 19:54:52.584076 (+ 7984us) op_driver.cc:464] REPLICATION: finished
0831 19:54:52.584214 (+ 138us) write_op.cc:301] APPLY: starting
0831 19:54:52.584234 (+ 20us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:52.584287 (+ 53us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:52.584323 (+ 36us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:52.584438 (+ 115us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:52.584503 (+ 65us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0831 19:54:52.584513 (+ 10us) write_op.cc:312] APPLY: finished
0831 19:54:52.584610 (+ 97us) log.cc:844] Serialized 29 byte log entry
0831 19:54:52.584676 (+ 66us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:52.584701 (+ 25us) write_op.cc:454] Released schema lock
0831 19:54:52.584709 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0831 19:54:52.584782 (+ 73us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:52.584788 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":85,"apply.run_cpu_time_us":556,"apply.run_wall_time_us":556,"num_ops":2,"prepare.queue_time_us":111,"prepare.run_cpu_time_us":789,"prepare.run_wall_time_us":790,"raft.queue_time_us":390,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":226,"replication_time_us":8121}]]}
I20250831 19:54:52.726626 2856 consensus_queue.cc:260] T 026b3c38d6ae4f3492e7d26a19c155d9 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:52.727694 2126 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_e3057132cbc4426e9fc52d84d5189d01" } modify_external_catalogs: true
I20250831 19:54:52.727880 2126 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_e3057132cbc4426e9fc52d84d5189d01" } modify_external_catalogs: true
I20250831 19:54:52.729719 1749 tablet_service.cc:1515] Processing DeleteTablet for tablet 4b3babfbfe394414b944bd53377edeb0 with delete_type TABLET_DATA_DELETED (replaced by tablet c5ea4587e33644fca784e1fb8720d354) from {username='slave'} at 127.0.0.1:50674
I20250831 19:54:52.729969 2840 tablet_replica.cc:331] T 4b3babfbfe394414b944bd53377edeb0 P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:54:52.730188 2840 raft_consensus.cc:2241] T 4b3babfbfe394414b944bd53377edeb0 P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: Raft consensus shutting down.
I20250831 19:54:52.730554 2856 ts_tablet_manager.cc:1428] T 026b3c38d6ae4f3492e7d26a19c155d9 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20250831 19:54:52.730742 2125 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_6a83a43f21484b2ba465fe72560bb53f" } new_table_name: "default.Table_4021d3dbb7f04e50997c9cc51c7e3888" modify_external_catalogs: true
I20250831 19:54:52.730837 2840 raft_consensus.cc:2270] T 4b3babfbfe394414b944bd53377edeb0 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:52.730980 1883 tablet_service.cc:1468] Processing CreateTablet for tablet f8578694650b4379a66d9ea3df34ca0c (DEFAULT_TABLE table=default.table_b90139c92a0d426db7ba39ca376bd8e2 [id=690a54011d784c13992fd596584eadb8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:52.731354 1883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8578694650b4379a66d9ea3df34ca0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:52.735427 2778 consensus_queue.cc:1035] T 769d6c67c8184282b90bda6c16a93dde P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:52.738029 2699 tablet_bootstrap.cc:492] T f8578694650b4379a66d9ea3df34ca0c P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:52.739620 2699 tablet_bootstrap.cc:654] T f8578694650b4379a66d9ea3df34ca0c P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:52.739697 2840 ts_tablet_manager.cc:1905] T 4b3babfbfe394414b944bd53377edeb0 P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:52.744602 1749 tablet_service.cc:1468] Processing CreateTablet for tablet f8578694650b4379a66d9ea3df34ca0c (DEFAULT_TABLE table=default.table_b90139c92a0d426db7ba39ca376bd8e2 [id=690a54011d784c13992fd596584eadb8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:52.745126 1749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8578694650b4379a66d9ea3df34ca0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:52.745505 1614 tablet_service.cc:1468] Processing CreateTablet for tablet f8578694650b4379a66d9ea3df34ca0c (DEFAULT_TABLE table=default.table_b90139c92a0d426db7ba39ca376bd8e2 [id=690a54011d784c13992fd596584eadb8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:52.745702 1883 tablet_service.cc:1468] Processing CreateTablet for tablet c5ea4587e33644fca784e1fb8720d354 (DEFAULT_TABLE table=default.table_60746664f3ef4d82866e4bcd56d4fac5 [id=0850f2b0e9324dd0a210fa7b2609c769]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:52.745851 1614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8578694650b4379a66d9ea3df34ca0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:52.746035 1883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5ea4587e33644fca784e1fb8720d354. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:52.746603 2723 tablet.cc:1722] T 05cda604dad041cfaad94d1b43d6b14d P de831f40fa1348a48a1f0260f4130197: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250831 19:54:52.755379 2282 tablet_bootstrap.cc:492] T f8578694650b4379a66d9ea3df34ca0c P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:52.757149 2282 tablet_bootstrap.cc:654] T f8578694650b4379a66d9ea3df34ca0c P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:52.757958 2699 tablet_bootstrap.cc:492] T f8578694650b4379a66d9ea3df34ca0c P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:52.758823 2699 ts_tablet_manager.cc:1397] T f8578694650b4379a66d9ea3df34ca0c P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.021s user 0.001s sys 0.006s
I20250831 19:54:52.760103 2699 raft_consensus.cc:357] T f8578694650b4379a66d9ea3df34ca0c P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:52.761742 2699 raft_consensus.cc:383] T f8578694650b4379a66d9ea3df34ca0c P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:52.761996 2699 raft_consensus.cc:738] T f8578694650b4379a66d9ea3df34ca0c P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:52.762107 2856 tablet_bootstrap.cc:492] T f8578694650b4379a66d9ea3df34ca0c P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:52.762181 2840 ts_tablet_manager.cc:1918] T 4b3babfbfe394414b944bd53377edeb0 P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20250831 19:54:52.762403 2840 log.cc:1199] T 4b3babfbfe394414b944bd53377edeb0 P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/4b3babfbfe394414b944bd53377edeb0
I20250831 19:54:52.762442 2699 consensus_queue.cc:260] T f8578694650b4379a66d9ea3df34ca0c P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:52.762943 2840 ts_tablet_manager.cc:1939] T 4b3babfbfe394414b944bd53377edeb0 P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
I20250831 19:54:52.764252 2699 ts_tablet_manager.cc:1428] T f8578694650b4379a66d9ea3df34ca0c P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.005s user 0.000s sys 0.001s
I20250831 19:54:52.765152 2856 tablet_bootstrap.cc:654] T f8578694650b4379a66d9ea3df34ca0c P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:52.765475 2699 tablet_bootstrap.cc:492] T c5ea4587e33644fca784e1fb8720d354 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:52.766731 2472 consensus_queue.cc:1035] T 769d6c67c8184282b90bda6c16a93dde P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:52.775483 2105 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet 4b3babfbfe394414b944bd53377edeb0 (table default.table_60746664f3ef4d82866e4bcd56d4fac5 [id=0850f2b0e9324dd0a210fa7b2609c769]) successfully deleted
I20250831 19:54:52.776895 2856 tablet_bootstrap.cc:492] T f8578694650b4379a66d9ea3df34ca0c P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:52.777145 2856 ts_tablet_manager.cc:1397] T f8578694650b4379a66d9ea3df34ca0c P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.004s
I20250831 19:54:52.778156 2856 raft_consensus.cc:357] T f8578694650b4379a66d9ea3df34ca0c P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:52.778496 2856 raft_consensus.cc:383] T f8578694650b4379a66d9ea3df34ca0c P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:52.778643 2856 raft_consensus.cc:738] T f8578694650b4379a66d9ea3df34ca0c P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:52.778860 2699 tablet_bootstrap.cc:654] T c5ea4587e33644fca784e1fb8720d354 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:52.779055 2856 consensus_queue.cc:260] T f8578694650b4379a66d9ea3df34ca0c P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:52.779826 2856 ts_tablet_manager.cc:1428] T f8578694650b4379a66d9ea3df34ca0c P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20250831 19:54:52.782732 1749 tablet_service.cc:1468] Processing CreateTablet for tablet c5ea4587e33644fca784e1fb8720d354 (DEFAULT_TABLE table=default.table_60746664f3ef4d82866e4bcd56d4fac5 [id=0850f2b0e9324dd0a210fa7b2609c769]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:52.783102 1749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5ea4587e33644fca784e1fb8720d354. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:52.783329 1614 tablet_service.cc:1468] Processing CreateTablet for tablet c5ea4587e33644fca784e1fb8720d354 (DEFAULT_TABLE table=default.table_60746664f3ef4d82866e4bcd56d4fac5 [id=0850f2b0e9324dd0a210fa7b2609c769]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:52.783739 1614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5ea4587e33644fca784e1fb8720d354. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:52.791815 2856 tablet_bootstrap.cc:492] T c5ea4587e33644fca784e1fb8720d354 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:52.793404 2856 tablet_bootstrap.cc:654] T c5ea4587e33644fca784e1fb8720d354 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:52.797747 2856 tablet_bootstrap.cc:492] T c5ea4587e33644fca784e1fb8720d354 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:52.797956 2856 ts_tablet_manager.cc:1397] T c5ea4587e33644fca784e1fb8720d354 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.006s user 0.006s sys 0.000s
I20250831 19:54:52.798822 2856 raft_consensus.cc:357] T c5ea4587e33644fca784e1fb8720d354 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:52.799095 2856 raft_consensus.cc:383] T c5ea4587e33644fca784e1fb8720d354 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:52.799214 2856 raft_consensus.cc:738] T c5ea4587e33644fca784e1fb8720d354 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:52.799546 2856 consensus_queue.cc:260] T c5ea4587e33644fca784e1fb8720d354 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:52.800112 2856 ts_tablet_manager.cc:1428] T c5ea4587e33644fca784e1fb8720d354 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250831 19:54:52.797969 2755 raft_consensus.cc:695] T 5b948d8301e343b3a5ea1cf90b841513 P 2441fafe1d62429386f4631ad423567d [term 1 LEADER]: Becoming Leader. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Running, Role: LEADER
I20250831 19:54:52.805255 2755 consensus_queue.cc:237] T 5b948d8301e343b3a5ea1cf90b841513 P 2441fafe1d62429386f4631ad423567d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:52.809113 2186 catalog_manager.cc:2747] Deleting table default.table_0c22133a9af24fe3b029fc31f3c63625 [id=c3969aded3a64f8c9707c760286a4312] in response to Hive Metastore notification log event 108
I20250831 19:54:52.812335 2472 raft_consensus.cc:491] T 026b3c38d6ae4f3492e7d26a19c155d9 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:52.812570 2472 raft_consensus.cc:513] T 026b3c38d6ae4f3492e7d26a19c155d9 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:52.813285 2472 leader_election.cc:290] T 026b3c38d6ae4f3492e7d26a19c155d9 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:52.814635 1633 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "026b3c38d6ae4f3492e7d26a19c155d9" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:52.814836 1633 raft_consensus.cc:2466] T 026b3c38d6ae4f3492e7d26a19c155d9 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 0.
I20250831 19:54:52.815449 2839 ts_tablet_manager.cc:1918] T 4b3babfbfe394414b944bd53377edeb0 P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20250831 19:54:52.815555 2839 log.cc:1199] T 4b3babfbfe394414b944bd53377edeb0 P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/4b3babfbfe394414b944bd53377edeb0
I20250831 19:54:52.815599 1706 leader_election.cc:304] T 026b3c38d6ae4f3492e7d26a19c155d9 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:52.815929 2839 ts_tablet_manager.cc:1939] T 4b3babfbfe394414b944bd53377edeb0 P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:54:52.815992 2584 consensus_queue.cc:1035] T 539e87d86bf7448c978743375bdb3a79 P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:52.816433 2584 raft_consensus.cc:2802] T 026b3c38d6ae4f3492e7d26a19c155d9 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:52.816532 2584 raft_consensus.cc:491] T 026b3c38d6ae4f3492e7d26a19c155d9 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:52.816637 2584 raft_consensus.cc:3058] T 026b3c38d6ae4f3492e7d26a19c155d9 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:52.817014 2186 catalog_manager.cc:5869] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Sending DeleteTablet for 3 replicas of tablet fe0a9178363d432f96eea9422293a2ed
I20250831 19:54:52.820520 1749 tablet_service.cc:1515] Processing DeleteTablet for tablet fe0a9178363d432f96eea9422293a2ed with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:52 UTC) from {username='slave'} at 127.0.0.1:50674
I20250831 19:54:52.820608 1614 tablet_service.cc:1515] Processing DeleteTablet for tablet fe0a9178363d432f96eea9422293a2ed with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:52 UTC) from {username='slave'} at 127.0.0.1:51022
I20250831 19:54:52.820775 2840 tablet_replica.cc:331] T fe0a9178363d432f96eea9422293a2ed P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:54:52.820966 2840 raft_consensus.cc:2241] T fe0a9178363d432f96eea9422293a2ed P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:52.821117 2840 raft_consensus.cc:2270] T fe0a9178363d432f96eea9422293a2ed P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:52.821138 2715 tablet_replica.cc:331] T fe0a9178363d432f96eea9422293a2ed P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:54:52.821377 2715 raft_consensus.cc:2241] T fe0a9178363d432f96eea9422293a2ed P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:52.821643 2715 raft_consensus.cc:2270] T fe0a9178363d432f96eea9422293a2ed P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:52.822244 2840 ts_tablet_manager.cc:1905] T fe0a9178363d432f96eea9422293a2ed P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:52.822314 2715 ts_tablet_manager.cc:1905] T fe0a9178363d432f96eea9422293a2ed P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:52.826337 1884 tablet_service.cc:1515] Processing DeleteTablet for tablet fe0a9178363d432f96eea9422293a2ed with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:52 UTC) from {username='slave'} at 127.0.0.1:45906
I20250831 19:54:52.826610 2584 raft_consensus.cc:513] T 026b3c38d6ae4f3492e7d26a19c155d9 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:52.827253 2699 tablet_bootstrap.cc:492] T c5ea4587e33644fca784e1fb8720d354 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:52.827387 2699 ts_tablet_manager.cc:1397] T c5ea4587e33644fca784e1fb8720d354 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.062s user 0.000s sys 0.004s
I20250831 19:54:52.828145 2699 raft_consensus.cc:357] T c5ea4587e33644fca784e1fb8720d354 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:52.828330 2699 raft_consensus.cc:383] T c5ea4587e33644fca784e1fb8720d354 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:52.828423 2699 raft_consensus.cc:738] T c5ea4587e33644fca784e1fb8720d354 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:52.828632 2699 consensus_queue.cc:260] T c5ea4587e33644fca784e1fb8720d354 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:52.829102 2699 ts_tablet_manager.cc:1428] T c5ea4587e33644fca784e1fb8720d354 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20250831 19:54:52.831372 1631 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "026b3c38d6ae4f3492e7d26a19c155d9" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:54:52.831581 1631 raft_consensus.cc:3058] T 026b3c38d6ae4f3492e7d26a19c155d9 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:52.832098 2584 leader_election.cc:290] T 026b3c38d6ae4f3492e7d26a19c155d9 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Requested vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:52.833618 2840 ts_tablet_manager.cc:1918] T fe0a9178363d432f96eea9422293a2ed P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:52.833747 2840 log.cc:1199] T fe0a9178363d432f96eea9422293a2ed P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/fe0a9178363d432f96eea9422293a2ed
I20250831 19:54:52.834085 2840 ts_tablet_manager.cc:1939] T fe0a9178363d432f96eea9422293a2ed P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
I20250831 19:54:52.834457 1631 raft_consensus.cc:2466] T 026b3c38d6ae4f3492e7d26a19c155d9 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:54:52.834832 2105 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet fe0a9178363d432f96eea9422293a2ed (table default.table_0c22133a9af24fe3b029fc31f3c63625 [id=c3969aded3a64f8c9707c760286a4312]) successfully deleted
I20250831 19:54:52.835055 1706 leader_election.cc:304] T 026b3c38d6ae4f3492e7d26a19c155d9 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:52.835220 2715 ts_tablet_manager.cc:1918] T fe0a9178363d432f96eea9422293a2ed P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:52.835306 2584 raft_consensus.cc:2802] T 026b3c38d6ae4f3492e7d26a19c155d9 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:52.836926 2584 raft_consensus.cc:695] T 026b3c38d6ae4f3492e7d26a19c155d9 P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: Becoming Leader. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Running, Role: LEADER
I20250831 19:54:52.837255 2584 consensus_queue.cc:237] T 026b3c38d6ae4f3492e7d26a19c155d9 P de831f40fa1348a48a1f0260f4130197 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:52.838245 2715 log.cc:1199] T fe0a9178363d432f96eea9422293a2ed P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/fe0a9178363d432f96eea9422293a2ed
I20250831 19:54:52.838835 2715 ts_tablet_manager.cc:1939] T fe0a9178363d432f96eea9422293a2ed P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
I20250831 19:54:52.840377 2104 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet fe0a9178363d432f96eea9422293a2ed (table default.table_0c22133a9af24fe3b029fc31f3c63625 [id=c3969aded3a64f8c9707c760286a4312]) successfully deleted
I20250831 19:54:52.841652 2282 tablet_bootstrap.cc:492] T f8578694650b4379a66d9ea3df34ca0c P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:52.842666 2282 ts_tablet_manager.cc:1397] T f8578694650b4379a66d9ea3df34ca0c P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.087s user 0.002s sys 0.009s
W20250831 19:54:52.842669 2123 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_dbd9b94e2d224171acd87195ab912666 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250831 19:54:52.844137 2282 raft_consensus.cc:357] T f8578694650b4379a66d9ea3df34ca0c P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:52.845201 2282 raft_consensus.cc:383] T f8578694650b4379a66d9ea3df34ca0c P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:52.845583 1906 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "026b3c38d6ae4f3492e7d26a19c155d9" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
W20250831 19:54:52.846287 1705 leader_election.cc:343] T 026b3c38d6ae4f3492e7d26a19c155d9 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): Illegal state: must be running to vote when last-logged opid is not known
I20250831 19:54:52.846971 2699 tablet_bootstrap.cc:492] T 026b3c38d6ae4f3492e7d26a19c155d9 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:52.848160 2101 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet 4b3babfbfe394414b944bd53377edeb0 (table default.table_60746664f3ef4d82866e4bcd56d4fac5 [id=0850f2b0e9324dd0a210fa7b2609c769]) successfully deleted
I20250831 19:54:52.848891 2699 tablet_bootstrap.cc:654] T 026b3c38d6ae4f3492e7d26a19c155d9 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:52.849577 2839 tablet_replica.cc:331] T fe0a9178363d432f96eea9422293a2ed P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:54:52.849848 2839 raft_consensus.cc:2241] T fe0a9178363d432f96eea9422293a2ed P 2441fafe1d62429386f4631ad423567d [term 1 LEADER]: Raft consensus shutting down.
I20250831 19:54:52.850189 2839 raft_consensus.cc:2270] T fe0a9178363d432f96eea9422293a2ed P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:52.850730 2839 ts_tablet_manager.cc:1905] T fe0a9178363d432f96eea9422293a2ed P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:52.859265 2839 ts_tablet_manager.cc:1918] T fe0a9178363d432f96eea9422293a2ed P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:52.861128 2839 log.cc:1199] T fe0a9178363d432f96eea9422293a2ed P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/fe0a9178363d432f96eea9422293a2ed
I20250831 19:54:52.860347 1903 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "026b3c38d6ae4f3492e7d26a19c155d9" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
W20250831 19:54:52.862030 1705 leader_election.cc:343] T 026b3c38d6ae4f3492e7d26a19c155d9 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): Illegal state: must be running to vote when last-logged opid is not known
I20250831 19:54:52.862982 2839 ts_tablet_manager.cc:1939] T fe0a9178363d432f96eea9422293a2ed P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:54:52.864637 2101 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet fe0a9178363d432f96eea9422293a2ed (table default.table_0c22133a9af24fe3b029fc31f3c63625 [id=c3969aded3a64f8c9707c760286a4312]) successfully deleted
I20250831 19:54:52.870800 2282 raft_consensus.cc:738] T f8578694650b4379a66d9ea3df34ca0c P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:52.875037 2282 consensus_queue.cc:260] T f8578694650b4379a66d9ea3df34ca0c P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:52.878398 2282 ts_tablet_manager.cc:1428] T f8578694650b4379a66d9ea3df34ca0c P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.035s user 0.002s sys 0.000s
I20250831 19:54:52.879267 2282 tablet_bootstrap.cc:492] T c5ea4587e33644fca784e1fb8720d354 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:52.883154 2699 tablet_bootstrap.cc:492] T 026b3c38d6ae4f3492e7d26a19c155d9 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:52.883379 2699 ts_tablet_manager.cc:1397] T 026b3c38d6ae4f3492e7d26a19c155d9 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.036s user 0.002s sys 0.007s
I20250831 19:54:52.884404 2699 raft_consensus.cc:357] T 026b3c38d6ae4f3492e7d26a19c155d9 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:52.884732 2699 raft_consensus.cc:383] T 026b3c38d6ae4f3492e7d26a19c155d9 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:52.884963 2699 raft_consensus.cc:738] T 026b3c38d6ae4f3492e7d26a19c155d9 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:52.885295 2699 consensus_queue.cc:260] T 026b3c38d6ae4f3492e7d26a19c155d9 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:52.886513 2699 ts_tablet_manager.cc:1428] T 026b3c38d6ae4f3492e7d26a19c155d9 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20250831 19:54:52.891158 2282 tablet_bootstrap.cc:654] T c5ea4587e33644fca784e1fb8720d354 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:52.895926 2121 catalog_manager.cc:2149] created HMS catalog entry for table [id=10598630389746d2886e5687fe074fd7]
I20250831 19:54:52.902338 2723 tablet.cc:1722] T 98c37cdff24447039bf0b8d832dbb8e5 P de831f40fa1348a48a1f0260f4130197: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:52.902842 2121 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:36958 (request call id 114) took 1854 ms. Trace:
I20250831 19:54:52.902959 2121 rpcz_store.cc:276] 0831 19:54:51.048333 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:52.122741 (+1074408us) service_pool.cc:225] Handling call
0831 19:54:52.303972 (+181231us) catalog_manager.cc:2076] Acquired catalog manager lock
0831 19:54:52.304359 (+ 387us) catalog_manager.cc:2122] Created new table and tablet info
0831 19:54:52.895870 (+591511us) catalog_manager.cc:2148] Created new table in HMS catalog
0831 19:54:52.902534 (+ 6664us) catalog_manager.cc:2182] Wrote table and tablets to system table
0831 19:54:52.902678 (+ 144us) catalog_manager.cc:2216] Inserted table and tablets into CatalogManager maps
0831 19:54:52.902799 (+ 121us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:52.896754 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:52.896913 (+ 159us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:52.896922 (+ 9us) write_op.cc:435] Acquired schema lock
0831 19:54:52.896926 (+ 4us) tablet.cc:660] Decoding operations
0831 19:54:52.897047 (+ 121us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:52.897064 (+ 17us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:52.897071 (+ 7us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:52.897175 (+ 104us) tablet.cc:699] Row locks acquired
0831 19:54:52.897179 (+ 4us) write_op.cc:260] PREPARE: finished
0831 19:54:52.897221 (+ 42us) write_op.cc:270] Start()
0831 19:54:52.897261 (+ 40us) write_op.cc:276] Timestamp: P: 1756670092897195 usec, L: 0
0831 19:54:52.897266 (+ 5us) op_driver.cc:348] REPLICATION: starting
0831 19:54:52.897491 (+ 225us) log.cc:844] Serialized 433 byte log entry
0831 19:54:52.900964 (+ 3473us) op_driver.cc:464] REPLICATION: finished
0831 19:54:52.901108 (+ 144us) write_op.cc:301] APPLY: starting
0831 19:54:52.901126 (+ 18us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:52.901182 (+ 56us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:52.901212 (+ 30us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:52.901428 (+ 216us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:52.901478 (+ 50us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0831 19:54:52.901483 (+ 5us) write_op.cc:312] APPLY: finished
0831 19:54:52.901561 (+ 78us) log.cc:844] Serialized 29 byte log entry
0831 19:54:52.901642 (+ 81us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:52.901666 (+ 24us) write_op.cc:454] Released schema lock
0831 19:54:52.901675 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0831 19:54:52.901763 (+ 88us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:52.901769 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":503918,"Hive Metastore.run_cpu_time_us":304,"Hive Metastore.run_wall_time_us":87167,"child_traces":[["op",{"apply.queue_time_us":90,"apply.run_cpu_time_us":640,"apply.run_wall_time_us":640,"num_ops":2,"prepare.queue_time_us":97,"prepare.run_cpu_time_us":859,"prepare.run_wall_time_us":859,"raft.queue_time_us":1308,"raft.run_cpu_time_us":285,"raft.run_wall_time_us":286,"replication_time_us":3663}]]}
I20250831 19:54:52.905205 2786 tablet.cc:1722] T 98c37cdff24447039bf0b8d832dbb8e5 P 89aa85d59c53436ebdf3074b13d14825: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:52.915748 1884 tablet_service.cc:1468] Processing CreateTablet for tablet 9fc4297f4d704acda823360fe6d406cf (DEFAULT_TABLE table=default.table_ca70026c55be4e7a9db72440e0205619 [id=10598630389746d2886e5687fe074fd7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:52.915917 1749 tablet_service.cc:1468] Processing CreateTablet for tablet 9fc4297f4d704acda823360fe6d406cf (DEFAULT_TABLE table=default.table_ca70026c55be4e7a9db72440e0205619 [id=10598630389746d2886e5687fe074fd7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:52.916158 1884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fc4297f4d704acda823360fe6d406cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:52.916344 1749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fc4297f4d704acda823360fe6d406cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:52.917141 2282 tablet_bootstrap.cc:492] T c5ea4587e33644fca784e1fb8720d354 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:52.917279 2282 ts_tablet_manager.cc:1397] T c5ea4587e33644fca784e1fb8720d354 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.039s user 0.008s sys 0.005s
I20250831 19:54:52.917740 1614 tablet_service.cc:1468] Processing CreateTablet for tablet 9fc4297f4d704acda823360fe6d406cf (DEFAULT_TABLE table=default.table_ca70026c55be4e7a9db72440e0205619 [id=10598630389746d2886e5687fe074fd7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:52.917955 2282 raft_consensus.cc:357] T c5ea4587e33644fca784e1fb8720d354 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:52.918077 1614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fc4297f4d704acda823360fe6d406cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:52.918155 2282 raft_consensus.cc:383] T c5ea4587e33644fca784e1fb8720d354 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:52.918231 2282 raft_consensus.cc:738] T c5ea4587e33644fca784e1fb8720d354 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:52.920264 2282 consensus_queue.cc:260] T c5ea4587e33644fca784e1fb8720d354 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:52.921850 2282 ts_tablet_manager.cc:1428] T c5ea4587e33644fca784e1fb8720d354 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20250831 19:54:52.923255 2121 catalog_manager.cc:5674] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475) does not have the latest schema for tablet 05cda604dad041cfaad94d1b43d6b14d (table default.table_6c2f9309b58643529114857aae0568f2 [id=ad7bb166843e423ea7e50a1d18710fa1]). Expected version 2 got 0
I20250831 19:54:52.924871 2761 tablet.cc:1722] T 98c37cdff24447039bf0b8d832dbb8e5 P 2441fafe1d62429386f4631ad423567d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:52.934182 2856 tablet_bootstrap.cc:492] T 9fc4297f4d704acda823360fe6d406cf P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:52.936244 2856 tablet_bootstrap.cc:654] T 9fc4297f4d704acda823360fe6d406cf P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:52.936223 2121 catalog_manager.cc:5674] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475) does not have the latest schema for tablet c5ea4587e33644fca784e1fb8720d354 (table default.table_60746664f3ef4d82866e4bcd56d4fac5 [id=0850f2b0e9324dd0a210fa7b2609c769]). Expected version 4 got 0
I20250831 19:54:52.936684 2121 catalog_manager.cc:5582] T 026b3c38d6ae4f3492e7d26a19c155d9 P de831f40fa1348a48a1f0260f4130197 reported cstate change: term changed from 0 to 1, leader changed from <none> to de831f40fa1348a48a1f0260f4130197 (127.1.1.194). New cstate: current_term: 1 leader_uuid: "de831f40fa1348a48a1f0260f4130197" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: UNKNOWN } } }
I20250831 19:54:52.952692 2121 catalog_manager.cc:6127] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: default.table_371cc4850a3443e09f9541001b3bbb0c [id=1df66f6230794e939a25c0f2254d6e17] alter complete (version 1)
W20250831 19:54:52.953613 2121 catalog_manager.cc:5774] Failed to send AlterTable RPC for tablet c5ea4587e33644fca784e1fb8720d354 (table default.table_60746664f3ef4d82866e4bcd56d4fac5 [id=0850f2b0e9324dd0a210fa7b2609c769], current schema version=4): Not found: failed to reset TS proxy: No leader found: Tablet c5ea4587e33644fca784e1fb8720d354 consensus state has no leader
I20250831 19:54:52.953640 2282 tablet_bootstrap.cc:492] T 9fc4297f4d704acda823360fe6d406cf P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:52.955245 2282 tablet_bootstrap.cc:654] T 9fc4297f4d704acda823360fe6d406cf P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:52.957973 2121 catalog_manager.cc:5582] T 5b948d8301e343b3a5ea1cf90b841513 P 2441fafe1d62429386f4631ad423567d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2441fafe1d62429386f4631ad423567d (127.1.1.195). New cstate: current_term: 1 leader_uuid: "2441fafe1d62429386f4631ad423567d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: UNKNOWN } } }
I20250831 19:54:52.958395 2121 catalog_manager.cc:5674] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237) does not have the latest schema for tablet 5b948d8301e343b3a5ea1cf90b841513 (table default.table_207ac87518bc487184a89bb52cd204b3 [id=f48af5bc3eff4c819be4aeeff4128c2a]). Expected version 1 got 0
I20250831 19:54:52.961613 2896 consensus_queue.cc:1035] T d3a587be468b4b7c8b90f4374af25e08 P 2441fafe1d62429386f4631ad423567d [LEADER]: Connected to new peer: Peer: permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20250831 19:54:52.964457 2699 tablet_bootstrap.cc:492] T 9fc4297f4d704acda823360fe6d406cf P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:52.965932 2699 tablet_bootstrap.cc:654] T 9fc4297f4d704acda823360fe6d406cf P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:52.968250 2121 catalog_manager.cc:5674] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237) does not have the latest schema for tablet c5ea4587e33644fca784e1fb8720d354 (table default.table_60746664f3ef4d82866e4bcd56d4fac5 [id=0850f2b0e9324dd0a210fa7b2609c769]). Expected version 4 got 0
I20250831 19:54:52.968619 2121 catalog_manager.cc:5582] T c5cfcb0956e44a1c9e64acc4d1ed568c P 2441fafe1d62429386f4631ad423567d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2441fafe1d62429386f4631ad423567d (127.1.1.195). New cstate: current_term: 1 leader_uuid: "2441fafe1d62429386f4631ad423567d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: UNKNOWN } } }
I20250831 19:54:52.977349 2584 raft_consensus.cc:491] T f8578694650b4379a66d9ea3df34ca0c P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:52.977573 2584 raft_consensus.cc:513] T f8578694650b4379a66d9ea3df34ca0c P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:52.978253 2584 leader_election.cc:290] T f8578694650b4379a66d9ea3df34ca0c P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:52.978817 1903 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f8578694650b4379a66d9ea3df34ca0c" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:52.979040 1903 raft_consensus.cc:2466] T f8578694650b4379a66d9ea3df34ca0c P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 0.
I20250831 19:54:52.979044 1633 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f8578694650b4379a66d9ea3df34ca0c" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:52.979223 1633 raft_consensus.cc:2466] T f8578694650b4379a66d9ea3df34ca0c P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 0.
I20250831 19:54:52.979460 1705 leader_election.cc:304] T f8578694650b4379a66d9ea3df34ca0c P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:52.979856 2584 raft_consensus.cc:2802] T f8578694650b4379a66d9ea3df34ca0c P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:52.979977 2584 raft_consensus.cc:491] T f8578694650b4379a66d9ea3df34ca0c P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:52.980067 2584 raft_consensus.cc:3058] T f8578694650b4379a66d9ea3df34ca0c P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:52.983160 2584 raft_consensus.cc:513] T f8578694650b4379a66d9ea3df34ca0c P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:52.984062 1903 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f8578694650b4379a66d9ea3df34ca0c" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:54:52.984261 1903 raft_consensus.cc:3058] T f8578694650b4379a66d9ea3df34ca0c P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:52.984503 2856 tablet_bootstrap.cc:492] T 9fc4297f4d704acda823360fe6d406cf P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:52.984645 2856 ts_tablet_manager.cc:1397] T 9fc4297f4d704acda823360fe6d406cf P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.051s user 0.001s sys 0.012s
I20250831 19:54:52.985329 2856 raft_consensus.cc:357] T 9fc4297f4d704acda823360fe6d406cf P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:52.985495 2856 raft_consensus.cc:383] T 9fc4297f4d704acda823360fe6d406cf P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:52.985591 2856 raft_consensus.cc:738] T 9fc4297f4d704acda823360fe6d406cf P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:52.985816 2856 consensus_queue.cc:260] T 9fc4297f4d704acda823360fe6d406cf P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:52.986287 2856 ts_tablet_manager.cc:1428] T 9fc4297f4d704acda823360fe6d406cf P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20250831 19:54:52.986858 1903 raft_consensus.cc:2466] T f8578694650b4379a66d9ea3df34ca0c P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:54:52.987543 1705 leader_election.cc:304] T f8578694650b4379a66d9ea3df34ca0c P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:52.987800 2778 raft_consensus.cc:2802] T f8578694650b4379a66d9ea3df34ca0c P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:52.987944 2778 raft_consensus.cc:695] T f8578694650b4379a66d9ea3df34ca0c P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: Becoming Leader. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Running, Role: LEADER
I20250831 19:54:52.988270 2584 leader_election.cc:290] T f8578694650b4379a66d9ea3df34ca0c P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Requested vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:52.988195 2778 consensus_queue.cc:237] T f8578694650b4379a66d9ea3df34ca0c P de831f40fa1348a48a1f0260f4130197 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:52.988351 1633 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f8578694650b4379a66d9ea3df34ca0c" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:54:52.988518 1633 raft_consensus.cc:3058] T f8578694650b4379a66d9ea3df34ca0c P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:52.990845 1633 raft_consensus.cc:2466] T f8578694650b4379a66d9ea3df34ca0c P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:54:52.997056 2123 catalog_manager.cc:2149] created HMS catalog entry for table [id=3671adc17a134657a7e9b07c97bea371]
I20250831 19:54:53.004272 2123 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:36958 (request call id 115) took 1904 ms. Trace:
I20250831 19:54:53.004437 2123 rpcz_store.cc:276] 0831 19:54:51.099573 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:52.295034 (+1195461us) service_pool.cc:225] Handling call
0831 19:54:52.842773 (+547739us) catalog_manager.cc:2076] Acquired catalog manager lock
0831 19:54:52.843203 (+ 430us) catalog_manager.cc:2122] Created new table and tablet info
0831 19:54:52.997009 (+153806us) catalog_manager.cc:2148] Created new table in HMS catalog
0831 19:54:53.003977 (+ 6968us) catalog_manager.cc:2182] Wrote table and tablets to system table
0831 19:54:53.004116 (+ 139us) catalog_manager.cc:2216] Inserted table and tablets into CatalogManager maps
0831 19:54:53.004232 (+ 116us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:52.997993 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:52.998141 (+ 148us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:52.998149 (+ 8us) write_op.cc:435] Acquired schema lock
0831 19:54:52.998154 (+ 5us) tablet.cc:660] Decoding operations
0831 19:54:52.998282 (+ 128us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:52.998298 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:52.998305 (+ 7us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:52.998400 (+ 95us) tablet.cc:699] Row locks acquired
0831 19:54:52.998403 (+ 3us) write_op.cc:260] PREPARE: finished
0831 19:54:52.998440 (+ 37us) write_op.cc:270] Start()
0831 19:54:52.998477 (+ 37us) write_op.cc:276] Timestamp: P: 1756670092998404 usec, L: 0
0831 19:54:52.998482 (+ 5us) op_driver.cc:348] REPLICATION: starting
0831 19:54:52.998691 (+ 209us) log.cc:844] Serialized 433 byte log entry
0831 19:54:53.002563 (+ 3872us) op_driver.cc:464] REPLICATION: finished
0831 19:54:53.002712 (+ 149us) write_op.cc:301] APPLY: starting
0831 19:54:53.002730 (+ 18us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:53.002793 (+ 63us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:53.002834 (+ 41us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:53.002973 (+ 139us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:53.003018 (+ 45us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0831 19:54:53.003030 (+ 12us) write_op.cc:312] APPLY: finished
0831 19:54:53.003115 (+ 85us) log.cc:844] Serialized 29 byte log entry
0831 19:54:53.003182 (+ 67us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:53.003205 (+ 23us) write_op.cc:454] Released schema lock
0831 19:54:53.003214 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0831 19:54:53.003286 (+ 72us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:53.003292 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":52277,"Hive Metastore.run_cpu_time_us":293,"Hive Metastore.run_wall_time_us":101213,"child_traces":[["op",{"apply.queue_time_us":95,"apply.run_cpu_time_us":562,"apply.run_wall_time_us":562,"num_ops":2,"prepare.queue_time_us":240,"prepare.run_cpu_time_us":827,"prepare.run_wall_time_us":826,"raft.queue_time_us":1354,"raft.run_cpu_time_us":237,"raft.run_wall_time_us":237,"replication_time_us":4049}]]}
I20250831 19:54:53.010035 2699 tablet_bootstrap.cc:492] T 9fc4297f4d704acda823360fe6d406cf P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:53.010159 2699 ts_tablet_manager.cc:1397] T 9fc4297f4d704acda823360fe6d406cf P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.059s user 0.010s sys 0.000s
I20250831 19:54:53.010792 2699 raft_consensus.cc:357] T 9fc4297f4d704acda823360fe6d406cf P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:53.010939 2699 raft_consensus.cc:383] T 9fc4297f4d704acda823360fe6d406cf P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:53.011000 2699 raft_consensus.cc:738] T 9fc4297f4d704acda823360fe6d406cf P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:53.011183 2699 consensus_queue.cc:260] T 9fc4297f4d704acda823360fe6d406cf P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:53.013583 2844 raft_consensus.cc:491] T 9525ea0cb58146d6851936d749447c3f P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:53.013736 2844 raft_consensus.cc:513] T 9525ea0cb58146d6851936d749447c3f P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:53.014312 2844 leader_election.cc:290] T 9525ea0cb58146d6851936d749447c3f P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:53.020002 2895 consensus_queue.cc:1035] T d3a587be468b4b7c8b90f4374af25e08 P 2441fafe1d62429386f4631ad423567d [LEADER]: Connected to new peer: Peer: permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:53.025641 1903 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9525ea0cb58146d6851936d749447c3f" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:53.025821 1903 raft_consensus.cc:2466] T 9525ea0cb58146d6851936d749447c3f P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 0.
I20250831 19:54:53.026553 1568 leader_election.cc:304] T 9525ea0cb58146d6851936d749447c3f P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:54:53.026859 2844 raft_consensus.cc:2802] T 9525ea0cb58146d6851936d749447c3f P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:53.026952 2844 raft_consensus.cc:491] T 9525ea0cb58146d6851936d749447c3f P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:53.027016 2844 raft_consensus.cc:3058] T 9525ea0cb58146d6851936d749447c3f P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
W20250831 19:54:53.037091 2122 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_afb8eb0248714122aa74efa2d6fcfce4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250831 19:54:53.037343 2117 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_0409d51b133145c5b7e7d4d407a471b2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250831 19:54:53.037521 2124 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_9e76b4c3909b459c812cb7fbddc11988 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250831 19:54:53.037084 2120 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_1dc7d3d86ed047bd8c86e21d7b38f477 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250831 19:54:53.037740 2118 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:36958 (request call id 110) took 2219 ms. Trace:
I20250831 19:54:53.037859 2118 rpcz_store.cc:276] 0831 19:54:50.818269 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:52.039910 (+1221641us) service_pool.cc:225] Handling call
0831 19:54:52.280289 (+240379us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:53.037192 (+756903us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:53.037463 (+ 271us) catalog_manager.cc:3683] Apply alter schema
0831 19:54:53.037680 (+ 217us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":120205,"Hive Metastore.run_cpu_time_us":614,"Hive Metastore.run_wall_time_us":174826}
I20250831 19:54:53.037132 2119 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:36958 (request call id 109) took 2234 ms. Trace:
I20250831 19:54:53.040030 2119 rpcz_store.cc:276] 0831 19:54:50.802529 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:52.038607 (+1236078us) service_pool.cc:225] Handling call
0831 19:54:52.280104 (+241497us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:53.037072 (+756968us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":13856,"Hive Metastore.run_cpu_time_us":172,"Hive Metastore.run_wall_time_us":106501}
I20250831 19:54:53.042096 2844 raft_consensus.cc:513] T 9525ea0cb58146d6851936d749447c3f P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:53.042724 2844 leader_election.cc:290] T 9525ea0cb58146d6851936d749447c3f P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Requested vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:53.043567 1903 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9525ea0cb58146d6851936d749447c3f" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:54:53.043745 1903 raft_consensus.cc:3058] T 9525ea0cb58146d6851936d749447c3f P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:53.046489 2778 raft_consensus.cc:491] T d1f811715ac64ca591a84b52be6e2621 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:53.046669 2778 raft_consensus.cc:513] T d1f811715ac64ca591a84b52be6e2621 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:53.047215 1884 tablet_service.cc:1468] Processing CreateTablet for tablet 8fb7abc5581e4a16a55f844acd5fd2e9 (DEFAULT_TABLE table=default.table_dbd9b94e2d224171acd87195ab912666 [id=3671adc17a134657a7e9b07c97bea371]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:53.047297 2778 leader_election.cc:290] T d1f811715ac64ca591a84b52be6e2621 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:53.047606 1903 raft_consensus.cc:2466] T 9525ea0cb58146d6851936d749447c3f P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1.
I20250831 19:54:53.047677 1884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fb7abc5581e4a16a55f844acd5fd2e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:53.047744 1749 tablet_service.cc:1468] Processing CreateTablet for tablet 8fb7abc5581e4a16a55f844acd5fd2e9 (DEFAULT_TABLE table=default.table_dbd9b94e2d224171acd87195ab912666 [id=3671adc17a134657a7e9b07c97bea371]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:53.048111 1749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fb7abc5581e4a16a55f844acd5fd2e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:53.048506 1568 leader_election.cc:304] T 9525ea0cb58146d6851936d749447c3f P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:54:53.049333 2895 consensus_queue.cc:1035] T c6db2a319cbf4359846c5f930ce8f0de P 2441fafe1d62429386f4631ad423567d [LEADER]: Connected to new peer: Peer: permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:53.054023 1632 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d1f811715ac64ca591a84b52be6e2621" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:53.054100 1903 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d1f811715ac64ca591a84b52be6e2621" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:53.054207 1632 raft_consensus.cc:2466] T d1f811715ac64ca591a84b52be6e2621 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 0.
I20250831 19:54:53.054268 1903 raft_consensus.cc:2466] T d1f811715ac64ca591a84b52be6e2621 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 0.
I20250831 19:54:53.054630 1705 leader_election.cc:304] T d1f811715ac64ca591a84b52be6e2621 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:53.055676 2844 raft_consensus.cc:2802] T 9525ea0cb58146d6851936d749447c3f P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:53.057152 2778 raft_consensus.cc:2802] T d1f811715ac64ca591a84b52be6e2621 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:53.057282 2778 raft_consensus.cc:491] T d1f811715ac64ca591a84b52be6e2621 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:53.057365 2778 raft_consensus.cc:3058] T d1f811715ac64ca591a84b52be6e2621 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:53.061580 2778 raft_consensus.cc:513] T d1f811715ac64ca591a84b52be6e2621 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:53.066370 1770 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9525ea0cb58146d6851936d749447c3f" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197"
I20250831 19:54:53.066565 1770 raft_consensus.cc:3058] T 9525ea0cb58146d6851936d749447c3f P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:53.066512 1614 tablet_service.cc:1468] Processing CreateTablet for tablet 8fb7abc5581e4a16a55f844acd5fd2e9 (DEFAULT_TABLE table=default.table_dbd9b94e2d224171acd87195ab912666 [id=3671adc17a134657a7e9b07c97bea371]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:53.066947 1614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fb7abc5581e4a16a55f844acd5fd2e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:53.068851 1770 raft_consensus.cc:2466] T 9525ea0cb58146d6851936d749447c3f P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1.
I20250831 19:54:53.070364 2896 consensus_queue.cc:1035] T c6db2a319cbf4359846c5f930ce8f0de P 2441fafe1d62429386f4631ad423567d [LEADER]: Connected to new peer: Peer: permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:53.071233 2118 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_ada526abffc1474c8cebeb3bcbb17824" } modify_external_catalogs: true
I20250831 19:54:53.071422 2118 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_ada526abffc1474c8cebeb3bcbb17824" } modify_external_catalogs: true
I20250831 19:54:53.071599 1632 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d1f811715ac64ca591a84b52be6e2621" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:54:53.071761 1632 raft_consensus.cc:3058] T d1f811715ac64ca591a84b52be6e2621 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:53.073670 2119 catalog_manager.cc:5582] T f8578694650b4379a66d9ea3df34ca0c P de831f40fa1348a48a1f0260f4130197 reported cstate change: term changed from 0 to 1, leader changed from <none> to de831f40fa1348a48a1f0260f4130197 (127.1.1.194). New cstate: current_term: 1 leader_uuid: "de831f40fa1348a48a1f0260f4130197" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: UNKNOWN } } }
I20250831 19:54:53.074416 1632 raft_consensus.cc:2466] T d1f811715ac64ca591a84b52be6e2621 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:54:53.075867 1706 leader_election.cc:304] T d1f811715ac64ca591a84b52be6e2621 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:53.076138 2914 raft_consensus.cc:2802] T d1f811715ac64ca591a84b52be6e2621 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:53.076272 2914 raft_consensus.cc:695] T d1f811715ac64ca591a84b52be6e2621 P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: Becoming Leader. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Running, Role: LEADER
I20250831 19:54:53.076560 2914 consensus_queue.cc:237] T d1f811715ac64ca591a84b52be6e2621 P de831f40fa1348a48a1f0260f4130197 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:53.077952 2778 leader_election.cc:290] T d1f811715ac64ca591a84b52be6e2621 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Requested vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:53.078311 1903 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d1f811715ac64ca591a84b52be6e2621" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:54:53.078503 1903 raft_consensus.cc:3058] T d1f811715ac64ca591a84b52be6e2621 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:53.079875 2123 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_4ab0ff6a6b0e49b0a8e0e9999f531e5b" } new_table_name: "default.Table_b5294d0b8f564e31865783000a954688" modify_external_catalogs: true
I20250831 19:54:53.082052 1771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9525ea0cb58146d6851936d749447c3f" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:53.082744 1771 raft_consensus.cc:2374] T 9525ea0cb58146d6851936d749447c3f P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1. Re-sending same reply.
I20250831 19:54:53.084053 2699 ts_tablet_manager.cc:1428] T 9fc4297f4d704acda823360fe6d406cf P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.074s user 0.002s sys 0.000s
I20250831 19:54:53.086292 2699 tablet_bootstrap.cc:492] T 8fb7abc5581e4a16a55f844acd5fd2e9 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:53.086328 2856 tablet_bootstrap.cc:492] T 8fb7abc5581e4a16a55f844acd5fd2e9 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:53.087500 1903 raft_consensus.cc:2466] T d1f811715ac64ca591a84b52be6e2621 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:54:53.087960 2856 tablet_bootstrap.cc:654] T 8fb7abc5581e4a16a55f844acd5fd2e9 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:53.091126 2699 tablet_bootstrap.cc:654] T 8fb7abc5581e4a16a55f844acd5fd2e9 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:53.093477 2126 catalog_manager.cc:2706] deleted HMS catalog entry for table default.table_e3057132cbc4426e9fc52d84d5189d01 [id=29bd77e83ad04288b3edceffb562bd03]
I20250831 19:54:53.095666 2856 tablet_bootstrap.cc:492] T 8fb7abc5581e4a16a55f844acd5fd2e9 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:53.095816 2856 ts_tablet_manager.cc:1397] T 8fb7abc5581e4a16a55f844acd5fd2e9 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.002s
I20250831 19:54:53.096613 2856 raft_consensus.cc:357] T 8fb7abc5581e4a16a55f844acd5fd2e9 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:53.096781 2856 raft_consensus.cc:383] T 8fb7abc5581e4a16a55f844acd5fd2e9 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:53.096838 2856 raft_consensus.cc:738] T 8fb7abc5581e4a16a55f844acd5fd2e9 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:53.097223 2856 consensus_queue.cc:260] T 8fb7abc5581e4a16a55f844acd5fd2e9 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:53.097790 2856 ts_tablet_manager.cc:1428] T 8fb7abc5581e4a16a55f844acd5fd2e9 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250831 19:54:53.098367 2119 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_b7904c1a8762458ca114fc256fb84e5a" } new_table_name: "default.Table_d30c0aaa2c2a465ca2999246bdd68e5f" modify_external_catalogs: true
I20250831 19:54:53.102960 2121 catalog_manager.cc:5674] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197) does not have the latest schema for tablet c5ea4587e33644fca784e1fb8720d354 (table default.table_60746664f3ef4d82866e4bcd56d4fac5 [id=0850f2b0e9324dd0a210fa7b2609c769]). Expected version 4 got 0
I20250831 19:54:53.106307 2282 tablet_bootstrap.cc:492] T 9fc4297f4d704acda823360fe6d406cf P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:53.106468 2282 ts_tablet_manager.cc:1397] T 9fc4297f4d704acda823360fe6d406cf P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.153s user 0.007s sys 0.028s
I20250831 19:54:53.107307 2282 raft_consensus.cc:357] T 9fc4297f4d704acda823360fe6d406cf P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:53.107476 2282 raft_consensus.cc:383] T 9fc4297f4d704acda823360fe6d406cf P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:53.107604 2282 raft_consensus.cc:738] T 9fc4297f4d704acda823360fe6d406cf P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:53.108733 2282 consensus_queue.cc:260] T 9fc4297f4d704acda823360fe6d406cf P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:53.109624 2282 ts_tablet_manager.cc:1428] T 9fc4297f4d704acda823360fe6d406cf P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20250831 19:54:53.109887 2282 tablet_bootstrap.cc:492] T 8fb7abc5581e4a16a55f844acd5fd2e9 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:53.110543 2844 raft_consensus.cc:695] T 9525ea0cb58146d6851936d749447c3f P 89aa85d59c53436ebdf3074b13d14825 [term 1 LEADER]: Becoming Leader. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Running, Role: LEADER
I20250831 19:54:53.110865 2844 consensus_queue.cc:237] T 9525ea0cb58146d6851936d749447c3f P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:53.111680 2282 tablet_bootstrap.cc:654] T 8fb7abc5581e4a16a55f844acd5fd2e9 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:53.114635 1633 raft_consensus.cc:1273] T 5b948d8301e343b3a5ea1cf90b841513 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Refusing update from remote peer 2441fafe1d62429386f4631ad423567d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250831 19:54:53.115186 2758 consensus_queue.cc:1035] T 5b948d8301e343b3a5ea1cf90b841513 P 2441fafe1d62429386f4631ad423567d [LEADER]: Connected to new peer: Peer: permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:53.117877 1769 raft_consensus.cc:1273] T 5b948d8301e343b3a5ea1cf90b841513 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Refusing update from remote peer 2441fafe1d62429386f4631ad423567d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250831 19:54:53.119822 2761 tablet.cc:1722] T 5b948d8301e343b3a5ea1cf90b841513 P 2441fafe1d62429386f4631ad423567d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:53.130262 2786 tablet.cc:1722] T 5b948d8301e343b3a5ea1cf90b841513 P 89aa85d59c53436ebdf3074b13d14825: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:53.130900 2755 consensus_queue.cc:1035] T 5b948d8301e343b3a5ea1cf90b841513 P 2441fafe1d62429386f4631ad423567d [LEADER]: Connected to new peer: Peer: permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:53.132684 2282 tablet_bootstrap.cc:492] T 8fb7abc5581e4a16a55f844acd5fd2e9 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:53.132848 2282 ts_tablet_manager.cc:1397] T 8fb7abc5581e4a16a55f844acd5fd2e9 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.023s user 0.005s sys 0.001s
I20250831 19:54:53.135131 2282 raft_consensus.cc:357] T 8fb7abc5581e4a16a55f844acd5fd2e9 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:53.135321 2282 raft_consensus.cc:383] T 8fb7abc5581e4a16a55f844acd5fd2e9 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:53.135386 2282 raft_consensus.cc:738] T 8fb7abc5581e4a16a55f844acd5fd2e9 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:53.135628 2282 consensus_queue.cc:260] T 8fb7abc5581e4a16a55f844acd5fd2e9 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:53.136118 2282 ts_tablet_manager.cc:1428] T 8fb7abc5581e4a16a55f844acd5fd2e9 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20250831 19:54:53.136543 2778 raft_consensus.cc:491] T c5ea4587e33644fca784e1fb8720d354 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:53.136693 2778 raft_consensus.cc:513] T c5ea4587e33644fca784e1fb8720d354 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:53.137642 1903 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c5ea4587e33644fca784e1fb8720d354" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:53.137828 1903 raft_consensus.cc:2466] T c5ea4587e33644fca784e1fb8720d354 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 0.
I20250831 19:54:53.138281 1705 leader_election.cc:304] T c5ea4587e33644fca784e1fb8720d354 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:53.138908 2914 raft_consensus.cc:2802] T c5ea4587e33644fca784e1fb8720d354 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:53.139060 2914 raft_consensus.cc:491] T c5ea4587e33644fca784e1fb8720d354 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:53.139200 2914 raft_consensus.cc:3058] T c5ea4587e33644fca784e1fb8720d354 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:53.140235 2584 raft_consensus.cc:491] T 8fb7abc5581e4a16a55f844acd5fd2e9 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:53.140357 2584 raft_consensus.cc:513] T 8fb7abc5581e4a16a55f844acd5fd2e9 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:53.140882 2584 leader_election.cc:290] T 8fb7abc5581e4a16a55f844acd5fd2e9 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197), 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237)
I20250831 19:54:53.141516 1903 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8fb7abc5581e4a16a55f844acd5fd2e9" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
W20250831 19:54:53.142046 1705 leader_election.cc:343] T 8fb7abc5581e4a16a55f844acd5fd2e9 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): Illegal state: must be running to vote when last-logged opid is not known
I20250831 19:54:53.144135 2914 raft_consensus.cc:513] T c5ea4587e33644fca784e1fb8720d354 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:53.145005 1903 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c5ea4587e33644fca784e1fb8720d354" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:54:53.145174 1903 raft_consensus.cc:3058] T c5ea4587e33644fca784e1fb8720d354 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:53.147755 1903 raft_consensus.cc:2466] T c5ea4587e33644fca784e1fb8720d354 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:54:53.148202 1705 leader_election.cc:304] T c5ea4587e33644fca784e1fb8720d354 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:53.148505 2584 raft_consensus.cc:2802] T c5ea4587e33644fca784e1fb8720d354 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:53.148675 2584 raft_consensus.cc:695] T c5ea4587e33644fca784e1fb8720d354 P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: Becoming Leader. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Running, Role: LEADER
I20250831 19:54:53.148945 2584 consensus_queue.cc:237] T c5ea4587e33644fca784e1fb8720d354 P de831f40fa1348a48a1f0260f4130197 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:53.150481 1633 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8fb7abc5581e4a16a55f844acd5fd2e9" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:53.150676 1633 raft_consensus.cc:2466] T 8fb7abc5581e4a16a55f844acd5fd2e9 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 0.
I20250831 19:54:53.151168 1706 leader_election.cc:304] T 8fb7abc5581e4a16a55f844acd5fd2e9 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197; no voters: 2441fafe1d62429386f4631ad423567d
I20250831 19:54:53.151407 2472 raft_consensus.cc:2802] T 8fb7abc5581e4a16a55f844acd5fd2e9 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:53.151502 2472 raft_consensus.cc:491] T 8fb7abc5581e4a16a55f844acd5fd2e9 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:53.151590 2472 raft_consensus.cc:3058] T 8fb7abc5581e4a16a55f844acd5fd2e9 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:53.153582 1633 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c5ea4587e33644fca784e1fb8720d354" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:53.153755 1633 raft_consensus.cc:2466] T c5ea4587e33644fca784e1fb8720d354 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 0.
I20250831 19:54:53.154143 2472 raft_consensus.cc:513] T 8fb7abc5581e4a16a55f844acd5fd2e9 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:53.154358 2778 leader_election.cc:290] T c5ea4587e33644fca784e1fb8720d354 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:53.154696 2472 leader_election.cc:290] T 8fb7abc5581e4a16a55f844acd5fd2e9 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Requested vote from peers 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197), 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237)
I20250831 19:54:53.154927 1633 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8fb7abc5581e4a16a55f844acd5fd2e9" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:54:53.155102 1633 raft_consensus.cc:3058] T 8fb7abc5581e4a16a55f844acd5fd2e9 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:53.156415 1903 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8fb7abc5581e4a16a55f844acd5fd2e9" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
W20250831 19:54:53.156905 1705 leader_election.cc:343] T 8fb7abc5581e4a16a55f844acd5fd2e9 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): Illegal state: must be running to vote when last-logged opid is not known
I20250831 19:54:53.158823 2723 tablet.cc:1722] T 5b948d8301e343b3a5ea1cf90b841513 P de831f40fa1348a48a1f0260f4130197: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:53.159747 1633 raft_consensus.cc:2466] T 8fb7abc5581e4a16a55f844acd5fd2e9 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:54:53.160168 1706 leader_election.cc:304] T 8fb7abc5581e4a16a55f844acd5fd2e9 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197; no voters: 2441fafe1d62429386f4631ad423567d
I20250831 19:54:53.161646 2914 leader_election.cc:290] T c5ea4587e33644fca784e1fb8720d354 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Requested vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:53.160643 2778 raft_consensus.cc:2802] T 8fb7abc5581e4a16a55f844acd5fd2e9 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:53.162353 2778 raft_consensus.cc:695] T 8fb7abc5581e4a16a55f844acd5fd2e9 P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: Becoming Leader. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Running, Role: LEADER
I20250831 19:54:53.162767 2121 catalog_manager.cc:5582] T d1f811715ac64ca591a84b52be6e2621 P de831f40fa1348a48a1f0260f4130197 reported cstate change: term changed from 0 to 1, leader changed from <none> to de831f40fa1348a48a1f0260f4130197 (127.1.1.194). New cstate: current_term: 1 leader_uuid: "de831f40fa1348a48a1f0260f4130197" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: UNKNOWN } } }
I20250831 19:54:53.162678 2778 consensus_queue.cc:237] T 8fb7abc5581e4a16a55f844acd5fd2e9 P de831f40fa1348a48a1f0260f4130197 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:53.167063 1633 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c5ea4587e33644fca784e1fb8720d354" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:54:53.168926 1633 raft_consensus.cc:3058] T c5ea4587e33644fca784e1fb8720d354 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:53.172132 1633 raft_consensus.cc:2466] T c5ea4587e33644fca784e1fb8720d354 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:54:53.181689 2121 catalog_manager.cc:5582] T 9525ea0cb58146d6851936d749447c3f P 89aa85d59c53436ebdf3074b13d14825 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193). New cstate: current_term: 1 leader_uuid: "89aa85d59c53436ebdf3074b13d14825" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: HEALTHY } } }
I20250831 19:54:53.196251 2699 tablet_bootstrap.cc:492] T 8fb7abc5581e4a16a55f844acd5fd2e9 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:53.196449 2699 ts_tablet_manager.cc:1397] T 8fb7abc5581e4a16a55f844acd5fd2e9 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.110s user 0.005s sys 0.015s
I20250831 19:54:53.197153 2699 raft_consensus.cc:357] T 8fb7abc5581e4a16a55f844acd5fd2e9 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:53.197333 2699 raft_consensus.cc:383] T 8fb7abc5581e4a16a55f844acd5fd2e9 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:53.197402 2699 raft_consensus.cc:738] T 8fb7abc5581e4a16a55f844acd5fd2e9 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:53.198112 2699 consensus_queue.cc:260] T 8fb7abc5581e4a16a55f844acd5fd2e9 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:53.198537 2699 ts_tablet_manager.cc:1428] T 8fb7abc5581e4a16a55f844acd5fd2e9 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250831 19:54:53.201342 2125 catalog_manager.cc:3460] renamed table default.table_6a83a43f21484b2ba465fe72560bb53f [id=321a68b57ebf4e3a80670c3c862403f1] in HMS: new name default.table_4021d3dbb7f04e50997c9cc51c7e3888
I20250831 19:54:53.206682 2121 catalog_manager.cc:5582] T 8fb7abc5581e4a16a55f844acd5fd2e9 P de831f40fa1348a48a1f0260f4130197 reported cstate change: term changed from 0 to 1, leader changed from <none> to de831f40fa1348a48a1f0260f4130197 (127.1.1.194). New cstate: current_term: 1 leader_uuid: "de831f40fa1348a48a1f0260f4130197" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } }
I20250831 19:54:53.207324 2121 catalog_manager.cc:5582] T c5ea4587e33644fca784e1fb8720d354 P de831f40fa1348a48a1f0260f4130197 reported cstate change: term changed from 0 to 1, leader changed from <none> to de831f40fa1348a48a1f0260f4130197 (127.1.1.194). New cstate: current_term: 1 leader_uuid: "de831f40fa1348a48a1f0260f4130197" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: UNKNOWN } } }
I20250831 19:54:53.207726 2121 catalog_manager.cc:5674] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475) does not have the latest schema for tablet c5ea4587e33644fca784e1fb8720d354 (table default.table_60746664f3ef4d82866e4bcd56d4fac5 [id=0850f2b0e9324dd0a210fa7b2609c769]). Expected version 4 got 0
I20250831 19:54:53.219929 2122 catalog_manager.cc:2149] created HMS catalog entry for table [id=fe54e4791a0d4e3c9a36e1968988ea0d]
I20250831 19:54:53.224124 2122 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:36958 (request call id 123) took 1690 ms. Trace:
I20250831 19:54:53.224252 2122 rpcz_store.cc:276] 0831 19:54:51.533740 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:52.710946 (+1177206us) service_pool.cc:225] Handling call
0831 19:54:53.037625 (+326679us) catalog_manager.cc:2076] Acquired catalog manager lock
0831 19:54:53.038112 (+ 487us) catalog_manager.cc:2122] Created new table and tablet info
0831 19:54:53.219871 (+181759us) catalog_manager.cc:2148] Created new table in HMS catalog
0831 19:54:53.223921 (+ 4050us) catalog_manager.cc:2182] Wrote table and tablets to system table
0831 19:54:53.224003 (+ 82us) catalog_manager.cc:2216] Inserted table and tablets into CatalogManager maps
0831 19:54:53.224085 (+ 82us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:53.220491 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:53.220600 (+ 109us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:53.220604 (+ 4us) write_op.cc:435] Acquired schema lock
0831 19:54:53.220607 (+ 3us) tablet.cc:660] Decoding operations
0831 19:54:53.220680 (+ 73us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:53.220690 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:53.220695 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:53.220775 (+ 80us) tablet.cc:699] Row locks acquired
0831 19:54:53.220777 (+ 2us) write_op.cc:260] PREPARE: finished
0831 19:54:53.220803 (+ 26us) write_op.cc:270] Start()
0831 19:54:53.220827 (+ 24us) write_op.cc:276] Timestamp: P: 1756670093220750 usec, L: 0
0831 19:54:53.220830 (+ 3us) op_driver.cc:348] REPLICATION: starting
0831 19:54:53.220962 (+ 132us) log.cc:844] Serialized 433 byte log entry
0831 19:54:53.223374 (+ 2412us) op_driver.cc:464] REPLICATION: finished
0831 19:54:53.223470 (+ 96us) write_op.cc:301] APPLY: starting
0831 19:54:53.223482 (+ 12us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:53.223517 (+ 35us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:53.223537 (+ 20us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:53.223631 (+ 94us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:53.223658 (+ 27us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0831 19:54:53.223665 (+ 7us) write_op.cc:312] APPLY: finished
0831 19:54:53.223720 (+ 55us) log.cc:844] Serialized 29 byte log entry
0831 19:54:53.223769 (+ 49us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:53.223785 (+ 16us) write_op.cc:454] Released schema lock
0831 19:54:53.223790 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0831 19:54:53.223841 (+ 51us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:53.223844 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":159396,"Hive Metastore.run_cpu_time_us":244,"Hive Metastore.run_wall_time_us":22021,"spinlock_wait_cycles":9472,"child_traces":[["op",{"apply.queue_time_us":60,"apply.run_cpu_time_us":363,"apply.run_wall_time_us":363,"num_ops":2,"prepare.queue_time_us":46,"prepare.run_cpu_time_us":564,"prepare.run_wall_time_us":564,"raft.queue_time_us":286,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":165,"replication_time_us":2521}]]}
I20250831 19:54:53.224963 2122 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36958:
name: "default.Table_e28995f706a34a2cb421352cb92a7349"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:53.234346 1884 tablet_service.cc:1468] Processing CreateTablet for tablet bde481a8e8fc4b1f82453a4e50ded47c (DEFAULT_TABLE table=default.table_afb8eb0248714122aa74efa2d6fcfce4 [id=fe54e4791a0d4e3c9a36e1968988ea0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:53.234714 1614 tablet_service.cc:1468] Processing CreateTablet for tablet bde481a8e8fc4b1f82453a4e50ded47c (DEFAULT_TABLE table=default.table_afb8eb0248714122aa74efa2d6fcfce4 [id=fe54e4791a0d4e3c9a36e1968988ea0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:53.234797 1884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bde481a8e8fc4b1f82453a4e50ded47c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:53.235091 1614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bde481a8e8fc4b1f82453a4e50ded47c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:53.238518 1749 tablet_service.cc:1468] Processing CreateTablet for tablet bde481a8e8fc4b1f82453a4e50ded47c (DEFAULT_TABLE table=default.table_afb8eb0248714122aa74efa2d6fcfce4 [id=fe54e4791a0d4e3c9a36e1968988ea0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:53.238909 1749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bde481a8e8fc4b1f82453a4e50ded47c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:53.240222 2699 tablet_bootstrap.cc:492] T bde481a8e8fc4b1f82453a4e50ded47c P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:53.241601 2117 catalog_manager.cc:2149] created HMS catalog entry for table [id=4cfc2f0bed1f4f5c80524f8cf8d69f3e]
I20250831 19:54:53.241817 2699 tablet_bootstrap.cc:654] T bde481a8e8fc4b1f82453a4e50ded47c P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:53.243256 2932 consensus_queue.cc:1035] T 920c6fcdf1a44d07b132de6a08b3cbf8 P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:53.255959 2117 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:36958 (request call id 118) took 2018 ms. Trace:
I20250831 19:54:53.256090 2117 rpcz_store.cc:276] 0831 19:54:51.237165 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:52.325949 (+1088784us) service_pool.cc:225] Handling call
0831 19:54:53.038114 (+712165us) catalog_manager.cc:2076] Acquired catalog manager lock
0831 19:54:53.038578 (+ 464us) catalog_manager.cc:2122] Created new table and tablet info
0831 19:54:53.241550 (+202972us) catalog_manager.cc:2148] Created new table in HMS catalog
0831 19:54:53.255663 (+ 14113us) catalog_manager.cc:2182] Wrote table and tablets to system table
0831 19:54:53.255804 (+ 141us) catalog_manager.cc:2216] Inserted table and tablets into CatalogManager maps
0831 19:54:53.255920 (+ 116us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:53.250077 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:53.250192 (+ 115us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:53.250197 (+ 5us) write_op.cc:435] Acquired schema lock
0831 19:54:53.250199 (+ 2us) tablet.cc:660] Decoding operations
0831 19:54:53.250292 (+ 93us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:53.250305 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:53.250309 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:53.250380 (+ 71us) tablet.cc:699] Row locks acquired
0831 19:54:53.250383 (+ 3us) write_op.cc:260] PREPARE: finished
0831 19:54:53.250420 (+ 37us) write_op.cc:270] Start()
0831 19:54:53.250452 (+ 32us) write_op.cc:276] Timestamp: P: 1756670093250360 usec, L: 0
0831 19:54:53.250455 (+ 3us) op_driver.cc:348] REPLICATION: starting
0831 19:54:53.250659 (+ 204us) log.cc:844] Serialized 433 byte log entry
0831 19:54:53.253562 (+ 2903us) op_driver.cc:464] REPLICATION: finished
0831 19:54:53.254581 (+ 1019us) write_op.cc:301] APPLY: starting
0831 19:54:53.254595 (+ 14us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:53.254637 (+ 42us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:53.254660 (+ 23us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:53.254771 (+ 111us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:53.254801 (+ 30us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0831 19:54:53.254807 (+ 6us) write_op.cc:312] APPLY: finished
0831 19:54:53.254871 (+ 64us) log.cc:844] Serialized 29 byte log entry
0831 19:54:53.254922 (+ 51us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:53.254940 (+ 18us) write_op.cc:454] Released schema lock
0831 19:54:53.254945 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0831 19:54:53.255006 (+ 61us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:53.255009 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":181011,"Hive Metastore.run_cpu_time_us":228,"Hive Metastore.run_wall_time_us":19643,"child_traces":[["op",{"apply.queue_time_us":960,"apply.run_cpu_time_us":421,"apply.run_wall_time_us":421,"num_ops":2,"prepare.queue_time_us":7845,"prepare.run_cpu_time_us":721,"prepare.run_wall_time_us":720,"raft.queue_time_us":441,"raft.run_cpu_time_us":259,"raft.run_wall_time_us":259,"replication_time_us":3073}]]}
I20250831 19:54:53.256708 2699 tablet_bootstrap.cc:492] T bde481a8e8fc4b1f82453a4e50ded47c P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:53.256882 2699 ts_tablet_manager.cc:1397] T bde481a8e8fc4b1f82453a4e50ded47c P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.017s user 0.013s sys 0.002s
I20250831 19:54:53.256960 2117 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_692b305d0d9a402dbff897ae3fea5186" } modify_external_catalogs: true
I20250831 19:54:53.257167 2117 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_692b305d0d9a402dbff897ae3fea5186" } modify_external_catalogs: true
I20250831 19:54:53.257674 2699 raft_consensus.cc:357] T bde481a8e8fc4b1f82453a4e50ded47c P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:53.257879 2699 raft_consensus.cc:383] T bde481a8e8fc4b1f82453a4e50ded47c P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:53.257967 2699 raft_consensus.cc:738] T bde481a8e8fc4b1f82453a4e50ded47c P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:53.258307 2699 consensus_queue.cc:260] T bde481a8e8fc4b1f82453a4e50ded47c P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:53.259009 2124 catalog_manager.cc:2149] created HMS catalog entry for table [id=5cc9b389dd1f4a0289aaecd18be10263]
I20250831 19:54:53.262447 2699 ts_tablet_manager.cc:1428] T bde481a8e8fc4b1f82453a4e50ded47c P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20250831 19:54:53.268244 1903 raft_consensus.cc:1273] T c5ea4587e33644fca784e1fb8720d354 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Refusing update from remote peer de831f40fa1348a48a1f0260f4130197: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250831 19:54:53.268811 2584 consensus_queue.cc:1035] T c5ea4587e33644fca784e1fb8720d354 P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:53.269311 2856 tablet_bootstrap.cc:492] T bde481a8e8fc4b1f82453a4e50ded47c P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:53.270337 2282 tablet_bootstrap.cc:492] T bde481a8e8fc4b1f82453a4e50ded47c P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:53.270761 2856 tablet_bootstrap.cc:654] T bde481a8e8fc4b1f82453a4e50ded47c P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:53.271824 2124 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:36958 (request call id 124) took 1050 ms. Trace:
I20250831 19:54:53.271872 2282 tablet_bootstrap.cc:654] T bde481a8e8fc4b1f82453a4e50ded47c P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:53.271936 2124 rpcz_store.cc:276] 0831 19:54:52.220916 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:52.712208 (+491292us) service_pool.cc:225] Handling call
0831 19:54:53.038249 (+326041us) catalog_manager.cc:2076] Acquired catalog manager lock
0831 19:54:53.038696 (+ 447us) catalog_manager.cc:2122] Created new table and tablet info
0831 19:54:53.258957 (+220261us) catalog_manager.cc:2148] Created new table in HMS catalog
0831 19:54:53.271531 (+ 12574us) catalog_manager.cc:2182] Wrote table and tablets to system table
0831 19:54:53.271678 (+ 147us) catalog_manager.cc:2216] Inserted table and tablets into CatalogManager maps
0831 19:54:53.271785 (+ 107us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:53.263446 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:53.263542 (+ 96us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:53.263547 (+ 5us) write_op.cc:435] Acquired schema lock
0831 19:54:53.263550 (+ 3us) tablet.cc:660] Decoding operations
0831 19:54:53.263649 (+ 99us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:53.263662 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:53.263666 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:53.263746 (+ 80us) tablet.cc:699] Row locks acquired
0831 19:54:53.263748 (+ 2us) write_op.cc:260] PREPARE: finished
0831 19:54:53.263779 (+ 31us) write_op.cc:270] Start()
0831 19:54:53.263807 (+ 28us) write_op.cc:276] Timestamp: P: 1756670093263720 usec, L: 0
0831 19:54:53.263812 (+ 5us) op_driver.cc:348] REPLICATION: starting
0831 19:54:53.263964 (+ 152us) log.cc:844] Serialized 433 byte log entry
0831 19:54:53.269130 (+ 5166us) op_driver.cc:464] REPLICATION: finished
0831 19:54:53.269335 (+ 205us) write_op.cc:301] APPLY: starting
0831 19:54:53.269348 (+ 13us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:53.269387 (+ 39us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:53.269407 (+ 20us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:53.269513 (+ 106us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:53.269541 (+ 28us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0831 19:54:53.269547 (+ 6us) write_op.cc:312] APPLY: finished
0831 19:54:53.269616 (+ 69us) log.cc:844] Serialized 29 byte log entry
0831 19:54:53.269665 (+ 49us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:53.269680 (+ 15us) write_op.cc:454] Released schema lock
0831 19:54:53.269685 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0831 19:54:53.269743 (+ 58us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:53.269747 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":200567,"Hive Metastore.run_cpu_time_us":243,"Hive Metastore.run_wall_time_us":19351,"child_traces":[["op",{"apply.queue_time_us":164,"apply.run_cpu_time_us":394,"apply.run_wall_time_us":394,"num_ops":2,"prepare.queue_time_us":3944,"prepare.run_cpu_time_us":642,"prepare.run_wall_time_us":641,"raft.queue_time_us":1371,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":204,"replication_time_us":5294}]]}
I20250831 19:54:53.274600 1633 raft_consensus.cc:1273] T c5ea4587e33644fca784e1fb8720d354 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Refusing update from remote peer de831f40fa1348a48a1f0260f4130197: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250831 19:54:53.275254 1884 tablet_service.cc:1468] Processing CreateTablet for tablet c1ccea09b6c34c52a9212a5a481c80f7 (DEFAULT_TABLE table=default.table_0409d51b133145c5b7e7d4d407a471b2 [id=4cfc2f0bed1f4f5c80524f8cf8d69f3e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:53.275655 1884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1ccea09b6c34c52a9212a5a481c80f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:53.276688 2778 consensus_queue.cc:1035] T c5ea4587e33644fca784e1fb8720d354 P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:53.281087 2121 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_15539726e4e647e5a28a991bc6e07cd7" } modify_external_catalogs: true
I20250831 19:54:53.281313 2121 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_15539726e4e647e5a28a991bc6e07cd7" } modify_external_catalogs: true
I20250831 19:54:53.286623 2856 tablet_bootstrap.cc:492] T bde481a8e8fc4b1f82453a4e50ded47c P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:53.286757 2856 ts_tablet_manager.cc:1397] T bde481a8e8fc4b1f82453a4e50ded47c P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.001s
I20250831 19:54:53.287432 2856 raft_consensus.cc:357] T bde481a8e8fc4b1f82453a4e50ded47c P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:53.287619 2856 raft_consensus.cc:383] T bde481a8e8fc4b1f82453a4e50ded47c P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:53.287701 2856 raft_consensus.cc:738] T bde481a8e8fc4b1f82453a4e50ded47c P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:53.289924 1614 tablet_service.cc:1468] Processing CreateTablet for tablet c1ccea09b6c34c52a9212a5a481c80f7 (DEFAULT_TABLE table=default.table_0409d51b133145c5b7e7d4d407a471b2 [id=4cfc2f0bed1f4f5c80524f8cf8d69f3e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:53.290316 2856 consensus_queue.cc:260] T bde481a8e8fc4b1f82453a4e50ded47c P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:53.290472 1749 tablet_service.cc:1468] Processing CreateTablet for tablet c1ccea09b6c34c52a9212a5a481c80f7 (DEFAULT_TABLE table=default.table_0409d51b133145c5b7e7d4d407a471b2 [id=4cfc2f0bed1f4f5c80524f8cf8d69f3e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:53.290690 1614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1ccea09b6c34c52a9212a5a481c80f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:53.290962 1749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1ccea09b6c34c52a9212a5a481c80f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:53.295141 2856 ts_tablet_manager.cc:1428] T bde481a8e8fc4b1f82453a4e50ded47c P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20250831 19:54:53.295847 2699 tablet_bootstrap.cc:492] T c1ccea09b6c34c52a9212a5a481c80f7 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:53.297472 2699 tablet_bootstrap.cc:654] T c1ccea09b6c34c52a9212a5a481c80f7 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:53.298841 2282 tablet_bootstrap.cc:492] T bde481a8e8fc4b1f82453a4e50ded47c P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:53.298976 2282 ts_tablet_manager.cc:1397] T bde481a8e8fc4b1f82453a4e50ded47c P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.029s user 0.001s sys 0.010s
I20250831 19:54:53.299732 2282 raft_consensus.cc:357] T bde481a8e8fc4b1f82453a4e50ded47c P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:53.299916 2282 raft_consensus.cc:383] T bde481a8e8fc4b1f82453a4e50ded47c P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:53.300005 2282 raft_consensus.cc:738] T bde481a8e8fc4b1f82453a4e50ded47c P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:53.300208 2282 consensus_queue.cc:260] T bde481a8e8fc4b1f82453a4e50ded47c P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:53.300782 2282 ts_tablet_manager.cc:1428] T bde481a8e8fc4b1f82453a4e50ded47c P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250831 19:54:53.301030 2282 tablet_bootstrap.cc:492] T c1ccea09b6c34c52a9212a5a481c80f7 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:53.302696 2282 tablet_bootstrap.cc:654] T c1ccea09b6c34c52a9212a5a481c80f7 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:53.302882 2239 raft_consensus.cc:491] T 026b3c38d6ae4f3492e7d26a19c155d9 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:53.303043 2239 raft_consensus.cc:513] T 026b3c38d6ae4f3492e7d26a19c155d9 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:53.303751 2239 leader_election.cc:290] T 026b3c38d6ae4f3492e7d26a19c155d9 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:53.305373 1631 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "026b3c38d6ae4f3492e7d26a19c155d9" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:53.305681 1631 raft_consensus.cc:2391] T 026b3c38d6ae4f3492e7d26a19c155d9 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2441fafe1d62429386f4631ad423567d in current term 1: Already voted for candidate de831f40fa1348a48a1f0260f4130197 in this term.
I20250831 19:54:53.297284 2124 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_bcc81e72ea324a389ebbcc6a6b4512ac" } new_table_name: "default.Table_08b74e57795c4dd8a7f91f01e1b5ba4a" modify_external_catalogs: true
I20250831 19:54:53.308125 1769 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "026b3c38d6ae4f3492e7d26a19c155d9" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:53.308748 1842 leader_election.cc:304] T 026b3c38d6ae4f3492e7d26a19c155d9 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2441fafe1d62429386f4631ad423567d; no voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197
I20250831 19:54:53.309080 2239 raft_consensus.cc:3058] T 026b3c38d6ae4f3492e7d26a19c155d9 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:53.311259 1751 tablet_service.cc:1468] Processing CreateTablet for tablet cd7f18899cd94bf09153e1fe9ebae78b (DEFAULT_TABLE table=default.table_9e76b4c3909b459c812cb7fbddc11988 [id=5cc9b389dd1f4a0289aaecd18be10263]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:53.311589 1751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd7f18899cd94bf09153e1fe9ebae78b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:53.312390 2239 raft_consensus.cc:2747] T 026b3c38d6ae4f3492e7d26a19c155d9 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250831 19:54:53.318873 1614 tablet_service.cc:1468] Processing CreateTablet for tablet cd7f18899cd94bf09153e1fe9ebae78b (DEFAULT_TABLE table=default.table_9e76b4c3909b459c812cb7fbddc11988 [id=5cc9b389dd1f4a0289aaecd18be10263]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:53.319293 1614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd7f18899cd94bf09153e1fe9ebae78b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:53.319582 1884 tablet_service.cc:1468] Processing CreateTablet for tablet cd7f18899cd94bf09153e1fe9ebae78b (DEFAULT_TABLE table=default.table_9e76b4c3909b459c812cb7fbddc11988 [id=5cc9b389dd1f4a0289aaecd18be10263]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:53.319955 1884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd7f18899cd94bf09153e1fe9ebae78b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:53.320519 2856 tablet_bootstrap.cc:492] T cd7f18899cd94bf09153e1fe9ebae78b P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:53.322131 2856 tablet_bootstrap.cc:654] T cd7f18899cd94bf09153e1fe9ebae78b P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:53.337070 1031 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskfwTdIj/build/asan/bin/kudu
/tmp/dist-test-taskfwTdIj/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.1.254:34259
--webserver_interface=127.1.1.254
--webserver_port=34345
--builtin_ntp_servers=127.1.1.212:44077
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943
--hive_metastore_uris=thrift://127.0.0.1:46163
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20250831 19:54:53.343441 2856 tablet_bootstrap.cc:492] T cd7f18899cd94bf09153e1fe9ebae78b P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:53.343665 2856 ts_tablet_manager.cc:1397] T cd7f18899cd94bf09153e1fe9ebae78b P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.023s user 0.003s sys 0.003s
I20250831 19:54:53.344426 2856 raft_consensus.cc:357] T cd7f18899cd94bf09153e1fe9ebae78b P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:53.344632 2856 raft_consensus.cc:383] T cd7f18899cd94bf09153e1fe9ebae78b P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:53.344717 2856 raft_consensus.cc:738] T cd7f18899cd94bf09153e1fe9ebae78b P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:53.345082 2723 tablet.cc:1722] T c5ea4587e33644fca784e1fb8720d354 P de831f40fa1348a48a1f0260f4130197: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20250831 19:54:53.346136 2761 tablet.cc:1722] T c5ea4587e33644fca784e1fb8720d354 P 2441fafe1d62429386f4631ad423567d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20250831 19:54:53.346329 2928 consensus_queue.cc:1035] T 920c6fcdf1a44d07b132de6a08b3cbf8 P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:53.355444 2120 catalog_manager.cc:2149] created HMS catalog entry for table [id=30b1e9d6cb5e486fbed42ac06053ebc3]
I20250831 19:54:53.363523 2186 catalog_manager.cc:2747] Deleting table default.table_e3057132cbc4426e9fc52d84d5189d01 [id=29bd77e83ad04288b3edceffb562bd03] in response to Hive Metastore notification log event 115
I20250831 19:54:53.364276 2120 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:36958 (request call id 116) took 2217 ms. Trace:
I20250831 19:54:53.364439 2120 rpcz_store.cc:276] 0831 19:54:51.146381 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:52.323876 (+1177495us) service_pool.cc:225] Handling call
0831 19:54:53.038698 (+714822us) catalog_manager.cc:2076] Acquired catalog manager lock
0831 19:54:53.039052 (+ 354us) catalog_manager.cc:2122] Created new table and tablet info
0831 19:54:53.355365 (+316313us) catalog_manager.cc:2148] Created new table in HMS catalog
0831 19:54:53.363948 (+ 8583us) catalog_manager.cc:2182] Wrote table and tablets to system table
0831 19:54:53.364100 (+ 152us) catalog_manager.cc:2216] Inserted table and tablets into CatalogManager maps
0831 19:54:53.364222 (+ 122us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:53.358859 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:53.359017 (+ 158us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:53.359025 (+ 8us) write_op.cc:435] Acquired schema lock
0831 19:54:53.359029 (+ 4us) tablet.cc:660] Decoding operations
0831 19:54:53.359157 (+ 128us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:53.359175 (+ 18us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:53.359182 (+ 7us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:53.359304 (+ 122us) tablet.cc:699] Row locks acquired
0831 19:54:53.359307 (+ 3us) write_op.cc:260] PREPARE: finished
0831 19:54:53.359355 (+ 48us) write_op.cc:270] Start()
0831 19:54:53.359398 (+ 43us) write_op.cc:276] Timestamp: P: 1756670093359337 usec, L: 0
0831 19:54:53.359403 (+ 5us) op_driver.cc:348] REPLICATION: starting
0831 19:54:53.359645 (+ 242us) log.cc:844] Serialized 433 byte log entry
0831 19:54:53.363022 (+ 3377us) op_driver.cc:464] REPLICATION: finished
0831 19:54:53.363185 (+ 163us) write_op.cc:301] APPLY: starting
0831 19:54:53.363206 (+ 21us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:53.363263 (+ 57us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:53.363295 (+ 32us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:53.363443 (+ 148us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:53.363489 (+ 46us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0831 19:54:53.363499 (+ 10us) write_op.cc:312] APPLY: finished
0831 19:54:53.363605 (+ 106us) log.cc:844] Serialized 29 byte log entry
0831 19:54:53.363679 (+ 74us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:53.363704 (+ 25us) write_op.cc:454] Released schema lock
0831 19:54:53.363713 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0831 19:54:53.363803 (+ 90us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:53.363808 (+ 5us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":219608,"Hive Metastore.run_cpu_time_us":257,"Hive Metastore.run_wall_time_us":96410,"spinlock_wait_cycles":6016,"child_traces":[["op",{"apply.queue_time_us":106,"apply.run_cpu_time_us":605,"apply.run_wall_time_us":605,"num_ops":2,"prepare.queue_time_us":2634,"prepare.run_cpu_time_us":923,"prepare.run_wall_time_us":923,"raft.queue_time_us":477,"raft.run_cpu_time_us":265,"raft.run_wall_time_us":267,"replication_time_us":3582}]]}
I20250831 19:54:53.378654 2186 catalog_manager.cc:5869] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Sending DeleteTablet for 3 replicas of tablet 75a6a340faad4e46924b79adc8bcb867
I20250831 19:54:53.381939 1614 tablet_service.cc:1515] Processing DeleteTablet for tablet 75a6a340faad4e46924b79adc8bcb867 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:53 UTC) from {username='slave'} at 127.0.0.1:51022
I20250831 19:54:53.382156 1884 tablet_service.cc:1515] Processing DeleteTablet for tablet 75a6a340faad4e46924b79adc8bcb867 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:53 UTC) from {username='slave'} at 127.0.0.1:45906
I20250831 19:54:53.382756 1749 tablet_service.cc:1515] Processing DeleteTablet for tablet 75a6a340faad4e46924b79adc8bcb867 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:53 UTC) from {username='slave'} at 127.0.0.1:50674
I20250831 19:54:53.397536 2957 tablet_replica.cc:331] T 75a6a340faad4e46924b79adc8bcb867 P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:54:53.398110 2958 tablet_replica.cc:331] T 75a6a340faad4e46924b79adc8bcb867 P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:54:53.398455 2958 raft_consensus.cc:2241] T 75a6a340faad4e46924b79adc8bcb867 P 2441fafe1d62429386f4631ad423567d [term 1 LEADER]: Raft consensus shutting down.
I20250831 19:54:53.398648 2120 catalog_manager.cc:5674] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237) does not have the latest schema for tablet c5ea4587e33644fca784e1fb8720d354 (table default.table_60746664f3ef4d82866e4bcd56d4fac5 [id=0850f2b0e9324dd0a210fa7b2609c769]). Expected version 4 got 0
I20250831 19:54:53.402087 2958 raft_consensus.cc:2270] T 75a6a340faad4e46924b79adc8bcb867 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:53.402690 2958 ts_tablet_manager.cc:1905] T 75a6a340faad4e46924b79adc8bcb867 P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:53.411612 1614 tablet_service.cc:1468] Processing CreateTablet for tablet b0d177e2e2f745b8969b65ab318321a1 (DEFAULT_TABLE table=default.table_1dc7d3d86ed047bd8c86e21d7b38f477 [id=30b1e9d6cb5e486fbed42ac06053ebc3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:53.411849 1884 tablet_service.cc:1468] Processing CreateTablet for tablet b0d177e2e2f745b8969b65ab318321a1 (DEFAULT_TABLE table=default.table_1dc7d3d86ed047bd8c86e21d7b38f477 [id=30b1e9d6cb5e486fbed42ac06053ebc3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:53.412194 1884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0d177e2e2f745b8969b65ab318321a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:53.412189 1614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0d177e2e2f745b8969b65ab318321a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:53.412343 1751 tablet_service.cc:1468] Processing CreateTablet for tablet b0d177e2e2f745b8969b65ab318321a1 (DEFAULT_TABLE table=default.table_1dc7d3d86ed047bd8c86e21d7b38f477 [id=30b1e9d6cb5e486fbed42ac06053ebc3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:53.412808 1751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0d177e2e2f745b8969b65ab318321a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:53.413679 2958 ts_tablet_manager.cc:1918] T 75a6a340faad4e46924b79adc8bcb867 P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:53.415546 2958 log.cc:1199] T 75a6a340faad4e46924b79adc8bcb867 P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/75a6a340faad4e46924b79adc8bcb867
I20250831 19:54:53.416175 2958 ts_tablet_manager.cc:1939] T 75a6a340faad4e46924b79adc8bcb867 P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:54:53.400187 2957 raft_consensus.cc:2241] T 75a6a340faad4e46924b79adc8bcb867 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:53.417774 2957 raft_consensus.cc:2270] T 75a6a340faad4e46924b79adc8bcb867 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:53.418480 2957 ts_tablet_manager.cc:1905] T 75a6a340faad4e46924b79adc8bcb867 P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:53.423189 2856 consensus_queue.cc:260] T cd7f18899cd94bf09153e1fe9ebae78b P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:53.425938 2699 tablet_bootstrap.cc:492] T c1ccea09b6c34c52a9212a5a481c80f7 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:53.426102 2699 ts_tablet_manager.cc:1397] T c1ccea09b6c34c52a9212a5a481c80f7 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.130s user 0.010s sys 0.056s
I20250831 19:54:53.427376 2856 ts_tablet_manager.cc:1428] T cd7f18899cd94bf09153e1fe9ebae78b P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.084s user 0.002s sys 0.001s
I20250831 19:54:53.428122 2699 raft_consensus.cc:357] T c1ccea09b6c34c52a9212a5a481c80f7 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:53.428293 2699 raft_consensus.cc:383] T c1ccea09b6c34c52a9212a5a481c80f7 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:53.428360 2699 raft_consensus.cc:738] T c1ccea09b6c34c52a9212a5a481c80f7 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:53.428565 2699 consensus_queue.cc:260] T c1ccea09b6c34c52a9212a5a481c80f7 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:53.429230 2856 tablet_bootstrap.cc:492] T c1ccea09b6c34c52a9212a5a481c80f7 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:53.430787 2699 ts_tablet_manager.cc:1428] T c1ccea09b6c34c52a9212a5a481c80f7 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20250831 19:54:53.430963 2856 tablet_bootstrap.cc:654] T c1ccea09b6c34c52a9212a5a481c80f7 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:53.431066 2699 tablet_bootstrap.cc:492] T cd7f18899cd94bf09153e1fe9ebae78b P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:53.432801 2699 tablet_bootstrap.cc:654] T cd7f18899cd94bf09153e1fe9ebae78b P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:53.436797 2959 tablet_replica.cc:331] T 75a6a340faad4e46924b79adc8bcb867 P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:54:53.437006 2959 raft_consensus.cc:2241] T 75a6a340faad4e46924b79adc8bcb867 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:53.437217 2959 raft_consensus.cc:2270] T 75a6a340faad4e46924b79adc8bcb867 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:53.437821 2959 ts_tablet_manager.cc:1905] T 75a6a340faad4e46924b79adc8bcb867 P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:53.438542 2957 ts_tablet_manager.cc:1918] T 75a6a340faad4e46924b79adc8bcb867 P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:53.439234 2957 log.cc:1199] T 75a6a340faad4e46924b79adc8bcb867 P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/75a6a340faad4e46924b79adc8bcb867
I20250831 19:54:53.439832 2957 ts_tablet_manager.cc:1939] T 75a6a340faad4e46924b79adc8bcb867 P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
I20250831 19:54:53.449399 2761 tablet.cc:1722] T d7551c6a0ebd493dba75b1f766c4db0f P 2441fafe1d62429386f4631ad423567d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250831 19:54:53.449869 2723 tablet.cc:1722] T d7551c6a0ebd493dba75b1f766c4db0f P de831f40fa1348a48a1f0260f4130197: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250831 19:54:53.451849 2786 tablet.cc:1722] T c5ea4587e33644fca784e1fb8720d354 P 89aa85d59c53436ebdf3074b13d14825: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20250831 19:54:53.456317 2699 tablet_bootstrap.cc:492] T cd7f18899cd94bf09153e1fe9ebae78b P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:53.456470 2699 ts_tablet_manager.cc:1397] T cd7f18899cd94bf09153e1fe9ebae78b P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.025s user 0.003s sys 0.001s
I20250831 19:54:53.457247 2699 raft_consensus.cc:357] T cd7f18899cd94bf09153e1fe9ebae78b P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:53.457480 2699 raft_consensus.cc:383] T cd7f18899cd94bf09153e1fe9ebae78b P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:53.457571 2699 raft_consensus.cc:738] T cd7f18899cd94bf09153e1fe9ebae78b P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:53.458309 2699 consensus_queue.cc:260] T cd7f18899cd94bf09153e1fe9ebae78b P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:53.458834 2699 ts_tablet_manager.cc:1428] T cd7f18899cd94bf09153e1fe9ebae78b P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250831 19:54:53.459106 2699 tablet_bootstrap.cc:492] T b0d177e2e2f745b8969b65ab318321a1 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:53.460935 2699 tablet_bootstrap.cc:654] T b0d177e2e2f745b8969b65ab318321a1 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:53.462287 2856 tablet_bootstrap.cc:492] T c1ccea09b6c34c52a9212a5a481c80f7 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:53.462435 2856 ts_tablet_manager.cc:1397] T c1ccea09b6c34c52a9212a5a481c80f7 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.033s user 0.005s sys 0.005s
I20250831 19:54:53.463305 2856 raft_consensus.cc:357] T c1ccea09b6c34c52a9212a5a481c80f7 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:53.463474 2856 raft_consensus.cc:383] T c1ccea09b6c34c52a9212a5a481c80f7 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:53.463565 2856 raft_consensus.cc:738] T c1ccea09b6c34c52a9212a5a481c80f7 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:53.463811 2856 consensus_queue.cc:260] T c1ccea09b6c34c52a9212a5a481c80f7 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:53.464332 2856 ts_tablet_manager.cc:1428] T c1ccea09b6c34c52a9212a5a481c80f7 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250831 19:54:53.465162 2856 tablet_bootstrap.cc:492] T b0d177e2e2f745b8969b65ab318321a1 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:53.465157 2786 tablet.cc:1722] T d7551c6a0ebd493dba75b1f766c4db0f P 89aa85d59c53436ebdf3074b13d14825: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250831 19:54:53.468458 2856 tablet_bootstrap.cc:654] T b0d177e2e2f745b8969b65ab318321a1 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:53.474244 2959 ts_tablet_manager.cc:1918] T 75a6a340faad4e46924b79adc8bcb867 P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:53.474378 2959 log.cc:1199] T 75a6a340faad4e46924b79adc8bcb867 P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/75a6a340faad4e46924b79adc8bcb867
I20250831 19:54:53.474998 2959 ts_tablet_manager.cc:1939] T 75a6a340faad4e46924b79adc8bcb867 P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
I20250831 19:54:53.482129 2699 tablet_bootstrap.cc:492] T b0d177e2e2f745b8969b65ab318321a1 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:53.482307 2699 ts_tablet_manager.cc:1397] T b0d177e2e2f745b8969b65ab318321a1 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.023s user 0.007s sys 0.000s
I20250831 19:54:53.483048 2699 raft_consensus.cc:357] T b0d177e2e2f745b8969b65ab318321a1 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:53.483235 2699 raft_consensus.cc:383] T b0d177e2e2f745b8969b65ab318321a1 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:53.483316 2699 raft_consensus.cc:738] T b0d177e2e2f745b8969b65ab318321a1 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:53.483527 2699 consensus_queue.cc:260] T b0d177e2e2f745b8969b65ab318321a1 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:53.486685 2699 ts_tablet_manager.cc:1428] T b0d177e2e2f745b8969b65ab318321a1 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20250831 19:54:53.427930 2101 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet 75a6a340faad4e46924b79adc8bcb867 (table default.table_e3057132cbc4426e9fc52d84d5189d01 [id=29bd77e83ad04288b3edceffb562bd03]) successfully deleted
W20250831 19:54:53.494243 2101 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.1.1.195:43237, user_credentials={real_user=slave}} blocked reactor thread for 66331.2us
I20250831 19:54:53.441268 2104 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet 75a6a340faad4e46924b79adc8bcb867 (table default.table_e3057132cbc4426e9fc52d84d5189d01 [id=29bd77e83ad04288b3edceffb562bd03]) successfully deleted
W20250831 19:54:53.495090 2104 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.1.1.193:46197, user_credentials={real_user=slave}} blocked reactor thread for 53845.1us
I20250831 19:54:53.474699 2118 catalog_manager.cc:2706] deleted HMS catalog entry for table default.table_ada526abffc1474c8cebeb3bcbb17824 [id=83de1930a88d4d86a0dc9a69a45333f6]
I20250831 19:54:53.476109 2105 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet 75a6a340faad4e46924b79adc8bcb867 (table default.table_e3057132cbc4426e9fc52d84d5189d01 [id=29bd77e83ad04288b3edceffb562bd03]) successfully deleted
W20250831 19:54:53.477149 2122 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_e28995f706a34a2cb421352cb92a7349 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250831 19:54:53.477322 2125 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:36958 (request call id 126) took 1232 ms. Trace:
I20250831 19:54:53.498459 2125 rpcz_store.cc:276] 0831 19:54:52.245160 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:52.730612 (+485452us) service_pool.cc:225] Handling call
0831 19:54:53.037508 (+306896us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:53.476816 (+439308us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:53.477067 (+ 251us) catalog_manager.cc:3683] Apply alter schema
0831 19:54:53.477290 (+ 223us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":55203,"Hive Metastore.run_cpu_time_us":564,"Hive Metastore.run_wall_time_us":104280}
I20250831 19:54:53.476763 2126 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:36958 (request call id 125) took 1231 ms. Trace:
I20250831 19:54:53.501955 2126 rpcz_store.cc:276] 0831 19:54:52.245057 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:52.727511 (+482454us) service_pool.cc:225] Handling call
0831 19:54:53.037532 (+310021us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:53.476703 (+439171us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":1214,"Hive Metastore.run_cpu_time_us":168,"Hive Metastore.run_wall_time_us":54093}
I20250831 19:54:53.505311 2126 catalog_manager.cc:5674] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197) does not have the latest schema for tablet c5ea4587e33644fca784e1fb8720d354 (table default.table_60746664f3ef4d82866e4bcd56d4fac5 [id=0850f2b0e9324dd0a210fa7b2609c769]). Expected version 4 got 0
I20250831 19:54:53.517140 2124 catalog_manager.cc:3460] renamed table default.table_bcc81e72ea324a389ebbcc6a6b4512ac [id=f63d391a9c824314bf6789cc7bbb5ffb] in HMS: new name default.table_08b74e57795c4dd8a7f91f01e1b5ba4a
I20250831 19:54:53.420735 2120 master_service.cc:948] ReplaceTablet: received request to replace tablet bf30ba308d494e2880bb7fae5794d489 from {username='slave'} at 127.0.0.1:36958
I20250831 19:54:53.521157 2125 catalog_manager.cc:6127] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: default.table_4021d3dbb7f04e50997c9cc51c7e3888 [id=321a68b57ebf4e3a80670c3c862403f1] alter complete (version 2)
I20250831 19:54:53.525321 2282 tablet_bootstrap.cc:492] T c1ccea09b6c34c52a9212a5a481c80f7 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:53.525514 2282 ts_tablet_manager.cc:1397] T c1ccea09b6c34c52a9212a5a481c80f7 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.225s user 0.050s sys 0.033s
I20250831 19:54:53.526275 2282 raft_consensus.cc:357] T c1ccea09b6c34c52a9212a5a481c80f7 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:53.526517 2282 raft_consensus.cc:383] T c1ccea09b6c34c52a9212a5a481c80f7 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:53.526600 2282 raft_consensus.cc:738] T c1ccea09b6c34c52a9212a5a481c80f7 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:53.527308 2282 consensus_queue.cc:260] T c1ccea09b6c34c52a9212a5a481c80f7 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:53.527907 2282 ts_tablet_manager.cc:1428] T c1ccea09b6c34c52a9212a5a481c80f7 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250831 19:54:53.526326 2125 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36958:
name: "default.Table_ac609d4af0b748438a68966d468a56c6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:53.528618 2126 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36958:
name: "default.Table_a03aade65d4449ec87fdbd94f7edd5ca"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:53.529696 2120 catalog_manager.cc:5869] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Sending DeleteTablet for 3 replicas of tablet bf30ba308d494e2880bb7fae5794d489
I20250831 19:54:53.530057 2856 tablet_bootstrap.cc:492] T b0d177e2e2f745b8969b65ab318321a1 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:53.530233 2856 ts_tablet_manager.cc:1397] T b0d177e2e2f745b8969b65ab318321a1 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.066s user 0.004s sys 0.013s
I20250831 19:54:53.530776 1884 tablet_service.cc:1515] Processing DeleteTablet for tablet bf30ba308d494e2880bb7fae5794d489 with delete_type TABLET_DATA_DELETED (replaced by tablet 5b6497a1ef3d4c5b84dc2bbbbfafd586) from {username='slave'} at 127.0.0.1:45906
I20250831 19:54:53.531049 1614 tablet_service.cc:1515] Processing DeleteTablet for tablet bf30ba308d494e2880bb7fae5794d489 with delete_type TABLET_DATA_DELETED (replaced by tablet 5b6497a1ef3d4c5b84dc2bbbbfafd586) from {username='slave'} at 127.0.0.1:51022
I20250831 19:54:53.531050 1749 tablet_service.cc:1515] Processing DeleteTablet for tablet bf30ba308d494e2880bb7fae5794d489 with delete_type TABLET_DATA_DELETED (replaced by tablet 5b6497a1ef3d4c5b84dc2bbbbfafd586) from {username='slave'} at 127.0.0.1:50674
I20250831 19:54:53.531117 2856 raft_consensus.cc:357] T b0d177e2e2f745b8969b65ab318321a1 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:53.531239 2957 tablet_replica.cc:331] T bf30ba308d494e2880bb7fae5794d489 P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:54:53.531323 2856 raft_consensus.cc:383] T b0d177e2e2f745b8969b65ab318321a1 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:53.531381 2856 raft_consensus.cc:738] T b0d177e2e2f745b8969b65ab318321a1 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:53.531246 2959 tablet_replica.cc:331] T bf30ba308d494e2880bb7fae5794d489 P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:54:53.531428 2957 raft_consensus.cc:2241] T bf30ba308d494e2880bb7fae5794d489 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:53.531574 2957 raft_consensus.cc:2270] T bf30ba308d494e2880bb7fae5794d489 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:53.531571 2856 consensus_queue.cc:260] T b0d177e2e2f745b8969b65ab318321a1 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:53.531693 2959 raft_consensus.cc:2241] T bf30ba308d494e2880bb7fae5794d489 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:53.532073 2856 ts_tablet_manager.cc:1428] T b0d177e2e2f745b8969b65ab318321a1 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20250831 19:54:53.532150 2957 ts_tablet_manager.cc:1905] T bf30ba308d494e2880bb7fae5794d489 P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:53.533298 2959 raft_consensus.cc:2270] T bf30ba308d494e2880bb7fae5794d489 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:53.533849 2959 ts_tablet_manager.cc:1905] T bf30ba308d494e2880bb7fae5794d489 P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:53.538080 1614 tablet_service.cc:1468] Processing CreateTablet for tablet 5b6497a1ef3d4c5b84dc2bbbbfafd586 (DEFAULT_TABLE table=default.table_f6d2041746f14f4a84962c26b1df1118 [id=59220fba0aa647bca189db2218f3e28f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:53.538225 1884 tablet_service.cc:1468] Processing CreateTablet for tablet 5b6497a1ef3d4c5b84dc2bbbbfafd586 (DEFAULT_TABLE table=default.table_f6d2041746f14f4a84962c26b1df1118 [id=59220fba0aa647bca189db2218f3e28f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:53.538430 1614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b6497a1ef3d4c5b84dc2bbbbfafd586. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:53.538564 1884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b6497a1ef3d4c5b84dc2bbbbfafd586. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:53.540180 2120 catalog_manager.cc:6652] ReplaceTablet: tablet bf30ba308d494e2880bb7fae5794d489 deleted and replaced by tablet 5b6497a1ef3d4c5b84dc2bbbbfafd586
I20250831 19:54:53.542927 2120 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36958:
name: "default.Table_5546b3f364ce47768a100eec7bcf06af"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:53.543569 1749 tablet_service.cc:1468] Processing CreateTablet for tablet 5b6497a1ef3d4c5b84dc2bbbbfafd586 (DEFAULT_TABLE table=default.table_f6d2041746f14f4a84962c26b1df1118 [id=59220fba0aa647bca189db2218f3e28f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:53.543725 2957 ts_tablet_manager.cc:1918] T bf30ba308d494e2880bb7fae5794d489 P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:53.543846 2957 log.cc:1199] T bf30ba308d494e2880bb7fae5794d489 P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/bf30ba308d494e2880bb7fae5794d489
I20250831 19:54:53.544212 2957 ts_tablet_manager.cc:1939] T bf30ba308d494e2880bb7fae5794d489 P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
I20250831 19:54:53.544625 1749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b6497a1ef3d4c5b84dc2bbbbfafd586. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:53.544795 2282 tablet_bootstrap.cc:492] T cd7f18899cd94bf09153e1fe9ebae78b P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:53.546454 2104 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet bf30ba308d494e2880bb7fae5794d489 (table default.table_f6d2041746f14f4a84962c26b1df1118 [id=59220fba0aa647bca189db2218f3e28f]) successfully deleted
I20250831 19:54:53.547003 2958 tablet_replica.cc:331] T bf30ba308d494e2880bb7fae5794d489 P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:54:53.547197 2958 raft_consensus.cc:2241] T bf30ba308d494e2880bb7fae5794d489 P 2441fafe1d62429386f4631ad423567d [term 1 LEADER]: Raft consensus shutting down.
I20250831 19:54:53.547467 2958 raft_consensus.cc:2270] T bf30ba308d494e2880bb7fae5794d489 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:53.547621 2282 tablet_bootstrap.cc:654] T cd7f18899cd94bf09153e1fe9ebae78b P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:53.547978 2958 ts_tablet_manager.cc:1905] T bf30ba308d494e2880bb7fae5794d489 P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:53.555640 2699 tablet_bootstrap.cc:492] T 5b6497a1ef3d4c5b84dc2bbbbfafd586 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:53.557042 2699 tablet_bootstrap.cc:654] T 5b6497a1ef3d4c5b84dc2bbbbfafd586 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:53.559990 2958 ts_tablet_manager.cc:1918] T bf30ba308d494e2880bb7fae5794d489 P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:53.561569 2958 log.cc:1199] T bf30ba308d494e2880bb7fae5794d489 P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/bf30ba308d494e2880bb7fae5794d489
I20250831 19:54:53.562278 2958 ts_tablet_manager.cc:1939] T bf30ba308d494e2880bb7fae5794d489 P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:54:53.563925 2101 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet bf30ba308d494e2880bb7fae5794d489 (table default.table_f6d2041746f14f4a84962c26b1df1118 [id=59220fba0aa647bca189db2218f3e28f]) successfully deleted
I20250831 19:54:53.570544 2856 tablet_bootstrap.cc:492] T 5b6497a1ef3d4c5b84dc2bbbbfafd586 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:53.572430 2856 tablet_bootstrap.cc:654] T 5b6497a1ef3d4c5b84dc2bbbbfafd586 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:53.575690 2959 ts_tablet_manager.cc:1918] T bf30ba308d494e2880bb7fae5794d489 P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:53.575860 2959 log.cc:1199] T bf30ba308d494e2880bb7fae5794d489 P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/bf30ba308d494e2880bb7fae5794d489
I20250831 19:54:53.576319 2959 ts_tablet_manager.cc:1939] T bf30ba308d494e2880bb7fae5794d489 P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
I20250831 19:54:53.577346 2105 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet bf30ba308d494e2880bb7fae5794d489 (table default.table_f6d2041746f14f4a84962c26b1df1118 [id=59220fba0aa647bca189db2218f3e28f]) successfully deleted
I20250831 19:54:53.585898 2282 tablet_bootstrap.cc:492] T cd7f18899cd94bf09153e1fe9ebae78b P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:53.585947 2856 tablet_bootstrap.cc:492] T 5b6497a1ef3d4c5b84dc2bbbbfafd586 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:53.586035 2699 tablet_bootstrap.cc:492] T 5b6497a1ef3d4c5b84dc2bbbbfafd586 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:53.586100 2856 ts_tablet_manager.cc:1397] T 5b6497a1ef3d4c5b84dc2bbbbfafd586 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.016s user 0.005s sys 0.001s
I20250831 19:54:53.586169 2699 ts_tablet_manager.cc:1397] T 5b6497a1ef3d4c5b84dc2bbbbfafd586 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.031s user 0.012s sys 0.003s
I20250831 19:54:53.586184 2282 ts_tablet_manager.cc:1397] T cd7f18899cd94bf09153e1fe9ebae78b P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.041s user 0.008s sys 0.030s
I20250831 19:54:53.586833 2856 raft_consensus.cc:357] T 5b6497a1ef3d4c5b84dc2bbbbfafd586 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:53.586916 2699 raft_consensus.cc:357] T 5b6497a1ef3d4c5b84dc2bbbbfafd586 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:53.587026 2856 raft_consensus.cc:383] T 5b6497a1ef3d4c5b84dc2bbbbfafd586 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:53.587073 2699 raft_consensus.cc:383] T 5b6497a1ef3d4c5b84dc2bbbbfafd586 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:53.587121 2856 raft_consensus.cc:738] T 5b6497a1ef3d4c5b84dc2bbbbfafd586 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:53.587167 2699 raft_consensus.cc:738] T 5b6497a1ef3d4c5b84dc2bbbbfafd586 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:53.586984 2282 raft_consensus.cc:357] T cd7f18899cd94bf09153e1fe9ebae78b P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:53.587388 2282 raft_consensus.cc:383] T cd7f18899cd94bf09153e1fe9ebae78b P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:53.587397 2856 consensus_queue.cc:260] T 5b6497a1ef3d4c5b84dc2bbbbfafd586 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:53.587384 2699 consensus_queue.cc:260] T 5b6497a1ef3d4c5b84dc2bbbbfafd586 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:53.587489 2282 raft_consensus.cc:738] T cd7f18899cd94bf09153e1fe9ebae78b P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:53.587798 2282 consensus_queue.cc:260] T cd7f18899cd94bf09153e1fe9ebae78b P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:53.589273 2856 ts_tablet_manager.cc:1428] T 5b6497a1ef3d4c5b84dc2bbbbfafd586 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20250831 19:54:53.590291 2282 ts_tablet_manager.cc:1428] T cd7f18899cd94bf09153e1fe9ebae78b P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20250831 19:54:53.590602 2282 tablet_bootstrap.cc:492] T b0d177e2e2f745b8969b65ab318321a1 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:53.592526 2282 tablet_bootstrap.cc:654] T b0d177e2e2f745b8969b65ab318321a1 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:53.594810 2699 ts_tablet_manager.cc:1428] T 5b6497a1ef3d4c5b84dc2bbbbfafd586 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20250831 19:54:53.606441 2282 tablet_bootstrap.cc:492] T b0d177e2e2f745b8969b65ab318321a1 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:53.606678 2282 ts_tablet_manager.cc:1397] T b0d177e2e2f745b8969b65ab318321a1 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.016s user 0.007s sys 0.001s
I20250831 19:54:53.607388 2282 raft_consensus.cc:357] T b0d177e2e2f745b8969b65ab318321a1 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:53.607664 2282 raft_consensus.cc:383] T b0d177e2e2f745b8969b65ab318321a1 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:53.607762 2282 raft_consensus.cc:738] T b0d177e2e2f745b8969b65ab318321a1 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:53.608034 2282 consensus_queue.cc:260] T b0d177e2e2f745b8969b65ab318321a1 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:53.608641 2282 ts_tablet_manager.cc:1428] T b0d177e2e2f745b8969b65ab318321a1 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250831 19:54:53.609133 2282 tablet_bootstrap.cc:492] T 5b6497a1ef3d4c5b84dc2bbbbfafd586 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:53.610877 2282 tablet_bootstrap.cc:654] T 5b6497a1ef3d4c5b84dc2bbbbfafd586 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:53.618666 2282 tablet_bootstrap.cc:492] T 5b6497a1ef3d4c5b84dc2bbbbfafd586 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:53.618860 2282 ts_tablet_manager.cc:1397] T 5b6497a1ef3d4c5b84dc2bbbbfafd586 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.002s
I20250831 19:54:53.620040 2282 raft_consensus.cc:357] T 5b6497a1ef3d4c5b84dc2bbbbfafd586 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:53.620261 2282 raft_consensus.cc:383] T 5b6497a1ef3d4c5b84dc2bbbbfafd586 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:53.620384 2282 raft_consensus.cc:738] T 5b6497a1ef3d4c5b84dc2bbbbfafd586 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:53.620680 2282 consensus_queue.cc:260] T 5b6497a1ef3d4c5b84dc2bbbbfafd586 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:53.624675 2282 ts_tablet_manager.cc:1428] T 5b6497a1ef3d4c5b84dc2bbbbfafd586 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20250831 19:54:53.633030 2123 catalog_manager.cc:3460] renamed table default.table_4ab0ff6a6b0e49b0a8e0e9999f531e5b [id=ee93396a22b546038473cc2df15fdc87] in HMS: new name default.table_b5294d0b8f564e31865783000a954688
I20250831 19:54:53.656313 2896 consensus_queue.cc:1035] T c5cfcb0956e44a1c9e64acc4d1ed568c P 2441fafe1d62429386f4631ad423567d [LEADER]: Connected to new peer: Peer: permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:53.667738 2119 catalog_manager.cc:3460] renamed table default.table_b7904c1a8762458ca114fc256fb84e5a [id=ba4c5ecf4ae94ede9bfb83af2ee894ab] in HMS: new name default.table_d30c0aaa2c2a465ca2999246bdd68e5f
I20250831 19:54:53.678457 2239 consensus_queue.cc:1035] T c5cfcb0956e44a1c9e64acc4d1ed568c P 2441fafe1d62429386f4631ad423567d [LEADER]: Connected to new peer: Peer: permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:53.690013 2117 catalog_manager.cc:2706] deleted HMS catalog entry for table default.table_692b305d0d9a402dbff897ae3fea5186 [id=f1801f35410d4e529900aa8dd86e1983]
I20250831 19:54:53.716881 2121 catalog_manager.cc:2706] deleted HMS catalog entry for table default.table_15539726e4e647e5a28a991bc6e07cd7 [id=c64d0e4719134d4185b4f4dbfd60cd19]
I20250831 19:54:53.720947 2186 catalog_manager.cc:2747] Deleting table default.table_ada526abffc1474c8cebeb3bcbb17824 [id=83de1930a88d4d86a0dc9a69a45333f6] in response to Hive Metastore notification log event 121
I20250831 19:54:53.726745 2186 catalog_manager.cc:5869] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Sending DeleteTablet for 3 replicas of tablet 76a46b9cd969481193f399c6fc229eec
I20250831 19:54:53.728562 1884 tablet_service.cc:1515] Processing DeleteTablet for tablet 76a46b9cd969481193f399c6fc229eec with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:53 UTC) from {username='slave'} at 127.0.0.1:45906
I20250831 19:54:53.728886 2958 tablet_replica.cc:331] T 76a46b9cd969481193f399c6fc229eec P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:54:53.729074 2958 raft_consensus.cc:2241] T 76a46b9cd969481193f399c6fc229eec P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:53.729259 2958 raft_consensus.cc:2270] T 76a46b9cd969481193f399c6fc229eec P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:53.729688 1749 tablet_service.cc:1515] Processing DeleteTablet for tablet 76a46b9cd969481193f399c6fc229eec with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:53 UTC) from {username='slave'} at 127.0.0.1:50674
I20250831 19:54:53.729831 2958 ts_tablet_manager.cc:1905] T 76a46b9cd969481193f399c6fc229eec P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:53.729981 2959 tablet_replica.cc:331] T 76a46b9cd969481193f399c6fc229eec P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:54:53.730150 2959 raft_consensus.cc:2241] T 76a46b9cd969481193f399c6fc229eec P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: Raft consensus shutting down.
I20250831 19:54:53.730473 2959 raft_consensus.cc:2270] T 76a46b9cd969481193f399c6fc229eec P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:53.730983 2959 ts_tablet_manager.cc:1905] T 76a46b9cd969481193f399c6fc229eec P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:53.733887 1614 tablet_service.cc:1515] Processing DeleteTablet for tablet 76a46b9cd969481193f399c6fc229eec with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:53 UTC) from {username='slave'} at 127.0.0.1:51022
I20250831 19:54:53.734213 2957 tablet_replica.cc:331] T 76a46b9cd969481193f399c6fc229eec P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:54:53.734408 2957 raft_consensus.cc:2241] T 76a46b9cd969481193f399c6fc229eec P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:53.734603 2957 raft_consensus.cc:2270] T 76a46b9cd969481193f399c6fc229eec P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:53.735152 2957 ts_tablet_manager.cc:1905] T 76a46b9cd969481193f399c6fc229eec P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:53.736124 2958 ts_tablet_manager.cc:1918] T 76a46b9cd969481193f399c6fc229eec P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:53.736255 2958 log.cc:1199] T 76a46b9cd969481193f399c6fc229eec P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/76a46b9cd969481193f399c6fc229eec
I20250831 19:54:53.736646 2958 ts_tablet_manager.cc:1939] T 76a46b9cd969481193f399c6fc229eec P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:54:53.737972 2101 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet 76a46b9cd969481193f399c6fc229eec (table default.table_ada526abffc1474c8cebeb3bcbb17824 [id=83de1930a88d4d86a0dc9a69a45333f6]) successfully deleted
I20250831 19:54:53.743880 2584 raft_consensus.cc:491] T c1ccea09b6c34c52a9212a5a481c80f7 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:53.744064 2584 raft_consensus.cc:513] T c1ccea09b6c34c52a9212a5a481c80f7 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:53.745036 2932 raft_consensus.cc:491] T c1ccea09b6c34c52a9212a5a481c80f7 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:53.745203 2932 raft_consensus.cc:513] T c1ccea09b6c34c52a9212a5a481c80f7 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:53.745976 2932 leader_election.cc:290] T c1ccea09b6c34c52a9212a5a481c80f7 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:53.746508 1769 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c1ccea09b6c34c52a9212a5a481c80f7" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:53.746696 2584 leader_election.cc:290] T c1ccea09b6c34c52a9212a5a481c80f7 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:53.746680 1903 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c1ccea09b6c34c52a9212a5a481c80f7" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:53.746851 1903 raft_consensus.cc:2466] T c1ccea09b6c34c52a9212a5a481c80f7 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 0.
I20250831 19:54:53.747311 1705 leader_election.cc:304] T c1ccea09b6c34c52a9212a5a481c80f7 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:53.747659 1903 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c1ccea09b6c34c52a9212a5a481c80f7" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:53.747764 1631 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c1ccea09b6c34c52a9212a5a481c80f7" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:53.747831 1903 raft_consensus.cc:2466] T c1ccea09b6c34c52a9212a5a481c80f7 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 0.
I20250831 19:54:53.747942 1631 raft_consensus.cc:2466] T c1ccea09b6c34c52a9212a5a481c80f7 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 0.
I20250831 19:54:53.746718 1769 raft_consensus.cc:2466] T c1ccea09b6c34c52a9212a5a481c80f7 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 0.
I20250831 19:54:53.748189 1568 leader_election.cc:304] T c1ccea09b6c34c52a9212a5a481c80f7 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:54:53.748436 2932 raft_consensus.cc:2802] T c1ccea09b6c34c52a9212a5a481c80f7 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:53.748518 2932 raft_consensus.cc:491] T c1ccea09b6c34c52a9212a5a481c80f7 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:53.748638 2932 raft_consensus.cc:3058] T c1ccea09b6c34c52a9212a5a481c80f7 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:53.748848 2778 raft_consensus.cc:2802] T c1ccea09b6c34c52a9212a5a481c80f7 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:53.748942 2778 raft_consensus.cc:491] T c1ccea09b6c34c52a9212a5a481c80f7 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:53.749017 2778 raft_consensus.cc:3058] T c1ccea09b6c34c52a9212a5a481c80f7 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:53.750171 2914 consensus_queue.cc:1035] T f8578694650b4379a66d9ea3df34ca0c P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:53.752154 2778 raft_consensus.cc:513] T c1ccea09b6c34c52a9212a5a481c80f7 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:53.752872 2778 leader_election.cc:290] T c1ccea09b6c34c52a9212a5a481c80f7 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Requested vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:53.753175 1903 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c1ccea09b6c34c52a9212a5a481c80f7" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:54:53.753319 1903 raft_consensus.cc:3058] T c1ccea09b6c34c52a9212a5a481c80f7 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:53.753279 1631 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c1ccea09b6c34c52a9212a5a481c80f7" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:54:53.755707 1903 raft_consensus.cc:2466] T c1ccea09b6c34c52a9212a5a481c80f7 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:54:53.756168 1705 leader_election.cc:304] T c1ccea09b6c34c52a9212a5a481c80f7 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:53.756899 2959 ts_tablet_manager.cc:1918] T 76a46b9cd969481193f399c6fc229eec P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:53.761380 2957 ts_tablet_manager.cc:1918] T 76a46b9cd969481193f399c6fc229eec P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:53.763084 2957 log.cc:1199] T 76a46b9cd969481193f399c6fc229eec P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/76a46b9cd969481193f399c6fc229eec
I20250831 19:54:53.763273 2959 log.cc:1199] T 76a46b9cd969481193f399c6fc229eec P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/76a46b9cd969481193f399c6fc229eec
I20250831 19:54:53.763725 2959 ts_tablet_manager.cc:1939] T 76a46b9cd969481193f399c6fc229eec P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
I20250831 19:54:53.764170 2957 ts_tablet_manager.cc:1939] T 76a46b9cd969481193f399c6fc229eec P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
I20250831 19:54:53.765164 2104 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet 76a46b9cd969481193f399c6fc229eec (table default.table_ada526abffc1474c8cebeb3bcbb17824 [id=83de1930a88d4d86a0dc9a69a45333f6]) successfully deleted
I20250831 19:54:53.757125 2778 raft_consensus.cc:2802] T c1ccea09b6c34c52a9212a5a481c80f7 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:53.766659 2778 raft_consensus.cc:695] T c1ccea09b6c34c52a9212a5a481c80f7 P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: Becoming Leader. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Running, Role: LEADER
I20250831 19:54:53.766872 2932 raft_consensus.cc:513] T c1ccea09b6c34c52a9212a5a481c80f7 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:53.767166 1631 raft_consensus.cc:2391] T c1ccea09b6c34c52a9212a5a481c80f7 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate de831f40fa1348a48a1f0260f4130197 in current term 1: Already voted for candidate 89aa85d59c53436ebdf3074b13d14825 in this term.
I20250831 19:54:53.766996 2778 consensus_queue.cc:237] T c1ccea09b6c34c52a9212a5a481c80f7 P de831f40fa1348a48a1f0260f4130197 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:53.770160 1903 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c1ccea09b6c34c52a9212a5a481c80f7" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:54:53.770447 1903 raft_consensus.cc:2391] T c1ccea09b6c34c52a9212a5a481c80f7 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 89aa85d59c53436ebdf3074b13d14825 in current term 1: Already voted for candidate de831f40fa1348a48a1f0260f4130197 in this term.
I20250831 19:54:53.771221 2932 leader_election.cc:290] T c1ccea09b6c34c52a9212a5a481c80f7 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Requested vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:53.771481 1769 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c1ccea09b6c34c52a9212a5a481c80f7" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197"
I20250831 19:54:53.772089 1570 leader_election.cc:304] T c1ccea09b6c34c52a9212a5a481c80f7 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825; no voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197
I20250831 19:54:53.772543 2932 raft_consensus.cc:2747] T c1ccea09b6c34c52a9212a5a481c80f7 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20250831 19:54:53.774109 2105 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet 76a46b9cd969481193f399c6fc229eec (table default.table_ada526abffc1474c8cebeb3bcbb17824 [id=83de1930a88d4d86a0dc9a69a45333f6]) successfully deleted
I20250831 19:54:53.776340 2943 consensus_queue.cc:1035] T f8578694650b4379a66d9ea3df34ca0c P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:53.790494 2723 tablet.cc:1722] T d3a587be468b4b7c8b90f4374af25e08 P de831f40fa1348a48a1f0260f4130197: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:53.795158 2761 tablet.cc:1722] T d3a587be468b4b7c8b90f4374af25e08 P 2441fafe1d62429386f4631ad423567d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:53.800724 2778 raft_consensus.cc:491] T 9fc4297f4d704acda823360fe6d406cf P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:53.800937 2778 raft_consensus.cc:513] T 9fc4297f4d704acda823360fe6d406cf P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:53.801831 1904 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9fc4297f4d704acda823360fe6d406cf" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:53.802040 1904 raft_consensus.cc:2466] T 9fc4297f4d704acda823360fe6d406cf P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 0.
I20250831 19:54:53.802449 1705 leader_election.cc:304] T 9fc4297f4d704acda823360fe6d406cf P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:53.802676 2943 raft_consensus.cc:2802] T 9fc4297f4d704acda823360fe6d406cf P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:53.802783 2943 raft_consensus.cc:491] T 9fc4297f4d704acda823360fe6d406cf P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:53.802888 2778 leader_election.cc:290] T 9fc4297f4d704acda823360fe6d406cf P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:53.802870 2943 raft_consensus.cc:3058] T 9fc4297f4d704acda823360fe6d406cf P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:53.803417 1632 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9fc4297f4d704acda823360fe6d406cf" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:53.803601 1632 raft_consensus.cc:2466] T 9fc4297f4d704acda823360fe6d406cf P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 0.
I20250831 19:54:53.803685 2186 catalog_manager.cc:2747] Deleting table default.table_692b305d0d9a402dbff897ae3fea5186 [id=f1801f35410d4e529900aa8dd86e1983] in response to Hive Metastore notification log event 125
I20250831 19:54:53.805591 2943 raft_consensus.cc:513] T 9fc4297f4d704acda823360fe6d406cf P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:53.806547 1904 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9fc4297f4d704acda823360fe6d406cf" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:54:53.806731 1904 raft_consensus.cc:3058] T 9fc4297f4d704acda823360fe6d406cf P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:53.809221 1904 raft_consensus.cc:2466] T 9fc4297f4d704acda823360fe6d406cf P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:54:53.810839 1705 leader_election.cc:304] T 9fc4297f4d704acda823360fe6d406cf P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:53.811066 2778 raft_consensus.cc:2802] T 9fc4297f4d704acda823360fe6d406cf P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:53.811196 2778 raft_consensus.cc:695] T 9fc4297f4d704acda823360fe6d406cf P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: Becoming Leader. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Running, Role: LEADER
I20250831 19:54:53.811445 2778 consensus_queue.cc:237] T 9fc4297f4d704acda823360fe6d406cf P de831f40fa1348a48a1f0260f4130197 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:53.811611 1632 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9fc4297f4d704acda823360fe6d406cf" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:54:53.811872 1632 raft_consensus.cc:3058] T 9fc4297f4d704acda823360fe6d406cf P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:53.811195 2943 leader_election.cc:290] T 9fc4297f4d704acda823360fe6d406cf P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Requested vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:53.814361 1632 raft_consensus.cc:2466] T 9fc4297f4d704acda823360fe6d406cf P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:54:53.820639 2186 catalog_manager.cc:5869] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Sending DeleteTablet for 3 replicas of tablet 920c6fcdf1a44d07b132de6a08b3cbf8
I20250831 19:54:53.821310 1884 tablet_service.cc:1515] Processing DeleteTablet for tablet 920c6fcdf1a44d07b132de6a08b3cbf8 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:53 UTC) from {username='slave'} at 127.0.0.1:45906
I20250831 19:54:53.821717 2958 tablet_replica.cc:331] T 920c6fcdf1a44d07b132de6a08b3cbf8 P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:54:53.822031 2958 raft_consensus.cc:2241] T 920c6fcdf1a44d07b132de6a08b3cbf8 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:53.822336 2958 raft_consensus.cc:2270] T 920c6fcdf1a44d07b132de6a08b3cbf8 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:53.822576 1749 tablet_service.cc:1515] Processing DeleteTablet for tablet 920c6fcdf1a44d07b132de6a08b3cbf8 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:53 UTC) from {username='slave'} at 127.0.0.1:50674
I20250831 19:54:53.823530 2958 ts_tablet_manager.cc:1905] T 920c6fcdf1a44d07b132de6a08b3cbf8 P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:53.828390 2786 tablet.cc:1722] T d3a587be468b4b7c8b90f4374af25e08 P 89aa85d59c53436ebdf3074b13d14825: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:53.828792 2959 tablet_replica.cc:331] T 920c6fcdf1a44d07b132de6a08b3cbf8 P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:54:53.829018 2959 raft_consensus.cc:2241] T 920c6fcdf1a44d07b132de6a08b3cbf8 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:53.829171 2959 raft_consensus.cc:2270] T 920c6fcdf1a44d07b132de6a08b3cbf8 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:53.830101 2959 ts_tablet_manager.cc:1905] T 920c6fcdf1a44d07b132de6a08b3cbf8 P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:53.830554 2958 ts_tablet_manager.cc:1918] T 920c6fcdf1a44d07b132de6a08b3cbf8 P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:53.830665 2958 log.cc:1199] T 920c6fcdf1a44d07b132de6a08b3cbf8 P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/920c6fcdf1a44d07b132de6a08b3cbf8
I20250831 19:54:53.831027 2958 ts_tablet_manager.cc:1939] T 920c6fcdf1a44d07b132de6a08b3cbf8 P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:54:53.832356 2101 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet 920c6fcdf1a44d07b132de6a08b3cbf8 (table default.table_692b305d0d9a402dbff897ae3fea5186 [id=f1801f35410d4e529900aa8dd86e1983]) successfully deleted
I20250831 19:54:53.833139 1614 tablet_service.cc:1515] Processing DeleteTablet for tablet 920c6fcdf1a44d07b132de6a08b3cbf8 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:53 UTC) from {username='slave'} at 127.0.0.1:51022
I20250831 19:54:53.833375 2957 tablet_replica.cc:331] T 920c6fcdf1a44d07b132de6a08b3cbf8 P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:54:53.833606 2957 raft_consensus.cc:2241] T 920c6fcdf1a44d07b132de6a08b3cbf8 P 89aa85d59c53436ebdf3074b13d14825 [term 1 LEADER]: Raft consensus shutting down.
I20250831 19:54:53.834549 2957 raft_consensus.cc:2270] T 920c6fcdf1a44d07b132de6a08b3cbf8 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:53.835297 2957 ts_tablet_manager.cc:1905] T 920c6fcdf1a44d07b132de6a08b3cbf8 P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:53.835490 2239 raft_consensus.cc:491] T b0d177e2e2f745b8969b65ab318321a1 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:53.835618 2239 raft_consensus.cc:513] T b0d177e2e2f745b8969b65ab318321a1 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:53.836159 2239 leader_election.cc:290] T b0d177e2e2f745b8969b65ab318321a1 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:53.836905 1634 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b0d177e2e2f745b8969b65ab318321a1" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:53.837107 1634 raft_consensus.cc:2466] T b0d177e2e2f745b8969b65ab318321a1 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 0.
I20250831 19:54:53.837591 1841 leader_election.cc:304] T b0d177e2e2f745b8969b65ab318321a1 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:54:53.838207 2239 raft_consensus.cc:2802] T b0d177e2e2f745b8969b65ab318321a1 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:53.838306 2239 raft_consensus.cc:491] T b0d177e2e2f745b8969b65ab318321a1 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:53.838380 2239 raft_consensus.cc:3058] T b0d177e2e2f745b8969b65ab318321a1 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:53.840621 2957 ts_tablet_manager.cc:1918] T 920c6fcdf1a44d07b132de6a08b3cbf8 P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:53.840727 2957 log.cc:1199] T 920c6fcdf1a44d07b132de6a08b3cbf8 P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/920c6fcdf1a44d07b132de6a08b3cbf8
I20250831 19:54:53.840883 2239 raft_consensus.cc:513] T b0d177e2e2f745b8969b65ab318321a1 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:53.841077 2957 ts_tablet_manager.cc:1939] T 920c6fcdf1a44d07b132de6a08b3cbf8 P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
I20250831 19:54:53.841182 2959 ts_tablet_manager.cc:1918] T 920c6fcdf1a44d07b132de6a08b3cbf8 P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:53.841316 2959 log.cc:1199] T 920c6fcdf1a44d07b132de6a08b3cbf8 P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/920c6fcdf1a44d07b132de6a08b3cbf8
I20250831 19:54:53.842134 2239 leader_election.cc:290] T b0d177e2e2f745b8969b65ab318321a1 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 election: Requested vote from peers 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:53.842331 2186 catalog_manager.cc:2747] Deleting table default.table_15539726e4e647e5a28a991bc6e07cd7 [id=c64d0e4719134d4185b4f4dbfd60cd19] in response to Hive Metastore notification log event 126
I20250831 19:54:53.843115 1771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b0d177e2e2f745b8969b65ab318321a1" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:53.843278 1771 raft_consensus.cc:2466] T b0d177e2e2f745b8969b65ab318321a1 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 0.
I20250831 19:54:53.843490 1634 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b0d177e2e2f745b8969b65ab318321a1" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:54:53.843549 1770 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b0d177e2e2f745b8969b65ab318321a1" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197"
I20250831 19:54:53.843652 1634 raft_consensus.cc:3058] T b0d177e2e2f745b8969b65ab318321a1 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:53.843714 1770 raft_consensus.cc:3058] T b0d177e2e2f745b8969b65ab318321a1 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:53.845888 1634 raft_consensus.cc:2466] T b0d177e2e2f745b8969b65ab318321a1 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 1.
I20250831 19:54:53.845959 1770 raft_consensus.cc:2466] T b0d177e2e2f745b8969b65ab318321a1 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 1.
I20250831 19:54:53.846462 1841 leader_election.cc:304] T b0d177e2e2f745b8969b65ab318321a1 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:54:53.850100 2186 catalog_manager.cc:5869] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Sending DeleteTablet for 3 replicas of tablet 2c343954bf6e44d683310415da3c0e58
I20250831 19:54:53.850795 1614 tablet_service.cc:1515] Processing DeleteTablet for tablet 2c343954bf6e44d683310415da3c0e58 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:53 UTC) from {username='slave'} at 127.0.0.1:51022
I20250831 19:54:53.851543 1749 tablet_service.cc:1515] Processing DeleteTablet for tablet 2c343954bf6e44d683310415da3c0e58 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:53 UTC) from {username='slave'} at 127.0.0.1:50674
I20250831 19:54:53.852524 2118 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:36958 (request call id 128) took 1607 ms. Trace:
I20250831 19:54:53.852694 2118 rpcz_store.cc:276] 0831 19:54:52.245317 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:53.071064 (+825747us) service_pool.cc:225] Handling call
0831 19:54:53.398134 (+327070us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:53.852465 (+454331us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":1876,"Hive Metastore.run_cpu_time_us":185,"Hive Metastore.run_wall_time_us":74405}
I20250831 19:54:53.852967 1884 tablet_service.cc:1515] Processing DeleteTablet for tablet 2c343954bf6e44d683310415da3c0e58 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:53 UTC) from {username='slave'} at 127.0.0.1:45906
I20250831 19:54:53.853756 2958 tablet_replica.cc:331] T 2c343954bf6e44d683310415da3c0e58 P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:54:53.854007 2958 raft_consensus.cc:2241] T 2c343954bf6e44d683310415da3c0e58 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:53.854236 2958 raft_consensus.cc:2270] T 2c343954bf6e44d683310415da3c0e58 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:53.854763 2958 ts_tablet_manager.cc:1905] T 2c343954bf6e44d683310415da3c0e58 P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:53.857972 2118 master_service.cc:948] ReplaceTablet: received request to replace tablet d3a587be468b4b7c8b90f4374af25e08 from {username='slave'} at 127.0.0.1:36958
I20250831 19:54:53.858453 2896 raft_consensus.cc:2802] T b0d177e2e2f745b8969b65ab318321a1 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:53.858600 2896 raft_consensus.cc:695] T b0d177e2e2f745b8969b65ab318321a1 P 2441fafe1d62429386f4631ad423567d [term 1 LEADER]: Becoming Leader. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Running, Role: LEADER
I20250831 19:54:53.858826 2896 consensus_queue.cc:237] T b0d177e2e2f745b8969b65ab318321a1 P 2441fafe1d62429386f4631ad423567d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:53.861732 2959 ts_tablet_manager.cc:1939] T 920c6fcdf1a44d07b132de6a08b3cbf8 P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
I20250831 19:54:53.865731 2118 catalog_manager.cc:5869] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Sending DeleteTablet for 3 replicas of tablet d3a587be468b4b7c8b90f4374af25e08
I20250831 19:54:53.865872 2239 raft_consensus.cc:491] T 8fb7abc5581e4a16a55f844acd5fd2e9 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:53.866405 1884 tablet_service.cc:1515] Processing DeleteTablet for tablet d3a587be468b4b7c8b90f4374af25e08 with delete_type TABLET_DATA_DELETED (replaced by tablet b7d78b564652422ba145265d74a06afc) from {username='slave'} at 127.0.0.1:45906
I20250831 19:54:53.866045 2239 raft_consensus.cc:513] T 8fb7abc5581e4a16a55f844acd5fd2e9 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:53.866683 1749 tablet_service.cc:1515] Processing DeleteTablet for tablet d3a587be468b4b7c8b90f4374af25e08 with delete_type TABLET_DATA_DELETED (replaced by tablet b7d78b564652422ba145265d74a06afc) from {username='slave'} at 127.0.0.1:50674
I20250831 19:54:53.867393 1614 tablet_service.cc:1515] Processing DeleteTablet for tablet d3a587be468b4b7c8b90f4374af25e08 with delete_type TABLET_DATA_DELETED (replaced by tablet b7d78b564652422ba145265d74a06afc) from {username='slave'} at 127.0.0.1:51022
I20250831 19:54:53.867453 2239 leader_election.cc:290] T 8fb7abc5581e4a16a55f844acd5fd2e9 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:53.867964 1632 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8fb7abc5581e4a16a55f844acd5fd2e9" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:53.868242 1632 raft_consensus.cc:2391] T 8fb7abc5581e4a16a55f844acd5fd2e9 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2441fafe1d62429386f4631ad423567d in current term 1: Already voted for candidate de831f40fa1348a48a1f0260f4130197 in this term.
I20250831 19:54:53.870440 2105 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet 920c6fcdf1a44d07b132de6a08b3cbf8 (table default.table_692b305d0d9a402dbff897ae3fea5186 [id=f1801f35410d4e529900aa8dd86e1983]) successfully deleted
I20250831 19:54:53.870950 2959 tablet_replica.cc:331] T 2c343954bf6e44d683310415da3c0e58 P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:54:53.871268 2959 raft_consensus.cc:2241] T 2c343954bf6e44d683310415da3c0e58 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:53.871534 2959 raft_consensus.cc:2270] T 2c343954bf6e44d683310415da3c0e58 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:53.872231 2959 ts_tablet_manager.cc:1905] T 2c343954bf6e44d683310415da3c0e58 P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:53.872340 2118 catalog_manager.cc:6652] ReplaceTablet: tablet d3a587be468b4b7c8b90f4374af25e08 deleted and replaced by tablet b7d78b564652422ba145265d74a06afc
I20250831 19:54:53.876870 1749 tablet_service.cc:1468] Processing CreateTablet for tablet b7d78b564652422ba145265d74a06afc (DEFAULT_TABLE table=default.table_b5294d0b8f564e31865783000a954688 [id=ee93396a22b546038473cc2df15fdc87]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:53.878180 1614 tablet_service.cc:1468] Processing CreateTablet for tablet b7d78b564652422ba145265d74a06afc (DEFAULT_TABLE table=default.table_b5294d0b8f564e31865783000a954688 [id=ee93396a22b546038473cc2df15fdc87]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:53.878369 1884 tablet_service.cc:1468] Processing CreateTablet for tablet b7d78b564652422ba145265d74a06afc (DEFAULT_TABLE table=default.table_b5294d0b8f564e31865783000a954688 [id=ee93396a22b546038473cc2df15fdc87]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:53.878650 1614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7d78b564652422ba145265d74a06afc. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:53.878717 1884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7d78b564652422ba145265d74a06afc. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:53.884260 2282 tablet_bootstrap.cc:492] T b7d78b564652422ba145265d74a06afc P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:53.885133 1749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7d78b564652422ba145265d74a06afc. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:53.885903 2282 tablet_bootstrap.cc:654] T b7d78b564652422ba145265d74a06afc P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:53.888576 2104 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet 920c6fcdf1a44d07b132de6a08b3cbf8 (table default.table_692b305d0d9a402dbff897ae3fea5186 [id=f1801f35410d4e529900aa8dd86e1983]) successfully deleted
I20250831 19:54:53.889081 2699 tablet_bootstrap.cc:492] T b7d78b564652422ba145265d74a06afc P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:53.888999 2957 tablet_replica.cc:331] T 2c343954bf6e44d683310415da3c0e58 P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:54:53.889396 2957 raft_consensus.cc:2241] T 2c343954bf6e44d683310415da3c0e58 P 89aa85d59c53436ebdf3074b13d14825 [term 1 LEADER]: Raft consensus shutting down.
I20250831 19:54:53.889802 2957 raft_consensus.cc:2270] T 2c343954bf6e44d683310415da3c0e58 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:53.890385 2957 ts_tablet_manager.cc:1905] T 2c343954bf6e44d683310415da3c0e58 P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:53.890741 2699 tablet_bootstrap.cc:654] T b7d78b564652422ba145265d74a06afc P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:53.894415 2856 tablet_bootstrap.cc:492] T b7d78b564652422ba145265d74a06afc P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:53.897179 2856 tablet_bootstrap.cc:654] T b7d78b564652422ba145265d74a06afc P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:53.909641 2122 catalog_manager.cc:2149] created HMS catalog entry for table [id=dc8984dc66cb4a01813cb742320a34cc]
I20250831 19:54:53.911186 2699 tablet_bootstrap.cc:492] T b7d78b564652422ba145265d74a06afc P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:53.911434 2699 ts_tablet_manager.cc:1397] T b7d78b564652422ba145265d74a06afc P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.022s user 0.002s sys 0.007s
I20250831 19:54:53.912437 2699 raft_consensus.cc:357] T b7d78b564652422ba145265d74a06afc P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:53.912834 2699 raft_consensus.cc:383] T b7d78b564652422ba145265d74a06afc P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:53.912982 2699 raft_consensus.cc:738] T b7d78b564652422ba145265d74a06afc P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:53.913312 2699 consensus_queue.cc:260] T b7d78b564652422ba145265d74a06afc P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:53.913980 2699 ts_tablet_manager.cc:1428] T b7d78b564652422ba145265d74a06afc P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20250831 19:54:53.915246 2856 tablet_bootstrap.cc:492] T b7d78b564652422ba145265d74a06afc P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:53.915401 2856 ts_tablet_manager.cc:1397] T b7d78b564652422ba145265d74a06afc P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.021s user 0.007s sys 0.005s
I20250831 19:54:53.916375 2122 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:36958 (request call id 131) took 1422 ms. Trace:
I20250831 19:54:53.916481 2122 rpcz_store.cc:276] 0831 19:54:52.493655 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:53.224823 (+731168us) service_pool.cc:225] Handling call
0831 19:54:53.497501 (+272678us) catalog_manager.cc:2076] Acquired catalog manager lock
0831 19:54:53.498158 (+ 657us) catalog_manager.cc:2122] Created new table and tablet info
0831 19:54:53.909615 (+411457us) catalog_manager.cc:2148] Created new table in HMS catalog
0831 19:54:53.916100 (+ 6485us) catalog_manager.cc:2182] Wrote table and tablets to system table
0831 19:54:53.916211 (+ 111us) catalog_manager.cc:2216] Inserted table and tablets into CatalogManager maps
0831 19:54:53.916319 (+ 108us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:53.910269 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:53.910396 (+ 127us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:53.910401 (+ 5us) write_op.cc:435] Acquired schema lock
0831 19:54:53.910403 (+ 2us) tablet.cc:660] Decoding operations
0831 19:54:53.910493 (+ 90us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:53.910504 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:53.910510 (+ 6us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:53.910597 (+ 87us) tablet.cc:699] Row locks acquired
0831 19:54:53.910600 (+ 3us) write_op.cc:260] PREPARE: finished
0831 19:54:53.910635 (+ 35us) write_op.cc:270] Start()
0831 19:54:53.910667 (+ 32us) write_op.cc:276] Timestamp: P: 1756670093910614 usec, L: 0
0831 19:54:53.910670 (+ 3us) op_driver.cc:348] REPLICATION: starting
0831 19:54:53.910860 (+ 190us) log.cc:844] Serialized 433 byte log entry
0831 19:54:53.914237 (+ 3377us) op_driver.cc:464] REPLICATION: finished
0831 19:54:53.914386 (+ 149us) write_op.cc:301] APPLY: starting
0831 19:54:53.914401 (+ 15us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:53.914445 (+ 44us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:53.914477 (+ 32us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:53.914583 (+ 106us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:53.914618 (+ 35us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0831 19:54:53.914626 (+ 8us) write_op.cc:312] APPLY: finished
0831 19:54:53.914702 (+ 76us) log.cc:844] Serialized 29 byte log entry
0831 19:54:53.914763 (+ 61us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:53.914782 (+ 19us) write_op.cc:454] Released schema lock
0831 19:54:53.914803 (+ 21us) write_op.cc:341] FINISH: Updating metrics
0831 19:54:53.914884 (+ 81us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:53.914888 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":221737,"Hive Metastore.run_cpu_time_us":237,"Hive Metastore.run_wall_time_us":189366,"child_traces":[["op",{"apply.queue_time_us":96,"apply.run_cpu_time_us":486,"apply.run_wall_time_us":485,"num_ops":2,"prepare.queue_time_us":48,"prepare.run_cpu_time_us":702,"prepare.run_wall_time_us":702,"raft.queue_time_us":1079,"raft.run_cpu_time_us":253,"raft.run_wall_time_us":254,"replication_time_us":3525}]]}
I20250831 19:54:53.917008 2856 raft_consensus.cc:357] T b7d78b564652422ba145265d74a06afc P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:53.917186 2856 raft_consensus.cc:383] T b7d78b564652422ba145265d74a06afc P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:53.917251 2856 raft_consensus.cc:738] T b7d78b564652422ba145265d74a06afc P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:53.917511 2856 consensus_queue.cc:260] T b7d78b564652422ba145265d74a06afc P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:53.918306 2959 ts_tablet_manager.cc:1918] T 2c343954bf6e44d683310415da3c0e58 P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:53.918407 2959 log.cc:1199] T 2c343954bf6e44d683310415da3c0e58 P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/2c343954bf6e44d683310415da3c0e58
I20250831 19:54:53.918828 2959 ts_tablet_manager.cc:1939] T 2c343954bf6e44d683310415da3c0e58 P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
I20250831 19:54:53.920881 2856 ts_tablet_manager.cc:1428] T b7d78b564652422ba145265d74a06afc P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20250831 19:54:53.924013 2122 catalog_manager.cc:5582] T c1ccea09b6c34c52a9212a5a481c80f7 P de831f40fa1348a48a1f0260f4130197 reported cstate change: term changed from 0 to 1, leader changed from <none> to de831f40fa1348a48a1f0260f4130197 (127.1.1.194). New cstate: current_term: 1 leader_uuid: "de831f40fa1348a48a1f0260f4130197" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: UNKNOWN } } }
I20250831 19:54:53.924135 1749 tablet_service.cc:1468] Processing CreateTablet for tablet f3ea6c8b0bf64d8b86dc96dc1abe0934 (DEFAULT_TABLE table=default.table_e28995f706a34a2cb421352cb92a7349 [id=dc8984dc66cb4a01813cb742320a34cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:53.924487 1749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3ea6c8b0bf64d8b86dc96dc1abe0934. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:53.924796 2122 catalog_manager.cc:5582] T 9fc4297f4d704acda823360fe6d406cf P de831f40fa1348a48a1f0260f4130197 reported cstate change: term changed from 0 to 1, leader changed from <none> to de831f40fa1348a48a1f0260f4130197 (127.1.1.194). New cstate: current_term: 1 leader_uuid: "de831f40fa1348a48a1f0260f4130197" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: UNKNOWN } } }
I20250831 19:54:53.928040 1884 tablet_service.cc:1468] Processing CreateTablet for tablet f3ea6c8b0bf64d8b86dc96dc1abe0934 (DEFAULT_TABLE table=default.table_e28995f706a34a2cb421352cb92a7349 [id=dc8984dc66cb4a01813cb742320a34cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:53.928472 1884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3ea6c8b0bf64d8b86dc96dc1abe0934. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:53.932310 2105 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet 2c343954bf6e44d683310415da3c0e58 (table default.table_15539726e4e647e5a28a991bc6e07cd7 [id=c64d0e4719134d4185b4f4dbfd60cd19]) successfully deleted
I20250831 19:54:53.933001 1614 tablet_service.cc:1468] Processing CreateTablet for tablet f3ea6c8b0bf64d8b86dc96dc1abe0934 (DEFAULT_TABLE table=default.table_e28995f706a34a2cb421352cb92a7349 [id=dc8984dc66cb4a01813cb742320a34cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:53.933322 2959 tablet_replica.cc:331] T d3a587be468b4b7c8b90f4374af25e08 P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:54:53.933660 2959 raft_consensus.cc:2241] T d3a587be468b4b7c8b90f4374af25e08 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:53.935878 2778 raft_consensus.cc:491] T cd7f18899cd94bf09153e1fe9ebae78b P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:53.937757 2856 tablet_bootstrap.cc:492] T f3ea6c8b0bf64d8b86dc96dc1abe0934 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:53.937677 2778 raft_consensus.cc:513] T cd7f18899cd94bf09153e1fe9ebae78b P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:53.937913 1614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3ea6c8b0bf64d8b86dc96dc1abe0934. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:53.937129 2122 catalog_manager.cc:5582] T b0d177e2e2f745b8969b65ab318321a1 P 2441fafe1d62429386f4631ad423567d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2441fafe1d62429386f4631ad423567d (127.1.1.195). New cstate: current_term: 1 leader_uuid: "2441fafe1d62429386f4631ad423567d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: UNKNOWN } } }
I20250831 19:54:53.938263 2778 leader_election.cc:290] T cd7f18899cd94bf09153e1fe9ebae78b P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197), 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237)
I20250831 19:54:53.939081 2959 raft_consensus.cc:2270] T d3a587be468b4b7c8b90f4374af25e08 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:53.939759 1631 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "cd7f18899cd94bf09153e1fe9ebae78b" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:53.940012 1631 raft_consensus.cc:2466] T cd7f18899cd94bf09153e1fe9ebae78b P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 0.
W20250831 19:54:53.940302 1842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.1.194:41475, user_credentials={real_user=slave}} blocked reactor thread for 82437.1us
I20250831 19:54:53.939292 2856 tablet_bootstrap.cc:654] T f3ea6c8b0bf64d8b86dc96dc1abe0934 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:53.940483 1706 leader_election.cc:304] T cd7f18899cd94bf09153e1fe9ebae78b P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:53.942175 2778 raft_consensus.cc:2802] T cd7f18899cd94bf09153e1fe9ebae78b P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:53.942278 2778 raft_consensus.cc:491] T cd7f18899cd94bf09153e1fe9ebae78b P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:53.942385 2778 raft_consensus.cc:3058] T cd7f18899cd94bf09153e1fe9ebae78b P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:53.945137 2778 raft_consensus.cc:513] T cd7f18899cd94bf09153e1fe9ebae78b P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:53.945732 2282 tablet_bootstrap.cc:492] T b7d78b564652422ba145265d74a06afc P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:53.945885 2282 ts_tablet_manager.cc:1397] T b7d78b564652422ba145265d74a06afc P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.062s user 0.004s sys 0.008s
I20250831 19:54:53.947556 2778 leader_election.cc:290] T cd7f18899cd94bf09153e1fe9ebae78b P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Requested vote from peers 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197), 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237)
I20250831 19:54:53.947777 1769 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8fb7abc5581e4a16a55f844acd5fd2e9" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:53.948711 1631 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "cd7f18899cd94bf09153e1fe9ebae78b" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:54:53.948930 1631 raft_consensus.cc:3058] T cd7f18899cd94bf09153e1fe9ebae78b P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:53.950678 2856 tablet_bootstrap.cc:492] T f3ea6c8b0bf64d8b86dc96dc1abe0934 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:53.950809 2856 ts_tablet_manager.cc:1397] T f3ea6c8b0bf64d8b86dc96dc1abe0934 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.013s user 0.004s sys 0.000s
I20250831 19:54:53.950994 2957 ts_tablet_manager.cc:1918] T 2c343954bf6e44d683310415da3c0e58 P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:53.951138 2957 log.cc:1199] T 2c343954bf6e44d683310415da3c0e58 P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/2c343954bf6e44d683310415da3c0e58
I20250831 19:54:53.951428 2856 raft_consensus.cc:357] T f3ea6c8b0bf64d8b86dc96dc1abe0934 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:53.951581 2856 raft_consensus.cc:383] T f3ea6c8b0bf64d8b86dc96dc1abe0934 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:53.951608 2957 ts_tablet_manager.cc:1939] T 2c343954bf6e44d683310415da3c0e58 P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
I20250831 19:54:53.951658 2856 raft_consensus.cc:738] T f3ea6c8b0bf64d8b86dc96dc1abe0934 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:53.951908 2856 consensus_queue.cc:260] T f3ea6c8b0bf64d8b86dc96dc1abe0934 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:53.952380 2856 ts_tablet_manager.cc:1428] T f3ea6c8b0bf64d8b86dc96dc1abe0934 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20250831 19:54:53.952726 2104 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet 2c343954bf6e44d683310415da3c0e58 (table default.table_15539726e4e647e5a28a991bc6e07cd7 [id=c64d0e4719134d4185b4f4dbfd60cd19]) successfully deleted
I20250831 19:54:53.953053 2957 tablet_replica.cc:331] T d3a587be468b4b7c8b90f4374af25e08 P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:54:53.953265 2957 raft_consensus.cc:2241] T d3a587be468b4b7c8b90f4374af25e08 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:53.953455 2957 raft_consensus.cc:2270] T d3a587be468b4b7c8b90f4374af25e08 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:53.954304 2957 ts_tablet_manager.cc:1905] T d3a587be468b4b7c8b90f4374af25e08 P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:53.954938 2959 ts_tablet_manager.cc:1905] T d3a587be468b4b7c8b90f4374af25e08 P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:53.960248 2957 ts_tablet_manager.cc:1918] T d3a587be468b4b7c8b90f4374af25e08 P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250831 19:54:53.960408 2957 log.cc:1199] T d3a587be468b4b7c8b90f4374af25e08 P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/d3a587be468b4b7c8b90f4374af25e08
I20250831 19:54:53.960810 2957 ts_tablet_manager.cc:1939] T d3a587be468b4b7c8b90f4374af25e08 P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
I20250831 19:54:53.961685 2104 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet d3a587be468b4b7c8b90f4374af25e08 (table default.table_b5294d0b8f564e31865783000a954688 [id=ee93396a22b546038473cc2df15fdc87]) successfully deleted
I20250831 19:54:53.968226 2118 catalog_manager.cc:5674] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237) does not have the latest schema for tablet b7d78b564652422ba145265d74a06afc (table default.table_b5294d0b8f564e31865783000a954688 [id=ee93396a22b546038473cc2df15fdc87]). Expected version 1 got 0
I20250831 19:54:53.970260 2958 ts_tablet_manager.cc:1918] T 2c343954bf6e44d683310415da3c0e58 P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:53.970480 2958 log.cc:1199] T 2c343954bf6e44d683310415da3c0e58 P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/2c343954bf6e44d683310415da3c0e58
W20250831 19:54:53.971524 2120 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_5546b3f364ce47768a100eec7bcf06af in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250831 19:54:53.971611 2125 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_ac609d4af0b748438a68966d468a56c6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250831 19:54:53.975574 2122 catalog_manager.cc:5674] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475) does not have the latest schema for tablet b7d78b564652422ba145265d74a06afc (table default.table_b5294d0b8f564e31865783000a954688 [id=ee93396a22b546038473cc2df15fdc87]). Expected version 1 got 0
I20250831 19:54:53.976140 2122 master_service.cc:948] ReplaceTablet: received request to replace tablet b6ef0e612b7e4b80af6fa5b2a66242c0 from {username='slave'} at 127.0.0.1:36958
I20250831 19:54:53.971742 2119 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:36958 (request call id 129) took 1726 ms. Trace:
I20250831 19:54:53.976495 2119 rpcz_store.cc:276] 0831 19:54:52.245386 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:53.098195 (+852809us) service_pool.cc:225] Handling call
0831 19:54:53.476876 (+378681us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:53.971249 (+494373us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:53.971472 (+ 223us) catalog_manager.cc:3683] Apply alter schema
0831 19:54:53.971705 (+ 233us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":155881,"Hive Metastore.run_cpu_time_us":683,"Hive Metastore.run_wall_time_us":34774}
I20250831 19:54:53.976807 2119 master_service.cc:948] ReplaceTablet: received request to replace tablet 75a6a340faad4e46924b79adc8bcb867 from {username='slave'} at 127.0.0.1:36958
W20250831 19:54:53.971928 2126 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_a03aade65d4449ec87fdbd94f7edd5ca in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250831 19:54:53.972502 2123 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:36958 (request call id 127) took 1727 ms. Trace:
I20250831 19:54:53.977514 2123 rpcz_store.cc:276] 0831 19:54:52.245259 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:53.053385 (+808126us) service_pool.cc:225] Handling call
0831 19:54:53.079823 (+ 26438us) spinlock_profiling.cc:243] Waited 26.1 ms on lock 0x616000040c54. stack: 00007f1e3b0dc7d6 00007f1e3b0dc590 00007f1e3a0cf3ad 0000000000972d94 0000000000972d5d 00007f1e49ea714d 00007f1e49ea7243 00007f1e46b66941 00007f1e4e6f1a5d 00007f1e4e87d126 00007f1e456b6126 00007f1e456b5e55 00007f1e41e8a2ce 00007f1e41e891ae 00007f1e41e8f3e5 00007f1e41e8fd0f
0831 19:54:53.476652 (+396829us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:53.972027 (+495375us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:53.972250 (+ 223us) catalog_manager.cc:3683] Apply alter schema
0831 19:54:53.972470 (+ 220us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":40147,"Hive Metastore.run_cpu_time_us":661,"Hive Metastore.run_wall_time_us":115842,"mutex_wait_us":31,"spinlock_wait_cycles":60118400}
I20250831 19:54:53.977871 2123 master_service.cc:948] ReplaceTablet: received request to replace tablet 920c6fcdf1a44d07b132de6a08b3cbf8 from {username='slave'} at 127.0.0.1:36958
I20250831 19:54:53.978199 2123 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:36958 (request call id 141) took 1031 ms. Trace:
I20250831 19:54:53.978264 2123 rpcz_store.cc:276] 0831 19:54:52.946212 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:53.977810 (+1031598us) service_pool.cc:225] Handling call
0831 19:54:53.978140 (+ 330us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250831 19:54:53.978615 2123 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36958:
name: "default.Table_268aaa1457f049d39b6e2eee7f41a1bb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:53.972658 2117 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:36958 (request call id 132) took 1465 ms. Trace:
I20250831 19:54:53.978873 2117 rpcz_store.cc:276] 0831 19:54:52.507119 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:53.256774 (+749655us) service_pool.cc:225] Handling call
0831 19:54:53.477178 (+220404us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:53.972613 (+495435us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":190417,"Hive Metastore.run_cpu_time_us":181,"Hive Metastore.run_wall_time_us":22097}
I20250831 19:54:53.979239 2117 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36958:
name: "default.Table_c48f1c99f3174cb8acca698339447ed9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:53.972774 2121 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:36958 (request call id 130) took 1727 ms. Trace:
I20250831 19:54:53.973237 2124 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:36958 (request call id 133) took 1448 ms. Trace:
I20250831 19:54:53.979480 2121 rpcz_store.cc:276] 0831 19:54:52.245457 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:53.280902 (+1035445us) service_pool.cc:225] Handling call
0831 19:54:53.477345 (+196443us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:53.972747 (+495402us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":212429,"Hive Metastore.run_cpu_time_us":194,"Hive Metastore.run_wall_time_us":26815}
I20250831 19:54:53.979604 2124 rpcz_store.cc:276] 0831 19:54:52.525241 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:53.297136 (+771895us) service_pool.cc:225] Handling call
0831 19:54:53.476668 (+179532us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:53.971249 (+494581us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:53.973033 (+ 1784us) catalog_manager.cc:3683] Apply alter schema
0831 19:54:53.973208 (+ 175us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":54,"Hive Metastore.run_cpu_time_us":736,"Hive Metastore.run_wall_time_us":40042,"spinlock_wait_cycles":2816}
I20250831 19:54:53.979792 2121 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_ca18962558654590b5d74892b4e00d0f" } new_table_name: "default.Table_55404df7d7524c7cb6139cc53ec92877" modify_external_catalogs: true
I20250831 19:54:53.979974 1842 leader_election.cc:304] T 8fb7abc5581e4a16a55f844acd5fd2e9 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2441fafe1d62429386f4631ad423567d; no voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197
I20250831 19:54:53.979967 2124 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_4e905daf26a044c38517f550bf5157f7" } modify_external_catalogs: true
I20250831 19:54:53.980126 2124 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_4e905daf26a044c38517f550bf5157f7" } modify_external_catalogs: true
I20250831 19:54:53.980998 1906 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "cd7f18899cd94bf09153e1fe9ebae78b" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:53.981202 1906 raft_consensus.cc:2466] T cd7f18899cd94bf09153e1fe9ebae78b P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 0.
I20250831 19:54:53.981424 2119 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:36958 (request call id 140) took 1035 ms. Trace:
I20250831 19:54:53.981535 2119 rpcz_store.cc:276] 0831 19:54:52.945611 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:53.976760 (+1031149us) service_pool.cc:225] Handling call
0831 19:54:53.981202 (+ 4442us) spinlock_profiling.cc:243] Waited 4.18 ms on lock 0x616000040c54. stack: 00007f1e3b0dc7d6 00007f1e3b0dc590 00007f1e3a0cf3ad 0000000000972d94 0000000000972d5d 00007f1e49ea714d 00007f1e49ea7243 00007f1e46b66941 00007f1e4e6f1a5d 00007f1e4e887bdb 00007f1e456bf0e7 00007f1e456bee15 00007f1e41e8a2ce 00007f1e41e891ae 00007f1e41e8f3e5 00007f1e41e8fd0f
0831 19:54:53.981374 (+ 172us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":9614592}
I20250831 19:54:53.981643 1906 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "cd7f18899cd94bf09153e1fe9ebae78b" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:54:53.981809 2959 ts_tablet_manager.cc:1918] T d3a587be468b4b7c8b90f4374af25e08 P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250831 19:54:53.981830 1906 raft_consensus.cc:3058] T cd7f18899cd94bf09153e1fe9ebae78b P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:53.981958 2959 log.cc:1199] T d3a587be468b4b7c8b90f4374af25e08 P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/d3a587be468b4b7c8b90f4374af25e08
I20250831 19:54:53.982371 2959 ts_tablet_manager.cc:1939] T d3a587be468b4b7c8b90f4374af25e08 P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
I20250831 19:54:53.983704 2119 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36958:
name: "default.Table_0498f784ecd944168cd0cbd019307408"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:53.984320 1906 raft_consensus.cc:2466] T cd7f18899cd94bf09153e1fe9ebae78b P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:54:53.984519 2105 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet d3a587be468b4b7c8b90f4374af25e08 (table default.table_b5294d0b8f564e31865783000a954688 [id=ee93396a22b546038473cc2df15fdc87]) successfully deleted
I20250831 19:54:53.985651 1705 leader_election.cc:304] T cd7f18899cd94bf09153e1fe9ebae78b P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:53.986099 2778 raft_consensus.cc:2802] T cd7f18899cd94bf09153e1fe9ebae78b P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:53.986239 2778 raft_consensus.cc:695] T cd7f18899cd94bf09153e1fe9ebae78b P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: Becoming Leader. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Running, Role: LEADER
I20250831 19:54:53.986537 1631 raft_consensus.cc:2466] T cd7f18899cd94bf09153e1fe9ebae78b P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:54:53.986481 2778 consensus_queue.cc:237] T cd7f18899cd94bf09153e1fe9ebae78b P de831f40fa1348a48a1f0260f4130197 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:53.974761 2958 ts_tablet_manager.cc:1939] T 2c343954bf6e44d683310415da3c0e58 P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:54:53.987604 2932 raft_consensus.cc:491] T 5b6497a1ef3d4c5b84dc2bbbbfafd586 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:53.987771 2932 raft_consensus.cc:513] T 5b6497a1ef3d4c5b84dc2bbbbfafd586 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:53.988348 2932 leader_election.cc:290] T 5b6497a1ef3d4c5b84dc2bbbbfafd586 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
W20250831 19:54:53.989499 2118 catalog_manager.cc:5774] Failed to send AlterTable RPC for tablet b7d78b564652422ba145265d74a06afc (table default.table_b5294d0b8f564e31865783000a954688 [id=ee93396a22b546038473cc2df15fdc87], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet b7d78b564652422ba145265d74a06afc consensus state has no leader
I20250831 19:54:53.989881 1769 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5b6497a1ef3d4c5b84dc2bbbbfafd586" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:53.990072 1769 raft_consensus.cc:2466] T 5b6497a1ef3d4c5b84dc2bbbbfafd586 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 0.
I20250831 19:54:53.990072 2118 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36958:
name: "default.Table_56778a4f18cc4ab29dfda4ed17259cc5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:53.991390 1570 leader_election.cc:304] T 5b6497a1ef3d4c5b84dc2bbbbfafd586 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:53.991617 2987 raft_consensus.cc:3058] T 8fb7abc5581e4a16a55f844acd5fd2e9 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:53.991673 2928 raft_consensus.cc:2802] T 5b6497a1ef3d4c5b84dc2bbbbfafd586 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:53.991832 2928 raft_consensus.cc:491] T 5b6497a1ef3d4c5b84dc2bbbbfafd586 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:53.991923 2928 raft_consensus.cc:3058] T 5b6497a1ef3d4c5b84dc2bbbbfafd586 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:53.993038 2943 consensus_queue.cc:1035] T 026b3c38d6ae4f3492e7d26a19c155d9 P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:53.994315 2987 raft_consensus.cc:2747] T 8fb7abc5581e4a16a55f844acd5fd2e9 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250831 19:54:53.994511 2928 raft_consensus.cc:513] T 5b6497a1ef3d4c5b84dc2bbbbfafd586 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:53.995620 2928 leader_election.cc:290] T 5b6497a1ef3d4c5b84dc2bbbbfafd586 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Requested vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:53.995702 1770 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5b6497a1ef3d4c5b84dc2bbbbfafd586" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197"
I20250831 19:54:53.995870 1770 raft_consensus.cc:3058] T 5b6497a1ef3d4c5b84dc2bbbbfafd586 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:54.001744 2943 raft_consensus.cc:491] T b7d78b564652422ba145265d74a06afc P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:54.001911 2943 raft_consensus.cc:513] T b7d78b564652422ba145265d74a06afc P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:54.002264 2101 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet 2c343954bf6e44d683310415da3c0e58 (table default.table_15539726e4e647e5a28a991bc6e07cd7 [id=c64d0e4719134d4185b4f4dbfd60cd19]) successfully deleted
I20250831 19:54:54.002511 2943 leader_election.cc:290] T b7d78b564652422ba145265d74a06afc P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:54.002970 1632 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b7d78b564652422ba145265d74a06afc" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:54.003976 2958 tablet_replica.cc:331] T d3a587be468b4b7c8b90f4374af25e08 P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:54:54.004616 2958 raft_consensus.cc:2241] T d3a587be468b4b7c8b90f4374af25e08 P 2441fafe1d62429386f4631ad423567d [term 1 LEADER]: Raft consensus shutting down.
I20250831 19:54:53.946678 2282 raft_consensus.cc:357] T b7d78b564652422ba145265d74a06afc P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:54.006542 2282 raft_consensus.cc:383] T b7d78b564652422ba145265d74a06afc P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:54.006656 2282 raft_consensus.cc:738] T b7d78b564652422ba145265d74a06afc P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:54.007059 2282 consensus_queue.cc:260] T b7d78b564652422ba145265d74a06afc P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:54.007372 1632 raft_consensus.cc:2466] T b7d78b564652422ba145265d74a06afc P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 0.
I20250831 19:54:54.007936 1706 leader_election.cc:304] T b7d78b564652422ba145265d74a06afc P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:54.008057 1770 raft_consensus.cc:2466] T 5b6497a1ef3d4c5b84dc2bbbbfafd586 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1.
I20250831 19:54:54.008371 2778 raft_consensus.cc:2802] T b7d78b564652422ba145265d74a06afc P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:54.008469 2778 raft_consensus.cc:491] T b7d78b564652422ba145265d74a06afc P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:54.008566 2778 raft_consensus.cc:3058] T b7d78b564652422ba145265d74a06afc P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:54.008558 1570 leader_election.cc:304] T 5b6497a1ef3d4c5b84dc2bbbbfafd586 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:54.008932 2928 raft_consensus.cc:2802] T 5b6497a1ef3d4c5b84dc2bbbbfafd586 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:54.009071 2928 raft_consensus.cc:695] T 5b6497a1ef3d4c5b84dc2bbbbfafd586 P 89aa85d59c53436ebdf3074b13d14825 [term 1 LEADER]: Becoming Leader. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Running, Role: LEADER
I20250831 19:54:54.009382 2928 consensus_queue.cc:237] T 5b6497a1ef3d4c5b84dc2bbbbfafd586 P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:54.012037 2778 raft_consensus.cc:513] T b7d78b564652422ba145265d74a06afc P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:54.013705 1632 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b7d78b564652422ba145265d74a06afc" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:54:54.013868 1632 raft_consensus.cc:3058] T b7d78b564652422ba145265d74a06afc P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:54.016707 1632 raft_consensus.cc:2466] T b7d78b564652422ba145265d74a06afc P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:54:54.017241 1706 leader_election.cc:304] T b7d78b564652422ba145265d74a06afc P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:54.017546 2914 raft_consensus.cc:2802] T b7d78b564652422ba145265d74a06afc P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:54.017661 2778 leader_election.cc:290] T b7d78b564652422ba145265d74a06afc P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Requested vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:54.017693 2914 raft_consensus.cc:695] T b7d78b564652422ba145265d74a06afc P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: Becoming Leader. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Running, Role: LEADER
W20250831 19:54:54.017743 2104 catalog_manager.cc:4726] Async tablet task AlterTable RPC for tablet b7d78b564652422ba145265d74a06afc (table default.table_b5294d0b8f564e31865783000a954688 [id=ee93396a22b546038473cc2df15fdc87], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet b7d78b564652422ba145265d74a06afc consensus state has no leader
I20250831 19:54:54.017942 2914 consensus_queue.cc:237] T b7d78b564652422ba145265d74a06afc P de831f40fa1348a48a1f0260f4130197 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:54.021664 2584 consensus_queue.cc:1035] T 026b3c38d6ae4f3492e7d26a19c155d9 P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:54.005537 1903 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5b6497a1ef3d4c5b84dc2bbbbfafd586" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:54.024565 2958 raft_consensus.cc:2270] T d3a587be468b4b7c8b90f4374af25e08 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:54.025426 2122 catalog_manager.cc:5869] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Sending DeleteTablet for 3 replicas of tablet b6ef0e612b7e4b80af6fa5b2a66242c0
I20250831 19:54:54.005828 2979 raft_consensus.cc:491] T bde481a8e8fc4b1f82453a4e50ded47c P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:54.006912 1905 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5b6497a1ef3d4c5b84dc2bbbbfafd586" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:54:54.026310 1883 tablet_service.cc:1515] Processing DeleteTablet for tablet b6ef0e612b7e4b80af6fa5b2a66242c0 with delete_type TABLET_DATA_DELETED (replaced by tablet 2a20faaf76fe4806b47e5ac80ccf5915) from {username='slave'} at 127.0.0.1:45906
I20250831 19:54:54.026407 1749 tablet_service.cc:1515] Processing DeleteTablet for tablet b6ef0e612b7e4b80af6fa5b2a66242c0 with delete_type TABLET_DATA_DELETED (replaced by tablet 2a20faaf76fe4806b47e5ac80ccf5915) from {username='slave'} at 127.0.0.1:50674
I20250831 19:54:54.026355 2979 raft_consensus.cc:513] T bde481a8e8fc4b1f82453a4e50ded47c P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:54.026674 2959 tablet_replica.cc:331] T b6ef0e612b7e4b80af6fa5b2a66242c0 P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:54:54.026932 2959 raft_consensus.cc:2241] T b6ef0e612b7e4b80af6fa5b2a66242c0 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:54.027158 2959 raft_consensus.cc:2270] T b6ef0e612b7e4b80af6fa5b2a66242c0 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:54.027801 2959 ts_tablet_manager.cc:1905] T b6ef0e612b7e4b80af6fa5b2a66242c0 P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:54.028203 1631 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bde481a8e8fc4b1f82453a4e50ded47c" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:54.028452 1631 raft_consensus.cc:2466] T bde481a8e8fc4b1f82453a4e50ded47c P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 0.
I20250831 19:54:54.028929 1841 leader_election.cc:304] T bde481a8e8fc4b1f82453a4e50ded47c P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:54:54.029254 2896 raft_consensus.cc:2802] T bde481a8e8fc4b1f82453a4e50ded47c P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:54.029337 2896 raft_consensus.cc:491] T bde481a8e8fc4b1f82453a4e50ded47c P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:54.029456 2896 raft_consensus.cc:3058] T bde481a8e8fc4b1f82453a4e50ded47c P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:54.031672 2896 raft_consensus.cc:513] T bde481a8e8fc4b1f82453a4e50ded47c P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:54.033308 1633 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bde481a8e8fc4b1f82453a4e50ded47c" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:54:54.033483 1633 raft_consensus.cc:3058] T bde481a8e8fc4b1f82453a4e50ded47c P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:54.034991 2959 ts_tablet_manager.cc:1918] T b6ef0e612b7e4b80af6fa5b2a66242c0 P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250831 19:54:54.035116 2959 log.cc:1199] T b6ef0e612b7e4b80af6fa5b2a66242c0 P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/b6ef0e612b7e4b80af6fa5b2a66242c0
I20250831 19:54:54.035506 2959 ts_tablet_manager.cc:1939] T b6ef0e612b7e4b80af6fa5b2a66242c0 P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
I20250831 19:54:54.035972 1633 raft_consensus.cc:2466] T bde481a8e8fc4b1f82453a4e50ded47c P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 1.
I20250831 19:54:54.036446 1749 tablet_service.cc:1468] Processing CreateTablet for tablet 2a20faaf76fe4806b47e5ac80ccf5915 (DEFAULT_TABLE table=default.table_ca18962558654590b5d74892b4e00d0f [id=2cd4af6b415c4e3a92a3732fa145aa42]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:54.036509 2105 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet b6ef0e612b7e4b80af6fa5b2a66242c0 (table default.table_ca18962558654590b5d74892b4e00d0f [id=2cd4af6b415c4e3a92a3732fa145aa42]) successfully deleted
I20250831 19:54:54.036778 1749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a20faaf76fe4806b47e5ac80ccf5915. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:54.036783 1841 leader_election.cc:304] T bde481a8e8fc4b1f82453a4e50ded47c P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:54:54.036963 1883 tablet_service.cc:1468] Processing CreateTablet for tablet 2a20faaf76fe4806b47e5ac80ccf5915 (DEFAULT_TABLE table=default.table_ca18962558654590b5d74892b4e00d0f [id=2cd4af6b415c4e3a92a3732fa145aa42]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:54.037320 1883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a20faaf76fe4806b47e5ac80ccf5915. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:54.037485 2896 leader_election.cc:290] T bde481a8e8fc4b1f82453a4e50ded47c P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 election: Requested vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:54.037772 2896 raft_consensus.cc:2802] T bde481a8e8fc4b1f82453a4e50ded47c P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:54.038321 1609 tablet_service.cc:1468] Processing CreateTablet for tablet 2a20faaf76fe4806b47e5ac80ccf5915 (DEFAULT_TABLE table=default.table_ca18962558654590b5d74892b4e00d0f [id=2cd4af6b415c4e3a92a3732fa145aa42]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:54.038651 1609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a20faaf76fe4806b47e5ac80ccf5915. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:54.041965 2896 raft_consensus.cc:695] T bde481a8e8fc4b1f82453a4e50ded47c P 2441fafe1d62429386f4631ad423567d [term 1 LEADER]: Becoming Leader. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Running, Role: LEADER
I20250831 19:54:54.042294 2896 consensus_queue.cc:237] T bde481a8e8fc4b1f82453a4e50ded47c P 2441fafe1d62429386f4631ad423567d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:54.042886 2856 tablet_bootstrap.cc:492] T 2a20faaf76fe4806b47e5ac80ccf5915 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:54.043219 2122 catalog_manager.cc:6652] ReplaceTablet: tablet b6ef0e612b7e4b80af6fa5b2a66242c0 deleted and replaced by tablet 2a20faaf76fe4806b47e5ac80ccf5915
I20250831 19:54:54.043501 2122 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:36958 (request call id 139) took 1102 ms. Trace:
I20250831 19:54:54.043794 2122 rpcz_store.cc:276] 0831 19:54:52.940987 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:53.976064 (+1035077us) service_pool.cc:225] Handling call
0831 19:54:54.043472 (+ 67408us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:53.978519 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:53.978609 (+ 90us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:53.978613 (+ 4us) write_op.cc:435] Acquired schema lock
0831 19:54:53.978615 (+ 2us) tablet.cc:660] Decoding operations
0831 19:54:53.978698 (+ 83us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:53.978707 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:53.978711 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:53.978787 (+ 76us) tablet.cc:699] Row locks acquired
0831 19:54:53.978789 (+ 2us) write_op.cc:260] PREPARE: finished
0831 19:54:53.978820 (+ 31us) write_op.cc:270] Start()
0831 19:54:53.978844 (+ 24us) write_op.cc:276] Timestamp: P: 1756670093978792 usec, L: 0
0831 19:54:53.978847 (+ 3us) op_driver.cc:348] REPLICATION: starting
0831 19:54:53.978981 (+ 134us) log.cc:844] Serialized 656 byte log entry
0831 19:54:53.985006 (+ 6025us) op_driver.cc:464] REPLICATION: finished
0831 19:54:53.985124 (+ 118us) write_op.cc:301] APPLY: starting
0831 19:54:53.985137 (+ 13us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:53.985176 (+ 39us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:53.985197 (+ 21us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:53.985288 (+ 91us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:53.985354 (+ 66us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0831 19:54:53.985361 (+ 7us) write_op.cc:312] APPLY: finished
0831 19:54:53.985429 (+ 68us) log.cc:844] Serialized 29 byte log entry
0831 19:54:53.985525 (+ 96us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:53.985570 (+ 45us) write_op.cc:454] Released schema lock
0831 19:54:53.985576 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0831 19:54:53.985648 (+ 72us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:53.985652 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":78,"apply.run_cpu_time_us":511,"apply.run_wall_time_us":510,"num_ops":2,"prepare.queue_time_us":41,"prepare.run_cpu_time_us":563,"prepare.run_wall_time_us":564,"raft.queue_time_us":597,"raft.run_cpu_time_us":247,"raft.run_wall_time_us":246,"replication_time_us":6135,"spinlock_wait_cycles":55168}]]}
I20250831 19:54:54.044660 2856 tablet_bootstrap.cc:654] T 2a20faaf76fe4806b47e5ac80ccf5915 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:54.048738 2122 catalog_manager.cc:5582] T cd7f18899cd94bf09153e1fe9ebae78b P de831f40fa1348a48a1f0260f4130197 reported cstate change: term changed from 0 to 1, leader changed from <none> to de831f40fa1348a48a1f0260f4130197 (127.1.1.194). New cstate: current_term: 1 leader_uuid: "de831f40fa1348a48a1f0260f4130197" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } }
I20250831 19:54:54.018198 2992 raft_consensus.cc:491] T 5b6497a1ef3d4c5b84dc2bbbbfafd586 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:54.018618 1904 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b7d78b564652422ba145265d74a06afc" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:54.018640 1901 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b7d78b564652422ba145265d74a06afc" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:54:54.049783 1901 raft_consensus.cc:3058] T b7d78b564652422ba145265d74a06afc P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:54.052366 1901 raft_consensus.cc:2466] T b7d78b564652422ba145265d74a06afc P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:54:54.052748 1904 raft_consensus.cc:2374] T b7d78b564652422ba145265d74a06afc P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1. Re-sending same reply.
I20250831 19:54:54.055471 2992 raft_consensus.cc:513] T 5b6497a1ef3d4c5b84dc2bbbbfafd586 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:54.058832 1903 raft_consensus.cc:2466] T 5b6497a1ef3d4c5b84dc2bbbbfafd586 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 0.
I20250831 19:54:54.059492 1614 tablet_service.cc:1515] Processing DeleteTablet for tablet b6ef0e612b7e4b80af6fa5b2a66242c0 with delete_type TABLET_DATA_DELETED (replaced by tablet 2a20faaf76fe4806b47e5ac80ccf5915) from {username='slave'} at 127.0.0.1:51022
I20250831 19:54:54.060372 2957 tablet_replica.cc:331] T b6ef0e612b7e4b80af6fa5b2a66242c0 P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:54:54.060554 2957 raft_consensus.cc:2241] T b6ef0e612b7e4b80af6fa5b2a66242c0 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:54.060734 2957 raft_consensus.cc:2270] T b6ef0e612b7e4b80af6fa5b2a66242c0 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:54.060802 2856 tablet_bootstrap.cc:492] T 2a20faaf76fe4806b47e5ac80ccf5915 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:54.060945 2856 ts_tablet_manager.cc:1397] T 2a20faaf76fe4806b47e5ac80ccf5915 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.018s user 0.004s sys 0.004s
I20250831 19:54:54.061230 2957 ts_tablet_manager.cc:1905] T b6ef0e612b7e4b80af6fa5b2a66242c0 P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:54.061642 2856 raft_consensus.cc:357] T 2a20faaf76fe4806b47e5ac80ccf5915 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:54.061875 2856 raft_consensus.cc:383] T 2a20faaf76fe4806b47e5ac80ccf5915 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:54.061970 2856 raft_consensus.cc:738] T 2a20faaf76fe4806b47e5ac80ccf5915 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:54.062359 2856 consensus_queue.cc:260] T 2a20faaf76fe4806b47e5ac80ccf5915 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:54.062896 2856 ts_tablet_manager.cc:1428] T 2a20faaf76fe4806b47e5ac80ccf5915 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250831 19:54:54.066246 1632 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5b6497a1ef3d4c5b84dc2bbbbfafd586" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:54.067250 2992 leader_election.cc:290] T 5b6497a1ef3d4c5b84dc2bbbbfafd586 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:54.069685 2914 raft_consensus.cc:491] T bde481a8e8fc4b1f82453a4e50ded47c P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:54.070264 2786 tablet.cc:1722] T b67e0472244e4d79b8dfb7e7474b96b7 P 89aa85d59c53436ebdf3074b13d14825: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:54.069829 2914 raft_consensus.cc:513] T bde481a8e8fc4b1f82453a4e50ded47c P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:54.070623 2282 ts_tablet_manager.cc:1428] T b7d78b564652422ba145265d74a06afc P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.125s user 0.002s sys 0.000s
I20250831 19:54:54.070971 2979 leader_election.cc:290] T bde481a8e8fc4b1f82453a4e50ded47c P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:54.071143 2914 leader_election.cc:290] T bde481a8e8fc4b1f82453a4e50ded47c P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:54.071336 1902 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bde481a8e8fc4b1f82453a4e50ded47c" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:54.071395 1632 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bde481a8e8fc4b1f82453a4e50ded47c" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:54.071594 1632 raft_consensus.cc:2391] T bde481a8e8fc4b1f82453a4e50ded47c P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate de831f40fa1348a48a1f0260f4130197 in current term 1: Already voted for candidate 2441fafe1d62429386f4631ad423567d in this term.
I20250831 19:54:54.072026 1705 leader_election.cc:304] T bde481a8e8fc4b1f82453a4e50ded47c P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: de831f40fa1348a48a1f0260f4130197; no voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825
I20250831 19:54:54.072507 2914 raft_consensus.cc:3058] T bde481a8e8fc4b1f82453a4e50ded47c P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:54.074646 1770 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bde481a8e8fc4b1f82453a4e50ded47c" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:54.075493 2914 raft_consensus.cc:2747] T bde481a8e8fc4b1f82453a4e50ded47c P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250831 19:54:54.075768 1770 raft_consensus.cc:2466] T bde481a8e8fc4b1f82453a4e50ded47c P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 1.
I20250831 19:54:54.076200 1771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bde481a8e8fc4b1f82453a4e50ded47c" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197"
I20250831 19:54:54.078585 1771 raft_consensus.cc:2466] T bde481a8e8fc4b1f82453a4e50ded47c P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 1.
I20250831 19:54:54.066340 2122 catalog_manager.cc:5582] T 5b6497a1ef3d4c5b84dc2bbbbfafd586 P 89aa85d59c53436ebdf3074b13d14825 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193). New cstate: current_term: 1 leader_uuid: "89aa85d59c53436ebdf3074b13d14825" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: HEALTHY } } }
I20250831 19:54:54.083527 2958 ts_tablet_manager.cc:1905] T d3a587be468b4b7c8b90f4374af25e08 P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:54.086125 1771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5b6497a1ef3d4c5b84dc2bbbbfafd586" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:54.086338 1771 raft_consensus.cc:2391] T 5b6497a1ef3d4c5b84dc2bbbbfafd586 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2441fafe1d62429386f4631ad423567d in current term 1: Already voted for candidate 89aa85d59c53436ebdf3074b13d14825 in this term.
I20250831 19:54:54.093183 2122 catalog_manager.cc:5582] T b7d78b564652422ba145265d74a06afc P de831f40fa1348a48a1f0260f4130197 reported cstate change: term changed from 0 to 1, leader changed from <none> to de831f40fa1348a48a1f0260f4130197 (127.1.1.194). New cstate: current_term: 1 leader_uuid: "de831f40fa1348a48a1f0260f4130197" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: UNKNOWN } } }
I20250831 19:54:54.094532 2122 catalog_manager.cc:5674] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475) does not have the latest schema for tablet b7d78b564652422ba145265d74a06afc (table default.table_b5294d0b8f564e31865783000a954688 [id=ee93396a22b546038473cc2df15fdc87]). Expected version 1 got 0
I20250831 19:54:54.098819 2723 tablet.cc:1722] T b67e0472244e4d79b8dfb7e7474b96b7 P de831f40fa1348a48a1f0260f4130197: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:54.101404 2699 tablet_bootstrap.cc:492] T f3ea6c8b0bf64d8b86dc96dc1abe0934 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:54.103139 2699 tablet_bootstrap.cc:654] T f3ea6c8b0bf64d8b86dc96dc1abe0934 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:54.114207 2699 tablet_bootstrap.cc:492] T f3ea6c8b0bf64d8b86dc96dc1abe0934 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:54.114336 2699 ts_tablet_manager.cc:1397] T f3ea6c8b0bf64d8b86dc96dc1abe0934 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.006s
I20250831 19:54:54.114425 1842 leader_election.cc:304] T 5b6497a1ef3d4c5b84dc2bbbbfafd586 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2441fafe1d62429386f4631ad423567d; no voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197
I20250831 19:54:54.114694 2896 raft_consensus.cc:3058] T 5b6497a1ef3d4c5b84dc2bbbbfafd586 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:54.115041 2699 raft_consensus.cc:357] T f3ea6c8b0bf64d8b86dc96dc1abe0934 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:54.115237 2699 raft_consensus.cc:383] T f3ea6c8b0bf64d8b86dc96dc1abe0934 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:54.115312 2699 raft_consensus.cc:738] T f3ea6c8b0bf64d8b86dc96dc1abe0934 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:54.115468 2699 consensus_queue.cc:260] T f3ea6c8b0bf64d8b86dc96dc1abe0934 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:54.115916 2699 ts_tablet_manager.cc:1428] T f3ea6c8b0bf64d8b86dc96dc1abe0934 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
I20250831 19:54:54.117573 2699 tablet_bootstrap.cc:492] T 2a20faaf76fe4806b47e5ac80ccf5915 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:54.117771 2282 tablet_bootstrap.cc:492] T f3ea6c8b0bf64d8b86dc96dc1abe0934 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:54.118875 2896 raft_consensus.cc:2747] T 5b6497a1ef3d4c5b84dc2bbbbfafd586 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250831 19:54:54.120188 2122 catalog_manager.cc:5674] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197) does not have the latest schema for tablet b7d78b564652422ba145265d74a06afc (table default.table_b5294d0b8f564e31865783000a954688 [id=ee93396a22b546038473cc2df15fdc87]). Expected version 1 got 0
I20250831 19:54:54.124051 2957 ts_tablet_manager.cc:1918] T b6ef0e612b7e4b80af6fa5b2a66242c0 P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250831 19:54:54.124182 2957 log.cc:1199] T b6ef0e612b7e4b80af6fa5b2a66242c0 P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/b6ef0e612b7e4b80af6fa5b2a66242c0
I20250831 19:54:54.124651 2957 ts_tablet_manager.cc:1939] T b6ef0e612b7e4b80af6fa5b2a66242c0 P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
I20250831 19:54:54.124963 2282 tablet_bootstrap.cc:654] T f3ea6c8b0bf64d8b86dc96dc1abe0934 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:54.131377 2122 catalog_manager.cc:6127] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: default.table_d30c0aaa2c2a465ca2999246bdd68e5f [id=ba4c5ecf4ae94ede9bfb83af2ee894ab] alter complete (version 1)
I20250831 19:54:54.142601 2786 tablet.cc:1722] T 48c3872dbaee495fb80d1415b5631eaf P 89aa85d59c53436ebdf3074b13d14825: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250831 19:54:54.148152 2761 tablet.cc:1722] T b67e0472244e4d79b8dfb7e7474b96b7 P 2441fafe1d62429386f4631ad423567d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:54.155670 2699 tablet_bootstrap.cc:654] T 2a20faaf76fe4806b47e5ac80ccf5915 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:54.164794 2122 catalog_manager.cc:5674] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475) does not have the latest schema for tablet 2a20faaf76fe4806b47e5ac80ccf5915 (table default.table_ca18962558654590b5d74892b4e00d0f [id=2cd4af6b415c4e3a92a3732fa145aa42]). Expected version 1 got 0
I20250831 19:54:54.166170 2104 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet b6ef0e612b7e4b80af6fa5b2a66242c0 (table default.table_ca18962558654590b5d74892b4e00d0f [id=2cd4af6b415c4e3a92a3732fa145aa42]) successfully deleted
I20250831 19:54:54.169864 3009 tablet.cc:1722] T 48c3872dbaee495fb80d1415b5631eaf P 2441fafe1d62429386f4631ad423567d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250831 19:54:54.170001 2723 tablet.cc:1722] T 48c3872dbaee495fb80d1415b5631eaf P de831f40fa1348a48a1f0260f4130197: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20250831 19:54:54.170575 2122 catalog_manager.cc:5774] Failed to send AlterTable RPC for tablet 2a20faaf76fe4806b47e5ac80ccf5915 (table default.table_ca18962558654590b5d74892b4e00d0f [id=2cd4af6b415c4e3a92a3732fa145aa42], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 2a20faaf76fe4806b47e5ac80ccf5915 consensus state has no leader
I20250831 19:54:54.183295 2282 tablet_bootstrap.cc:492] T f3ea6c8b0bf64d8b86dc96dc1abe0934 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:54.183538 2282 ts_tablet_manager.cc:1397] T f3ea6c8b0bf64d8b86dc96dc1abe0934 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.111s user 0.002s sys 0.006s
I20250831 19:54:54.184929 2282 raft_consensus.cc:357] T f3ea6c8b0bf64d8b86dc96dc1abe0934 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:54.185352 2282 raft_consensus.cc:383] T f3ea6c8b0bf64d8b86dc96dc1abe0934 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:54.185514 2282 raft_consensus.cc:738] T f3ea6c8b0bf64d8b86dc96dc1abe0934 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:54.186412 2282 consensus_queue.cc:260] T f3ea6c8b0bf64d8b86dc96dc1abe0934 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:54.187350 2122 catalog_manager.cc:6127] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: default.table_08b74e57795c4dd8a7f91f01e1b5ba4a [id=f63d391a9c824314bf6789cc7bbb5ffb] alter complete (version 2)
I20250831 19:54:54.187505 2282 ts_tablet_manager.cc:1428] T f3ea6c8b0bf64d8b86dc96dc1abe0934 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20250831 19:54:54.191808 1632 raft_consensus.cc:1273] T b7d78b564652422ba145265d74a06afc P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Refusing update from remote peer de831f40fa1348a48a1f0260f4130197: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250831 19:54:54.192420 2584 consensus_queue.cc:1035] T b7d78b564652422ba145265d74a06afc P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:54.198045 1906 raft_consensus.cc:1273] T b7d78b564652422ba145265d74a06afc P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Refusing update from remote peer de831f40fa1348a48a1f0260f4130197: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250831 19:54:54.198639 2584 consensus_queue.cc:1035] T b7d78b564652422ba145265d74a06afc P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:54.201694 2282 tablet_bootstrap.cc:492] T 2a20faaf76fe4806b47e5ac80ccf5915 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:54.202684 2995 consensus_queue.cc:1035] T 9525ea0cb58146d6851936d749447c3f P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:54.206701 2584 consensus_queue.cc:1035] T d1f811715ac64ca591a84b52be6e2621 P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:54.210847 2282 tablet_bootstrap.cc:654] T 2a20faaf76fe4806b47e5ac80ccf5915 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:54.222844 2958 ts_tablet_manager.cc:1918] T d3a587be468b4b7c8b90f4374af25e08 P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250831 19:54:54.223030 2958 log.cc:1199] T d3a587be468b4b7c8b90f4374af25e08 P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/d3a587be468b4b7c8b90f4374af25e08
I20250831 19:54:54.223469 2958 ts_tablet_manager.cc:1939] T d3a587be468b4b7c8b90f4374af25e08 P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:54:54.225509 2120 catalog_manager.cc:2149] created HMS catalog entry for table [id=7c4a0345486747339c3e158a950bc5aa]
I20250831 19:54:54.239862 2101 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet d3a587be468b4b7c8b90f4374af25e08 (table default.table_b5294d0b8f564e31865783000a954688 [id=ee93396a22b546038473cc2df15fdc87]) successfully deleted
I20250831 19:54:54.240239 2120 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:36958 (request call id 137) took 1305 ms. Trace:
I20250831 19:54:54.240340 2120 rpcz_store.cc:276] 0831 19:54:52.926517 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:53.542759 (+616242us) service_pool.cc:225] Handling call
0831 19:54:53.974949 (+432190us) catalog_manager.cc:2076] Acquired catalog manager lock
0831 19:54:53.975364 (+ 415us) catalog_manager.cc:2122] Created new table and tablet info
0831 19:54:54.221411 (+246047us) catalog_manager.cc:2148] Created new table in HMS catalog
0831 19:54:54.231609 (+ 10198us) catalog_manager.cc:2182] Wrote table and tablets to system table
0831 19:54:54.231730 (+ 121us) catalog_manager.cc:2216] Inserted table and tablets into CatalogManager maps
0831 19:54:54.231838 (+ 108us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:54.226221 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:54.226352 (+ 131us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:54.226358 (+ 6us) write_op.cc:435] Acquired schema lock
0831 19:54:54.226361 (+ 3us) tablet.cc:660] Decoding operations
0831 19:54:54.226450 (+ 89us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:54.226463 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:54.226467 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:54.226539 (+ 72us) tablet.cc:699] Row locks acquired
0831 19:54:54.226541 (+ 2us) write_op.cc:260] PREPARE: finished
0831 19:54:54.226574 (+ 33us) write_op.cc:270] Start()
0831 19:54:54.226606 (+ 32us) write_op.cc:276] Timestamp: P: 1756670094226521 usec, L: 0
0831 19:54:54.226610 (+ 4us) op_driver.cc:348] REPLICATION: starting
0831 19:54:54.226804 (+ 194us) log.cc:844] Serialized 433 byte log entry
0831 19:54:54.230612 (+ 3808us) op_driver.cc:464] REPLICATION: finished
0831 19:54:54.230734 (+ 122us) write_op.cc:301] APPLY: starting
0831 19:54:54.230749 (+ 15us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:54.230795 (+ 46us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:54.230837 (+ 42us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:54.230936 (+ 99us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:54.230969 (+ 33us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0831 19:54:54.230976 (+ 7us) write_op.cc:312] APPLY: finished
0831 19:54:54.231042 (+ 66us) log.cc:844] Serialized 29 byte log entry
0831 19:54:54.231104 (+ 62us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:54.231123 (+ 19us) write_op.cc:454] Released schema lock
0831 19:54:54.231129 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0831 19:54:54.231194 (+ 65us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:54.231198 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":656,"Hive Metastore.run_cpu_time_us":238,"Hive Metastore.run_wall_time_us":245007,"child_traces":[["op",{"apply.queue_time_us":80,"apply.run_cpu_time_us":451,"apply.run_wall_time_us":450,"num_ops":2,"prepare.queue_time_us":106,"prepare.run_cpu_time_us":706,"prepare.run_wall_time_us":707,"raft.queue_time_us":440,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":219,"replication_time_us":3975}]]}
I20250831 19:54:54.243768 2120 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36958:
name: "default.Table_62a803bf234d4af29aa61db8fba3d765"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:54.246758 2125 catalog_manager.cc:2149] created HMS catalog entry for table [id=9b01227041494090854149aefbbc4a88]
I20250831 19:54:54.247483 2122 catalog_manager.cc:5582] T bde481a8e8fc4b1f82453a4e50ded47c P 2441fafe1d62429386f4631ad423567d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2441fafe1d62429386f4631ad423567d (127.1.1.195). New cstate: current_term: 1 leader_uuid: "2441fafe1d62429386f4631ad423567d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: UNKNOWN } } }
I20250831 19:54:54.251425 2125 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:36958 (request call id 135) took 1431 ms. Trace:
I20250831 19:54:54.251538 2125 rpcz_store.cc:276] 0831 19:54:52.819996 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:53.526120 (+706124us) service_pool.cc:225] Handling call
0831 19:54:53.975549 (+449429us) catalog_manager.cc:2076] Acquired catalog manager lock
0831 19:54:53.975933 (+ 384us) catalog_manager.cc:2122] Created new table and tablet info
0831 19:54:54.246709 (+270776us) catalog_manager.cc:2148] Created new table in HMS catalog
0831 19:54:54.251214 (+ 4505us) catalog_manager.cc:2182] Wrote table and tablets to system table
0831 19:54:54.251303 (+ 89us) catalog_manager.cc:2216] Inserted table and tablets into CatalogManager maps
0831 19:54:54.251382 (+ 79us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:54.247363 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:54.247478 (+ 115us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:54.247483 (+ 5us) write_op.cc:435] Acquired schema lock
0831 19:54:54.247485 (+ 2us) tablet.cc:660] Decoding operations
0831 19:54:54.247610 (+ 125us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:54.247623 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:54.247628 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:54.247699 (+ 71us) tablet.cc:699] Row locks acquired
0831 19:54:54.247701 (+ 2us) write_op.cc:260] PREPARE: finished
0831 19:54:54.247739 (+ 38us) write_op.cc:270] Start()
0831 19:54:54.247771 (+ 32us) write_op.cc:276] Timestamp: P: 1756670094247682 usec, L: 0
0831 19:54:54.247780 (+ 9us) op_driver.cc:348] REPLICATION: starting
0831 19:54:54.248043 (+ 263us) log.cc:844] Serialized 433 byte log entry
0831 19:54:54.250531 (+ 2488us) op_driver.cc:464] REPLICATION: finished
0831 19:54:54.250674 (+ 143us) write_op.cc:301] APPLY: starting
0831 19:54:54.250686 (+ 12us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:54.250727 (+ 41us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:54.250756 (+ 29us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:54.250893 (+ 137us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:54.250924 (+ 31us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0831 19:54:54.250931 (+ 7us) write_op.cc:312] APPLY: finished
0831 19:54:54.250994 (+ 63us) log.cc:844] Serialized 29 byte log entry
0831 19:54:54.251052 (+ 58us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:54.251070 (+ 18us) write_op.cc:454] Released schema lock
0831 19:54:54.251076 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0831 19:54:54.251132 (+ 56us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:54.251136 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":245175,"Hive Metastore.run_cpu_time_us":273,"Hive Metastore.run_wall_time_us":25263,"child_traces":[["op",{"apply.queue_time_us":91,"apply.run_cpu_time_us":451,"apply.run_wall_time_us":463,"num_ops":2,"prepare.queue_time_us":46,"prepare.run_cpu_time_us":756,"prepare.run_wall_time_us":812,"raft.queue_time_us":410,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":212,"replication_time_us":2727}]]}
I20250831 19:54:54.254460 2958 tablet_replica.cc:331] T b6ef0e612b7e4b80af6fa5b2a66242c0 P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:54:54.254927 2125 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36958:
name: "default.Table_969c1fd9ed5340858aa7434d10785589"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:54.255766 2958 raft_consensus.cc:2241] T b6ef0e612b7e4b80af6fa5b2a66242c0 P 2441fafe1d62429386f4631ad423567d [term 1 LEADER]: Raft consensus shutting down.
I20250831 19:54:54.260257 2282 tablet_bootstrap.cc:492] T 2a20faaf76fe4806b47e5ac80ccf5915 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:54.260231 2958 raft_consensus.cc:2270] T b6ef0e612b7e4b80af6fa5b2a66242c0 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:54.260442 2282 ts_tablet_manager.cc:1397] T 2a20faaf76fe4806b47e5ac80ccf5915 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.073s user 0.002s sys 0.001s
I20250831 19:54:54.261040 2958 ts_tablet_manager.cc:1905] T b6ef0e612b7e4b80af6fa5b2a66242c0 P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:54.268541 2958 ts_tablet_manager.cc:1918] T b6ef0e612b7e4b80af6fa5b2a66242c0 P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250831 19:54:54.261200 2282 raft_consensus.cc:357] T 2a20faaf76fe4806b47e5ac80ccf5915 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:54.269944 2282 raft_consensus.cc:383] T 2a20faaf76fe4806b47e5ac80ccf5915 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:54.270047 2282 raft_consensus.cc:738] T 2a20faaf76fe4806b47e5ac80ccf5915 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:54.270452 2282 consensus_queue.cc:260] T 2a20faaf76fe4806b47e5ac80ccf5915 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:54.271958 2282 ts_tablet_manager.cc:1428] T 2a20faaf76fe4806b47e5ac80ccf5915 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
I20250831 19:54:54.278877 1614 tablet_service.cc:1468] Processing CreateTablet for tablet 27a32ae2ed1a4b94b1a2e6a9aa9d0d8c (DEFAULT_TABLE table=default.table_5546b3f364ce47768a100eec7bcf06af [id=7c4a0345486747339c3e158a950bc5aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:54.279012 1749 tablet_service.cc:1468] Processing CreateTablet for tablet 27a32ae2ed1a4b94b1a2e6a9aa9d0d8c (DEFAULT_TABLE table=default.table_5546b3f364ce47768a100eec7bcf06af [id=7c4a0345486747339c3e158a950bc5aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:54.279351 1614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27a32ae2ed1a4b94b1a2e6a9aa9d0d8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:54.279403 1749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27a32ae2ed1a4b94b1a2e6a9aa9d0d8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:54.289453 2122 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_f5e850536e8c40ccae5b78ae7e787b7d" } new_table_name: "default.Table_c714288d42d74e799fc5e0c60cb920fa" modify_external_catalogs: true
I20250831 19:54:54.291990 2126 catalog_manager.cc:2149] created HMS catalog entry for table [id=124c069ee3d5449cb64e8a816f67a365]
I20250831 19:54:54.292593 2282 tablet_bootstrap.cc:492] T 27a32ae2ed1a4b94b1a2e6a9aa9d0d8c P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:54.281802 1884 tablet_service.cc:1468] Processing CreateTablet for tablet 27a32ae2ed1a4b94b1a2e6a9aa9d0d8c (DEFAULT_TABLE table=default.table_5546b3f364ce47768a100eec7bcf06af [id=7c4a0345486747339c3e158a950bc5aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:54.295142 2282 tablet_bootstrap.cc:654] T 27a32ae2ed1a4b94b1a2e6a9aa9d0d8c P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:54.295501 1884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27a32ae2ed1a4b94b1a2e6a9aa9d0d8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:54.296720 2126 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:36958 (request call id 136) took 1426 ms. Trace:
I20250831 19:54:54.296829 2126 rpcz_store.cc:276] 0831 19:54:52.870436 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:53.528420 (+657984us) service_pool.cc:225] Handling call
0831 19:54:53.977006 (+448586us) catalog_manager.cc:2076] Acquired catalog manager lock
0831 19:54:53.977343 (+ 337us) catalog_manager.cc:2122] Created new table and tablet info
0831 19:54:54.291943 (+314600us) catalog_manager.cc:2148] Created new table in HMS catalog
0831 19:54:54.296484 (+ 4541us) catalog_manager.cc:2182] Wrote table and tablets to system table
0831 19:54:54.296602 (+ 118us) catalog_manager.cc:2216] Inserted table and tablets into CatalogManager maps
0831 19:54:54.296685 (+ 83us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:54.292967 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:54.293090 (+ 123us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:54.293097 (+ 7us) write_op.cc:435] Acquired schema lock
0831 19:54:54.293100 (+ 3us) tablet.cc:660] Decoding operations
0831 19:54:54.293194 (+ 94us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:54.293207 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:54.293213 (+ 6us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:54.293290 (+ 77us) tablet.cc:699] Row locks acquired
0831 19:54:54.293293 (+ 3us) write_op.cc:260] PREPARE: finished
0831 19:54:54.293321 (+ 28us) write_op.cc:270] Start()
0831 19:54:54.293349 (+ 28us) write_op.cc:276] Timestamp: P: 1756670094293262 usec, L: 0
0831 19:54:54.293354 (+ 5us) op_driver.cc:348] REPLICATION: starting
0831 19:54:54.293529 (+ 175us) log.cc:844] Serialized 433 byte log entry
0831 19:54:54.295752 (+ 2223us) op_driver.cc:464] REPLICATION: finished
0831 19:54:54.296023 (+ 271us) write_op.cc:301] APPLY: starting
0831 19:54:54.296037 (+ 14us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:54.296071 (+ 34us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:54.296095 (+ 24us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:54.296192 (+ 97us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:54.296219 (+ 27us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0831 19:54:54.296225 (+ 6us) write_op.cc:312] APPLY: finished
0831 19:54:54.296280 (+ 55us) log.cc:844] Serialized 29 byte log entry
0831 19:54:54.296334 (+ 54us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:54.296349 (+ 15us) write_op.cc:454] Released schema lock
0831 19:54:54.296355 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0831 19:54:54.296407 (+ 52us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:54.296411 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":269070,"Hive Metastore.run_cpu_time_us":274,"Hive Metastore.run_wall_time_us":45258,"child_traces":[["op",{"apply.queue_time_us":229,"apply.run_cpu_time_us":381,"apply.run_wall_time_us":381,"num_ops":2,"prepare.queue_time_us":386,"prepare.run_cpu_time_us":664,"prepare.run_wall_time_us":665,"raft.queue_time_us":359,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":214,"replication_time_us":2364}]]}
I20250831 19:54:54.297554 2126 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_60746664f3ef4d82866e4bcd56d4fac5" } modify_external_catalogs: true
I20250831 19:54:54.297775 2126 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_60746664f3ef4d82866e4bcd56d4fac5" } modify_external_catalogs: true
I20250831 19:54:54.301708 1751 tablet_service.cc:1468] Processing CreateTablet for tablet c307e8673f164f509e0c5ebcfcc2a033 (DEFAULT_TABLE table=default.table_ac609d4af0b748438a68966d468a56c6 [id=9b01227041494090854149aefbbc4a88]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:54.301776 1614 tablet_service.cc:1468] Processing CreateTablet for tablet c307e8673f164f509e0c5ebcfcc2a033 (DEFAULT_TABLE table=default.table_ac609d4af0b748438a68966d468a56c6 [id=9b01227041494090854149aefbbc4a88]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:54.302048 2958 log.cc:1199] T b6ef0e612b7e4b80af6fa5b2a66242c0 P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/b6ef0e612b7e4b80af6fa5b2a66242c0
I20250831 19:54:54.302145 1751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c307e8673f164f509e0c5ebcfcc2a033. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:54.302213 1614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c307e8673f164f509e0c5ebcfcc2a033. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:54.303078 2958 ts_tablet_manager.cc:1939] T b6ef0e612b7e4b80af6fa5b2a66242c0 P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:54:54.306679 2101 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet b6ef0e612b7e4b80af6fa5b2a66242c0 (table default.table_ca18962558654590b5d74892b4e00d0f [id=2cd4af6b415c4e3a92a3732fa145aa42]) successfully deleted
I20250831 19:54:54.307655 2778 consensus_queue.cc:1035] T d1f811715ac64ca591a84b52be6e2621 P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:54.308998 2928 consensus_queue.cc:1035] T 9525ea0cb58146d6851936d749447c3f P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:54.313340 2856 tablet_bootstrap.cc:492] T c307e8673f164f509e0c5ebcfcc2a033 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:54.314376 2723 tablet.cc:1722] T b7d78b564652422ba145265d74a06afc P de831f40fa1348a48a1f0260f4130197: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:54.314970 2856 tablet_bootstrap.cc:654] T c307e8673f164f509e0c5ebcfcc2a033 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:54.323721 2699 tablet_bootstrap.cc:492] T 2a20faaf76fe4806b47e5ac80ccf5915 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:54.323665 1884 tablet_service.cc:1468] Processing CreateTablet for tablet c307e8673f164f509e0c5ebcfcc2a033 (DEFAULT_TABLE table=default.table_ac609d4af0b748438a68966d468a56c6 [id=9b01227041494090854149aefbbc4a88]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:54.323894 2699 ts_tablet_manager.cc:1397] T 2a20faaf76fe4806b47e5ac80ccf5915 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.206s user 0.006s sys 0.008s
I20250831 19:54:54.324610 1884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c307e8673f164f509e0c5ebcfcc2a033. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:54.327802 2778 raft_consensus.cc:491] T f3ea6c8b0bf64d8b86dc96dc1abe0934 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:54.327950 2778 raft_consensus.cc:513] T f3ea6c8b0bf64d8b86dc96dc1abe0934 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:54.328580 2778 leader_election.cc:290] T f3ea6c8b0bf64d8b86dc96dc1abe0934 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:54.329514 2042 master_runner.cc:186] Error getting master registration for 127.1.1.254:34259: Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111),
I20250831 19:54:54.329734 2042 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20250831 19:54:54.329355 1633 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f3ea6c8b0bf64d8b86dc96dc1abe0934" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:54.329753 1902 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f3ea6c8b0bf64d8b86dc96dc1abe0934" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:54.329936 1902 raft_consensus.cc:2466] T f3ea6c8b0bf64d8b86dc96dc1abe0934 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 0.
I20250831 19:54:54.329952 1633 raft_consensus.cc:2466] T f3ea6c8b0bf64d8b86dc96dc1abe0934 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 0.
I20250831 19:54:54.330310 1705 leader_election.cc:304] T f3ea6c8b0bf64d8b86dc96dc1abe0934 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:54.330545 2778 raft_consensus.cc:2802] T f3ea6c8b0bf64d8b86dc96dc1abe0934 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:54.330629 2778 raft_consensus.cc:491] T f3ea6c8b0bf64d8b86dc96dc1abe0934 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:54.330701 2778 raft_consensus.cc:3058] T f3ea6c8b0bf64d8b86dc96dc1abe0934 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:54.333287 2778 raft_consensus.cc:513] T f3ea6c8b0bf64d8b86dc96dc1abe0934 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:54.336438 1902 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f3ea6c8b0bf64d8b86dc96dc1abe0934" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:54:54.336642 1902 raft_consensus.cc:3058] T f3ea6c8b0bf64d8b86dc96dc1abe0934 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:54.339619 1902 raft_consensus.cc:2466] T f3ea6c8b0bf64d8b86dc96dc1abe0934 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:54:54.341135 1705 leader_election.cc:304] T f3ea6c8b0bf64d8b86dc96dc1abe0934 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:54.341495 2943 raft_consensus.cc:2802] T f3ea6c8b0bf64d8b86dc96dc1abe0934 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:54.341641 2943 raft_consensus.cc:695] T f3ea6c8b0bf64d8b86dc96dc1abe0934 P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: Becoming Leader. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Running, Role: LEADER
I20250831 19:54:54.342005 2943 consensus_queue.cc:237] T f3ea6c8b0bf64d8b86dc96dc1abe0934 P de831f40fa1348a48a1f0260f4130197 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:54.345124 2778 leader_election.cc:290] T f3ea6c8b0bf64d8b86dc96dc1abe0934 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Requested vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:54.345183 1633 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f3ea6c8b0bf64d8b86dc96dc1abe0934" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:54:54.345417 1633 raft_consensus.cc:3058] T f3ea6c8b0bf64d8b86dc96dc1abe0934 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:54.348702 1633 raft_consensus.cc:2466] T f3ea6c8b0bf64d8b86dc96dc1abe0934 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:54:54.350997 1614 tablet_service.cc:1468] Processing CreateTablet for tablet a4e2586021c046dd8c5acd838bb5e83f (DEFAULT_TABLE table=default.table_a03aade65d4449ec87fdbd94f7edd5ca [id=124c069ee3d5449cb64e8a816f67a365]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:54.351052 1883 tablet_service.cc:1468] Processing CreateTablet for tablet a4e2586021c046dd8c5acd838bb5e83f (DEFAULT_TABLE table=default.table_a03aade65d4449ec87fdbd94f7edd5ca [id=124c069ee3d5449cb64e8a816f67a365]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:54.351491 1883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4e2586021c046dd8c5acd838bb5e83f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:54.351774 1749 tablet_service.cc:1468] Processing CreateTablet for tablet a4e2586021c046dd8c5acd838bb5e83f (DEFAULT_TABLE table=default.table_a03aade65d4449ec87fdbd94f7edd5ca [id=124c069ee3d5449cb64e8a816f67a365]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:54.352167 1749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4e2586021c046dd8c5acd838bb5e83f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:54.352324 1614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4e2586021c046dd8c5acd838bb5e83f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:54.355633 2282 tablet_bootstrap.cc:492] T 27a32ae2ed1a4b94b1a2e6a9aa9d0d8c P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:54.355752 2282 ts_tablet_manager.cc:1397] T 27a32ae2ed1a4b94b1a2e6a9aa9d0d8c P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.063s user 0.001s sys 0.002s
I20250831 19:54:54.356482 2282 raft_consensus.cc:357] T 27a32ae2ed1a4b94b1a2e6a9aa9d0d8c P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:54.356640 2282 raft_consensus.cc:383] T 27a32ae2ed1a4b94b1a2e6a9aa9d0d8c P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:54.356705 2282 raft_consensus.cc:738] T 27a32ae2ed1a4b94b1a2e6a9aa9d0d8c P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:54.356993 2282 consensus_queue.cc:260] T 27a32ae2ed1a4b94b1a2e6a9aa9d0d8c P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:54.357784 2282 ts_tablet_manager.cc:1428] T 27a32ae2ed1a4b94b1a2e6a9aa9d0d8c P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250831 19:54:54.358058 2282 tablet_bootstrap.cc:492] T c307e8673f164f509e0c5ebcfcc2a033 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:54.325089 2699 raft_consensus.cc:357] T 2a20faaf76fe4806b47e5ac80ccf5915 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:54.359544 2699 raft_consensus.cc:383] T 2a20faaf76fe4806b47e5ac80ccf5915 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:54.359519 2778 consensus_queue.cc:1035] T 8fb7abc5581e4a16a55f844acd5fd2e9 P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:54.359639 2699 raft_consensus.cc:738] T 2a20faaf76fe4806b47e5ac80ccf5915 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:54.359861 2699 consensus_queue.cc:260] T 2a20faaf76fe4806b47e5ac80ccf5915 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:54.360544 2282 tablet_bootstrap.cc:654] T c307e8673f164f509e0c5ebcfcc2a033 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:54.363554 3009 tablet.cc:1722] T b7d78b564652422ba145265d74a06afc P 2441fafe1d62429386f4631ad423567d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:54.366750 2856 tablet_bootstrap.cc:492] T c307e8673f164f509e0c5ebcfcc2a033 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:54.366899 2856 ts_tablet_manager.cc:1397] T c307e8673f164f509e0c5ebcfcc2a033 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.054s user 0.007s sys 0.002s
I20250831 19:54:54.367220 2786 tablet.cc:1722] T b7d78b564652422ba145265d74a06afc P 89aa85d59c53436ebdf3074b13d14825: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:54.368081 2699 ts_tablet_manager.cc:1428] T 2a20faaf76fe4806b47e5ac80ccf5915 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.044s user 0.001s sys 0.002s
I20250831 19:54:54.368372 2699 tablet_bootstrap.cc:492] T 27a32ae2ed1a4b94b1a2e6a9aa9d0d8c P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:54.369735 2856 raft_consensus.cc:357] T c307e8673f164f509e0c5ebcfcc2a033 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:54.369882 2856 raft_consensus.cc:383] T c307e8673f164f509e0c5ebcfcc2a033 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:54.369953 2856 raft_consensus.cc:738] T c307e8673f164f509e0c5ebcfcc2a033 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:54.370152 2856 consensus_queue.cc:260] T c307e8673f164f509e0c5ebcfcc2a033 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:54.371205 2699 tablet_bootstrap.cc:654] T 27a32ae2ed1a4b94b1a2e6a9aa9d0d8c P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:54.373948 2282 tablet_bootstrap.cc:492] T c307e8673f164f509e0c5ebcfcc2a033 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:54.374120 2282 ts_tablet_manager.cc:1397] T c307e8673f164f509e0c5ebcfcc2a033 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.016s user 0.001s sys 0.004s
I20250831 19:54:54.374884 2282 raft_consensus.cc:357] T c307e8673f164f509e0c5ebcfcc2a033 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:54.375058 2282 raft_consensus.cc:383] T c307e8673f164f509e0c5ebcfcc2a033 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:54.375133 2282 raft_consensus.cc:738] T c307e8673f164f509e0c5ebcfcc2a033 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:54.375375 2282 consensus_queue.cc:260] T c307e8673f164f509e0c5ebcfcc2a033 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:54.375911 2282 ts_tablet_manager.cc:1428] T c307e8673f164f509e0c5ebcfcc2a033 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
W20250831 19:54:54.383884 2123 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_268aaa1457f049d39b6e2eee7f41a1bb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250831 19:54:54.385399 1410 master_runner.cc:186] Error getting master registration for 127.1.1.254:34259: Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111),
I20250831 19:54:54.385562 1410 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20250831 19:54:54.389662 2282 tablet_bootstrap.cc:492] T a4e2586021c046dd8c5acd838bb5e83f P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:54.390018 2856 ts_tablet_manager.cc:1428] T c307e8673f164f509e0c5ebcfcc2a033 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.023s user 0.001s sys 0.001s
I20250831 19:54:54.390250 2856 tablet_bootstrap.cc:492] T 27a32ae2ed1a4b94b1a2e6a9aa9d0d8c P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:54.391494 2282 tablet_bootstrap.cc:654] T a4e2586021c046dd8c5acd838bb5e83f P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:54.392275 2856 tablet_bootstrap.cc:654] T 27a32ae2ed1a4b94b1a2e6a9aa9d0d8c P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:54.404317 2699 tablet_bootstrap.cc:492] T 27a32ae2ed1a4b94b1a2e6a9aa9d0d8c P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:54.404539 2699 ts_tablet_manager.cc:1397] T 27a32ae2ed1a4b94b1a2e6a9aa9d0d8c P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.036s user 0.001s sys 0.008s
I20250831 19:54:54.404834 2943 consensus_queue.cc:1035] T 8fb7abc5581e4a16a55f844acd5fd2e9 P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:54.405663 2699 raft_consensus.cc:357] T 27a32ae2ed1a4b94b1a2e6a9aa9d0d8c P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:54.405964 2699 raft_consensus.cc:383] T 27a32ae2ed1a4b94b1a2e6a9aa9d0d8c P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:54.406082 2699 raft_consensus.cc:738] T 27a32ae2ed1a4b94b1a2e6a9aa9d0d8c P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:54.406320 2699 consensus_queue.cc:260] T 27a32ae2ed1a4b94b1a2e6a9aa9d0d8c P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:54.407016 2699 ts_tablet_manager.cc:1428] T 27a32ae2ed1a4b94b1a2e6a9aa9d0d8c P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250831 19:54:54.407307 2699 tablet_bootstrap.cc:492] T c307e8673f164f509e0c5ebcfcc2a033 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:54.409133 2699 tablet_bootstrap.cc:654] T c307e8673f164f509e0c5ebcfcc2a033 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:54.410063 2282 tablet_bootstrap.cc:492] T a4e2586021c046dd8c5acd838bb5e83f P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:54.410209 2282 ts_tablet_manager.cc:1397] T a4e2586021c046dd8c5acd838bb5e83f P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.021s user 0.001s sys 0.006s
I20250831 19:54:54.410996 2282 raft_consensus.cc:357] T a4e2586021c046dd8c5acd838bb5e83f P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:54.411165 2282 raft_consensus.cc:383] T a4e2586021c046dd8c5acd838bb5e83f P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:54.411293 2282 raft_consensus.cc:738] T a4e2586021c046dd8c5acd838bb5e83f P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:54.412142 2282 consensus_queue.cc:260] T a4e2586021c046dd8c5acd838bb5e83f P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:54.412806 2282 ts_tablet_manager.cc:1428] T a4e2586021c046dd8c5acd838bb5e83f P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250831 19:54:54.423316 2123 catalog_manager.cc:2149] created HMS catalog entry for table [id=2b57fa1ef98f4029bc75e981255c74da]
W20250831 19:54:54.427188 2117 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_c48f1c99f3174cb8acca698339447ed9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250831 19:54:54.427232 2118 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_56778a4f18cc4ab29dfda4ed17259cc5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250831 19:54:54.428627 2119 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_0498f784ecd944168cd0cbd019307408 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250831 19:54:54.429395 2120 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_62a803bf234d4af29aa61db8fba3d765 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250831 19:54:54.430410 2125 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_969c1fd9ed5340858aa7434d10785589 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250831 19:54:54.433593 2123 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:36958 (request call id 142) took 1324 ms. Trace:
I20250831 19:54:54.434353 2123 rpcz_store.cc:276] 0831 19:54:53.108717 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:53.978436 (+869719us) service_pool.cc:225] Handling call
0831 19:54:54.383986 (+405550us) catalog_manager.cc:2076] Acquired catalog manager lock
0831 19:54:54.384406 (+ 420us) catalog_manager.cc:2122] Created new table and tablet info
0831 19:54:54.423274 (+ 38868us) catalog_manager.cc:2148] Created new table in HMS catalog
0831 19:54:54.433349 (+ 10075us) catalog_manager.cc:2182] Wrote table and tablets to system table
0831 19:54:54.433447 (+ 98us) catalog_manager.cc:2216] Inserted table and tablets into CatalogManager maps
0831 19:54:54.433554 (+ 107us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:54.424418 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:54.424542 (+ 124us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:54.424548 (+ 6us) write_op.cc:435] Acquired schema lock
0831 19:54:54.424550 (+ 2us) tablet.cc:660] Decoding operations
0831 19:54:54.424653 (+ 103us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:54.424668 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:54.424672 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:54.424758 (+ 86us) tablet.cc:699] Row locks acquired
0831 19:54:54.424761 (+ 3us) write_op.cc:260] PREPARE: finished
0831 19:54:54.424803 (+ 42us) write_op.cc:270] Start()
0831 19:54:54.424845 (+ 42us) write_op.cc:276] Timestamp: P: 1756670094424774 usec, L: 0
0831 19:54:54.424848 (+ 3us) op_driver.cc:348] REPLICATION: starting
0831 19:54:54.425020 (+ 172us) log.cc:844] Serialized 433 byte log entry
0831 19:54:54.432410 (+ 7390us) op_driver.cc:464] REPLICATION: finished
0831 19:54:54.432736 (+ 326us) write_op.cc:301] APPLY: starting
0831 19:54:54.432755 (+ 19us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:54.432802 (+ 47us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:54.432885 (+ 83us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:54.433010 (+ 125us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:54.433041 (+ 31us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0831 19:54:54.433047 (+ 6us) write_op.cc:312] APPLY: finished
0831 19:54:54.433117 (+ 70us) log.cc:844] Serialized 29 byte log entry
0831 19:54:54.433182 (+ 65us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:54.433200 (+ 18us) write_op.cc:454] Released schema lock
0831 19:54:54.433206 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0831 19:54:54.433265 (+ 59us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:54.433268 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":2790,"Hive Metastore.run_cpu_time_us":239,"Hive Metastore.run_wall_time_us":35783,"child_traces":[["op",{"apply.queue_time_us":272,"apply.run_cpu_time_us":528,"apply.run_wall_time_us":528,"num_ops":2,"prepare.queue_time_us":457,"prepare.run_cpu_time_us":716,"prepare.run_wall_time_us":715,"raft.queue_time_us":363,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":218,"replication_time_us":7537}]]}
I20250831 19:54:54.436862 2123 catalog_manager.cc:5674] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237) does not have the latest schema for tablet b7d78b564652422ba145265d74a06afc (table default.table_b5294d0b8f564e31865783000a954688 [id=ee93396a22b546038473cc2df15fdc87]). Expected version 1 got 0
I20250831 19:54:54.443421 1614 tablet_service.cc:1468] Processing CreateTablet for tablet 7afc8e9259a548fe946265ea513fde2f (DEFAULT_TABLE table=default.table_268aaa1457f049d39b6e2eee7f41a1bb [id=2b57fa1ef98f4029bc75e981255c74da]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:54.443629 1749 tablet_service.cc:1468] Processing CreateTablet for tablet 7afc8e9259a548fe946265ea513fde2f (DEFAULT_TABLE table=default.table_268aaa1457f049d39b6e2eee7f41a1bb [id=2b57fa1ef98f4029bc75e981255c74da]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:54.443673 1883 tablet_service.cc:1468] Processing CreateTablet for tablet 7afc8e9259a548fe946265ea513fde2f (DEFAULT_TABLE table=default.table_268aaa1457f049d39b6e2eee7f41a1bb [id=2b57fa1ef98f4029bc75e981255c74da]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:54.443833 1614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7afc8e9259a548fe946265ea513fde2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:54.443991 1749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7afc8e9259a548fe946265ea513fde2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:54.444052 1883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7afc8e9259a548fe946265ea513fde2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:54.446895 2123 catalog_manager.cc:5674] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197) does not have the latest schema for tablet b7d78b564652422ba145265d74a06afc (table default.table_b5294d0b8f564e31865783000a954688 [id=ee93396a22b546038473cc2df15fdc87]). Expected version 1 got 0
I20250831 19:54:54.447901 2123 master_service.cc:948] ReplaceTablet: received request to replace tablet cd7f18899cd94bf09153e1fe9ebae78b from {username='slave'} at 127.0.0.1:36958
I20250831 19:54:54.450115 2282 tablet_bootstrap.cc:492] T 7afc8e9259a548fe946265ea513fde2f P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:54.451066 2856 tablet_bootstrap.cc:492] T 27a32ae2ed1a4b94b1a2e6a9aa9d0d8c P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:54.451226 2856 ts_tablet_manager.cc:1397] T 27a32ae2ed1a4b94b1a2e6a9aa9d0d8c P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.061s user 0.002s sys 0.002s
I20250831 19:54:54.451866 2282 tablet_bootstrap.cc:654] T 7afc8e9259a548fe946265ea513fde2f P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:54.452039 2856 raft_consensus.cc:357] T 27a32ae2ed1a4b94b1a2e6a9aa9d0d8c P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:54.452226 2856 raft_consensus.cc:383] T 27a32ae2ed1a4b94b1a2e6a9aa9d0d8c P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:54.452296 2856 raft_consensus.cc:738] T 27a32ae2ed1a4b94b1a2e6a9aa9d0d8c P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:54.457340 2123 catalog_manager.cc:5869] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Sending DeleteTablet for 3 replicas of tablet cd7f18899cd94bf09153e1fe9ebae78b
I20250831 19:54:54.458336 2123 catalog_manager.cc:6652] ReplaceTablet: tablet cd7f18899cd94bf09153e1fe9ebae78b deleted and replaced by tablet eed712e77ad740ae95050fe589f3a61a
I20250831 19:54:54.458365 1614 tablet_service.cc:1515] Processing DeleteTablet for tablet cd7f18899cd94bf09153e1fe9ebae78b with delete_type TABLET_DATA_DELETED (replaced by tablet eed712e77ad740ae95050fe589f3a61a) from {username='slave'} at 127.0.0.1:51022
I20250831 19:54:54.458734 2957 tablet_replica.cc:331] T cd7f18899cd94bf09153e1fe9ebae78b P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:54:54.458943 2957 raft_consensus.cc:2241] T cd7f18899cd94bf09153e1fe9ebae78b P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:54.459097 2957 raft_consensus.cc:2270] T cd7f18899cd94bf09153e1fe9ebae78b P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:54.459583 2957 ts_tablet_manager.cc:1905] T cd7f18899cd94bf09153e1fe9ebae78b P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:54.461223 1751 tablet_service.cc:1515] Processing DeleteTablet for tablet cd7f18899cd94bf09153e1fe9ebae78b with delete_type TABLET_DATA_DELETED (replaced by tablet eed712e77ad740ae95050fe589f3a61a) from {username='slave'} at 127.0.0.1:50674
I20250831 19:54:54.461553 1883 tablet_service.cc:1515] Processing DeleteTablet for tablet cd7f18899cd94bf09153e1fe9ebae78b with delete_type TABLET_DATA_DELETED (replaced by tablet eed712e77ad740ae95050fe589f3a61a) from {username='slave'} at 127.0.0.1:45906
I20250831 19:54:54.452502 2856 consensus_queue.cc:260] T 27a32ae2ed1a4b94b1a2e6a9aa9d0d8c P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:54.461787 2958 tablet_replica.cc:331] T cd7f18899cd94bf09153e1fe9ebae78b P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:54:54.461889 2959 tablet_replica.cc:331] T cd7f18899cd94bf09153e1fe9ebae78b P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:54:54.461992 2958 raft_consensus.cc:2241] T cd7f18899cd94bf09153e1fe9ebae78b P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:54.462072 2959 raft_consensus.cc:2241] T cd7f18899cd94bf09153e1fe9ebae78b P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: Raft consensus shutting down.
I20250831 19:54:54.462172 2958 raft_consensus.cc:2270] T cd7f18899cd94bf09153e1fe9ebae78b P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:54.462704 2958 ts_tablet_manager.cc:1905] T cd7f18899cd94bf09153e1fe9ebae78b P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:54.464411 2959 pending_rounds.cc:70] T cd7f18899cd94bf09153e1fe9ebae78b P de831f40fa1348a48a1f0260f4130197: Trying to abort 1 pending ops.
I20250831 19:54:54.464494 2959 pending_rounds.cc:77] T cd7f18899cd94bf09153e1fe9ebae78b P de831f40fa1348a48a1f0260f4130197: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7195320704970702848 op_type: NO_OP noop_request { }
I20250831 19:54:54.464591 2959 raft_consensus.cc:2887] T cd7f18899cd94bf09153e1fe9ebae78b P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250831 19:54:54.464687 2959 raft_consensus.cc:2270] T cd7f18899cd94bf09153e1fe9ebae78b P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:54.465492 2959 ts_tablet_manager.cc:1905] T cd7f18899cd94bf09153e1fe9ebae78b P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:54.465938 2957 ts_tablet_manager.cc:1918] T cd7f18899cd94bf09153e1fe9ebae78b P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250831 19:54:54.466073 2957 log.cc:1199] T cd7f18899cd94bf09153e1fe9ebae78b P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/cd7f18899cd94bf09153e1fe9ebae78b
I20250831 19:54:54.466171 2856 ts_tablet_manager.cc:1428] T 27a32ae2ed1a4b94b1a2e6a9aa9d0d8c P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.015s user 0.000s sys 0.003s
I20250831 19:54:54.466391 2957 ts_tablet_manager.cc:1939] T cd7f18899cd94bf09153e1fe9ebae78b P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
I20250831 19:54:54.466459 2856 tablet_bootstrap.cc:492] T a4e2586021c046dd8c5acd838bb5e83f P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:54.467289 2104 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet cd7f18899cd94bf09153e1fe9ebae78b (table default.table_9e76b4c3909b459c812cb7fbddc11988 [id=5cc9b389dd1f4a0289aaecd18be10263]) successfully deleted
I20250831 19:54:54.469012 2856 tablet_bootstrap.cc:654] T a4e2586021c046dd8c5acd838bb5e83f P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:54.473810 1614 tablet_service.cc:1468] Processing CreateTablet for tablet eed712e77ad740ae95050fe589f3a61a (DEFAULT_TABLE table=default.table_9e76b4c3909b459c812cb7fbddc11988 [id=5cc9b389dd1f4a0289aaecd18be10263]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:54.474236 1614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eed712e77ad740ae95050fe589f3a61a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:54.475287 2959 ts_tablet_manager.cc:1918] T cd7f18899cd94bf09153e1fe9ebae78b P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:54.475445 2959 log.cc:1199] T cd7f18899cd94bf09153e1fe9ebae78b P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/cd7f18899cd94bf09153e1fe9ebae78b
I20250831 19:54:54.475844 2959 ts_tablet_manager.cc:1939] T cd7f18899cd94bf09153e1fe9ebae78b P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
I20250831 19:54:54.476768 2105 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet cd7f18899cd94bf09153e1fe9ebae78b (table default.table_9e76b4c3909b459c812cb7fbddc11988 [id=5cc9b389dd1f4a0289aaecd18be10263]) successfully deleted
I20250831 19:54:54.476969 1883 tablet_service.cc:1468] Processing CreateTablet for tablet eed712e77ad740ae95050fe589f3a61a (DEFAULT_TABLE table=default.table_9e76b4c3909b459c812cb7fbddc11988 [id=5cc9b389dd1f4a0289aaecd18be10263]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:54.477139 1751 tablet_service.cc:1468] Processing CreateTablet for tablet eed712e77ad740ae95050fe589f3a61a (DEFAULT_TABLE table=default.table_9e76b4c3909b459c812cb7fbddc11988 [id=5cc9b389dd1f4a0289aaecd18be10263]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:54.477347 1883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eed712e77ad740ae95050fe589f3a61a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:54.477438 1751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eed712e77ad740ae95050fe589f3a61a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:54.477543 2958 ts_tablet_manager.cc:1918] T cd7f18899cd94bf09153e1fe9ebae78b P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250831 19:54:54.477674 2958 log.cc:1199] T cd7f18899cd94bf09153e1fe9ebae78b P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/cd7f18899cd94bf09153e1fe9ebae78b
I20250831 19:54:54.477975 2958 ts_tablet_manager.cc:1939] T cd7f18899cd94bf09153e1fe9ebae78b P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:54:54.481369 2282 tablet_bootstrap.cc:492] T 7afc8e9259a548fe946265ea513fde2f P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:54.481571 2282 ts_tablet_manager.cc:1397] T 7afc8e9259a548fe946265ea513fde2f P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.031s user 0.004s sys 0.005s
I20250831 19:54:54.481551 2101 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet cd7f18899cd94bf09153e1fe9ebae78b (table default.table_9e76b4c3909b459c812cb7fbddc11988 [id=5cc9b389dd1f4a0289aaecd18be10263]) successfully deleted
I20250831 19:54:54.482571 2282 raft_consensus.cc:357] T 7afc8e9259a548fe946265ea513fde2f P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:54.482820 2282 raft_consensus.cc:383] T 7afc8e9259a548fe946265ea513fde2f P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:54.482914 2282 raft_consensus.cc:738] T 7afc8e9259a548fe946265ea513fde2f P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:54.483162 2282 consensus_queue.cc:260] T 7afc8e9259a548fe946265ea513fde2f P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:54.483680 2282 ts_tablet_manager.cc:1428] T 7afc8e9259a548fe946265ea513fde2f P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20250831 19:54:54.483932 2282 tablet_bootstrap.cc:492] T eed712e77ad740ae95050fe589f3a61a P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:54.489977 2123 catalog_manager.cc:5674] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197) does not have the latest schema for tablet 2a20faaf76fe4806b47e5ac80ccf5915 (table default.table_ca18962558654590b5d74892b4e00d0f [id=2cd4af6b415c4e3a92a3732fa145aa42]). Expected version 1 got 0
I20250831 19:54:54.494124 2282 tablet_bootstrap.cc:654] T eed712e77ad740ae95050fe589f3a61a P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:54.500005 2584 raft_consensus.cc:491] T 2a20faaf76fe4806b47e5ac80ccf5915 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:54.500136 2584 raft_consensus.cc:513] T 2a20faaf76fe4806b47e5ac80ccf5915 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:54.500730 2584 leader_election.cc:290] T 2a20faaf76fe4806b47e5ac80ccf5915 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:54.501518 1631 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2a20faaf76fe4806b47e5ac80ccf5915" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:54.501757 1631 raft_consensus.cc:2466] T 2a20faaf76fe4806b47e5ac80ccf5915 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 0.
I20250831 19:54:54.502490 2282 tablet_bootstrap.cc:492] T eed712e77ad740ae95050fe589f3a61a P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:54.502646 2282 ts_tablet_manager.cc:1397] T eed712e77ad740ae95050fe589f3a61a P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.019s user 0.002s sys 0.001s
I20250831 19:54:54.502830 1706 leader_election.cc:304] T 2a20faaf76fe4806b47e5ac80ccf5915 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:54.503108 2584 raft_consensus.cc:2802] T 2a20faaf76fe4806b47e5ac80ccf5915 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:54.503194 2584 raft_consensus.cc:491] T 2a20faaf76fe4806b47e5ac80ccf5915 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:54.503259 2584 raft_consensus.cc:3058] T 2a20faaf76fe4806b47e5ac80ccf5915 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:54.503335 2282 raft_consensus.cc:357] T eed712e77ad740ae95050fe589f3a61a P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:54.503479 2282 raft_consensus.cc:383] T eed712e77ad740ae95050fe589f3a61a P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:54.503566 2282 raft_consensus.cc:738] T eed712e77ad740ae95050fe589f3a61a P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:54.503760 2282 consensus_queue.cc:260] T eed712e77ad740ae95050fe589f3a61a P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:54.504235 2282 ts_tablet_manager.cc:1428] T eed712e77ad740ae95050fe589f3a61a P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250831 19:54:54.512737 2584 raft_consensus.cc:513] T 2a20faaf76fe4806b47e5ac80ccf5915 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:54.514071 1903 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2a20faaf76fe4806b47e5ac80ccf5915" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:54:54.514273 1903 raft_consensus.cc:3058] T 2a20faaf76fe4806b47e5ac80ccf5915 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:54.516831 1903 raft_consensus.cc:2466] T 2a20faaf76fe4806b47e5ac80ccf5915 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:54:54.517307 2584 leader_election.cc:290] T 2a20faaf76fe4806b47e5ac80ccf5915 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Requested vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:54.517743 1705 leader_election.cc:304] T 2a20faaf76fe4806b47e5ac80ccf5915 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:54.519580 2778 raft_consensus.cc:2802] T 2a20faaf76fe4806b47e5ac80ccf5915 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:54.519716 2778 raft_consensus.cc:695] T 2a20faaf76fe4806b47e5ac80ccf5915 P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: Becoming Leader. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Running, Role: LEADER
I20250831 19:54:54.519939 2778 consensus_queue.cc:237] T 2a20faaf76fe4806b47e5ac80ccf5915 P de831f40fa1348a48a1f0260f4130197 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:54.521515 1631 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2a20faaf76fe4806b47e5ac80ccf5915" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:54:54.521708 1631 raft_consensus.cc:3058] T 2a20faaf76fe4806b47e5ac80ccf5915 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:54.523095 2122 catalog_manager.cc:3460] renamed table default.table_f5e850536e8c40ccae5b78ae7e787b7d [id=aabaa79336954b3ab0450dcff3afa7bf] in HMS: new name default.table_c714288d42d74e799fc5e0c60cb920fa
I20250831 19:54:54.524317 1631 raft_consensus.cc:2466] T 2a20faaf76fe4806b47e5ac80ccf5915 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:54:54.501309 1902 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2a20faaf76fe4806b47e5ac80ccf5915" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:54.526970 1902 raft_consensus.cc:2374] T 2a20faaf76fe4806b47e5ac80ccf5915 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1. Re-sending same reply.
I20250831 19:54:54.529295 2123 catalog_manager.cc:6127] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: default.table_b5294d0b8f564e31865783000a954688 [id=ee93396a22b546038473cc2df15fdc87] alter complete (version 1)
I20250831 19:54:54.531314 2856 tablet_bootstrap.cc:492] T a4e2586021c046dd8c5acd838bb5e83f P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:54.531497 2856 ts_tablet_manager.cc:1397] T a4e2586021c046dd8c5acd838bb5e83f P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.065s user 0.001s sys 0.002s
I20250831 19:54:54.532516 2856 raft_consensus.cc:357] T a4e2586021c046dd8c5acd838bb5e83f P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:54.532780 2856 raft_consensus.cc:383] T a4e2586021c046dd8c5acd838bb5e83f P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:54.532881 2856 raft_consensus.cc:738] T a4e2586021c046dd8c5acd838bb5e83f P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:54.533185 2856 consensus_queue.cc:260] T a4e2586021c046dd8c5acd838bb5e83f P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:54.533748 2856 ts_tablet_manager.cc:1428] T a4e2586021c046dd8c5acd838bb5e83f P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250831 19:54:54.534022 2856 tablet_bootstrap.cc:492] T 7afc8e9259a548fe946265ea513fde2f P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:54.534703 2699 tablet_bootstrap.cc:492] T c307e8673f164f509e0c5ebcfcc2a033 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:54.534870 2699 ts_tablet_manager.cc:1397] T c307e8673f164f509e0c5ebcfcc2a033 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.128s user 0.009s sys 0.025s
I20250831 19:54:54.535442 2699 raft_consensus.cc:357] T c307e8673f164f509e0c5ebcfcc2a033 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:54.535578 2699 raft_consensus.cc:383] T c307e8673f164f509e0c5ebcfcc2a033 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:54.535629 2699 raft_consensus.cc:738] T c307e8673f164f509e0c5ebcfcc2a033 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:54.535823 2699 consensus_queue.cc:260] T c307e8673f164f509e0c5ebcfcc2a033 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:54.536237 2699 ts_tablet_manager.cc:1428] T c307e8673f164f509e0c5ebcfcc2a033 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20250831 19:54:54.536612 2699 tablet_bootstrap.cc:492] T a4e2586021c046dd8c5acd838bb5e83f P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:54.538080 2699 tablet_bootstrap.cc:654] T a4e2586021c046dd8c5acd838bb5e83f P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:54.541391 2117 catalog_manager.cc:2149] created HMS catalog entry for table [id=f707909e6af44750a5fc5e3b15af0b24]
I20250831 19:54:54.544590 2123 catalog_manager.cc:5582] T f3ea6c8b0bf64d8b86dc96dc1abe0934 P de831f40fa1348a48a1f0260f4130197 reported cstate change: term changed from 0 to 1, leader changed from <none> to de831f40fa1348a48a1f0260f4130197 (127.1.1.194). New cstate: current_term: 1 leader_uuid: "de831f40fa1348a48a1f0260f4130197" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: HEALTHY } } }
I20250831 19:54:54.547132 2699 tablet_bootstrap.cc:492] T a4e2586021c046dd8c5acd838bb5e83f P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:54.547279 2699 ts_tablet_manager.cc:1397] T a4e2586021c046dd8c5acd838bb5e83f P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.002s
I20250831 19:54:54.547948 2117 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:36958 (request call id 143) took 1335 ms. Trace:
I20250831 19:54:54.548249 2699 raft_consensus.cc:357] T a4e2586021c046dd8c5acd838bb5e83f P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:54.548415 2699 raft_consensus.cc:383] T a4e2586021c046dd8c5acd838bb5e83f P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:54.548491 2699 raft_consensus.cc:738] T a4e2586021c046dd8c5acd838bb5e83f P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:54.548077 2117 rpcz_store.cc:276] 0831 19:54:53.212373 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:53.979064 (+766691us) service_pool.cc:225] Handling call
0831 19:54:54.427330 (+448266us) catalog_manager.cc:2076] Acquired catalog manager lock
0831 19:54:54.427972 (+ 642us) catalog_manager.cc:2122] Created new table and tablet info
0831 19:54:54.541338 (+113366us) catalog_manager.cc:2148] Created new table in HMS catalog
0831 19:54:54.547684 (+ 6346us) catalog_manager.cc:2182] Wrote table and tablets to system table
0831 19:54:54.547790 (+ 106us) catalog_manager.cc:2216] Inserted table and tablets into CatalogManager maps
0831 19:54:54.547902 (+ 112us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:54.542070 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:54.542193 (+ 123us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:54.542202 (+ 9us) write_op.cc:435] Acquired schema lock
0831 19:54:54.542205 (+ 3us) tablet.cc:660] Decoding operations
0831 19:54:54.542314 (+ 109us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:54.542330 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:54.542336 (+ 6us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:54.542426 (+ 90us) tablet.cc:699] Row locks acquired
0831 19:54:54.542430 (+ 4us) write_op.cc:260] PREPARE: finished
0831 19:54:54.542473 (+ 43us) write_op.cc:270] Start()
0831 19:54:54.542512 (+ 39us) write_op.cc:276] Timestamp: P: 1756670094542430 usec, L: 0
0831 19:54:54.542516 (+ 4us) op_driver.cc:348] REPLICATION: starting
0831 19:54:54.542764 (+ 248us) log.cc:844] Serialized 433 byte log entry
0831 19:54:54.546990 (+ 4226us) op_driver.cc:464] REPLICATION: finished
0831 19:54:54.547134 (+ 144us) write_op.cc:301] APPLY: starting
0831 19:54:54.547151 (+ 17us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:54.547195 (+ 44us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:54.547227 (+ 32us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:54.547355 (+ 128us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:54.547392 (+ 37us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0831 19:54:54.547400 (+ 8us) write_op.cc:312] APPLY: finished
0831 19:54:54.547478 (+ 78us) log.cc:844] Serialized 29 byte log entry
0831 19:54:54.547565 (+ 87us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:54.547599 (+ 34us) write_op.cc:454] Released schema lock
0831 19:54:54.547608 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0831 19:54:54.547682 (+ 74us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:54.547686 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":94785,"Hive Metastore.run_cpu_time_us":269,"Hive Metastore.run_wall_time_us":18413,"spinlock_wait_cycles":41216,"child_traces":[["op",{"apply.queue_time_us":94,"apply.run_cpu_time_us":541,"apply.run_wall_time_us":540,"num_ops":2,"prepare.queue_time_us":41,"prepare.run_cpu_time_us":841,"prepare.run_wall_time_us":841,"raft.queue_time_us":452,"raft.run_cpu_time_us":239,"raft.run_wall_time_us":239,"replication_time_us":4445}]]}
I20250831 19:54:54.548681 2699 consensus_queue.cc:260] T a4e2586021c046dd8c5acd838bb5e83f P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:54.550678 2699 ts_tablet_manager.cc:1428] T a4e2586021c046dd8c5acd838bb5e83f P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20250831 19:54:54.550944 2699 tablet_bootstrap.cc:492] T 7afc8e9259a548fe946265ea513fde2f P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:54.555619 2699 tablet_bootstrap.cc:654] T 7afc8e9259a548fe946265ea513fde2f P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:54.557010 2856 tablet_bootstrap.cc:654] T 7afc8e9259a548fe946265ea513fde2f P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:54.566702 2117 catalog_manager.cc:5674] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237) does not have the latest schema for tablet 2a20faaf76fe4806b47e5ac80ccf5915 (table default.table_ca18962558654590b5d74892b4e00d0f [id=2cd4af6b415c4e3a92a3732fa145aa42]). Expected version 1 got 0
I20250831 19:54:54.566881 2118 catalog_manager.cc:2149] created HMS catalog entry for table [id=7d61ab3e027645ebb701e9f5c60c659e]
I20250831 19:54:54.567808 1614 tablet_service.cc:1468] Processing CreateTablet for tablet 43b456d5ee8d40e1a8999565cec2d230 (DEFAULT_TABLE table=default.table_c48f1c99f3174cb8acca698339447ed9 [id=f707909e6af44750a5fc5e3b15af0b24]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:54.568240 1614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43b456d5ee8d40e1a8999565cec2d230. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:54.569531 2117 catalog_manager.cc:5582] T 2a20faaf76fe4806b47e5ac80ccf5915 P de831f40fa1348a48a1f0260f4130197 reported cstate change: term changed from 0 to 1, leader changed from <none> to de831f40fa1348a48a1f0260f4130197 (127.1.1.194). New cstate: current_term: 1 leader_uuid: "de831f40fa1348a48a1f0260f4130197" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: UNKNOWN } } }
I20250831 19:54:54.569890 2117 catalog_manager.cc:5674] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475) does not have the latest schema for tablet 2a20faaf76fe4806b47e5ac80ccf5915 (table default.table_ca18962558654590b5d74892b4e00d0f [id=2cd4af6b415c4e3a92a3732fa145aa42]). Expected version 1 got 0
I20250831 19:54:54.574623 1751 tablet_service.cc:1468] Processing CreateTablet for tablet 43b456d5ee8d40e1a8999565cec2d230 (DEFAULT_TABLE table=default.table_c48f1c99f3174cb8acca698339447ed9 [id=f707909e6af44750a5fc5e3b15af0b24]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:54.575024 1751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43b456d5ee8d40e1a8999565cec2d230. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:54.574956 1883 tablet_service.cc:1468] Processing CreateTablet for tablet 43b456d5ee8d40e1a8999565cec2d230 (DEFAULT_TABLE table=default.table_c48f1c99f3174cb8acca698339447ed9 [id=f707909e6af44750a5fc5e3b15af0b24]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:54.575294 1883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43b456d5ee8d40e1a8999565cec2d230. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:54.580071 2123 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_28a8f98e8e534694b9e17ec734373e90" } modify_external_catalogs: true
I20250831 19:54:54.580526 2123 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_28a8f98e8e534694b9e17ec734373e90" } modify_external_catalogs: true
I20250831 19:54:54.591547 2118 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:36958 (request call id 147) took 1131 ms. Trace:
I20250831 19:54:54.591701 2118 rpcz_store.cc:276] 0831 19:54:53.460348 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:53.989906 (+529558us) service_pool.cc:225] Handling call
0831 19:54:54.427441 (+437535us) catalog_manager.cc:2076] Acquired catalog manager lock
0831 19:54:54.428115 (+ 674us) catalog_manager.cc:2122] Created new table and tablet info
0831 19:54:54.566812 (+138697us) catalog_manager.cc:2148] Created new table in HMS catalog
0831 19:54:54.591241 (+ 24429us) catalog_manager.cc:2182] Wrote table and tablets to system table
0831 19:54:54.591370 (+ 129us) catalog_manager.cc:2216] Inserted table and tablets into CatalogManager maps
0831 19:54:54.591489 (+ 119us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:54.577556 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:54.577671 (+ 115us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:54.577678 (+ 7us) write_op.cc:435] Acquired schema lock
0831 19:54:54.577681 (+ 3us) tablet.cc:660] Decoding operations
0831 19:54:54.577767 (+ 86us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:54.577778 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:54.577782 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:54.577849 (+ 67us) tablet.cc:699] Row locks acquired
0831 19:54:54.577852 (+ 3us) write_op.cc:260] PREPARE: finished
0831 19:54:54.577889 (+ 37us) write_op.cc:270] Start()
0831 19:54:54.577920 (+ 31us) write_op.cc:276] Timestamp: P: 1756670094577847 usec, L: 0
0831 19:54:54.577923 (+ 3us) op_driver.cc:348] REPLICATION: starting
0831 19:54:54.578097 (+ 174us) log.cc:844] Serialized 433 byte log entry
0831 19:54:54.590255 (+ 12158us) op_driver.cc:464] REPLICATION: finished
0831 19:54:54.590643 (+ 388us) write_op.cc:301] APPLY: starting
0831 19:54:54.590658 (+ 15us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:54.590701 (+ 43us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:54.590732 (+ 31us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:54.590828 (+ 96us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:54.590859 (+ 31us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0831 19:54:54.590866 (+ 7us) write_op.cc:312] APPLY: finished
0831 19:54:54.590932 (+ 66us) log.cc:844] Serialized 29 byte log entry
0831 19:54:54.591001 (+ 69us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:54.591018 (+ 17us) write_op.cc:454] Released schema lock
0831 19:54:54.591025 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0831 19:54:54.591092 (+ 67us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:54.591096 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":113079,"Hive Metastore.run_cpu_time_us":294,"Hive Metastore.run_wall_time_us":25302,"child_traces":[["op",{"apply.queue_time_us":337,"apply.run_cpu_time_us":444,"apply.run_wall_time_us":444,"num_ops":2,"prepare.queue_time_us":10102,"prepare.run_cpu_time_us":643,"prepare.run_wall_time_us":644,"raft.queue_time_us":562,"raft.run_cpu_time_us":4,"raft.run_wall_time_us":4,"replication_time_us":12303}]]}
I20250831 19:54:54.595353 2117 master_service.cc:948] ReplaceTablet: received request to replace tablet 6b61f7d06007437f803d400e73800415 from {username='slave'} at 127.0.0.1:36958
I20250831 19:54:54.599231 2118 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36958:
name: "default.Table_ba7cea85816c4b98a116ec6b7a569c98"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:54.602391 2282 tablet_bootstrap.cc:492] T 43b456d5ee8d40e1a8999565cec2d230 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:54.604020 2282 tablet_bootstrap.cc:654] T 43b456d5ee8d40e1a8999565cec2d230 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:54.606235 3018 raft_consensus.cc:491] T a4e2586021c046dd8c5acd838bb5e83f P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:54.606374 3018 raft_consensus.cc:513] T a4e2586021c046dd8c5acd838bb5e83f P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:54.607023 3018 leader_election.cc:290] T a4e2586021c046dd8c5acd838bb5e83f P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237)
I20250831 19:54:54.608547 1903 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a4e2586021c046dd8c5acd838bb5e83f" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:54.608747 1903 raft_consensus.cc:2466] T a4e2586021c046dd8c5acd838bb5e83f P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 0.
I20250831 19:54:54.609462 1769 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a4e2586021c046dd8c5acd838bb5e83f" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:54.609716 1769 raft_consensus.cc:2466] T a4e2586021c046dd8c5acd838bb5e83f P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 0.
I20250831 19:54:54.610217 1570 leader_election.cc:304] T a4e2586021c046dd8c5acd838bb5e83f P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:54.610788 3018 raft_consensus.cc:2802] T a4e2586021c046dd8c5acd838bb5e83f P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:54.610886 3018 raft_consensus.cc:491] T a4e2586021c046dd8c5acd838bb5e83f P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:54.610962 3018 raft_consensus.cc:3058] T a4e2586021c046dd8c5acd838bb5e83f P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:54.613678 2778 consensus_queue.cc:1035] T 9fc4297f4d704acda823360fe6d406cf P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:54.614161 3018 raft_consensus.cc:513] T a4e2586021c046dd8c5acd838bb5e83f P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:54.615124 1769 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a4e2586021c046dd8c5acd838bb5e83f" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197"
I20250831 19:54:54.615370 1769 raft_consensus.cc:3058] T a4e2586021c046dd8c5acd838bb5e83f P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:54.618642 1903 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a4e2586021c046dd8c5acd838bb5e83f" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:54:54.618876 1903 raft_consensus.cc:3058] T a4e2586021c046dd8c5acd838bb5e83f P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:54.621668 3018 leader_election.cc:290] T a4e2586021c046dd8c5acd838bb5e83f P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Requested vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237)
I20250831 19:54:54.622996 1769 raft_consensus.cc:2466] T a4e2586021c046dd8c5acd838bb5e83f P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1.
I20250831 19:54:54.623420 1570 leader_election.cc:304] T a4e2586021c046dd8c5acd838bb5e83f P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:54.623884 1903 raft_consensus.cc:2466] T a4e2586021c046dd8c5acd838bb5e83f P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1.
I20250831 19:54:54.624670 3018 raft_consensus.cc:2802] T a4e2586021c046dd8c5acd838bb5e83f P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:54.625949 3018 raft_consensus.cc:695] T a4e2586021c046dd8c5acd838bb5e83f P 89aa85d59c53436ebdf3074b13d14825 [term 1 LEADER]: Becoming Leader. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Running, Role: LEADER
I20250831 19:54:54.626509 3018 consensus_queue.cc:237] T a4e2586021c046dd8c5acd838bb5e83f P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:54.639108 2914 consensus_queue.cc:1035] T 9fc4297f4d704acda823360fe6d406cf P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:54.646322 2121 catalog_manager.cc:3460] renamed table default.table_ca18962558654590b5d74892b4e00d0f [id=2cd4af6b415c4e3a92a3732fa145aa42] in HMS: new name default.table_55404df7d7524c7cb6139cc53ec92877
I20250831 19:54:54.660240 2584 raft_consensus.cc:491] T c307e8673f164f509e0c5ebcfcc2a033 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:54.660434 2584 raft_consensus.cc:513] T c307e8673f164f509e0c5ebcfcc2a033 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:54.661171 2584 leader_election.cc:290] T c307e8673f164f509e0c5ebcfcc2a033 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197), 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237)
I20250831 19:54:54.662248 1632 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c307e8673f164f509e0c5ebcfcc2a033" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:54.662494 1632 raft_consensus.cc:2466] T c307e8673f164f509e0c5ebcfcc2a033 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 0.
I20250831 19:54:54.662607 1902 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c307e8673f164f509e0c5ebcfcc2a033" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:54.662828 1902 raft_consensus.cc:2466] T c307e8673f164f509e0c5ebcfcc2a033 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 0.
I20250831 19:54:54.663465 1706 leader_election.cc:304] T c307e8673f164f509e0c5ebcfcc2a033 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:54.664167 2584 raft_consensus.cc:2802] T c307e8673f164f509e0c5ebcfcc2a033 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:54.664284 2584 raft_consensus.cc:491] T c307e8673f164f509e0c5ebcfcc2a033 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:54.664373 2584 raft_consensus.cc:3058] T c307e8673f164f509e0c5ebcfcc2a033 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:54.667395 2584 raft_consensus.cc:513] T c307e8673f164f509e0c5ebcfcc2a033 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:54.668582 1632 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c307e8673f164f509e0c5ebcfcc2a033" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:54:54.668804 1632 raft_consensus.cc:3058] T c307e8673f164f509e0c5ebcfcc2a033 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:54.672042 1632 raft_consensus.cc:2466] T c307e8673f164f509e0c5ebcfcc2a033 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:54:54.672592 1706 leader_election.cc:304] T c307e8673f164f509e0c5ebcfcc2a033 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:54.672911 2943 raft_consensus.cc:2802] T c307e8673f164f509e0c5ebcfcc2a033 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:54.673035 2943 raft_consensus.cc:695] T c307e8673f164f509e0c5ebcfcc2a033 P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: Becoming Leader. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Running, Role: LEADER
I20250831 19:54:54.673288 2943 consensus_queue.cc:237] T c307e8673f164f509e0c5ebcfcc2a033 P de831f40fa1348a48a1f0260f4130197 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:54.677027 1902 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c307e8673f164f509e0c5ebcfcc2a033" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:54:54.677214 1902 raft_consensus.cc:3058] T c307e8673f164f509e0c5ebcfcc2a033 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:54.680473 1902 raft_consensus.cc:2466] T c307e8673f164f509e0c5ebcfcc2a033 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:54:54.681103 2584 leader_election.cc:290] T c307e8673f164f509e0c5ebcfcc2a033 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Requested vote from peers 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197), 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237)
I20250831 19:54:54.682427 2282 tablet_bootstrap.cc:492] T 43b456d5ee8d40e1a8999565cec2d230 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:54.682595 2282 ts_tablet_manager.cc:1397] T 43b456d5ee8d40e1a8999565cec2d230 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.080s user 0.006s sys 0.006s
I20250831 19:54:54.683336 2282 raft_consensus.cc:357] T 43b456d5ee8d40e1a8999565cec2d230 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:54.683534 2282 raft_consensus.cc:383] T 43b456d5ee8d40e1a8999565cec2d230 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:54.683635 2282 raft_consensus.cc:738] T 43b456d5ee8d40e1a8999565cec2d230 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:54.684134 2282 consensus_queue.cc:260] T 43b456d5ee8d40e1a8999565cec2d230 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:54.684634 2282 ts_tablet_manager.cc:1428] T 43b456d5ee8d40e1a8999565cec2d230 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
W20250831 19:54:54.686846 2955 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20250831 19:54:54.687849 2955 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20250831 19:54:54.687991 2955 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20250831 19:54:54.688822 2856 tablet_bootstrap.cc:492] T 7afc8e9259a548fe946265ea513fde2f P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:54.688975 2856 ts_tablet_manager.cc:1397] T 7afc8e9259a548fe946265ea513fde2f P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.155s user 0.012s sys 0.029s
I20250831 19:54:54.689656 2856 raft_consensus.cc:357] T 7afc8e9259a548fe946265ea513fde2f P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:54.689869 2856 raft_consensus.cc:383] T 7afc8e9259a548fe946265ea513fde2f P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:54.689939 2856 raft_consensus.cc:738] T 7afc8e9259a548fe946265ea513fde2f P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:54.690145 2856 consensus_queue.cc:260] T 7afc8e9259a548fe946265ea513fde2f P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:54.690600 2856 ts_tablet_manager.cc:1428] T 7afc8e9259a548fe946265ea513fde2f P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250831 19:54:54.690881 2856 tablet_bootstrap.cc:492] T eed712e77ad740ae95050fe589f3a61a P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:54.692365 2856 tablet_bootstrap.cc:654] T eed712e77ad740ae95050fe589f3a61a P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:54.700657 2699 tablet_bootstrap.cc:492] T 7afc8e9259a548fe946265ea513fde2f P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:54.700848 2699 ts_tablet_manager.cc:1397] T 7afc8e9259a548fe946265ea513fde2f P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.150s user 0.020s sys 0.031s
I20250831 19:54:54.701658 2699 raft_consensus.cc:357] T 7afc8e9259a548fe946265ea513fde2f P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:54.701846 2699 raft_consensus.cc:383] T 7afc8e9259a548fe946265ea513fde2f P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:54.701903 2699 raft_consensus.cc:738] T 7afc8e9259a548fe946265ea513fde2f P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:54.702135 2699 consensus_queue.cc:260] T 7afc8e9259a548fe946265ea513fde2f P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:54.702730 2699 ts_tablet_manager.cc:1428] T 7afc8e9259a548fe946265ea513fde2f P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250831 19:54:54.702996 2699 tablet_bootstrap.cc:492] T eed712e77ad740ae95050fe589f3a61a P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:54.704633 2699 tablet_bootstrap.cc:654] T eed712e77ad740ae95050fe589f3a61a P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:54.710361 2117 catalog_manager.cc:5869] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Sending DeleteTablet for 3 replicas of tablet 6b61f7d06007437f803d400e73800415
I20250831 19:54:54.710870 2117 catalog_manager.cc:6652] ReplaceTablet: tablet 6b61f7d06007437f803d400e73800415 deleted and replaced by tablet 2a0c12b9233244809b96121e034c029e
I20250831 19:54:54.712157 1614 tablet_service.cc:1515] Processing DeleteTablet for tablet 6b61f7d06007437f803d400e73800415 with delete_type TABLET_DATA_DELETED (replaced by tablet 2a0c12b9233244809b96121e034c029e) from {username='slave'} at 127.0.0.1:51022
I20250831 19:54:54.712445 1609 tablet_service.cc:1468] Processing CreateTablet for tablet 172f71a8fe554a5b8bfdb2a5bc109abc (DEFAULT_TABLE table=default.table_56778a4f18cc4ab29dfda4ed17259cc5 [id=7d61ab3e027645ebb701e9f5c60c659e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:54.712850 1609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 172f71a8fe554a5b8bfdb2a5bc109abc. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:54.713702 1883 tablet_service.cc:1515] Processing DeleteTablet for tablet 6b61f7d06007437f803d400e73800415 with delete_type TABLET_DATA_DELETED (replaced by tablet 2a0c12b9233244809b96121e034c029e) from {username='slave'} at 127.0.0.1:45906
I20250831 19:54:54.714438 2958 tablet_replica.cc:331] T 6b61f7d06007437f803d400e73800415 P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:54:54.714543 1884 tablet_service.cc:1468] Processing CreateTablet for tablet 172f71a8fe554a5b8bfdb2a5bc109abc (DEFAULT_TABLE table=default.table_56778a4f18cc4ab29dfda4ed17259cc5 [id=7d61ab3e027645ebb701e9f5c60c659e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:54.714643 2958 raft_consensus.cc:2241] T 6b61f7d06007437f803d400e73800415 P 2441fafe1d62429386f4631ad423567d [term 1 LEADER]: Raft consensus shutting down.
I20250831 19:54:54.714896 1884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 172f71a8fe554a5b8bfdb2a5bc109abc. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:54.714982 2958 raft_consensus.cc:2270] T 6b61f7d06007437f803d400e73800415 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus is shut down!
W20250831 19:54:54.715325 2955 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20250831 19:54:54.715402 2955 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20250831 19:54:54.715471 2955 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
I20250831 19:54:54.715468 2958 ts_tablet_manager.cc:1905] T 6b61f7d06007437f803d400e73800415 P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250831 19:54:54.715521 2955 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20250831 19:54:54.717501 2957 tablet_replica.cc:331] T 6b61f7d06007437f803d400e73800415 P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:54:54.717705 2957 raft_consensus.cc:2241] T 6b61f7d06007437f803d400e73800415 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:54.717901 2957 raft_consensus.cc:2270] T 6b61f7d06007437f803d400e73800415 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:54.718381 2957 ts_tablet_manager.cc:1905] T 6b61f7d06007437f803d400e73800415 P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:54.722901 2958 ts_tablet_manager.cc:1918] T 6b61f7d06007437f803d400e73800415 P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250831 19:54:54.723029 2958 log.cc:1199] T 6b61f7d06007437f803d400e73800415 P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/6b61f7d06007437f803d400e73800415
I20250831 19:54:54.723414 2958 ts_tablet_manager.cc:1939] T 6b61f7d06007437f803d400e73800415 P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:54:54.724414 2101 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet 6b61f7d06007437f803d400e73800415 (table default.table_af003c3f30c04853bc025b34d543d0e0 [id=5ce6c4d5dcd34d73af61fd2c4bf28799]) successfully deleted
I20250831 19:54:54.724831 2957 ts_tablet_manager.cc:1918] T 6b61f7d06007437f803d400e73800415 P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250831 19:54:54.724952 2957 log.cc:1199] T 6b61f7d06007437f803d400e73800415 P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/6b61f7d06007437f803d400e73800415
I20250831 19:54:54.725350 2957 ts_tablet_manager.cc:1939] T 6b61f7d06007437f803d400e73800415 P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
I20250831 19:54:54.726984 2282 tablet_bootstrap.cc:492] T 172f71a8fe554a5b8bfdb2a5bc109abc P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:54.728690 2282 tablet_bootstrap.cc:654] T 172f71a8fe554a5b8bfdb2a5bc109abc P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:54.729851 2104 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet 6b61f7d06007437f803d400e73800415 (table default.table_af003c3f30c04853bc025b34d543d0e0 [id=5ce6c4d5dcd34d73af61fd2c4bf28799]) successfully deleted
I20250831 19:54:54.730324 1883 tablet_service.cc:1468] Processing CreateTablet for tablet 2a0c12b9233244809b96121e034c029e (DEFAULT_TABLE table=default.table_af003c3f30c04853bc025b34d543d0e0 [id=5ce6c4d5dcd34d73af61fd2c4bf28799]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:54.730695 1883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a0c12b9233244809b96121e034c029e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:54.732092 2124 catalog_manager.cc:2706] deleted HMS catalog entry for table default.table_4e905daf26a044c38517f550bf5157f7 [id=29dc63d23c10406db017e396faefbe4c]
I20250831 19:54:54.733181 1609 tablet_service.cc:1468] Processing CreateTablet for tablet 2a0c12b9233244809b96121e034c029e (DEFAULT_TABLE table=default.table_af003c3f30c04853bc025b34d543d0e0 [id=5ce6c4d5dcd34d73af61fd2c4bf28799]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:54.733510 1609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a0c12b9233244809b96121e034c029e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:54.734580 2117 catalog_manager.cc:5582] T a4e2586021c046dd8c5acd838bb5e83f P 89aa85d59c53436ebdf3074b13d14825 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193). New cstate: current_term: 1 leader_uuid: "89aa85d59c53436ebdf3074b13d14825" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } }
W20250831 19:54:54.744422 2105 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.1.254:34259, user_credentials={real_user=slave}} blocked reactor thread for 50090.1us
I20250831 19:54:54.745054 1751 tablet_service.cc:1515] Processing DeleteTablet for tablet 6b61f7d06007437f803d400e73800415 with delete_type TABLET_DATA_DELETED (replaced by tablet 2a0c12b9233244809b96121e034c029e) from {username='slave'} at 127.0.0.1:50674
I20250831 19:54:54.745360 2959 tablet_replica.cc:331] T 6b61f7d06007437f803d400e73800415 P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:54:54.745546 1749 tablet_service.cc:1468] Processing CreateTablet for tablet 172f71a8fe554a5b8bfdb2a5bc109abc (DEFAULT_TABLE table=default.table_56778a4f18cc4ab29dfda4ed17259cc5 [id=7d61ab3e027645ebb701e9f5c60c659e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:54.745790 2959 raft_consensus.cc:2241] T 6b61f7d06007437f803d400e73800415 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:54.745997 2959 raft_consensus.cc:2270] T 6b61f7d06007437f803d400e73800415 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:54.746490 2959 ts_tablet_manager.cc:1905] T 6b61f7d06007437f803d400e73800415 P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:54.746004 1749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 172f71a8fe554a5b8bfdb2a5bc109abc. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:54.747864 2955 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.1.212:44077
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-0/wal
--hive_metastore_uris=thrift://127.0.0.1:46163
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.1.254:34259
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.1.254
--webserver_port=34345
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 06466b25e294b4d7d455e6c56263318dc34a80ef
build type FASTDEBUG
built by None at 31 Aug 2025 19:43:25 UTC on 24a791456cd2
build id 7836
ASAN enabled
W20250831 19:54:54.749743 2105 consensus_peers.cc:489] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 -> Peer 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259): Couldn't send request to peer 6c830f6055d64a3b8a9f78b405ad8aa3. Status: Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20250831 19:54:54.752285 2955 env_posix.cc:2264] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20250831 19:54:54.753726 1751 tablet_service.cc:1468] Processing CreateTablet for tablet 2a0c12b9233244809b96121e034c029e (DEFAULT_TABLE table=default.table_af003c3f30c04853bc025b34d543d0e0 [id=5ce6c4d5dcd34d73af61fd2c4bf28799]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:54.754108 1751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a0c12b9233244809b96121e034c029e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:54.754643 2955 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20250831 19:54:54.761652 2699 tablet_bootstrap.cc:492] T eed712e77ad740ae95050fe589f3a61a P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:54.761854 2699 ts_tablet_manager.cc:1397] T eed712e77ad740ae95050fe589f3a61a P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.059s user 0.005s sys 0.008s
I20250831 19:54:54.762719 2699 raft_consensus.cc:357] T eed712e77ad740ae95050fe589f3a61a P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:54.762957 2699 raft_consensus.cc:383] T eed712e77ad740ae95050fe589f3a61a P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:54.763051 2699 raft_consensus.cc:738] T eed712e77ad740ae95050fe589f3a61a P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:54.763353 2699 consensus_queue.cc:260] T eed712e77ad740ae95050fe589f3a61a P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:54.763597 2856 tablet_bootstrap.cc:492] T eed712e77ad740ae95050fe589f3a61a P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:54.763725 2856 ts_tablet_manager.cc:1397] T eed712e77ad740ae95050fe589f3a61a P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.073s user 0.006s sys 0.008s
I20250831 19:54:54.764456 2856 raft_consensus.cc:357] T eed712e77ad740ae95050fe589f3a61a P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:54.764556 2699 ts_tablet_manager.cc:1428] T eed712e77ad740ae95050fe589f3a61a P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20250831 19:54:54.764621 2856 raft_consensus.cc:383] T eed712e77ad740ae95050fe589f3a61a P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:54.764693 2856 raft_consensus.cc:738] T eed712e77ad740ae95050fe589f3a61a P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:54.764868 2856 consensus_queue.cc:260] T eed712e77ad740ae95050fe589f3a61a P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:54.765326 2856 ts_tablet_manager.cc:1428] T eed712e77ad740ae95050fe589f3a61a P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250831 19:54:54.765967 2856 tablet_bootstrap.cc:492] T 43b456d5ee8d40e1a8999565cec2d230 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:54.767568 2856 tablet_bootstrap.cc:654] T 43b456d5ee8d40e1a8999565cec2d230 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:54.768496 2699 tablet_bootstrap.cc:492] T 43b456d5ee8d40e1a8999565cec2d230 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:54.770807 2119 catalog_manager.cc:2149] created HMS catalog entry for table [id=003066b121574814b254d138ec66c64c]
I20250831 19:54:54.773415 1902 raft_consensus.cc:1273] T 2a20faaf76fe4806b47e5ac80ccf5915 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Refusing update from remote peer de831f40fa1348a48a1f0260f4130197: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250831 19:54:54.775156 2584 consensus_queue.cc:1035] T 2a20faaf76fe4806b47e5ac80ccf5915 P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:54.776202 1631 raft_consensus.cc:1273] T 2a20faaf76fe4806b47e5ac80ccf5915 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Refusing update from remote peer de831f40fa1348a48a1f0260f4130197: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250831 19:54:54.778270 2943 consensus_queue.cc:1035] T 2a20faaf76fe4806b47e5ac80ccf5915 P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:54.782896 2119 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:36958 (request call id 146) took 1346 ms. Trace:
I20250831 19:54:54.783051 2119 rpcz_store.cc:276] 0831 19:54:53.436544 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:53.983573 (+547029us) service_pool.cc:225] Handling call
0831 19:54:54.428718 (+445145us) catalog_manager.cc:2076] Acquired catalog manager lock
0831 19:54:54.429069 (+ 351us) catalog_manager.cc:2122] Created new table and tablet info
0831 19:54:54.770754 (+341685us) catalog_manager.cc:2148] Created new table in HMS catalog
0831 19:54:54.782640 (+ 11886us) catalog_manager.cc:2182] Wrote table and tablets to system table
0831 19:54:54.782747 (+ 107us) catalog_manager.cc:2216] Inserted table and tablets into CatalogManager maps
0831 19:54:54.782855 (+ 108us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:54.773341 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:54.773719 (+ 378us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:54.773727 (+ 8us) write_op.cc:435] Acquired schema lock
0831 19:54:54.773731 (+ 4us) tablet.cc:660] Decoding operations
0831 19:54:54.773879 (+ 148us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:54.773895 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:54.773903 (+ 8us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:54.773991 (+ 88us) tablet.cc:699] Row locks acquired
0831 19:54:54.773995 (+ 4us) write_op.cc:260] PREPARE: finished
0831 19:54:54.774033 (+ 38us) write_op.cc:270] Start()
0831 19:54:54.774068 (+ 35us) write_op.cc:276] Timestamp: P: 1756670094773969 usec, L: 0
0831 19:54:54.774073 (+ 5us) op_driver.cc:348] REPLICATION: starting
0831 19:54:54.774253 (+ 180us) log.cc:844] Serialized 433 byte log entry
0831 19:54:54.781923 (+ 7670us) op_driver.cc:464] REPLICATION: finished
0831 19:54:54.782047 (+ 124us) write_op.cc:301] APPLY: starting
0831 19:54:54.782062 (+ 15us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:54.782107 (+ 45us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:54.782139 (+ 32us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:54.782243 (+ 104us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:54.782278 (+ 35us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0831 19:54:54.782285 (+ 7us) write_op.cc:312] APPLY: finished
0831 19:54:54.782360 (+ 75us) log.cc:844] Serialized 29 byte log entry
0831 19:54:54.782433 (+ 73us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:54.782453 (+ 20us) write_op.cc:454] Released schema lock
0831 19:54:54.782460 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0831 19:54:54.782528 (+ 68us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:54.782532 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":302899,"Hive Metastore.run_cpu_time_us":260,"Hive Metastore.run_wall_time_us":38387,"child_traces":[["op",{"apply.queue_time_us":79,"apply.run_cpu_time_us":471,"apply.run_wall_time_us":470,"num_ops":2,"prepare.queue_time_us":1940,"prepare.run_cpu_time_us":841,"prepare.run_wall_time_us":1056,"raft.queue_time_us":407,"raft.run_cpu_time_us":237,"raft.run_wall_time_us":237,"replication_time_us":7821}]]}
I20250831 19:54:54.792657 2959 ts_tablet_manager.cc:1918] T 6b61f7d06007437f803d400e73800415 P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250831 19:54:54.793187 2959 log.cc:1199] T 6b61f7d06007437f803d400e73800415 P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/6b61f7d06007437f803d400e73800415
I20250831 19:54:54.801270 2119 catalog_manager.cc:5582] T c307e8673f164f509e0c5ebcfcc2a033 P de831f40fa1348a48a1f0260f4130197 reported cstate change: term changed from 0 to 1, leader changed from <none> to de831f40fa1348a48a1f0260f4130197 (127.1.1.194). New cstate: current_term: 1 leader_uuid: "de831f40fa1348a48a1f0260f4130197" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } }
I20250831 19:54:54.801602 1883 tablet_service.cc:1468] Processing CreateTablet for tablet 326c4af4214a4ea6a9ae784525758630 (DEFAULT_TABLE table=default.table_0498f784ecd944168cd0cbd019307408 [id=003066b121574814b254d138ec66c64c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:54.802047 1883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 326c4af4214a4ea6a9ae784525758630. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:54.802450 2896 consensus_queue.cc:1035] T b0d177e2e2f745b8969b65ab318321a1 P 2441fafe1d62429386f4631ad423567d [LEADER]: Connected to new peer: Peer: permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:54.802542 1609 tablet_service.cc:1468] Processing CreateTablet for tablet 326c4af4214a4ea6a9ae784525758630 (DEFAULT_TABLE table=default.table_0498f784ecd944168cd0cbd019307408 [id=003066b121574814b254d138ec66c64c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:54.802907 1609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 326c4af4214a4ea6a9ae784525758630. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:54.794560 2959 ts_tablet_manager.cc:1939] T 6b61f7d06007437f803d400e73800415 P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
I20250831 19:54:54.805531 2105 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet 6b61f7d06007437f803d400e73800415 (table default.table_af003c3f30c04853bc025b34d543d0e0 [id=5ce6c4d5dcd34d73af61fd2c4bf28799]) successfully deleted
I20250831 19:54:54.807911 1749 tablet_service.cc:1468] Processing CreateTablet for tablet 326c4af4214a4ea6a9ae784525758630 (DEFAULT_TABLE table=default.table_0498f784ecd944168cd0cbd019307408 [id=003066b121574814b254d138ec66c64c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:54.809080 1749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 326c4af4214a4ea6a9ae784525758630. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:54.810531 2119 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_35ecd102852d45ef82370764dbe230af" } modify_external_catalogs: true
I20250831 19:54:54.810726 2119 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_35ecd102852d45ef82370764dbe230af" } modify_external_catalogs: true
I20250831 19:54:54.816804 2117 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_ca70026c55be4e7a9db72440e0205619" } new_table_name: "default.Table_9e316239c779453a9a3a3b8b84d62adc" modify_external_catalogs: true
I20250831 19:54:54.818113 2992 consensus_queue.cc:1035] T b0d177e2e2f745b8969b65ab318321a1 P 2441fafe1d62429386f4631ad423567d [LEADER]: Connected to new peer: Peer: permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:54.818389 2856 tablet_bootstrap.cc:492] T 43b456d5ee8d40e1a8999565cec2d230 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:54.818548 2856 ts_tablet_manager.cc:1397] T 43b456d5ee8d40e1a8999565cec2d230 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.053s user 0.001s sys 0.009s
I20250831 19:54:54.819324 2856 raft_consensus.cc:357] T 43b456d5ee8d40e1a8999565cec2d230 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:54.819564 2856 raft_consensus.cc:383] T 43b456d5ee8d40e1a8999565cec2d230 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:54.819638 2856 raft_consensus.cc:738] T 43b456d5ee8d40e1a8999565cec2d230 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:54.819847 2856 consensus_queue.cc:260] T 43b456d5ee8d40e1a8999565cec2d230 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:54.820299 2282 tablet_bootstrap.cc:492] T 172f71a8fe554a5b8bfdb2a5bc109abc P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:54.820333 2856 ts_tablet_manager.cc:1428] T 43b456d5ee8d40e1a8999565cec2d230 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20250831 19:54:54.820426 2282 ts_tablet_manager.cc:1397] T 172f71a8fe554a5b8bfdb2a5bc109abc P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.094s user 0.021s sys 0.009s
I20250831 19:54:54.820618 2856 tablet_bootstrap.cc:492] T 2a0c12b9233244809b96121e034c029e P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:54.821076 2282 raft_consensus.cc:357] T 172f71a8fe554a5b8bfdb2a5bc109abc P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:54.821238 2282 raft_consensus.cc:383] T 172f71a8fe554a5b8bfdb2a5bc109abc P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:54.821301 2282 raft_consensus.cc:738] T 172f71a8fe554a5b8bfdb2a5bc109abc P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:54.821507 2282 consensus_queue.cc:260] T 172f71a8fe554a5b8bfdb2a5bc109abc P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:54.822211 2856 tablet_bootstrap.cc:654] T 2a0c12b9233244809b96121e034c029e P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:54.822247 2282 ts_tablet_manager.cc:1428] T 172f71a8fe554a5b8bfdb2a5bc109abc P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250831 19:54:54.822503 2282 tablet_bootstrap.cc:492] T 2a0c12b9233244809b96121e034c029e P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:54.824920 2282 tablet_bootstrap.cc:654] T 2a0c12b9233244809b96121e034c029e P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:54.840598 2699 tablet_bootstrap.cc:654] T 43b456d5ee8d40e1a8999565cec2d230 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:54.848929 2584 raft_consensus.cc:491] T 27a32ae2ed1a4b94b1a2e6a9aa9d0d8c P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:54.849095 2584 raft_consensus.cc:513] T 27a32ae2ed1a4b94b1a2e6a9aa9d0d8c P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:54.850122 2584 leader_election.cc:290] T 27a32ae2ed1a4b94b1a2e6a9aa9d0d8c P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197), 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237)
I20250831 19:54:54.851552 1903 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "27a32ae2ed1a4b94b1a2e6a9aa9d0d8c" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:54.851819 1903 raft_consensus.cc:2466] T 27a32ae2ed1a4b94b1a2e6a9aa9d0d8c P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 0.
I20250831 19:54:54.852583 1705 leader_election.cc:304] T 27a32ae2ed1a4b94b1a2e6a9aa9d0d8c P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:54.853048 2584 raft_consensus.cc:2802] T 27a32ae2ed1a4b94b1a2e6a9aa9d0d8c P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:54.853139 2584 raft_consensus.cc:491] T 27a32ae2ed1a4b94b1a2e6a9aa9d0d8c P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:54.853231 2584 raft_consensus.cc:3058] T 27a32ae2ed1a4b94b1a2e6a9aa9d0d8c P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:54.855726 2584 raft_consensus.cc:513] T 27a32ae2ed1a4b94b1a2e6a9aa9d0d8c P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:54.856878 1633 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "27a32ae2ed1a4b94b1a2e6a9aa9d0d8c" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:54:54.857088 1633 raft_consensus.cc:3058] T 27a32ae2ed1a4b94b1a2e6a9aa9d0d8c P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
W20250831 19:54:54.860175 3060 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250831 19:54:54.860759 1633 raft_consensus.cc:2466] T 27a32ae2ed1a4b94b1a2e6a9aa9d0d8c P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:54:54.861965 1706 leader_election.cc:304] T 27a32ae2ed1a4b94b1a2e6a9aa9d0d8c P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:54.862221 2943 raft_consensus.cc:2802] T 27a32ae2ed1a4b94b1a2e6a9aa9d0d8c P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:54.862337 2943 raft_consensus.cc:695] T 27a32ae2ed1a4b94b1a2e6a9aa9d0d8c P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: Becoming Leader. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Running, Role: LEADER
I20250831 19:54:54.862576 2943 consensus_queue.cc:237] T 27a32ae2ed1a4b94b1a2e6a9aa9d0d8c P de831f40fa1348a48a1f0260f4130197 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:54.864635 1632 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "27a32ae2ed1a4b94b1a2e6a9aa9d0d8c" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:54.864853 1632 raft_consensus.cc:2374] T 27a32ae2ed1a4b94b1a2e6a9aa9d0d8c P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1. Re-sending same reply.
I20250831 19:54:54.866333 1903 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "27a32ae2ed1a4b94b1a2e6a9aa9d0d8c" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:54:54.866547 1903 raft_consensus.cc:3058] T 27a32ae2ed1a4b94b1a2e6a9aa9d0d8c P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:54.867571 2120 catalog_manager.cc:2149] created HMS catalog entry for table [id=3ce07674f6334eb0a2a5fe731a620e25]
I20250831 19:54:54.869269 1903 raft_consensus.cc:2466] T 27a32ae2ed1a4b94b1a2e6a9aa9d0d8c P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:54:54.872131 2584 leader_election.cc:290] T 27a32ae2ed1a4b94b1a2e6a9aa9d0d8c P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Requested vote from peers 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197), 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237)
I20250831 19:54:54.873481 2120 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:36958 (request call id 148) took 1399 ms. Trace:
I20250831 19:54:54.873628 2120 rpcz_store.cc:276] 0831 19:54:53.474233 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:54.243543 (+769310us) service_pool.cc:225] Handling call
0831 19:54:54.429493 (+185950us) catalog_manager.cc:2076] Acquired catalog manager lock
0831 19:54:54.429844 (+ 351us) catalog_manager.cc:2122] Created new table and tablet info
0831 19:54:54.867497 (+437653us) catalog_manager.cc:2148] Created new table in HMS catalog
0831 19:54:54.873130 (+ 5633us) catalog_manager.cc:2182] Wrote table and tablets to system table
0831 19:54:54.873279 (+ 149us) catalog_manager.cc:2216] Inserted table and tablets into CatalogManager maps
0831 19:54:54.873399 (+ 120us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:54.868521 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:54.868648 (+ 127us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:54.868657 (+ 9us) write_op.cc:435] Acquired schema lock
0831 19:54:54.868662 (+ 5us) tablet.cc:660] Decoding operations
0831 19:54:54.868798 (+ 136us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:54.868815 (+ 17us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:54.868830 (+ 15us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:54.868944 (+ 114us) tablet.cc:699] Row locks acquired
0831 19:54:54.868947 (+ 3us) write_op.cc:260] PREPARE: finished
0831 19:54:54.868988 (+ 41us) write_op.cc:270] Start()
0831 19:54:54.869028 (+ 40us) write_op.cc:276] Timestamp: P: 1756670094868914 usec, L: 0
0831 19:54:54.869033 (+ 5us) op_driver.cc:348] REPLICATION: starting
0831 19:54:54.869245 (+ 212us) log.cc:844] Serialized 433 byte log entry
0831 19:54:54.872266 (+ 3021us) op_driver.cc:464] REPLICATION: finished
0831 19:54:54.872406 (+ 140us) write_op.cc:301] APPLY: starting
0831 19:54:54.872425 (+ 19us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:54.872478 (+ 53us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:54.872514 (+ 36us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:54.872657 (+ 143us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:54.872700 (+ 43us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0831 19:54:54.872711 (+ 11us) write_op.cc:312] APPLY: finished
0831 19:54:54.872793 (+ 82us) log.cc:844] Serialized 29 byte log entry
0831 19:54:54.872873 (+ 80us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:54.872897 (+ 24us) write_op.cc:454] Released schema lock
0831 19:54:54.872904 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0831 19:54:54.872979 (+ 75us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:54.872985 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":340583,"Hive Metastore.run_cpu_time_us":277,"Hive Metastore.run_wall_time_us":96782,"child_traces":[["op",{"apply.queue_time_us":88,"apply.run_cpu_time_us":561,"apply.run_wall_time_us":560,"num_ops":2,"prepare.queue_time_us":240,"prepare.run_cpu_time_us":856,"prepare.run_wall_time_us":856,"raft.queue_time_us":457,"raft.run_cpu_time_us":282,"raft.run_wall_time_us":282,"replication_time_us":3200}]]}
I20250831 19:54:54.874612 2120 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_d30c0aaa2c2a465ca2999246bdd68e5f" } new_table_name: "default.Table_4e12fc12cae640b99d4f3794151b6915" modify_external_catalogs: true
I20250831 19:54:54.879081 2992 consensus_queue.cc:1035] T bde481a8e8fc4b1f82453a4e50ded47c P 2441fafe1d62429386f4631ad423567d [LEADER]: Connected to new peer: Peer: permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:54.886232 2896 consensus_queue.cc:1035] T bde481a8e8fc4b1f82453a4e50ded47c P 2441fafe1d62429386f4631ad423567d [LEADER]: Connected to new peer: Peer: permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:54.889197 1883 tablet_service.cc:1468] Processing CreateTablet for tablet 65026496c5b14baab6f66dce4a6d0fc2 (DEFAULT_TABLE table=default.table_62a803bf234d4af29aa61db8fba3d765 [id=3ce07674f6334eb0a2a5fe731a620e25]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:54.889667 1883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65026496c5b14baab6f66dce4a6d0fc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:54.889757 1609 tablet_service.cc:1468] Processing CreateTablet for tablet 65026496c5b14baab6f66dce4a6d0fc2 (DEFAULT_TABLE table=default.table_62a803bf234d4af29aa61db8fba3d765 [id=3ce07674f6334eb0a2a5fe731a620e25]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:54.890182 1609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65026496c5b14baab6f66dce4a6d0fc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:54.893951 1751 tablet_service.cc:1468] Processing CreateTablet for tablet 65026496c5b14baab6f66dce4a6d0fc2 (DEFAULT_TABLE table=default.table_62a803bf234d4af29aa61db8fba3d765 [id=3ce07674f6334eb0a2a5fe731a620e25]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:54.894328 1751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65026496c5b14baab6f66dce4a6d0fc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:54.912117 2914 consensus_queue.cc:1035] T c1ccea09b6c34c52a9212a5a481c80f7 P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:54.942734 2699 tablet_bootstrap.cc:492] T 43b456d5ee8d40e1a8999565cec2d230 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:54.949692 2699 ts_tablet_manager.cc:1397] T 43b456d5ee8d40e1a8999565cec2d230 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.185s user 0.004s sys 0.000s
I20250831 19:54:54.950759 2699 raft_consensus.cc:357] T 43b456d5ee8d40e1a8999565cec2d230 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:54.951042 2699 raft_consensus.cc:383] T 43b456d5ee8d40e1a8999565cec2d230 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:54.951157 2699 raft_consensus.cc:738] T 43b456d5ee8d40e1a8999565cec2d230 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:54.951568 2699 consensus_queue.cc:260] T 43b456d5ee8d40e1a8999565cec2d230 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:54.953941 2699 ts_tablet_manager.cc:1428] T 43b456d5ee8d40e1a8999565cec2d230 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20250831 19:54:54.955624 2699 tablet_bootstrap.cc:492] T 172f71a8fe554a5b8bfdb2a5bc109abc P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:54.957731 2699 tablet_bootstrap.cc:654] T 172f71a8fe554a5b8bfdb2a5bc109abc P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:54.966729 2856 tablet_bootstrap.cc:492] T 2a0c12b9233244809b96121e034c029e P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:54.966879 2856 ts_tablet_manager.cc:1397] T 2a0c12b9233244809b96121e034c029e P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.146s user 0.018s sys 0.009s
I20250831 19:54:54.967653 2856 raft_consensus.cc:357] T 2a0c12b9233244809b96121e034c029e P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:54.967731 3018 consensus_queue.cc:1035] T 5b6497a1ef3d4c5b84dc2bbbbfafd586 P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:54.967839 2856 raft_consensus.cc:383] T 2a0c12b9233244809b96121e034c029e P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:54.967917 2856 raft_consensus.cc:738] T 2a0c12b9233244809b96121e034c029e P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:54.968192 2856 consensus_queue.cc:260] T 2a0c12b9233244809b96121e034c029e P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:54.968819 2856 ts_tablet_manager.cc:1428] T 2a0c12b9233244809b96121e034c029e P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250831 19:54:54.969740 2856 tablet_bootstrap.cc:492] T 172f71a8fe554a5b8bfdb2a5bc109abc P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:54.971316 2856 tablet_bootstrap.cc:654] T 172f71a8fe554a5b8bfdb2a5bc109abc P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:54.977661 3067 tablet.cc:1722] T 2a20faaf76fe4806b47e5ac80ccf5915 P de831f40fa1348a48a1f0260f4130197: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:54.994484 3070 tablet.cc:1722] T 2a20faaf76fe4806b47e5ac80ccf5915 P 89aa85d59c53436ebdf3074b13d14825: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:54.979851 2584 consensus_queue.cc:1035] T c1ccea09b6c34c52a9212a5a481c80f7 P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:54.998225 2856 tablet_bootstrap.cc:492] T 172f71a8fe554a5b8bfdb2a5bc109abc P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:54.999009 2856 ts_tablet_manager.cc:1397] T 172f71a8fe554a5b8bfdb2a5bc109abc P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.030s user 0.000s sys 0.004s
I20250831 19:54:54.999778 2856 raft_consensus.cc:357] T 172f71a8fe554a5b8bfdb2a5bc109abc P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:54.999954 2856 raft_consensus.cc:383] T 172f71a8fe554a5b8bfdb2a5bc109abc P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:55.000020 2856 raft_consensus.cc:738] T 172f71a8fe554a5b8bfdb2a5bc109abc P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:55.000241 2856 consensus_queue.cc:260] T 172f71a8fe554a5b8bfdb2a5bc109abc P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:55.000691 2856 ts_tablet_manager.cc:1428] T 172f71a8fe554a5b8bfdb2a5bc109abc P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20250831 19:54:55.000954 2856 tablet_bootstrap.cc:492] T 65026496c5b14baab6f66dce4a6d0fc2 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:55.003140 2856 tablet_bootstrap.cc:654] T 65026496c5b14baab6f66dce4a6d0fc2 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:55.023113 2856 tablet_bootstrap.cc:492] T 65026496c5b14baab6f66dce4a6d0fc2 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:55.023265 2856 ts_tablet_manager.cc:1397] T 65026496c5b14baab6f66dce4a6d0fc2 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.022s user 0.000s sys 0.004s
I20250831 19:54:55.024102 2856 raft_consensus.cc:357] T 65026496c5b14baab6f66dce4a6d0fc2 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:55.024257 2856 raft_consensus.cc:383] T 65026496c5b14baab6f66dce4a6d0fc2 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:55.024343 2856 raft_consensus.cc:738] T 65026496c5b14baab6f66dce4a6d0fc2 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:55.026098 2126 catalog_manager.cc:2706] deleted HMS catalog entry for table default.table_60746664f3ef4d82866e4bcd56d4fac5 [id=0850f2b0e9324dd0a210fa7b2609c769]
I20250831 19:54:55.026403 2856 consensus_queue.cc:260] T 65026496c5b14baab6f66dce4a6d0fc2 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:55.027585 2856 ts_tablet_manager.cc:1428] T 65026496c5b14baab6f66dce4a6d0fc2 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.004s user 0.000s sys 0.001s
I20250831 19:54:55.037775 2282 tablet_bootstrap.cc:492] T 2a0c12b9233244809b96121e034c029e P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:55.037925 2282 ts_tablet_manager.cc:1397] T 2a0c12b9233244809b96121e034c029e P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.215s user 0.031s sys 0.049s
I20250831 19:54:55.038576 2856 tablet_bootstrap.cc:492] T 326c4af4214a4ea6a9ae784525758630 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:55.038650 2282 raft_consensus.cc:357] T 2a0c12b9233244809b96121e034c029e P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:55.038837 2282 raft_consensus.cc:383] T 2a0c12b9233244809b96121e034c029e P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:55.038910 2282 raft_consensus.cc:738] T 2a0c12b9233244809b96121e034c029e P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:55.039551 2282 consensus_queue.cc:260] T 2a0c12b9233244809b96121e034c029e P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:55.042079 2282 ts_tablet_manager.cc:1428] T 2a0c12b9233244809b96121e034c029e P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20250831 19:54:55.042371 2282 tablet_bootstrap.cc:492] T 326c4af4214a4ea6a9ae784525758630 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:55.043053 2856 tablet_bootstrap.cc:654] T 326c4af4214a4ea6a9ae784525758630 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:55.044330 2282 tablet_bootstrap.cc:654] T 326c4af4214a4ea6a9ae784525758630 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:55.053160 2282 tablet_bootstrap.cc:492] T 326c4af4214a4ea6a9ae784525758630 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:55.053325 2282 ts_tablet_manager.cc:1397] T 326c4af4214a4ea6a9ae784525758630 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.001s
I20250831 19:54:55.054297 2282 raft_consensus.cc:357] T 326c4af4214a4ea6a9ae784525758630 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:55.054517 2282 raft_consensus.cc:383] T 326c4af4214a4ea6a9ae784525758630 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:55.054633 2282 raft_consensus.cc:738] T 326c4af4214a4ea6a9ae784525758630 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:55.054874 2282 consensus_queue.cc:260] T 326c4af4214a4ea6a9ae784525758630 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:55.055408 2282 ts_tablet_manager.cc:1428] T 326c4af4214a4ea6a9ae784525758630 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20250831 19:54:55.055732 2282 tablet_bootstrap.cc:492] T 65026496c5b14baab6f66dce4a6d0fc2 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:55.058422 2282 tablet_bootstrap.cc:654] T 65026496c5b14baab6f66dce4a6d0fc2 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:55.070948 2584 raft_consensus.cc:491] T 7afc8e9259a548fe946265ea513fde2f P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:55.071127 2584 raft_consensus.cc:513] T 7afc8e9259a548fe946265ea513fde2f P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:55.072152 1633 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7afc8e9259a548fe946265ea513fde2f" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:55.072237 2584 leader_election.cc:290] T 7afc8e9259a548fe946265ea513fde2f P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197), 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237)
I20250831 19:54:55.072384 1633 raft_consensus.cc:2466] T 7afc8e9259a548fe946265ea513fde2f P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 0.
I20250831 19:54:54.980356 3068 tablet.cc:1722] T 2a20faaf76fe4806b47e5ac80ccf5915 P 2441fafe1d62429386f4631ad423567d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:55.072811 1706 leader_election.cc:304] T 7afc8e9259a548fe946265ea513fde2f P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:55.073307 2584 raft_consensus.cc:2802] T 7afc8e9259a548fe946265ea513fde2f P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:55.073483 2584 raft_consensus.cc:491] T 7afc8e9259a548fe946265ea513fde2f P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:55.073582 2584 raft_consensus.cc:3058] T 7afc8e9259a548fe946265ea513fde2f P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:55.073578 3018 raft_consensus.cc:491] T 43b456d5ee8d40e1a8999565cec2d230 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:55.073702 3018 raft_consensus.cc:513] T 43b456d5ee8d40e1a8999565cec2d230 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:55.074417 3018 leader_election.cc:290] T 43b456d5ee8d40e1a8999565cec2d230 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:55.075134 1906 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "43b456d5ee8d40e1a8999565cec2d230" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:55.075662 1906 raft_consensus.cc:2466] T 43b456d5ee8d40e1a8999565cec2d230 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 0.
I20250831 19:54:55.076038 1568 leader_election.cc:304] T 43b456d5ee8d40e1a8999565cec2d230 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:54:55.076329 3018 raft_consensus.cc:2802] T 43b456d5ee8d40e1a8999565cec2d230 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:55.075889 1771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "43b456d5ee8d40e1a8999565cec2d230" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:55.076449 3018 raft_consensus.cc:491] T 43b456d5ee8d40e1a8999565cec2d230 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:55.076550 3018 raft_consensus.cc:3058] T 43b456d5ee8d40e1a8999565cec2d230 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:55.076647 1771 raft_consensus.cc:2466] T 43b456d5ee8d40e1a8999565cec2d230 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 0.
I20250831 19:54:55.080510 3018 raft_consensus.cc:513] T 43b456d5ee8d40e1a8999565cec2d230 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:55.081785 3018 leader_election.cc:290] T 43b456d5ee8d40e1a8999565cec2d230 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Requested vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:55.081962 2995 consensus_queue.cc:1035] T 5b6497a1ef3d4c5b84dc2bbbbfafd586 P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:55.089461 1903 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "43b456d5ee8d40e1a8999565cec2d230" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:54:55.089656 1903 raft_consensus.cc:3058] T 43b456d5ee8d40e1a8999565cec2d230 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:55.092237 1771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "43b456d5ee8d40e1a8999565cec2d230" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197"
I20250831 19:54:55.092670 1771 raft_consensus.cc:3058] T 43b456d5ee8d40e1a8999565cec2d230 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:55.096418 1904 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7afc8e9259a548fe946265ea513fde2f" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:55.096910 1904 raft_consensus.cc:2466] T 7afc8e9259a548fe946265ea513fde2f P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 0.
I20250831 19:54:55.101151 2943 consensus_queue.cc:1035] T f3ea6c8b0bf64d8b86dc96dc1abe0934 P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:55.106578 2856 tablet_bootstrap.cc:492] T 326c4af4214a4ea6a9ae784525758630 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:55.076050 2584 raft_consensus.cc:513] T 7afc8e9259a548fe946265ea513fde2f P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:55.108840 1633 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7afc8e9259a548fe946265ea513fde2f" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:54:55.109018 1633 raft_consensus.cc:3058] T 7afc8e9259a548fe946265ea513fde2f P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:55.111495 1633 raft_consensus.cc:2466] T 7afc8e9259a548fe946265ea513fde2f P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:54:55.106602 1903 raft_consensus.cc:2466] T 43b456d5ee8d40e1a8999565cec2d230 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1.
I20250831 19:54:55.116155 1568 leader_election.cc:304] T 43b456d5ee8d40e1a8999565cec2d230 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:54:55.116552 3018 raft_consensus.cc:2802] T 43b456d5ee8d40e1a8999565cec2d230 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election won for term 1
W20250831 19:54:55.120849 3063 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250831 19:54:55.122911 2699 tablet_bootstrap.cc:492] T 172f71a8fe554a5b8bfdb2a5bc109abc P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:55.123225 3018 raft_consensus.cc:695] T 43b456d5ee8d40e1a8999565cec2d230 P 89aa85d59c53436ebdf3074b13d14825 [term 1 LEADER]: Becoming Leader. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Running, Role: LEADER
I20250831 19:54:55.123347 3081 raft_consensus.cc:491] T 326c4af4214a4ea6a9ae784525758630 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:55.123481 3081 raft_consensus.cc:513] T 326c4af4214a4ea6a9ae784525758630 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:55.123593 3018 consensus_queue.cc:237] T 43b456d5ee8d40e1a8999565cec2d230 P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:55.124233 3081 leader_election.cc:290] T 326c4af4214a4ea6a9ae784525758630 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:55.124413 2699 ts_tablet_manager.cc:1397] T 172f71a8fe554a5b8bfdb2a5bc109abc P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.169s user 0.005s sys 0.000s
I20250831 19:54:55.125231 2699 raft_consensus.cc:357] T 172f71a8fe554a5b8bfdb2a5bc109abc P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:55.125398 2699 raft_consensus.cc:383] T 172f71a8fe554a5b8bfdb2a5bc109abc P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:55.125507 2699 raft_consensus.cc:738] T 172f71a8fe554a5b8bfdb2a5bc109abc P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:55.125768 1903 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "326c4af4214a4ea6a9ae784525758630" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
W20250831 19:54:55.126423 1568 leader_election.cc:343] T 326c4af4214a4ea6a9ae784525758630 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): Illegal state: must be running to vote when last-logged opid is not known
I20250831 19:54:55.126873 2282 tablet_bootstrap.cc:492] T 65026496c5b14baab6f66dce4a6d0fc2 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:55.128865 2856 ts_tablet_manager.cc:1397] T 326c4af4214a4ea6a9ae784525758630 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.070s user 0.003s sys 0.003s
I20250831 19:54:55.129244 1706 leader_election.cc:304] T 7afc8e9259a548fe946265ea513fde2f P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:55.129418 2282 ts_tablet_manager.cc:1397] T 65026496c5b14baab6f66dce4a6d0fc2 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.073s user 0.034s sys 0.032s
I20250831 19:54:55.130056 2943 raft_consensus.cc:2802] T 7afc8e9259a548fe946265ea513fde2f P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:55.130198 2943 raft_consensus.cc:695] T 7afc8e9259a548fe946265ea513fde2f P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: Becoming Leader. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Running, Role: LEADER
I20250831 19:54:55.130643 2943 consensus_queue.cc:237] T 7afc8e9259a548fe946265ea513fde2f P de831f40fa1348a48a1f0260f4130197 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:54:55.131182 2282 raft_consensus.cc:357] T 65026496c5b14baab6f66dce4a6d0fc2 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:55.131381 2282 raft_consensus.cc:383] T 65026496c5b14baab6f66dce4a6d0fc2 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:55.131490 2282 raft_consensus.cc:738] T 65026496c5b14baab6f66dce4a6d0fc2 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:55.131862 2282 consensus_queue.cc:260] T 65026496c5b14baab6f66dce4a6d0fc2 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:55.132616 2282 ts_tablet_manager.cc:1428] T 65026496c5b14baab6f66dce4a6d0fc2 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20250831 19:54:55.140733 2856 raft_consensus.cc:357] T 326c4af4214a4ea6a9ae784525758630 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:55.141764 2856 raft_consensus.cc:383] T 326c4af4214a4ea6a9ae784525758630 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:55.141896 2856 raft_consensus.cc:738] T 326c4af4214a4ea6a9ae784525758630 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:55.142345 1771 raft_consensus.cc:2466] T 43b456d5ee8d40e1a8999565cec2d230 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1.
I20250831 19:54:55.142338 2955 server_base.cc:1047] running on GCE node
I20250831 19:54:55.142956 2125 catalog_manager.cc:2149] created HMS catalog entry for table [id=416489b351d443ebb067fa9b8625e63e]
I20250831 19:54:55.142997 2856 consensus_queue.cc:260] T 326c4af4214a4ea6a9ae784525758630 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:55.143786 1769 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "326c4af4214a4ea6a9ae784525758630" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:55.143967 1769 raft_consensus.cc:2466] T 326c4af4214a4ea6a9ae784525758630 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 0.
I20250831 19:54:55.144049 2856 ts_tablet_manager.cc:1428] T 326c4af4214a4ea6a9ae784525758630 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.015s user 0.001s sys 0.001s
I20250831 19:54:55.144317 1570 leader_election.cc:304] T 326c4af4214a4ea6a9ae784525758630 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197; no voters: 2441fafe1d62429386f4631ad423567d
I20250831 19:54:55.144577 3018 raft_consensus.cc:2802] T 326c4af4214a4ea6a9ae784525758630 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:55.144647 2584 leader_election.cc:290] T 7afc8e9259a548fe946265ea513fde2f P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Requested vote from peers 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197), 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237)
I20250831 19:54:55.144685 3018 raft_consensus.cc:491] T 326c4af4214a4ea6a9ae784525758630 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:55.144762 3018 raft_consensus.cc:3058] T 326c4af4214a4ea6a9ae784525758630 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:55.144905 1903 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7afc8e9259a548fe946265ea513fde2f" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:54:55.145129 1903 raft_consensus.cc:3058] T 7afc8e9259a548fe946265ea513fde2f P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:55.147128 3018 raft_consensus.cc:513] T 326c4af4214a4ea6a9ae784525758630 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:55.148545 2125 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:36958 (request call id 149) took 1580 ms. Trace:
I20250831 19:54:55.148869 1769 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "326c4af4214a4ea6a9ae784525758630" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197"
I20250831 19:54:55.148650 2125 rpcz_store.cc:276] 0831 19:54:53.568509 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:54.254781 (+686272us) service_pool.cc:225] Handling call
0831 19:54:54.430493 (+175712us) catalog_manager.cc:2076] Acquired catalog manager lock
0831 19:54:54.430843 (+ 350us) catalog_manager.cc:2122] Created new table and tablet info
0831 19:54:55.142918 (+712075us) catalog_manager.cc:2148] Created new table in HMS catalog
0831 19:54:55.148278 (+ 5360us) catalog_manager.cc:2182] Wrote table and tablets to system table
0831 19:54:55.148384 (+ 106us) catalog_manager.cc:2216] Inserted table and tablets into CatalogManager maps
0831 19:54:55.148489 (+ 105us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:55.143785 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:55.143903 (+ 118us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:55.143908 (+ 5us) write_op.cc:435] Acquired schema lock
0831 19:54:55.143911 (+ 3us) tablet.cc:660] Decoding operations
0831 19:54:55.144002 (+ 91us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:55.144016 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:55.144021 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:55.144105 (+ 84us) tablet.cc:699] Row locks acquired
0831 19:54:55.144107 (+ 2us) write_op.cc:260] PREPARE: finished
0831 19:54:55.144143 (+ 36us) write_op.cc:270] Start()
0831 19:54:55.144181 (+ 38us) write_op.cc:276] Timestamp: P: 1756670095144095 usec, L: 0
0831 19:54:55.144188 (+ 7us) op_driver.cc:348] REPLICATION: starting
0831 19:54:55.144425 (+ 237us) log.cc:844] Serialized 433 byte log entry
0831 19:54:55.147159 (+ 2734us) op_driver.cc:464] REPLICATION: finished
0831 19:54:55.147285 (+ 126us) write_op.cc:301] APPLY: starting
0831 19:54:55.147299 (+ 14us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:55.147342 (+ 43us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:55.147370 (+ 28us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:55.147488 (+ 118us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:55.147522 (+ 34us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0831 19:54:55.147552 (+ 30us) write_op.cc:312] APPLY: finished
0831 19:54:55.147652 (+ 100us) log.cc:844] Serialized 29 byte log entry
0831 19:54:55.147714 (+ 62us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:55.147734 (+ 20us) write_op.cc:454] Released schema lock
0831 19:54:55.147740 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0831 19:54:55.147813 (+ 73us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:55.147816 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":594937,"Hive Metastore.run_cpu_time_us":257,"Hive Metastore.run_wall_time_us":116941,"child_traces":[["op",{"apply.queue_time_us":79,"apply.run_cpu_time_us":519,"apply.run_wall_time_us":518,"num_ops":2,"prepare.queue_time_us":69,"prepare.run_cpu_time_us":751,"prepare.run_wall_time_us":751,"raft.queue_time_us":421,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":234,"replication_time_us":2942}]]}
I20250831 19:54:55.149235 1769 raft_consensus.cc:3058] T 326c4af4214a4ea6a9ae784525758630 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:55.149977 3018 leader_election.cc:290] T 326c4af4214a4ea6a9ae784525758630 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Requested vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:55.151145 2125 catalog_manager.cc:5674] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197) does not have the latest schema for tablet 2a20faaf76fe4806b47e5ac80ccf5915 (table default.table_ca18962558654590b5d74892b4e00d0f [id=2cd4af6b415c4e3a92a3732fa145aa42]). Expected version 1 got 0
I20250831 19:54:55.156435 1769 raft_consensus.cc:2466] T 326c4af4214a4ea6a9ae784525758630 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1.
I20250831 19:54:55.157748 1904 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "326c4af4214a4ea6a9ae784525758630" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:54:55.158337 1570 leader_election.cc:304] T 326c4af4214a4ea6a9ae784525758630 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:55.158690 3018 raft_consensus.cc:2802] T 326c4af4214a4ea6a9ae784525758630 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:55.158828 3018 raft_consensus.cc:695] T 326c4af4214a4ea6a9ae784525758630 P 89aa85d59c53436ebdf3074b13d14825 [term 1 LEADER]: Becoming Leader. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Running, Role: LEADER
I20250831 19:54:55.159276 3018 consensus_queue.cc:237] T 326c4af4214a4ea6a9ae784525758630 P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
W20250831 19:54:55.160380 1568 leader_election.cc:343] T 326c4af4214a4ea6a9ae784525758630 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): Illegal state: must be running to vote when last-logged opid is not known
I20250831 19:54:55.164729 2125 catalog_manager.cc:5674] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237) does not have the latest schema for tablet 2a20faaf76fe4806b47e5ac80ccf5915 (table default.table_ca18962558654590b5d74892b4e00d0f [id=2cd4af6b415c4e3a92a3732fa145aa42]). Expected version 1 got 0
I20250831 19:54:55.164762 1609 tablet_service.cc:1468] Processing CreateTablet for tablet 93bfd2c663634436a61211a406c9f92f (DEFAULT_TABLE table=default.table_969c1fd9ed5340858aa7434d10785589 [id=416489b351d443ebb067fa9b8625e63e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:55.165225 1609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93bfd2c663634436a61211a406c9f92f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:55.165477 1883 tablet_service.cc:1468] Processing CreateTablet for tablet 93bfd2c663634436a61211a406c9f92f (DEFAULT_TABLE table=default.table_969c1fd9ed5340858aa7434d10785589 [id=416489b351d443ebb067fa9b8625e63e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:55.165871 1883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93bfd2c663634436a61211a406c9f92f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:55.169756 1903 raft_consensus.cc:2466] T 7afc8e9259a548fe946265ea513fde2f P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:54:55.171500 2282 tablet_bootstrap.cc:492] T 93bfd2c663634436a61211a406c9f92f P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:55.173149 2282 tablet_bootstrap.cc:654] T 93bfd2c663634436a61211a406c9f92f P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:55.175223 2282 tablet_bootstrap.cc:492] T 93bfd2c663634436a61211a406c9f92f P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:55.175362 2282 ts_tablet_manager.cc:1397] T 93bfd2c663634436a61211a406c9f92f P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.001s
I20250831 19:54:55.175966 3081 raft_consensus.cc:491] T eed712e77ad740ae95050fe589f3a61a P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:55.176120 3081 raft_consensus.cc:513] T eed712e77ad740ae95050fe589f3a61a P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:55.176632 3081 leader_election.cc:290] T eed712e77ad740ae95050fe589f3a61a P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:55.176800 2282 raft_consensus.cc:357] T 93bfd2c663634436a61211a406c9f92f P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:55.176956 2282 raft_consensus.cc:383] T 93bfd2c663634436a61211a406c9f92f P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:55.177030 2282 raft_consensus.cc:738] T 93bfd2c663634436a61211a406c9f92f P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:55.177194 2282 consensus_queue.cc:260] T 93bfd2c663634436a61211a406c9f92f P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:55.177883 2282 ts_tablet_manager.cc:1428] T 93bfd2c663634436a61211a406c9f92f P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250831 19:54:55.185655 1769 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "eed712e77ad740ae95050fe589f3a61a" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:55.185865 1769 raft_consensus.cc:2466] T eed712e77ad740ae95050fe589f3a61a P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 0.
I20250831 19:54:55.186192 1570 leader_election.cc:304] T eed712e77ad740ae95050fe589f3a61a P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:55.186460 3081 raft_consensus.cc:2802] T eed712e77ad740ae95050fe589f3a61a P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:55.186547 3081 raft_consensus.cc:491] T eed712e77ad740ae95050fe589f3a61a P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:55.186642 3081 raft_consensus.cc:3058] T eed712e77ad740ae95050fe589f3a61a P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:55.189158 3081 raft_consensus.cc:513] T eed712e77ad740ae95050fe589f3a61a P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:55.189674 1749 tablet_service.cc:1468] Processing CreateTablet for tablet 93bfd2c663634436a61211a406c9f92f (DEFAULT_TABLE table=default.table_969c1fd9ed5340858aa7434d10785589 [id=416489b351d443ebb067fa9b8625e63e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:55.190220 3081 leader_election.cc:290] T eed712e77ad740ae95050fe589f3a61a P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Requested vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:55.190250 1749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93bfd2c663634436a61211a406c9f92f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:55.190521 1902 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "eed712e77ad740ae95050fe589f3a61a" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:54:55.190699 1902 raft_consensus.cc:3058] T eed712e77ad740ae95050fe589f3a61a P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:55.193336 1902 raft_consensus.cc:2466] T eed712e77ad740ae95050fe589f3a61a P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1.
I20250831 19:54:55.193887 1771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "eed712e77ad740ae95050fe589f3a61a" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197"
I20250831 19:54:55.194121 1771 raft_consensus.cc:3058] T eed712e77ad740ae95050fe589f3a61a P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:55.194136 1568 leader_election.cc:304] T eed712e77ad740ae95050fe589f3a61a P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:54:55.194433 3081 raft_consensus.cc:2802] T eed712e77ad740ae95050fe589f3a61a P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:55.194836 3081 raft_consensus.cc:695] T eed712e77ad740ae95050fe589f3a61a P 89aa85d59c53436ebdf3074b13d14825 [term 1 LEADER]: Becoming Leader. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Running, Role: LEADER
I20250831 19:54:55.195093 3081 consensus_queue.cc:237] T eed712e77ad740ae95050fe589f3a61a P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:55.196841 1771 raft_consensus.cc:2466] T eed712e77ad740ae95050fe589f3a61a P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1.
I20250831 19:54:55.196184 2125 catalog_manager.cc:5582] T 43b456d5ee8d40e1a8999565cec2d230 P 89aa85d59c53436ebdf3074b13d14825 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193). New cstate: current_term: 1 leader_uuid: "89aa85d59c53436ebdf3074b13d14825" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: HEALTHY } } }
I20250831 19:54:55.200145 2125 catalog_manager.cc:5674] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197) does not have the latest schema for tablet 2a0c12b9233244809b96121e034c029e (table default.table_af003c3f30c04853bc025b34d543d0e0 [id=5ce6c4d5dcd34d73af61fd2c4bf28799]). Expected version 1 got 0
I20250831 19:54:55.201315 1904 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "eed712e77ad740ae95050fe589f3a61a" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:55.201521 1904 raft_consensus.cc:2374] T eed712e77ad740ae95050fe589f3a61a P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1. Re-sending same reply.
I20250831 19:54:55.202059 2186 catalog_manager.cc:2747] Deleting table default.table_4e905daf26a044c38517f550bf5157f7 [id=29dc63d23c10406db017e396faefbe4c] in response to Hive Metastore notification log event 136
I20250831 19:54:55.211405 2186 catalog_manager.cc:5869] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Sending DeleteTablet for 3 replicas of tablet 026b3c38d6ae4f3492e7d26a19c155d9
I20250831 19:54:55.212023 3067 tablet.cc:1722] T 2a20faaf76fe4806b47e5ac80ccf5915 P de831f40fa1348a48a1f0260f4130197: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250831 19:54:55.212198 1883 tablet_service.cc:1515] Processing DeleteTablet for tablet 026b3c38d6ae4f3492e7d26a19c155d9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:55 UTC) from {username='slave'} at 127.0.0.1:45906
I20250831 19:54:55.212451 2958 tablet_replica.cc:331] T 026b3c38d6ae4f3492e7d26a19c155d9 P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:54:55.212667 2958 raft_consensus.cc:2241] T 026b3c38d6ae4f3492e7d26a19c155d9 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:55.212656 1751 tablet_service.cc:1515] Processing DeleteTablet for tablet 026b3c38d6ae4f3492e7d26a19c155d9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:55 UTC) from {username='slave'} at 127.0.0.1:50674
I20250831 19:54:55.212841 2958 raft_consensus.cc:2270] T 026b3c38d6ae4f3492e7d26a19c155d9 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:55.212972 2959 tablet_replica.cc:331] T 026b3c38d6ae4f3492e7d26a19c155d9 P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:54:55.213192 2959 raft_consensus.cc:2241] T 026b3c38d6ae4f3492e7d26a19c155d9 P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: Raft consensus shutting down.
I20250831 19:54:55.213359 2958 ts_tablet_manager.cc:1905] T 026b3c38d6ae4f3492e7d26a19c155d9 P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:55.213573 2959 raft_consensus.cc:2270] T 026b3c38d6ae4f3492e7d26a19c155d9 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:55.214157 2959 ts_tablet_manager.cc:1905] T 026b3c38d6ae4f3492e7d26a19c155d9 P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:55.219172 2958 ts_tablet_manager.cc:1918] T 026b3c38d6ae4f3492e7d26a19c155d9 P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:55.219305 2958 log.cc:1199] T 026b3c38d6ae4f3492e7d26a19c155d9 P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/026b3c38d6ae4f3492e7d26a19c155d9
I20250831 19:54:55.219630 2958 ts_tablet_manager.cc:1939] T 026b3c38d6ae4f3492e7d26a19c155d9 P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:54:55.220924 3070 tablet.cc:1722] T 2a20faaf76fe4806b47e5ac80ccf5915 P 89aa85d59c53436ebdf3074b13d14825: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250831 19:54:55.221161 2101 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet 026b3c38d6ae4f3492e7d26a19c155d9 (table default.table_4e905daf26a044c38517f550bf5157f7 [id=29dc63d23c10406db017e396faefbe4c]) successfully deleted
I20250831 19:54:55.222599 1609 tablet_service.cc:1515] Processing DeleteTablet for tablet 026b3c38d6ae4f3492e7d26a19c155d9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:55 UTC) from {username='slave'} at 127.0.0.1:51022
I20250831 19:54:55.222833 2957 tablet_replica.cc:331] T 026b3c38d6ae4f3492e7d26a19c155d9 P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:54:55.223055 2957 raft_consensus.cc:2241] T 026b3c38d6ae4f3492e7d26a19c155d9 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:55.223202 2957 raft_consensus.cc:2270] T 026b3c38d6ae4f3492e7d26a19c155d9 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:55.223670 2957 ts_tablet_manager.cc:1905] T 026b3c38d6ae4f3492e7d26a19c155d9 P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:55.226110 2186 catalog_manager.cc:2747] Deleting table default.table_60746664f3ef4d82866e4bcd56d4fac5 [id=0850f2b0e9324dd0a210fa7b2609c769] in response to Hive Metastore notification log event 139
I20250831 19:54:55.229885 2957 ts_tablet_manager.cc:1918] T 026b3c38d6ae4f3492e7d26a19c155d9 P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:55.230007 2957 log.cc:1199] T 026b3c38d6ae4f3492e7d26a19c155d9 P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/026b3c38d6ae4f3492e7d26a19c155d9
I20250831 19:54:55.230370 2957 ts_tablet_manager.cc:1939] T 026b3c38d6ae4f3492e7d26a19c155d9 P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
I20250831 19:54:55.231527 2104 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet 026b3c38d6ae4f3492e7d26a19c155d9 (table default.table_4e905daf26a044c38517f550bf5157f7 [id=29dc63d23c10406db017e396faefbe4c]) successfully deleted
I20250831 19:54:55.238438 2186 catalog_manager.cc:5869] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Sending DeleteTablet for 3 replicas of tablet c5ea4587e33644fca784e1fb8720d354
I20250831 19:54:55.239209 1883 tablet_service.cc:1515] Processing DeleteTablet for tablet c5ea4587e33644fca784e1fb8720d354 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:55 UTC) from {username='slave'} at 127.0.0.1:45906
I20250831 19:54:55.239440 2958 tablet_replica.cc:331] T c5ea4587e33644fca784e1fb8720d354 P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:54:55.239413 1751 tablet_service.cc:1515] Processing DeleteTablet for tablet c5ea4587e33644fca784e1fb8720d354 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:55 UTC) from {username='slave'} at 127.0.0.1:50674
I20250831 19:54:55.239616 2958 raft_consensus.cc:2241] T c5ea4587e33644fca784e1fb8720d354 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:55.240116 1609 tablet_service.cc:1515] Processing DeleteTablet for tablet c5ea4587e33644fca784e1fb8720d354 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:55 UTC) from {username='slave'} at 127.0.0.1:51022
I20250831 19:54:55.240379 2957 tablet_replica.cc:331] T c5ea4587e33644fca784e1fb8720d354 P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:54:55.240343 2958 raft_consensus.cc:2270] T c5ea4587e33644fca784e1fb8720d354 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:55.240329 2584 consensus_queue.cc:1035] T f3ea6c8b0bf64d8b86dc96dc1abe0934 P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:55.240648 2957 raft_consensus.cc:2241] T c5ea4587e33644fca784e1fb8720d354 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:55.240868 2958 ts_tablet_manager.cc:1905] T c5ea4587e33644fca784e1fb8720d354 P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:55.241209 2957 raft_consensus.cc:2270] T c5ea4587e33644fca784e1fb8720d354 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:55.241917 2957 ts_tablet_manager.cc:1905] T c5ea4587e33644fca784e1fb8720d354 P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:55.245085 2959 ts_tablet_manager.cc:1918] T 026b3c38d6ae4f3492e7d26a19c155d9 P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:55.245195 2959 log.cc:1199] T 026b3c38d6ae4f3492e7d26a19c155d9 P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/026b3c38d6ae4f3492e7d26a19c155d9
I20250831 19:54:55.245589 2959 ts_tablet_manager.cc:1939] T 026b3c38d6ae4f3492e7d26a19c155d9 P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
I20250831 19:54:55.246766 2105 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet 026b3c38d6ae4f3492e7d26a19c155d9 (table default.table_4e905daf26a044c38517f550bf5157f7 [id=29dc63d23c10406db017e396faefbe4c]) successfully deleted
I20250831 19:54:55.247107 2959 tablet_replica.cc:331] T c5ea4587e33644fca784e1fb8720d354 P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:54:55.247390 2959 raft_consensus.cc:2241] T c5ea4587e33644fca784e1fb8720d354 P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: Raft consensus shutting down.
I20250831 19:54:55.250133 3068 tablet.cc:1722] T 2a20faaf76fe4806b47e5ac80ccf5915 P 2441fafe1d62429386f4631ad423567d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250831 19:54:55.252080 2957 ts_tablet_manager.cc:1918] T c5ea4587e33644fca784e1fb8720d354 P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
W20250831 19:54:55.256088 3086 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250831 19:54:55.256260 2957 log.cc:1199] T c5ea4587e33644fca784e1fb8720d354 P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/c5ea4587e33644fca784e1fb8720d354
I20250831 19:54:55.256809 2957 ts_tablet_manager.cc:1939] T c5ea4587e33644fca784e1fb8720d354 P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
I20250831 19:54:55.257372 2955 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20250831 19:54:55.257975 2104 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet c5ea4587e33644fca784e1fb8720d354 (table default.table_60746664f3ef4d82866e4bcd56d4fac5 [id=0850f2b0e9324dd0a210fa7b2609c769]) successfully deleted
W20250831 19:54:55.258636 2125 catalog_manager.cc:5774] Failed to send AlterTable RPC for tablet 2a0c12b9233244809b96121e034c029e (table default.table_af003c3f30c04853bc025b34d543d0e0 [id=5ce6c4d5dcd34d73af61fd2c4bf28799], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 2a0c12b9233244809b96121e034c029e consensus state has no leader
I20250831 19:54:55.261106 2699 consensus_queue.cc:260] T 172f71a8fe554a5b8bfdb2a5bc109abc P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:55.262323 2122 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:36958 (request call id 150) took 1557 ms. Trace:
I20250831 19:54:55.262434 2122 rpcz_store.cc:276] 0831 19:54:53.705329 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:54.289214 (+583885us) service_pool.cc:225] Handling call
0831 19:54:54.426858 (+137644us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:55.261701 (+834843us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:55.262010 (+ 309us) catalog_manager.cc:3683] Apply alter schema
0831 19:54:55.262286 (+ 276us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":29,"Hive Metastore.run_cpu_time_us":606,"Hive Metastore.run_wall_time_us":95786}
I20250831 19:54:55.262616 2699 ts_tablet_manager.cc:1428] T 172f71a8fe554a5b8bfdb2a5bc109abc P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.138s user 0.002s sys 0.000s
I20250831 19:54:55.262892 2699 tablet_bootstrap.cc:492] T 2a0c12b9233244809b96121e034c029e P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:55.262923 2122 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_b5294d0b8f564e31865783000a954688" } modify_external_catalogs: true
I20250831 19:54:55.263119 2122 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_b5294d0b8f564e31865783000a954688" } modify_external_catalogs: true
I20250831 19:54:55.266515 2856 tablet_bootstrap.cc:492] T 93bfd2c663634436a61211a406c9f92f P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:55.267879 2121 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:36958 (request call id 144) took 2021 ms. Trace:
I20250831 19:54:55.267985 2121 rpcz_store.cc:276] 0831 19:54:53.246487 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:53.979679 (+733192us) service_pool.cc:225] Handling call
0831 19:54:54.428117 (+448438us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:55.267341 (+839224us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:55.267605 (+ 264us) catalog_manager.cc:3683] Apply alter schema
0831 19:54:55.267844 (+ 239us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":138415,"Hive Metastore.run_cpu_time_us":611,"Hive Metastore.run_wall_time_us":79457,"mutex_wait_us":32}
I20250831 19:54:55.268126 2856 tablet_bootstrap.cc:654] T 93bfd2c663634436a61211a406c9f92f P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:55.268361 2121 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_371cc4850a3443e09f9541001b3bbb0c" } new_table_name: "default.Table_c7390b7344da4c3fbf7f2f502b096669" modify_external_catalogs: true
I20250831 19:54:55.268683 2124 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:36958 (request call id 145) took 2022 ms. Trace:
I20250831 19:54:55.268764 2124 rpcz_store.cc:276] 0831 19:54:53.246646 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:53.979828 (+733182us) service_pool.cc:225] Handling call
0831 19:54:54.428266 (+448438us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:55.268627 (+840361us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":217778,"Hive Metastore.run_cpu_time_us":166,"Hive Metastore.run_wall_time_us":85858}
I20250831 19:54:55.269088 2124 master_service.cc:948] ReplaceTablet: received request to replace tablet 73e83ccb99b643428aef635b8ea90f03 from {username='slave'} at 127.0.0.1:36958
W20250831 19:54:55.269403 2118 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_ba7cea85816c4b98a116ec6b7a569c98 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250831 19:54:55.274523 2124 catalog_manager.cc:5869] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Sending DeleteTablet for 3 replicas of tablet 73e83ccb99b643428aef635b8ea90f03
I20250831 19:54:55.275009 2124 catalog_manager.cc:6652] ReplaceTablet: tablet 73e83ccb99b643428aef635b8ea90f03 deleted and replaced by tablet fae02e9ed1434c7c82f6c5faa3a1acec
I20250831 19:54:55.275110 2124 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:36958 (request call id 161) took 1087 ms. Trace:
I20250831 19:54:55.275193 2124 rpcz_store.cc:276] 0831 19:54:54.187955 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:55.269016 (+1081061us) service_pool.cc:225] Handling call
0831 19:54:55.275083 (+ 6067us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:55.270055 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:55.270130 (+ 75us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:55.270134 (+ 4us) write_op.cc:435] Acquired schema lock
0831 19:54:55.270136 (+ 2us) tablet.cc:660] Decoding operations
0831 19:54:55.270236 (+ 100us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:55.270247 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:55.270251 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:55.270321 (+ 70us) tablet.cc:699] Row locks acquired
0831 19:54:55.270323 (+ 2us) write_op.cc:260] PREPARE: finished
0831 19:54:55.270356 (+ 33us) write_op.cc:270] Start()
0831 19:54:55.270385 (+ 29us) write_op.cc:276] Timestamp: P: 1756670095270297 usec, L: 0
0831 19:54:55.270388 (+ 3us) op_driver.cc:348] REPLICATION: starting
0831 19:54:55.270624 (+ 236us) log.cc:844] Serialized 656 byte log entry
0831 19:54:55.273454 (+ 2830us) op_driver.cc:464] REPLICATION: finished
0831 19:54:55.273745 (+ 291us) write_op.cc:301] APPLY: starting
0831 19:54:55.273759 (+ 14us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:55.273808 (+ 49us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:55.273836 (+ 28us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:55.273944 (+ 108us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:55.274009 (+ 65us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0831 19:54:55.274018 (+ 9us) write_op.cc:312] APPLY: finished
0831 19:54:55.274096 (+ 78us) log.cc:844] Serialized 29 byte log entry
0831 19:54:55.274156 (+ 60us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:55.274177 (+ 21us) write_op.cc:454] Released schema lock
0831 19:54:55.274184 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0831 19:54:55.274251 (+ 67us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:55.274256 (+ 5us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":243,"apply.run_cpu_time_us":498,"apply.run_wall_time_us":497,"num_ops":2,"prepare.queue_time_us":42,"prepare.run_cpu_time_us":663,"prepare.run_wall_time_us":1224,"raft.queue_time_us":68,"raft.run_cpu_time_us":261,"raft.run_wall_time_us":261,"replication_time_us":3031}]]}
I20250831 19:54:55.275926 2124 master_service.cc:948] ReplaceTablet: received request to replace tablet 7dbfbe9b2b024f699c52046e09aa3301 from {username='slave'} at 127.0.0.1:36958
I20250831 19:54:55.277098 1751 tablet_service.cc:1515] Processing DeleteTablet for tablet 73e83ccb99b643428aef635b8ea90f03 with delete_type TABLET_DATA_DELETED (replaced by tablet fae02e9ed1434c7c82f6c5faa3a1acec) from {username='slave'} at 127.0.0.1:50674
I20250831 19:54:55.277307 1883 tablet_service.cc:1515] Processing DeleteTablet for tablet 73e83ccb99b643428aef635b8ea90f03 with delete_type TABLET_DATA_DELETED (replaced by tablet fae02e9ed1434c7c82f6c5faa3a1acec) from {username='slave'} at 127.0.0.1:45906
I20250831 19:54:55.278932 1609 tablet_service.cc:1515] Processing DeleteTablet for tablet 73e83ccb99b643428aef635b8ea90f03 with delete_type TABLET_DATA_DELETED (replaced by tablet fae02e9ed1434c7c82f6c5faa3a1acec) from {username='slave'} at 127.0.0.1:51022
I20250831 19:54:55.280723 2957 tablet_replica.cc:331] T 73e83ccb99b643428aef635b8ea90f03 P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:54:55.280987 2957 raft_consensus.cc:2241] T 73e83ccb99b643428aef635b8ea90f03 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:55.281196 2957 raft_consensus.cc:2270] T 73e83ccb99b643428aef635b8ea90f03 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:55.281790 2957 ts_tablet_manager.cc:1905] T 73e83ccb99b643428aef635b8ea90f03 P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:55.284701 2126 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:36958 (request call id 151) took 1579 ms. Trace:
I20250831 19:54:55.284785 2126 rpcz_store.cc:276] 0831 19:54:53.705421 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:54.297391 (+591970us) service_pool.cc:225] Handling call
0831 19:54:54.429951 (+132560us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:55.284649 (+854698us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":437295,"Hive Metastore.run_cpu_time_us":175,"Hive Metastore.run_wall_time_us":158499}
I20250831 19:54:55.285076 2126 master_service.cc:948] ReplaceTablet: received request to replace tablet 5b948d8301e343b3a5ea1cf90b841513 from {username='slave'} at 127.0.0.1:36958
I20250831 19:54:55.247798 2959 raft_consensus.cc:2270] T c5ea4587e33644fca784e1fb8720d354 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:55.290642 2959 ts_tablet_manager.cc:1905] T c5ea4587e33644fca784e1fb8720d354 P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:55.301460 2124 catalog_manager.cc:5869] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Sending DeleteTablet for 3 replicas of tablet 7dbfbe9b2b024f699c52046e09aa3301
I20250831 19:54:55.301955 2124 catalog_manager.cc:6652] ReplaceTablet: tablet 7dbfbe9b2b024f699c52046e09aa3301 deleted and replaced by tablet e6438652703c45d691f528a4322767b9
I20250831 19:54:55.302093 2124 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:36958 (request call id 162) took 1098 ms. Trace:
I20250831 19:54:55.302168 2124 rpcz_store.cc:276] 0831 19:54:54.203896 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:55.275882 (+1071986us) service_pool.cc:225] Handling call
0831 19:54:55.302045 (+ 26163us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:55.282814 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:55.282952 (+ 138us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:55.282958 (+ 6us) write_op.cc:435] Acquired schema lock
0831 19:54:55.282962 (+ 4us) tablet.cc:660] Decoding operations
0831 19:54:55.283110 (+ 148us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:55.283124 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:55.283130 (+ 6us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:55.283211 (+ 81us) tablet.cc:699] Row locks acquired
0831 19:54:55.283215 (+ 4us) write_op.cc:260] PREPARE: finished
0831 19:54:55.283248 (+ 33us) write_op.cc:270] Start()
0831 19:54:55.283277 (+ 29us) write_op.cc:276] Timestamp: P: 1756670095283187 usec, L: 0
0831 19:54:55.283282 (+ 5us) op_driver.cc:348] REPLICATION: starting
0831 19:54:55.283447 (+ 165us) log.cc:844] Serialized 656 byte log entry
0831 19:54:55.285832 (+ 2385us) op_driver.cc:464] REPLICATION: finished
0831 19:54:55.286457 (+ 625us) write_op.cc:301] APPLY: starting
0831 19:54:55.286469 (+ 12us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:55.286503 (+ 34us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:55.286523 (+ 20us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:55.286612 (+ 89us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:55.286661 (+ 49us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0831 19:54:55.286666 (+ 5us) write_op.cc:312] APPLY: finished
0831 19:54:55.286725 (+ 59us) log.cc:844] Serialized 29 byte log entry
0831 19:54:55.286781 (+ 56us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:55.286798 (+ 17us) write_op.cc:454] Released schema lock
0831 19:54:55.286803 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0831 19:54:55.286858 (+ 55us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:55.286862 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":577,"apply.run_cpu_time_us":399,"apply.run_wall_time_us":400,"num_ops":2,"prepare.queue_time_us":2849,"prepare.run_cpu_time_us":786,"prepare.run_wall_time_us":2516,"raft.queue_time_us":80,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":207,"replication_time_us":2526}]]}
W20250831 19:54:55.304379 2100 catalog_manager.cc:4726] Async tablet task AlterTable RPC for tablet 2a0c12b9233244809b96121e034c029e (table default.table_af003c3f30c04853bc025b34d543d0e0 [id=5ce6c4d5dcd34d73af61fd2c4bf28799], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 2a0c12b9233244809b96121e034c029e consensus state has no leader
I20250831 19:54:55.305033 1883 tablet_service.cc:1515] Processing DeleteTablet for tablet 7dbfbe9b2b024f699c52046e09aa3301 with delete_type TABLET_DATA_DELETED (replaced by tablet e6438652703c45d691f528a4322767b9) from {username='slave'} at 127.0.0.1:45906
I20250831 19:54:55.305039 1609 tablet_service.cc:1515] Processing DeleteTablet for tablet 7dbfbe9b2b024f699c52046e09aa3301 with delete_type TABLET_DATA_DELETED (replaced by tablet e6438652703c45d691f528a4322767b9) from {username='slave'} at 127.0.0.1:51022
I20250831 19:54:55.305290 2126 catalog_manager.cc:5869] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Sending DeleteTablet for 3 replicas of tablet 5b948d8301e343b3a5ea1cf90b841513
I20250831 19:54:55.305722 2126 catalog_manager.cc:6652] ReplaceTablet: tablet 5b948d8301e343b3a5ea1cf90b841513 deleted and replaced by tablet 5ed927d4935143968fb89a73730eb8a1
I20250831 19:54:55.305943 2856 tablet_bootstrap.cc:492] T 93bfd2c663634436a61211a406c9f92f P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:55.306118 2856 ts_tablet_manager.cc:1397] T 93bfd2c663634436a61211a406c9f92f P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.040s user 0.010s sys 0.000s
I20250831 19:54:55.306962 2957 ts_tablet_manager.cc:1918] T 73e83ccb99b643428aef635b8ea90f03 P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:55.307021 3068 tablet.cc:1722] T 7a217324e97b43e5a7ec540e3b9f70a5 P 2441fafe1d62429386f4631ad423567d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250831 19:54:55.307178 2856 raft_consensus.cc:357] T 93bfd2c663634436a61211a406c9f92f P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:55.307389 2856 raft_consensus.cc:383] T 93bfd2c663634436a61211a406c9f92f P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:55.308892 1883 tablet_service.cc:1515] Processing DeleteTablet for tablet 5b948d8301e343b3a5ea1cf90b841513 with delete_type TABLET_DATA_DELETED (replaced by tablet 5ed927d4935143968fb89a73730eb8a1) from {username='slave'} at 127.0.0.1:45906
I20250831 19:54:55.307492 2856 raft_consensus.cc:738] T 93bfd2c663634436a61211a406c9f92f P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:55.310195 1751 tablet_service.cc:1515] Processing DeleteTablet for tablet 5b948d8301e343b3a5ea1cf90b841513 with delete_type TABLET_DATA_DELETED (replaced by tablet 5ed927d4935143968fb89a73730eb8a1) from {username='slave'} at 127.0.0.1:50674
I20250831 19:54:55.312952 2699 tablet_bootstrap.cc:654] T 2a0c12b9233244809b96121e034c029e P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:55.313563 3067 tablet.cc:1722] T 7a217324e97b43e5a7ec540e3b9f70a5 P de831f40fa1348a48a1f0260f4130197: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250831 19:54:55.314255 2856 consensus_queue.cc:260] T 93bfd2c663634436a61211a406c9f92f P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:55.317095 1751 tablet_service.cc:1468] Processing CreateTablet for tablet fae02e9ed1434c7c82f6c5faa3a1acec (DEFAULT_TABLE table=default.table_486ee0377a714038aaf8f3f5b1ad7f79 [id=028e873d141c4006aca7d45be88d9ae3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:55.317665 1883 tablet_service.cc:1468] Processing CreateTablet for tablet fae02e9ed1434c7c82f6c5faa3a1acec (DEFAULT_TABLE table=default.table_486ee0377a714038aaf8f3f5b1ad7f79 [id=028e873d141c4006aca7d45be88d9ae3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:55.318032 1883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fae02e9ed1434c7c82f6c5faa3a1acec. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:55.326445 1748 tablet_service.cc:1468] Processing CreateTablet for tablet 5ed927d4935143968fb89a73730eb8a1 (DEFAULT_TABLE table=default.table_207ac87518bc487184a89bb52cd204b3 [id=f48af5bc3eff4c819be4aeeff4128c2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:55.326525 2124 catalog_manager.cc:5582] T 326c4af4214a4ea6a9ae784525758630 P 89aa85d59c53436ebdf3074b13d14825 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193). New cstate: current_term: 1 leader_uuid: "89aa85d59c53436ebdf3074b13d14825" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: HEALTHY } } }
I20250831 19:54:55.327296 2124 catalog_manager.cc:5582] T eed712e77ad740ae95050fe589f3a61a P 89aa85d59c53436ebdf3074b13d14825 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193). New cstate: current_term: 1 leader_uuid: "89aa85d59c53436ebdf3074b13d14825" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: HEALTHY } } }
I20250831 19:54:55.307829 1609 tablet_service.cc:1515] Processing DeleteTablet for tablet 5b948d8301e343b3a5ea1cf90b841513 with delete_type TABLET_DATA_DELETED (replaced by tablet 5ed927d4935143968fb89a73730eb8a1) from {username='slave'} at 127.0.0.1:51022
I20250831 19:54:55.308593 3070 tablet.cc:1722] T 7a217324e97b43e5a7ec540e3b9f70a5 P 89aa85d59c53436ebdf3074b13d14825: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250831 19:54:55.317119 1614 tablet_service.cc:1468] Processing CreateTablet for tablet fae02e9ed1434c7c82f6c5faa3a1acec (DEFAULT_TABLE table=default.table_486ee0377a714038aaf8f3f5b1ad7f79 [id=028e873d141c4006aca7d45be88d9ae3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:55.329720 1883 tablet_service.cc:1468] Processing CreateTablet for tablet 5ed927d4935143968fb89a73730eb8a1 (DEFAULT_TABLE table=default.table_207ac87518bc487184a89bb52cd204b3 [id=f48af5bc3eff4c819be4aeeff4128c2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:55.330057 1883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ed927d4935143968fb89a73730eb8a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:55.330127 1614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fae02e9ed1434c7c82f6c5faa3a1acec. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:55.327173 1613 tablet_service.cc:1468] Processing CreateTablet for tablet 5ed927d4935143968fb89a73730eb8a1 (DEFAULT_TABLE table=default.table_207ac87518bc487184a89bb52cd204b3 [id=f48af5bc3eff4c819be4aeeff4128c2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:55.334045 1613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ed927d4935143968fb89a73730eb8a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:55.337232 2856 ts_tablet_manager.cc:1428] T 93bfd2c663634436a61211a406c9f92f P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.031s user 0.002s sys 0.000s
I20250831 19:54:55.337855 1749 tablet_service.cc:1515] Processing DeleteTablet for tablet 7dbfbe9b2b024f699c52046e09aa3301 with delete_type TABLET_DATA_DELETED (replaced by tablet e6438652703c45d691f528a4322767b9) from {username='slave'} at 127.0.0.1:50674
I20250831 19:54:55.340624 2124 catalog_manager.cc:6127] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: default.table_55404df7d7524c7cb6139cc53ec92877 [id=2cd4af6b415c4e3a92a3732fa145aa42] alter complete (version 2)
I20250831 19:54:55.342830 2126 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36958:
name: "default.Table_dbf76772503b48c3a9083efbcbbb62a3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:55.344476 2957 log.cc:1199] T 73e83ccb99b643428aef635b8ea90f03 P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/73e83ccb99b643428aef635b8ea90f03
I20250831 19:54:55.345070 2957 ts_tablet_manager.cc:1939] T 73e83ccb99b643428aef635b8ea90f03 P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
I20250831 19:54:55.345074 1884 tablet_service.cc:1468] Processing CreateTablet for tablet e6438652703c45d691f528a4322767b9 (DEFAULT_TABLE table=default.table_d3002519e6964bb484d995d871e766c9 [id=1137b2754d104964bbe5bbaa4a0578b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:55.345309 1749 tablet_service.cc:1468] Processing CreateTablet for tablet e6438652703c45d691f528a4322767b9 (DEFAULT_TABLE table=default.table_d3002519e6964bb484d995d871e766c9 [id=1137b2754d104964bbe5bbaa4a0578b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:55.345419 1884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6438652703c45d691f528a4322767b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:55.346589 1614 tablet_service.cc:1468] Processing CreateTablet for tablet e6438652703c45d691f528a4322767b9 (DEFAULT_TABLE table=default.table_d3002519e6964bb484d995d871e766c9 [id=1137b2754d104964bbe5bbaa4a0578b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:55.346936 1614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6438652703c45d691f528a4322767b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:55.344511 2282 tablet_bootstrap.cc:492] T 5ed927d4935143968fb89a73730eb8a1 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:55.349602 2957 tablet_replica.cc:331] T 7dbfbe9b2b024f699c52046e09aa3301 P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:54:55.349651 2104 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet 73e83ccb99b643428aef635b8ea90f03 (table default.table_486ee0377a714038aaf8f3f5b1ad7f79 [id=028e873d141c4006aca7d45be88d9ae3]) successfully deleted
I20250831 19:54:55.349787 2957 raft_consensus.cc:2241] T 7dbfbe9b2b024f699c52046e09aa3301 P 89aa85d59c53436ebdf3074b13d14825 [term 1 LEADER]: Raft consensus shutting down.
I20250831 19:54:55.350193 2957 raft_consensus.cc:2270] T 7dbfbe9b2b024f699c52046e09aa3301 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:55.351766 2282 tablet_bootstrap.cc:654] T 5ed927d4935143968fb89a73730eb8a1 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:55.357990 2957 ts_tablet_manager.cc:1905] T 7dbfbe9b2b024f699c52046e09aa3301 P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:55.362414 2958 ts_tablet_manager.cc:1918] T c5ea4587e33644fca784e1fb8720d354 P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250831 19:54:55.362569 2958 log.cc:1199] T c5ea4587e33644fca784e1fb8720d354 P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/c5ea4587e33644fca784e1fb8720d354
I20250831 19:54:55.362995 2958 ts_tablet_manager.cc:1939] T c5ea4587e33644fca784e1fb8720d354 P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:54:55.366355 2959 ts_tablet_manager.cc:1918] T c5ea4587e33644fca784e1fb8720d354 P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250831 19:54:55.366509 2959 log.cc:1199] T c5ea4587e33644fca784e1fb8720d354 P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/c5ea4587e33644fca784e1fb8720d354
I20250831 19:54:55.366899 2959 ts_tablet_manager.cc:1939] T c5ea4587e33644fca784e1fb8720d354 P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
I20250831 19:54:55.367854 2959 tablet_replica.cc:331] T 73e83ccb99b643428aef635b8ea90f03 P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:54:55.367981 2105 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet c5ea4587e33644fca784e1fb8720d354 (table default.table_60746664f3ef4d82866e4bcd56d4fac5 [id=0850f2b0e9324dd0a210fa7b2609c769]) successfully deleted
I20250831 19:54:55.368049 2959 raft_consensus.cc:2241] T 73e83ccb99b643428aef635b8ea90f03 P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: Raft consensus shutting down.
I20250831 19:54:55.368364 2959 raft_consensus.cc:2270] T 73e83ccb99b643428aef635b8ea90f03 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:55.368894 2959 ts_tablet_manager.cc:1905] T 73e83ccb99b643428aef635b8ea90f03 P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:55.369637 1751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fae02e9ed1434c7c82f6c5faa3a1acec. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:55.369906 1748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ed927d4935143968fb89a73730eb8a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:55.371063 2282 tablet_bootstrap.cc:492] T 5ed927d4935143968fb89a73730eb8a1 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:55.371234 2282 ts_tablet_manager.cc:1397] T 5ed927d4935143968fb89a73730eb8a1 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.027s user 0.006s sys 0.003s
I20250831 19:54:55.371997 2282 raft_consensus.cc:357] T 5ed927d4935143968fb89a73730eb8a1 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:55.372195 2282 raft_consensus.cc:383] T 5ed927d4935143968fb89a73730eb8a1 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:55.372254 2282 raft_consensus.cc:738] T 5ed927d4935143968fb89a73730eb8a1 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:55.372500 2282 consensus_queue.cc:260] T 5ed927d4935143968fb89a73730eb8a1 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:55.372968 2282 ts_tablet_manager.cc:1428] T 5ed927d4935143968fb89a73730eb8a1 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250831 19:54:55.373253 2282 tablet_bootstrap.cc:492] T fae02e9ed1434c7c82f6c5faa3a1acec P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:55.376585 1749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6438652703c45d691f528a4322767b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:55.382062 2957 ts_tablet_manager.cc:1918] T 7dbfbe9b2b024f699c52046e09aa3301 P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250831 19:54:55.382207 2957 log.cc:1199] T 7dbfbe9b2b024f699c52046e09aa3301 P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/7dbfbe9b2b024f699c52046e09aa3301
I20250831 19:54:55.382755 2957 ts_tablet_manager.cc:1939] T 7dbfbe9b2b024f699c52046e09aa3301 P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
I20250831 19:54:55.383894 2104 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet 7dbfbe9b2b024f699c52046e09aa3301 (table default.table_d3002519e6964bb484d995d871e766c9 [id=1137b2754d104964bbe5bbaa4a0578b8]) successfully deleted
I20250831 19:54:55.385854 2125 catalog_manager.cc:5582] T 27a32ae2ed1a4b94b1a2e6a9aa9d0d8c P de831f40fa1348a48a1f0260f4130197 reported cstate change: term changed from 0 to 1, leader changed from <none> to de831f40fa1348a48a1f0260f4130197 (127.1.1.194). New cstate: current_term: 1 leader_uuid: "de831f40fa1348a48a1f0260f4130197" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } }
I20250831 19:54:55.387326 2101 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet c5ea4587e33644fca784e1fb8720d354 (table default.table_60746664f3ef4d82866e4bcd56d4fac5 [id=0850f2b0e9324dd0a210fa7b2609c769]) successfully deleted
I20250831 19:54:55.387794 2125 catalog_manager.cc:5674] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475) does not have the latest schema for tablet 2a0c12b9233244809b96121e034c029e (table default.table_af003c3f30c04853bc025b34d543d0e0 [id=5ce6c4d5dcd34d73af61fd2c4bf28799]). Expected version 1 got 0
I20250831 19:54:55.388074 2125 catalog_manager.cc:5674] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475) does not have the latest schema for tablet 2a20faaf76fe4806b47e5ac80ccf5915 (table default.table_55404df7d7524c7cb6139cc53ec92877 [id=2cd4af6b415c4e3a92a3732fa145aa42]). Expected version 2 got 1
I20250831 19:54:55.388345 2958 tablet_replica.cc:331] T 73e83ccb99b643428aef635b8ea90f03 P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:54:55.388911 2125 catalog_manager.cc:5582] T 7afc8e9259a548fe946265ea513fde2f P de831f40fa1348a48a1f0260f4130197 reported cstate change: term changed from 0 to 1, leader changed from <none> to de831f40fa1348a48a1f0260f4130197 (127.1.1.194). New cstate: current_term: 1 leader_uuid: "de831f40fa1348a48a1f0260f4130197" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } }
I20250831 19:54:55.389427 2958 raft_consensus.cc:2241] T 73e83ccb99b643428aef635b8ea90f03 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:55.389670 2958 raft_consensus.cc:2270] T 73e83ccb99b643428aef635b8ea90f03 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:55.390065 2856 tablet_bootstrap.cc:492] T fae02e9ed1434c7c82f6c5faa3a1acec P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:55.388630 2124 catalog_manager.cc:6127] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: default.table_c714288d42d74e799fc5e0c60cb920fa [id=aabaa79336954b3ab0450dcff3afa7bf] alter complete (version 2)
I20250831 19:54:55.391537 2856 tablet_bootstrap.cc:654] T fae02e9ed1434c7c82f6c5faa3a1acec P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:55.392306 2958 ts_tablet_manager.cc:1905] T 73e83ccb99b643428aef635b8ea90f03 P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:55.394970 2282 tablet_bootstrap.cc:654] T fae02e9ed1434c7c82f6c5faa3a1acec P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:55.395852 2955 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20250831 19:54:55.401753 2957 tablet_replica.cc:331] T 5b948d8301e343b3a5ea1cf90b841513 P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:54:55.402069 2957 raft_consensus.cc:2241] T 5b948d8301e343b3a5ea1cf90b841513 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:55.402308 2957 raft_consensus.cc:2270] T 5b948d8301e343b3a5ea1cf90b841513 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:55.402904 2943 raft_consensus.cc:491] T 172f71a8fe554a5b8bfdb2a5bc109abc P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:55.403120 2943 raft_consensus.cc:513] T 172f71a8fe554a5b8bfdb2a5bc109abc P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:55.404345 1904 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "172f71a8fe554a5b8bfdb2a5bc109abc" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:55.404559 1904 raft_consensus.cc:2466] T 172f71a8fe554a5b8bfdb2a5bc109abc P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 0.
I20250831 19:54:55.404740 2955 hybrid_clock.cc:648] HybridClock initialized: now 1756670095403714 us; error 122 us; skew 500 ppm
I20250831 19:54:55.405094 1705 leader_election.cc:304] T 172f71a8fe554a5b8bfdb2a5bc109abc P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:55.405206 2955 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250831 19:54:55.405339 2584 raft_consensus.cc:2802] T 172f71a8fe554a5b8bfdb2a5bc109abc P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:55.405449 2584 raft_consensus.cc:491] T 172f71a8fe554a5b8bfdb2a5bc109abc P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:55.405530 2584 raft_consensus.cc:3058] T 172f71a8fe554a5b8bfdb2a5bc109abc P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:55.405762 2124 catalog_manager.cc:5674] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197) does not have the latest schema for tablet 5ed927d4935143968fb89a73730eb8a1 (table default.table_207ac87518bc487184a89bb52cd204b3 [id=f48af5bc3eff4c819be4aeeff4128c2a]). Expected version 1 got 0
I20250831 19:54:55.407927 2856 tablet_bootstrap.cc:492] T fae02e9ed1434c7c82f6c5faa3a1acec P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:55.408079 2856 ts_tablet_manager.cc:1397] T fae02e9ed1434c7c82f6c5faa3a1acec P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.000s
I20250831 19:54:55.409152 2584 raft_consensus.cc:513] T 172f71a8fe554a5b8bfdb2a5bc109abc P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:55.409281 2282 tablet_bootstrap.cc:492] T fae02e9ed1434c7c82f6c5faa3a1acec P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:55.409399 2282 ts_tablet_manager.cc:1397] T fae02e9ed1434c7c82f6c5faa3a1acec P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.036s user 0.003s sys 0.000s
I20250831 19:54:55.410008 2856 raft_consensus.cc:357] T fae02e9ed1434c7c82f6c5faa3a1acec P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:55.410183 2856 raft_consensus.cc:383] T fae02e9ed1434c7c82f6c5faa3a1acec P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:55.410244 2856 raft_consensus.cc:738] T fae02e9ed1434c7c82f6c5faa3a1acec P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:55.410318 2958 ts_tablet_manager.cc:1918] T 73e83ccb99b643428aef635b8ea90f03 P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:55.410444 2958 log.cc:1199] T 73e83ccb99b643428aef635b8ea90f03 P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/73e83ccb99b643428aef635b8ea90f03
I20250831 19:54:55.410470 2856 consensus_queue.cc:260] T fae02e9ed1434c7c82f6c5faa3a1acec P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:55.410490 1904 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "172f71a8fe554a5b8bfdb2a5bc109abc" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:54:55.410746 1904 raft_consensus.cc:3058] T 172f71a8fe554a5b8bfdb2a5bc109abc P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:55.410861 2958 ts_tablet_manager.cc:1939] T 73e83ccb99b643428aef635b8ea90f03 P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:54:55.411759 2101 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet 73e83ccb99b643428aef635b8ea90f03 (table default.table_486ee0377a714038aaf8f3f5b1ad7f79 [id=028e873d141c4006aca7d45be88d9ae3]) successfully deleted
I20250831 19:54:55.414506 2584 leader_election.cc:290] T 172f71a8fe554a5b8bfdb2a5bc109abc P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Requested vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:55.414579 1633 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "172f71a8fe554a5b8bfdb2a5bc109abc" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:54:55.414755 1633 raft_consensus.cc:3058] T 172f71a8fe554a5b8bfdb2a5bc109abc P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:55.415210 1904 raft_consensus.cc:2466] T 172f71a8fe554a5b8bfdb2a5bc109abc P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:54:55.415608 1705 leader_election.cc:304] T 172f71a8fe554a5b8bfdb2a5bc109abc P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:55.416383 2943 leader_election.cc:290] T 172f71a8fe554a5b8bfdb2a5bc109abc P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:55.416605 2943 raft_consensus.cc:2802] T 172f71a8fe554a5b8bfdb2a5bc109abc P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:55.416864 2943 raft_consensus.cc:695] T 172f71a8fe554a5b8bfdb2a5bc109abc P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: Becoming Leader. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Running, Role: LEADER
I20250831 19:54:55.417160 1633 raft_consensus.cc:2466] T 172f71a8fe554a5b8bfdb2a5bc109abc P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:54:55.417160 2943 consensus_queue.cc:237] T 172f71a8fe554a5b8bfdb2a5bc109abc P de831f40fa1348a48a1f0260f4130197 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:55.418449 1631 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "172f71a8fe554a5b8bfdb2a5bc109abc" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:55.418604 1631 raft_consensus.cc:2374] T 172f71a8fe554a5b8bfdb2a5bc109abc P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1. Re-sending same reply.
W20250831 19:54:55.418766 2124 catalog_manager.cc:5774] Failed to send AlterTable RPC for tablet 5ed927d4935143968fb89a73730eb8a1 (table default.table_207ac87518bc487184a89bb52cd204b3 [id=f48af5bc3eff4c819be4aeeff4128c2a], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 5ed927d4935143968fb89a73730eb8a1 consensus state has no leader
I20250831 19:54:55.419536 2124 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36958:
name: "default.Table_3f81774719a24ce68cce90f20487fa97"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:55.420200 2125 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36958:
name: "default.Table_06c3d3b006e64e1b8e20c6d64625ea64"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:55.422583 2958 tablet_replica.cc:331] T 7dbfbe9b2b024f699c52046e09aa3301 P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:54:55.422809 2958 raft_consensus.cc:2241] T 7dbfbe9b2b024f699c52046e09aa3301 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:55.423070 2958 raft_consensus.cc:2270] T 7dbfbe9b2b024f699c52046e09aa3301 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:55.424012 2957 ts_tablet_manager.cc:1905] T 5b948d8301e343b3a5ea1cf90b841513 P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:55.424580 2958 ts_tablet_manager.cc:1905] T 7dbfbe9b2b024f699c52046e09aa3301 P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:55.426267 2959 ts_tablet_manager.cc:1918] T 73e83ccb99b643428aef635b8ea90f03 P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:55.426419 2959 log.cc:1199] T 73e83ccb99b643428aef635b8ea90f03 P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/73e83ccb99b643428aef635b8ea90f03
I20250831 19:54:55.426849 2959 ts_tablet_manager.cc:1939] T 73e83ccb99b643428aef635b8ea90f03 P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
I20250831 19:54:55.427870 2105 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet 73e83ccb99b643428aef635b8ea90f03 (table default.table_486ee0377a714038aaf8f3f5b1ad7f79 [id=028e873d141c4006aca7d45be88d9ae3]) successfully deleted
I20250831 19:54:55.432557 2958 ts_tablet_manager.cc:1918] T 7dbfbe9b2b024f699c52046e09aa3301 P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250831 19:54:55.432789 2959 tablet_replica.cc:331] T 5b948d8301e343b3a5ea1cf90b841513 P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:54:55.433027 2959 raft_consensus.cc:2241] T 5b948d8301e343b3a5ea1cf90b841513 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:55.433238 2959 raft_consensus.cc:2270] T 5b948d8301e343b3a5ea1cf90b841513 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:55.433821 2959 ts_tablet_manager.cc:1905] T 5b948d8301e343b3a5ea1cf90b841513 P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:55.434314 2282 raft_consensus.cc:357] T fae02e9ed1434c7c82f6c5faa3a1acec P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:55.434477 2282 raft_consensus.cc:383] T fae02e9ed1434c7c82f6c5faa3a1acec P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:55.434561 2282 raft_consensus.cc:738] T fae02e9ed1434c7c82f6c5faa3a1acec P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:55.434801 2282 consensus_queue.cc:260] T fae02e9ed1434c7c82f6c5faa3a1acec P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:55.435266 2856 ts_tablet_manager.cc:1428] T fae02e9ed1434c7c82f6c5faa3a1acec P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.027s user 0.001s sys 0.001s
I20250831 19:54:55.436237 2856 tablet_bootstrap.cc:492] T 5ed927d4935143968fb89a73730eb8a1 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:55.439770 2959 ts_tablet_manager.cc:1918] T 5b948d8301e343b3a5ea1cf90b841513 P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250831 19:54:55.439955 2958 log.cc:1199] T 7dbfbe9b2b024f699c52046e09aa3301 P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/7dbfbe9b2b024f699c52046e09aa3301
I20250831 19:54:55.440421 2958 ts_tablet_manager.cc:1939] T 7dbfbe9b2b024f699c52046e09aa3301 P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:54:55.441413 2101 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet 7dbfbe9b2b024f699c52046e09aa3301 (table default.table_d3002519e6964bb484d995d871e766c9 [id=1137b2754d104964bbe5bbaa4a0578b8]) successfully deleted
I20250831 19:54:55.441820 2958 tablet_replica.cc:331] T 5b948d8301e343b3a5ea1cf90b841513 P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:54:55.442083 2958 raft_consensus.cc:2241] T 5b948d8301e343b3a5ea1cf90b841513 P 2441fafe1d62429386f4631ad423567d [term 1 LEADER]: Raft consensus shutting down.
I20250831 19:54:55.442444 2958 raft_consensus.cc:2270] T 5b948d8301e343b3a5ea1cf90b841513 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:55.443065 2958 ts_tablet_manager.cc:1905] T 5b948d8301e343b3a5ea1cf90b841513 P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:55.443241 2959 log.cc:1199] T 5b948d8301e343b3a5ea1cf90b841513 P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/5b948d8301e343b3a5ea1cf90b841513
I20250831 19:54:55.443666 2959 ts_tablet_manager.cc:1939] T 5b948d8301e343b3a5ea1cf90b841513 P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
I20250831 19:54:55.448909 2282 ts_tablet_manager.cc:1428] T fae02e9ed1434c7c82f6c5faa3a1acec P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.038s user 0.002s sys 0.000s
I20250831 19:54:55.448995 2119 catalog_manager.cc:2706] deleted HMS catalog entry for table default.table_35ecd102852d45ef82370764dbe230af [id=98afc1315ef847eaa56545a18123993b]
I20250831 19:54:55.449980 2105 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet 5b948d8301e343b3a5ea1cf90b841513 (table default.table_207ac87518bc487184a89bb52cd204b3 [id=f48af5bc3eff4c819be4aeeff4128c2a]) successfully deleted
I20250831 19:54:55.450289 2959 tablet_replica.cc:331] T 7dbfbe9b2b024f699c52046e09aa3301 P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:54:55.450470 2959 raft_consensus.cc:2241] T 7dbfbe9b2b024f699c52046e09aa3301 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:55.450659 2959 raft_consensus.cc:2270] T 7dbfbe9b2b024f699c52046e09aa3301 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:55.451123 2959 ts_tablet_manager.cc:1905] T 7dbfbe9b2b024f699c52046e09aa3301 P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:55.452531 2282 tablet_bootstrap.cc:492] T e6438652703c45d691f528a4322767b9 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:55.454712 2957 ts_tablet_manager.cc:1918] T 5b948d8301e343b3a5ea1cf90b841513 P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250831 19:54:55.456616 2959 ts_tablet_manager.cc:1918] T 7dbfbe9b2b024f699c52046e09aa3301 P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250831 19:54:55.456737 2959 log.cc:1199] T 7dbfbe9b2b024f699c52046e09aa3301 P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/7dbfbe9b2b024f699c52046e09aa3301
I20250831 19:54:55.457122 2959 ts_tablet_manager.cc:1939] T 7dbfbe9b2b024f699c52046e09aa3301 P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
I20250831 19:54:55.457192 2856 tablet_bootstrap.cc:654] T 5ed927d4935143968fb89a73730eb8a1 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:55.457552 2958 ts_tablet_manager.cc:1918] T 5b948d8301e343b3a5ea1cf90b841513 P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250831 19:54:55.457687 2958 log.cc:1199] T 5b948d8301e343b3a5ea1cf90b841513 P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/5b948d8301e343b3a5ea1cf90b841513
I20250831 19:54:55.458081 2958 ts_tablet_manager.cc:1939] T 5b948d8301e343b3a5ea1cf90b841513 P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:54:55.459002 2101 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet 5b948d8301e343b3a5ea1cf90b841513 (table default.table_207ac87518bc487184a89bb52cd204b3 [id=f48af5bc3eff4c819be4aeeff4128c2a]) successfully deleted
I20250831 19:54:55.459523 2955 webserver.cc:480] Webserver started at http://127.1.1.254:34345/ using document root <none> and password file <none>
I20250831 19:54:55.459980 2105 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet 7dbfbe9b2b024f699c52046e09aa3301 (table default.table_d3002519e6964bb484d995d871e766c9 [id=1137b2754d104964bbe5bbaa4a0578b8]) successfully deleted
I20250831 19:54:55.462423 2955 fs_manager.cc:362] Metadata directory not provided
I20250831 19:54:55.462586 2955 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250831 19:54:55.462921 2699 tablet_bootstrap.cc:492] T 2a0c12b9233244809b96121e034c029e P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:55.464124 2699 ts_tablet_manager.cc:1397] T 2a0c12b9233244809b96121e034c029e P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.201s user 0.034s sys 0.067s
I20250831 19:54:55.464848 2699 raft_consensus.cc:357] T 2a0c12b9233244809b96121e034c029e P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:55.465698 2957 log.cc:1199] T 5b948d8301e343b3a5ea1cf90b841513 P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/5b948d8301e343b3a5ea1cf90b841513
I20250831 19:54:55.466136 2957 ts_tablet_manager.cc:1939] T 5b948d8301e343b3a5ea1cf90b841513 P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
I20250831 19:54:55.455613 2282 tablet_bootstrap.cc:654] T e6438652703c45d691f528a4322767b9 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:55.470456 2104 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet 5b948d8301e343b3a5ea1cf90b841513 (table default.table_207ac87518bc487184a89bb52cd204b3 [id=f48af5bc3eff4c819be4aeeff4128c2a]) successfully deleted
I20250831 19:54:55.472605 2699 raft_consensus.cc:383] T 2a0c12b9233244809b96121e034c029e P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:55.472710 2699 raft_consensus.cc:738] T 2a0c12b9233244809b96121e034c029e P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:55.473068 2699 consensus_queue.cc:260] T 2a0c12b9233244809b96121e034c029e P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:55.473696 2699 ts_tablet_manager.cc:1428] T 2a0c12b9233244809b96121e034c029e P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20250831 19:54:55.474505 2856 tablet_bootstrap.cc:492] T 5ed927d4935143968fb89a73730eb8a1 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:55.474656 2856 ts_tablet_manager.cc:1397] T 5ed927d4935143968fb89a73730eb8a1 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.039s user 0.001s sys 0.001s
I20250831 19:54:55.475337 2856 raft_consensus.cc:357] T 5ed927d4935143968fb89a73730eb8a1 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:55.475492 2856 raft_consensus.cc:383] T 5ed927d4935143968fb89a73730eb8a1 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:55.475605 2856 raft_consensus.cc:738] T 5ed927d4935143968fb89a73730eb8a1 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:55.475826 2856 consensus_queue.cc:260] T 5ed927d4935143968fb89a73730eb8a1 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:55.476284 2856 ts_tablet_manager.cc:1428] T 5ed927d4935143968fb89a73730eb8a1 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250831 19:54:55.476569 2856 tablet_bootstrap.cc:492] T e6438652703c45d691f528a4322767b9 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:55.478590 2856 tablet_bootstrap.cc:654] T e6438652703c45d691f528a4322767b9 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:55.487074 2699 tablet_bootstrap.cc:492] T 326c4af4214a4ea6a9ae784525758630 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:55.488649 2699 tablet_bootstrap.cc:654] T 326c4af4214a4ea6a9ae784525758630 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:55.493247 2282 tablet_bootstrap.cc:492] T e6438652703c45d691f528a4322767b9 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:55.493409 2282 ts_tablet_manager.cc:1397] T e6438652703c45d691f528a4322767b9 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.041s user 0.005s sys 0.000s
I20250831 19:54:55.494012 2856 tablet_bootstrap.cc:492] T e6438652703c45d691f528a4322767b9 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:55.494146 2282 raft_consensus.cc:357] T e6438652703c45d691f528a4322767b9 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:55.494221 2856 ts_tablet_manager.cc:1397] T e6438652703c45d691f528a4322767b9 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.018s user 0.009s sys 0.004s
I20250831 19:54:55.494319 2282 raft_consensus.cc:383] T e6438652703c45d691f528a4322767b9 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:55.494385 2282 raft_consensus.cc:738] T e6438652703c45d691f528a4322767b9 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:55.494630 2282 consensus_queue.cc:260] T e6438652703c45d691f528a4322767b9 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:55.495121 2282 ts_tablet_manager.cc:1428] T e6438652703c45d691f528a4322767b9 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20250831 19:54:55.495219 2856 raft_consensus.cc:357] T e6438652703c45d691f528a4322767b9 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:55.495471 2856 raft_consensus.cc:383] T e6438652703c45d691f528a4322767b9 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:55.496400 2955 fs_manager.cc:714] Time spent opening directory manager: real 0.031s user 0.005s sys 0.003s
I20250831 19:54:55.496909 2856 raft_consensus.cc:738] T e6438652703c45d691f528a4322767b9 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:55.497299 2856 consensus_queue.cc:260] T e6438652703c45d691f528a4322767b9 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:55.498024 2856 ts_tablet_manager.cc:1428] T e6438652703c45d691f528a4322767b9 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20250831 19:54:55.500583 2699 tablet_bootstrap.cc:492] T 326c4af4214a4ea6a9ae784525758630 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:55.500715 2699 ts_tablet_manager.cc:1397] T 326c4af4214a4ea6a9ae784525758630 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.000s
I20250831 19:54:55.501369 2699 raft_consensus.cc:357] T 326c4af4214a4ea6a9ae784525758630 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:55.501557 2699 raft_consensus.cc:383] T 326c4af4214a4ea6a9ae784525758630 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:55.501665 2699 raft_consensus.cc:738] T 326c4af4214a4ea6a9ae784525758630 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:55.501925 2699 consensus_queue.cc:260] T 326c4af4214a4ea6a9ae784525758630 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:55.503012 2699 ts_tablet_manager.cc:1428] T 326c4af4214a4ea6a9ae784525758630 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250831 19:54:55.503705 2699 tablet_bootstrap.cc:492] T 65026496c5b14baab6f66dce4a6d0fc2 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:55.505652 2699 tablet_bootstrap.cc:654] T 65026496c5b14baab6f66dce4a6d0fc2 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:55.515955 2943 raft_consensus.cc:491] T 93bfd2c663634436a61211a406c9f92f P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:55.516113 2943 raft_consensus.cc:513] T 93bfd2c663634436a61211a406c9f92f P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:55.516202 3111 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250831 19:54:55.516664 2943 leader_election.cc:290] T 93bfd2c663634436a61211a406c9f92f P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:55.517263 1904 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "93bfd2c663634436a61211a406c9f92f" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:55.518023 2955 fs_manager.cc:730] Time spent opening block manager: real 0.020s user 0.004s sys 0.001s
W20250831 19:54:55.518083 1705 leader_election.cc:343] T 93bfd2c663634436a61211a406c9f92f P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): Illegal state: must be running to vote when last-logged opid is not known
I20250831 19:54:55.518581 1631 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "93bfd2c663634436a61211a406c9f92f" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:55.518853 1631 raft_consensus.cc:2466] T 93bfd2c663634436a61211a406c9f92f P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 0.
I20250831 19:54:55.519536 1706 leader_election.cc:304] T 93bfd2c663634436a61211a406c9f92f P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197; no voters: 2441fafe1d62429386f4631ad423567d
I20250831 19:54:55.518210 2955 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-0/data,/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-0/wal
uuid: "6c830f6055d64a3b8a9f78b405ad8aa3"
format_stamp: "Formatted at 2025-08-31 19:54:38 on dist-test-slave-v4kn"
I20250831 19:54:55.519937 2955 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250831 19:54:55.521509 2943 raft_consensus.cc:2802] T 93bfd2c663634436a61211a406c9f92f P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:55.521595 2943 raft_consensus.cc:491] T 93bfd2c663634436a61211a406c9f92f P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:55.521677 2943 raft_consensus.cc:3058] T 93bfd2c663634436a61211a406c9f92f P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:55.522686 2123 catalog_manager.cc:2706] deleted HMS catalog entry for table default.table_28a8f98e8e534694b9e17ec734373e90 [id=7963cab6b62d4957a18ed7af45c202c6]
I20250831 19:54:55.524487 2943 raft_consensus.cc:513] T 93bfd2c663634436a61211a406c9f92f P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:55.525683 1904 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "93bfd2c663634436a61211a406c9f92f" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
W20250831 19:54:55.526168 1705 leader_election.cc:343] T 93bfd2c663634436a61211a406c9f92f P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): Illegal state: must be running to vote when last-logged opid is not known
I20250831 19:54:55.531152 1631 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "93bfd2c663634436a61211a406c9f92f" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:54:55.531345 1631 raft_consensus.cc:3058] T 93bfd2c663634436a61211a406c9f92f P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:55.534121 2943 leader_election.cc:290] T 93bfd2c663634436a61211a406c9f92f P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Requested vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:55.537927 1631 raft_consensus.cc:2466] T 93bfd2c663634436a61211a406c9f92f P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:54:55.538376 1706 leader_election.cc:304] T 93bfd2c663634436a61211a406c9f92f P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197; no voters: 2441fafe1d62429386f4631ad423567d
I20250831 19:54:55.543099 2943 raft_consensus.cc:2802] T 93bfd2c663634436a61211a406c9f92f P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:55.544422 2943 raft_consensus.cc:695] T 93bfd2c663634436a61211a406c9f92f P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: Becoming Leader. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Running, Role: LEADER
I20250831 19:54:55.544721 2943 consensus_queue.cc:237] T 93bfd2c663634436a61211a406c9f92f P de831f40fa1348a48a1f0260f4130197 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:55.546708 2995 consensus_queue.cc:1035] T a4e2586021c046dd8c5acd838bb5e83f P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:55.548556 2118 catalog_manager.cc:2149] created HMS catalog entry for table [id=c8f8d410198f4e0ba51900271218aebe]
I20250831 19:54:55.554230 2118 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:36958 (request call id 155) took 1435 ms. Trace:
I20250831 19:54:55.554330 2118 rpcz_store.cc:276] 0831 19:54:54.118609 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:54.599073 (+480464us) service_pool.cc:225] Handling call
0831 19:54:55.269496 (+670423us) catalog_manager.cc:2076] Acquired catalog manager lock
0831 19:54:55.269875 (+ 379us) catalog_manager.cc:2122] Created new table and tablet info
0831 19:54:55.548521 (+278646us) catalog_manager.cc:2148] Created new table in HMS catalog
0831 19:54:55.553954 (+ 5433us) catalog_manager.cc:2182] Wrote table and tablets to system table
0831 19:54:55.554067 (+ 113us) catalog_manager.cc:2216] Inserted table and tablets into CatalogManager maps
0831 19:54:55.554168 (+ 101us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:55.549395 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:55.549563 (+ 168us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:55.549570 (+ 7us) write_op.cc:435] Acquired schema lock
0831 19:54:55.549572 (+ 2us) tablet.cc:660] Decoding operations
0831 19:54:55.549672 (+ 100us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:55.549685 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:55.549690 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:55.549786 (+ 96us) tablet.cc:699] Row locks acquired
0831 19:54:55.549790 (+ 4us) write_op.cc:260] PREPARE: finished
0831 19:54:55.549827 (+ 37us) write_op.cc:270] Start()
0831 19:54:55.549861 (+ 34us) write_op.cc:276] Timestamp: P: 1756670095549793 usec, L: 0
0831 19:54:55.549865 (+ 4us) op_driver.cc:348] REPLICATION: starting
0831 19:54:55.550037 (+ 172us) log.cc:844] Serialized 433 byte log entry
0831 19:54:55.553026 (+ 2989us) op_driver.cc:464] REPLICATION: finished
0831 19:54:55.553374 (+ 348us) write_op.cc:301] APPLY: starting
0831 19:54:55.553407 (+ 33us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:55.553465 (+ 58us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:55.553513 (+ 48us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:55.553665 (+ 152us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:55.553716 (+ 51us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0831 19:54:55.553726 (+ 10us) write_op.cc:312] APPLY: finished
0831 19:54:55.553805 (+ 79us) log.cc:844] Serialized 29 byte log entry
0831 19:54:55.553859 (+ 54us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:55.553877 (+ 18us) write_op.cc:454] Released schema lock
0831 19:54:55.553882 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0831 19:54:55.553947 (+ 65us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:55.553950 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":252682,"Hive Metastore.run_cpu_time_us":304,"Hive Metastore.run_wall_time_us":25634,"child_traces":[["op",{"apply.queue_time_us":257,"apply.run_cpu_time_us":590,"apply.run_wall_time_us":589,"num_ops":2,"prepare.queue_time_us":39,"prepare.run_cpu_time_us":747,"prepare.run_wall_time_us":754,"raft.queue_time_us":392,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":249,"replication_time_us":3134}]]}
I20250831 19:54:55.562678 1749 tablet_service.cc:1468] Processing CreateTablet for tablet bd12184dd70f451fbd9a2025d2c00758 (DEFAULT_TABLE table=default.table_ba7cea85816c4b98a116ec6b7a569c98 [id=c8f8d410198f4e0ba51900271218aebe]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:55.563114 1749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd12184dd70f451fbd9a2025d2c00758. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:55.563066 1614 tablet_service.cc:1468] Processing CreateTablet for tablet bd12184dd70f451fbd9a2025d2c00758 (DEFAULT_TABLE table=default.table_ba7cea85816c4b98a116ec6b7a569c98 [id=c8f8d410198f4e0ba51900271218aebe]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:55.563401 1614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd12184dd70f451fbd9a2025d2c00758. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:55.565968 1883 tablet_service.cc:1468] Processing CreateTablet for tablet bd12184dd70f451fbd9a2025d2c00758 (DEFAULT_TABLE table=default.table_ba7cea85816c4b98a116ec6b7a569c98 [id=c8f8d410198f4e0ba51900271218aebe]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:55.566294 1883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd12184dd70f451fbd9a2025d2c00758. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:55.569777 2995 raft_consensus.cc:491] T 2a0c12b9233244809b96121e034c029e P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:55.569957 2995 raft_consensus.cc:513] T 2a0c12b9233244809b96121e034c029e P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:55.570683 2995 leader_election.cc:290] T 2a0c12b9233244809b96121e034c029e P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:55.571480 1903 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2a0c12b9233244809b96121e034c029e" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:55.571666 1903 raft_consensus.cc:2466] T 2a0c12b9233244809b96121e034c029e P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 0.
I20250831 19:54:55.571486 2118 catalog_manager.cc:5582] T 172f71a8fe554a5b8bfdb2a5bc109abc P de831f40fa1348a48a1f0260f4130197 reported cstate change: term changed from 0 to 1, leader changed from <none> to de831f40fa1348a48a1f0260f4130197 (127.1.1.194). New cstate: current_term: 1 leader_uuid: "de831f40fa1348a48a1f0260f4130197" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: UNKNOWN } } }
I20250831 19:54:55.571668 1769 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2a0c12b9233244809b96121e034c029e" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:55.571863 1769 raft_consensus.cc:2466] T 2a0c12b9233244809b96121e034c029e P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 0.
I20250831 19:54:55.572335 1568 leader_election.cc:304] T 2a0c12b9233244809b96121e034c029e P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:54:55.572856 2282 tablet_bootstrap.cc:492] T bd12184dd70f451fbd9a2025d2c00758 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:55.573143 2995 raft_consensus.cc:2802] T 2a0c12b9233244809b96121e034c029e P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:55.573228 2995 raft_consensus.cc:491] T 2a0c12b9233244809b96121e034c029e P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:55.573319 2995 raft_consensus.cc:3058] T 2a0c12b9233244809b96121e034c029e P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:55.574625 2282 tablet_bootstrap.cc:654] T bd12184dd70f451fbd9a2025d2c00758 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:55.575978 2995 raft_consensus.cc:513] T 2a0c12b9233244809b96121e034c029e P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:55.577018 1903 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2a0c12b9233244809b96121e034c029e" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:54:55.577196 1903 raft_consensus.cc:3058] T 2a0c12b9233244809b96121e034c029e P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:55.577466 1769 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2a0c12b9233244809b96121e034c029e" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197"
I20250831 19:54:55.577632 1769 raft_consensus.cc:3058] T 2a0c12b9233244809b96121e034c029e P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:55.579597 1903 raft_consensus.cc:2466] T 2a0c12b9233244809b96121e034c029e P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1.
I20250831 19:54:55.580299 1769 raft_consensus.cc:2466] T 2a0c12b9233244809b96121e034c029e P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1.
I20250831 19:54:55.581141 1568 leader_election.cc:304] T 2a0c12b9233244809b96121e034c029e P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:54:55.581559 3018 raft_consensus.cc:2802] T 2a0c12b9233244809b96121e034c029e P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:55.581724 2995 leader_election.cc:290] T 2a0c12b9233244809b96121e034c029e P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Requested vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:55.581746 3018 raft_consensus.cc:695] T 2a0c12b9233244809b96121e034c029e P 89aa85d59c53436ebdf3074b13d14825 [term 1 LEADER]: Becoming Leader. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Running, Role: LEADER
I20250831 19:54:55.582427 3018 consensus_queue.cc:237] T 2a0c12b9233244809b96121e034c029e P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:55.585666 2856 tablet_bootstrap.cc:492] T bd12184dd70f451fbd9a2025d2c00758 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:55.588212 2856 tablet_bootstrap.cc:654] T bd12184dd70f451fbd9a2025d2c00758 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:55.596776 2282 tablet_bootstrap.cc:492] T bd12184dd70f451fbd9a2025d2c00758 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:55.596922 2282 ts_tablet_manager.cc:1397] T bd12184dd70f451fbd9a2025d2c00758 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.024s user 0.004s sys 0.005s
I20250831 19:54:55.600818 2282 raft_consensus.cc:357] T bd12184dd70f451fbd9a2025d2c00758 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:55.600980 2282 raft_consensus.cc:383] T bd12184dd70f451fbd9a2025d2c00758 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:55.601066 2282 raft_consensus.cc:738] T bd12184dd70f451fbd9a2025d2c00758 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:55.601259 2282 consensus_queue.cc:260] T bd12184dd70f451fbd9a2025d2c00758 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:55.601784 2282 ts_tablet_manager.cc:1428] T bd12184dd70f451fbd9a2025d2c00758 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20250831 19:54:55.603480 2118 catalog_manager.cc:5674] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237) does not have the latest schema for tablet 2a0c12b9233244809b96121e034c029e (table default.table_af003c3f30c04853bc025b34d543d0e0 [id=5ce6c4d5dcd34d73af61fd2c4bf28799]). Expected version 1 got 0
I20250831 19:54:55.605886 2118 catalog_manager.cc:5582] T 2a0c12b9233244809b96121e034c029e P 89aa85d59c53436ebdf3074b13d14825 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193). New cstate: current_term: 1 leader_uuid: "89aa85d59c53436ebdf3074b13d14825" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: HEALTHY } } }
I20250831 19:54:55.614683 2118 catalog_manager.cc:5674] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197) does not have the latest schema for tablet 2a0c12b9233244809b96121e034c029e (table default.table_af003c3f30c04853bc025b34d543d0e0 [id=5ce6c4d5dcd34d73af61fd2c4bf28799]). Expected version 1 got 0
I20250831 19:54:55.615348 2118 catalog_manager.cc:5674] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197) does not have the latest schema for tablet e6438652703c45d691f528a4322767b9 (table default.table_d3002519e6964bb484d995d871e766c9 [id=1137b2754d104964bbe5bbaa4a0578b8]). Expected version 3 got 0
I20250831 19:54:55.616451 2117 catalog_manager.cc:3460] renamed table default.table_ca70026c55be4e7a9db72440e0205619 [id=10598630389746d2886e5687fe074fd7] in HMS: new name default.table_9e316239c779453a9a3a3b8b84d62adc
W20250831 19:54:55.625710 2118 catalog_manager.cc:5774] Failed to send AlterTable RPC for tablet e6438652703c45d691f528a4322767b9 (table default.table_d3002519e6964bb484d995d871e766c9 [id=1137b2754d104964bbe5bbaa4a0578b8], current schema version=3): Not found: failed to reset TS proxy: No leader found: Tablet e6438652703c45d691f528a4322767b9 consensus state has no leader
I20250831 19:54:55.626108 2856 tablet_bootstrap.cc:492] T bd12184dd70f451fbd9a2025d2c00758 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:55.626282 2856 ts_tablet_manager.cc:1397] T bd12184dd70f451fbd9a2025d2c00758 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.041s user 0.006s sys 0.004s
I20250831 19:54:55.627113 2856 raft_consensus.cc:357] T bd12184dd70f451fbd9a2025d2c00758 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:55.627285 2856 raft_consensus.cc:383] T bd12184dd70f451fbd9a2025d2c00758 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:55.627364 2856 raft_consensus.cc:738] T bd12184dd70f451fbd9a2025d2c00758 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:55.627944 2856 consensus_queue.cc:260] T bd12184dd70f451fbd9a2025d2c00758 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:55.630322 2856 ts_tablet_manager.cc:1428] T bd12184dd70f451fbd9a2025d2c00758 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20250831 19:54:55.631989 1903 raft_consensus.cc:1273] T 2a0c12b9233244809b96121e034c029e P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Refusing update from remote peer 89aa85d59c53436ebdf3074b13d14825: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250831 19:54:55.632598 1770 raft_consensus.cc:1273] T 2a0c12b9233244809b96121e034c029e P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Refusing update from remote peer 89aa85d59c53436ebdf3074b13d14825: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250831 19:54:55.633128 3018 consensus_queue.cc:1035] T 2a0c12b9233244809b96121e034c029e P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:55.633539 3081 consensus_queue.cc:1035] T 2a0c12b9233244809b96121e034c029e P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:55.635838 2118 catalog_manager.cc:5674] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237) does not have the latest schema for tablet 2a0c12b9233244809b96121e034c029e (table default.table_af003c3f30c04853bc025b34d543d0e0 [id=5ce6c4d5dcd34d73af61fd2c4bf28799]). Expected version 1 got 0
I20250831 19:54:55.645880 2995 consensus_queue.cc:1035] T a4e2586021c046dd8c5acd838bb5e83f P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:55.650203 3081 raft_consensus.cc:491] T 65026496c5b14baab6f66dce4a6d0fc2 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:55.650421 3081 raft_consensus.cc:513] T 65026496c5b14baab6f66dce4a6d0fc2 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:55.650966 3081 leader_election.cc:290] T 65026496c5b14baab6f66dce4a6d0fc2 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:55.651652 1904 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "65026496c5b14baab6f66dce4a6d0fc2" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
W20250831 19:54:55.652180 1568 leader_election.cc:343] T 65026496c5b14baab6f66dce4a6d0fc2 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): Illegal state: must be running to vote when last-logged opid is not known
I20250831 19:54:55.653048 1771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "65026496c5b14baab6f66dce4a6d0fc2" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:55.653265 1771 raft_consensus.cc:2466] T 65026496c5b14baab6f66dce4a6d0fc2 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 0.
I20250831 19:54:55.653852 1570 leader_election.cc:304] T 65026496c5b14baab6f66dce4a6d0fc2 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197; no voters: 2441fafe1d62429386f4631ad423567d
I20250831 19:54:55.655474 2995 raft_consensus.cc:2802] T 65026496c5b14baab6f66dce4a6d0fc2 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:55.655568 2995 raft_consensus.cc:491] T 65026496c5b14baab6f66dce4a6d0fc2 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:55.655664 2995 raft_consensus.cc:3058] T 65026496c5b14baab6f66dce4a6d0fc2 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:55.656390 2118 catalog_manager.cc:5674] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475) does not have the latest schema for tablet e6438652703c45d691f528a4322767b9 (table default.table_d3002519e6964bb484d995d871e766c9 [id=1137b2754d104964bbe5bbaa4a0578b8]). Expected version 3 got 0
I20250831 19:54:55.656628 2118 catalog_manager.cc:5582] T 93bfd2c663634436a61211a406c9f92f P de831f40fa1348a48a1f0260f4130197 reported cstate change: term changed from 0 to 1, leader changed from <none> to de831f40fa1348a48a1f0260f4130197 (127.1.1.194). New cstate: current_term: 1 leader_uuid: "de831f40fa1348a48a1f0260f4130197" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: UNKNOWN } } }
I20250831 19:54:55.657063 2118 catalog_manager.cc:5674] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475) does not have the latest schema for tablet 5ed927d4935143968fb89a73730eb8a1 (table default.table_207ac87518bc487184a89bb52cd204b3 [id=f48af5bc3eff4c819be4aeeff4128c2a]). Expected version 1 got 0
I20250831 19:54:55.660197 2995 raft_consensus.cc:513] T 65026496c5b14baab6f66dce4a6d0fc2 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:55.661139 1904 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "65026496c5b14baab6f66dce4a6d0fc2" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
W20250831 19:54:55.661641 1568 leader_election.cc:343] T 65026496c5b14baab6f66dce4a6d0fc2 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): Illegal state: must be running to vote when last-logged opid is not known
I20250831 19:54:55.662220 2995 leader_election.cc:290] T 65026496c5b14baab6f66dce4a6d0fc2 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Requested vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:55.662911 3070 tablet.cc:1722] T 2a0c12b9233244809b96121e034c029e P 89aa85d59c53436ebdf3074b13d14825: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:55.664113 1771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "65026496c5b14baab6f66dce4a6d0fc2" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197"
I20250831 19:54:55.664305 1771 raft_consensus.cc:3058] T 65026496c5b14baab6f66dce4a6d0fc2 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:55.673588 3067 tablet.cc:1722] T 2a0c12b9233244809b96121e034c029e P de831f40fa1348a48a1f0260f4130197: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:55.677315 1771 raft_consensus.cc:2466] T 65026496c5b14baab6f66dce4a6d0fc2 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1.
I20250831 19:54:55.677762 1570 leader_election.cc:304] T 65026496c5b14baab6f66dce4a6d0fc2 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197; no voters: 2441fafe1d62429386f4631ad423567d
I20250831 19:54:55.678197 3081 raft_consensus.cc:2802] T 65026496c5b14baab6f66dce4a6d0fc2 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:55.678332 3081 raft_consensus.cc:695] T 65026496c5b14baab6f66dce4a6d0fc2 P 89aa85d59c53436ebdf3074b13d14825 [term 1 LEADER]: Becoming Leader. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Running, Role: LEADER
I20250831 19:54:55.678620 3081 consensus_queue.cc:237] T 65026496c5b14baab6f66dce4a6d0fc2 P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:55.686676 3068 tablet.cc:1722] T 2a0c12b9233244809b96121e034c029e P 2441fafe1d62429386f4631ad423567d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:55.691478 2955 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250831 19:54:55.692474 2955 env_posix.cc:2264] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20250831 19:54:55.692744 2955 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250831 19:54:55.694291 2118 catalog_manager.cc:5674] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237) does not have the latest schema for tablet 2a0c12b9233244809b96121e034c029e (table default.table_af003c3f30c04853bc025b34d543d0e0 [id=5ce6c4d5dcd34d73af61fd2c4bf28799]). Expected version 1 got 0
I20250831 19:54:55.699021 2118 catalog_manager.cc:5582] T 65026496c5b14baab6f66dce4a6d0fc2 P 89aa85d59c53436ebdf3074b13d14825 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193). New cstate: current_term: 1 leader_uuid: "89aa85d59c53436ebdf3074b13d14825" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: HEALTHY } } }
I20250831 19:54:55.708226 2118 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36958:
name: "default.Table_4dba59fc46824095bd698aa0ccc13224"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:55.710440 2699 tablet_bootstrap.cc:492] T 65026496c5b14baab6f66dce4a6d0fc2 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:55.710687 2699 ts_tablet_manager.cc:1397] T 65026496c5b14baab6f66dce4a6d0fc2 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.207s user 0.035s sys 0.021s
I20250831 19:54:55.711753 2699 raft_consensus.cc:357] T 65026496c5b14baab6f66dce4a6d0fc2 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:55.712023 2699 raft_consensus.cc:383] T 65026496c5b14baab6f66dce4a6d0fc2 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:55.712126 2699 raft_consensus.cc:738] T 65026496c5b14baab6f66dce4a6d0fc2 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:55.712426 2699 consensus_queue.cc:260] T 65026496c5b14baab6f66dce4a6d0fc2 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:55.713120 2699 ts_tablet_manager.cc:1428] T 65026496c5b14baab6f66dce4a6d0fc2 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.002s user 0.001s sys 0.002s
I20250831 19:54:55.713641 2699 tablet_bootstrap.cc:492] T 93bfd2c663634436a61211a406c9f92f P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:55.716089 2699 tablet_bootstrap.cc:654] T 93bfd2c663634436a61211a406c9f92f P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:55.732311 2699 tablet_bootstrap.cc:492] T 93bfd2c663634436a61211a406c9f92f P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:55.732476 2699 ts_tablet_manager.cc:1397] T 93bfd2c663634436a61211a406c9f92f P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.019s user 0.006s sys 0.002s
I20250831 19:54:55.733290 2699 raft_consensus.cc:357] T 93bfd2c663634436a61211a406c9f92f P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:55.733517 2699 raft_consensus.cc:383] T 93bfd2c663634436a61211a406c9f92f P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:55.733623 2699 raft_consensus.cc:738] T 93bfd2c663634436a61211a406c9f92f P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:55.733846 2699 consensus_queue.cc:260] T 93bfd2c663634436a61211a406c9f92f P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:55.734457 2699 ts_tablet_manager.cc:1428] T 93bfd2c663634436a61211a406c9f92f P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20250831 19:54:55.735033 2699 tablet_bootstrap.cc:492] T fae02e9ed1434c7c82f6c5faa3a1acec P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:55.736768 2699 tablet_bootstrap.cc:654] T fae02e9ed1434c7c82f6c5faa3a1acec P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:55.749330 2699 tablet_bootstrap.cc:492] T fae02e9ed1434c7c82f6c5faa3a1acec P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:55.749521 2699 ts_tablet_manager.cc:1397] T fae02e9ed1434c7c82f6c5faa3a1acec P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.000s
I20250831 19:54:55.750191 2699 raft_consensus.cc:357] T fae02e9ed1434c7c82f6c5faa3a1acec P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:55.750355 2699 raft_consensus.cc:383] T fae02e9ed1434c7c82f6c5faa3a1acec P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:55.750406 2699 raft_consensus.cc:738] T fae02e9ed1434c7c82f6c5faa3a1acec P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:55.750617 2699 consensus_queue.cc:260] T fae02e9ed1434c7c82f6c5faa3a1acec P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:55.751058 2699 ts_tablet_manager.cc:1428] T fae02e9ed1434c7c82f6c5faa3a1acec P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250831 19:54:55.751794 2699 tablet_bootstrap.cc:492] T 5ed927d4935143968fb89a73730eb8a1 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:55.753327 2699 tablet_bootstrap.cc:654] T 5ed927d4935143968fb89a73730eb8a1 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:55.770555 2699 tablet_bootstrap.cc:492] T 5ed927d4935143968fb89a73730eb8a1 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:55.770725 2699 ts_tablet_manager.cc:1397] T 5ed927d4935143968fb89a73730eb8a1 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.019s user 0.002s sys 0.008s
I20250831 19:54:55.772505 2699 raft_consensus.cc:357] T 5ed927d4935143968fb89a73730eb8a1 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:55.772702 2699 raft_consensus.cc:383] T 5ed927d4935143968fb89a73730eb8a1 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:55.772799 2699 raft_consensus.cc:738] T 5ed927d4935143968fb89a73730eb8a1 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:55.773851 2699 consensus_queue.cc:260] T 5ed927d4935143968fb89a73730eb8a1 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:55.778666 2699 ts_tablet_manager.cc:1428] T 5ed927d4935143968fb89a73730eb8a1 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20250831 19:54:55.779692 2699 tablet_bootstrap.cc:492] T e6438652703c45d691f528a4322767b9 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:55.780534 2120 catalog_manager.cc:3460] renamed table default.table_d30c0aaa2c2a465ca2999246bdd68e5f [id=ba4c5ecf4ae94ede9bfb83af2ee894ab] in HMS: new name default.table_4e12fc12cae640b99d4f3794151b6915
I20250831 19:54:55.783537 2699 tablet_bootstrap.cc:654] T e6438652703c45d691f528a4322767b9 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:55.790508 2778 consensus_queue.cc:1035] T c307e8673f164f509e0c5ebcfcc2a033 P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:55.793035 2778 consensus_queue.cc:1035] T c307e8673f164f509e0c5ebcfcc2a033 P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:55.799153 2186 catalog_manager.cc:2747] Deleting table default.table_35ecd102852d45ef82370764dbe230af [id=98afc1315ef847eaa56545a18123993b] in response to Hive Metastore notification log event 141
I20250831 19:54:55.808015 2186 catalog_manager.cc:5869] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Sending DeleteTablet for 3 replicas of tablet 99d703eb7412458e95070fffe3cde91b
I20250831 19:54:55.808759 1883 tablet_service.cc:1515] Processing DeleteTablet for tablet 99d703eb7412458e95070fffe3cde91b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:55 UTC) from {username='slave'} at 127.0.0.1:45906
I20250831 19:54:55.809010 2958 tablet_replica.cc:331] T 99d703eb7412458e95070fffe3cde91b P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:54:55.808992 1749 tablet_service.cc:1515] Processing DeleteTablet for tablet 99d703eb7412458e95070fffe3cde91b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:55 UTC) from {username='slave'} at 127.0.0.1:50674
I20250831 19:54:55.809190 2958 raft_consensus.cc:2241] T 99d703eb7412458e95070fffe3cde91b P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:55.809221 2959 tablet_replica.cc:331] T 99d703eb7412458e95070fffe3cde91b P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:54:55.809357 2958 raft_consensus.cc:2270] T 99d703eb7412458e95070fffe3cde91b P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:55.809405 2959 raft_consensus.cc:2241] T 99d703eb7412458e95070fffe3cde91b P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:55.809581 2959 raft_consensus.cc:2270] T 99d703eb7412458e95070fffe3cde91b P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:55.809768 1614 tablet_service.cc:1515] Processing DeleteTablet for tablet 99d703eb7412458e95070fffe3cde91b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:55 UTC) from {username='slave'} at 127.0.0.1:51022
I20250831 19:54:55.810043 2957 tablet_replica.cc:331] T 99d703eb7412458e95070fffe3cde91b P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:54:55.810108 2959 ts_tablet_manager.cc:1905] T 99d703eb7412458e95070fffe3cde91b P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:55.810221 2957 raft_consensus.cc:2241] T 99d703eb7412458e95070fffe3cde91b P 89aa85d59c53436ebdf3074b13d14825 [term 1 LEADER]: Raft consensus shutting down.
I20250831 19:54:55.810293 2958 ts_tablet_manager.cc:1905] T 99d703eb7412458e95070fffe3cde91b P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:55.810511 2957 raft_consensus.cc:2270] T 99d703eb7412458e95070fffe3cde91b P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:55.810989 2957 ts_tablet_manager.cc:1905] T 99d703eb7412458e95070fffe3cde91b P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:55.816485 2186 catalog_manager.cc:2747] Deleting table default.table_28a8f98e8e534694b9e17ec734373e90 [id=7963cab6b62d4957a18ed7af45c202c6] in response to Hive Metastore notification log event 142
I20250831 19:54:55.816795 2995 raft_consensus.cc:491] T bd12184dd70f451fbd9a2025d2c00758 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:55.816955 2995 raft_consensus.cc:513] T bd12184dd70f451fbd9a2025d2c00758 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:55.817534 2995 leader_election.cc:290] T bd12184dd70f451fbd9a2025d2c00758 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:55.818166 1769 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bd12184dd70f451fbd9a2025d2c00758" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:55.818352 1769 raft_consensus.cc:2466] T bd12184dd70f451fbd9a2025d2c00758 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 0.
I20250831 19:54:55.818508 2959 ts_tablet_manager.cc:1918] T 99d703eb7412458e95070fffe3cde91b P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:55.818754 1570 leader_election.cc:304] T bd12184dd70f451fbd9a2025d2c00758 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:55.819139 2959 log.cc:1199] T 99d703eb7412458e95070fffe3cde91b P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/99d703eb7412458e95070fffe3cde91b
I20250831 19:54:55.819540 2959 ts_tablet_manager.cc:1939] T 99d703eb7412458e95070fffe3cde91b P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
I20250831 19:54:55.820009 1904 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bd12184dd70f451fbd9a2025d2c00758" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:55.820775 2995 raft_consensus.cc:2802] T bd12184dd70f451fbd9a2025d2c00758 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:55.820878 2995 raft_consensus.cc:491] T bd12184dd70f451fbd9a2025d2c00758 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:55.820976 2995 raft_consensus.cc:3058] T bd12184dd70f451fbd9a2025d2c00758 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:55.823426 2995 raft_consensus.cc:513] T bd12184dd70f451fbd9a2025d2c00758 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:55.823755 2186 catalog_manager.cc:5869] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Sending DeleteTablet for 3 replicas of tablet 539e87d86bf7448c978743375bdb3a79
I20250831 19:54:55.824337 1749 tablet_service.cc:1515] Processing DeleteTablet for tablet 539e87d86bf7448c978743375bdb3a79 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:55 UTC) from {username='slave'} at 127.0.0.1:50674
I20250831 19:54:55.824337 1904 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bd12184dd70f451fbd9a2025d2c00758" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
W20250831 19:54:55.824654 1568 leader_election.cc:343] T bd12184dd70f451fbd9a2025d2c00758 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): Illegal state: must be running to vote when last-logged opid is not known
I20250831 19:54:55.825100 1883 tablet_service.cc:1515] Processing DeleteTablet for tablet 539e87d86bf7448c978743375bdb3a79 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:55 UTC) from {username='slave'} at 127.0.0.1:45906
I20250831 19:54:55.825328 1614 tablet_service.cc:1515] Processing DeleteTablet for tablet 539e87d86bf7448c978743375bdb3a79 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:55 UTC) from {username='slave'} at 127.0.0.1:51022
W20250831 19:54:55.825333 1568 leader_election.cc:343] T bd12184dd70f451fbd9a2025d2c00758 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): Illegal state: must be running to vote when last-logged opid is not known
I20250831 19:54:55.825959 2105 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet 99d703eb7412458e95070fffe3cde91b (table default.table_35ecd102852d45ef82370764dbe230af [id=98afc1315ef847eaa56545a18123993b]) successfully deleted
I20250831 19:54:55.826251 2959 tablet_replica.cc:331] T 539e87d86bf7448c978743375bdb3a79 P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:54:55.826483 2959 raft_consensus.cc:2241] T 539e87d86bf7448c978743375bdb3a79 P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: Raft consensus shutting down.
I20250831 19:54:55.826779 2959 raft_consensus.cc:2270] T 539e87d86bf7448c978743375bdb3a79 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:55.827251 2959 ts_tablet_manager.cc:1905] T 539e87d86bf7448c978743375bdb3a79 P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:55.828826 2957 ts_tablet_manager.cc:1918] T 99d703eb7412458e95070fffe3cde91b P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:55.829092 2958 ts_tablet_manager.cc:1918] T 99d703eb7412458e95070fffe3cde91b P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:55.829130 2957 log.cc:1199] T 99d703eb7412458e95070fffe3cde91b P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/99d703eb7412458e95070fffe3cde91b
I20250831 19:54:55.829257 2958 log.cc:1199] T 99d703eb7412458e95070fffe3cde91b P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/99d703eb7412458e95070fffe3cde91b
I20250831 19:54:55.829644 2958 ts_tablet_manager.cc:1939] T 99d703eb7412458e95070fffe3cde91b P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:54:55.830255 2995 leader_election.cc:290] T bd12184dd70f451fbd9a2025d2c00758 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Requested vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:55.831283 2101 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet 99d703eb7412458e95070fffe3cde91b (table default.table_35ecd102852d45ef82370764dbe230af [id=98afc1315ef847eaa56545a18123993b]) successfully deleted
I20250831 19:54:55.832398 2958 tablet_replica.cc:331] T 539e87d86bf7448c978743375bdb3a79 P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:54:55.833871 2957 ts_tablet_manager.cc:1939] T 99d703eb7412458e95070fffe3cde91b P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
I20250831 19:54:55.835131 1769 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bd12184dd70f451fbd9a2025d2c00758" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197"
I20250831 19:54:55.835202 2958 raft_consensus.cc:2241] T 539e87d86bf7448c978743375bdb3a79 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:55.835297 1769 raft_consensus.cc:3058] T bd12184dd70f451fbd9a2025d2c00758 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:55.835369 2958 raft_consensus.cc:2270] T 539e87d86bf7448c978743375bdb3a79 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:55.835856 2958 ts_tablet_manager.cc:1905] T 539e87d86bf7448c978743375bdb3a79 P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:55.839006 1769 raft_consensus.cc:2466] T bd12184dd70f451fbd9a2025d2c00758 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1.
I20250831 19:54:55.841073 2958 ts_tablet_manager.cc:1918] T 539e87d86bf7448c978743375bdb3a79 P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:55.841192 2958 log.cc:1199] T 539e87d86bf7448c978743375bdb3a79 P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/539e87d86bf7448c978743375bdb3a79
I20250831 19:54:55.841754 2958 ts_tablet_manager.cc:1939] T 539e87d86bf7448c978743375bdb3a79 P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:54:55.842882 2101 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet 539e87d86bf7448c978743375bdb3a79 (table default.table_28a8f98e8e534694b9e17ec734373e90 [id=7963cab6b62d4957a18ed7af45c202c6]) successfully deleted
I20250831 19:54:55.842947 2943 consensus_queue.cc:1035] T 27a32ae2ed1a4b94b1a2e6a9aa9d0d8c P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:55.843780 2959 ts_tablet_manager.cc:1918] T 539e87d86bf7448c978743375bdb3a79 P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:55.843766 1570 leader_election.cc:304] T bd12184dd70f451fbd9a2025d2c00758 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197; no voters: 2441fafe1d62429386f4631ad423567d
I20250831 19:54:55.843875 2959 log.cc:1199] T 539e87d86bf7448c978743375bdb3a79 P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/539e87d86bf7448c978743375bdb3a79
I20250831 19:54:55.844206 3081 raft_consensus.cc:2802] T bd12184dd70f451fbd9a2025d2c00758 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:55.844389 3081 raft_consensus.cc:695] T bd12184dd70f451fbd9a2025d2c00758 P 89aa85d59c53436ebdf3074b13d14825 [term 1 LEADER]: Becoming Leader. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Running, Role: LEADER
I20250831 19:54:55.844686 3081 consensus_queue.cc:237] T bd12184dd70f451fbd9a2025d2c00758 P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:55.844897 2959 ts_tablet_manager.cc:1939] T 539e87d86bf7448c978743375bdb3a79 P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
I20250831 19:54:55.846902 2105 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet 539e87d86bf7448c978743375bdb3a79 (table default.table_28a8f98e8e534694b9e17ec734373e90 [id=7963cab6b62d4957a18ed7af45c202c6]) successfully deleted
I20250831 19:54:55.852634 2104 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet 99d703eb7412458e95070fffe3cde91b (table default.table_35ecd102852d45ef82370764dbe230af [id=98afc1315ef847eaa56545a18123993b]) successfully deleted
I20250831 19:54:55.852846 2957 tablet_replica.cc:331] T 539e87d86bf7448c978743375bdb3a79 P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:54:55.853057 2957 raft_consensus.cc:2241] T 539e87d86bf7448c978743375bdb3a79 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:55.853210 2957 raft_consensus.cc:2270] T 539e87d86bf7448c978743375bdb3a79 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:55.853785 2957 ts_tablet_manager.cc:1905] T 539e87d86bf7448c978743375bdb3a79 P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:55.867681 2699 tablet_bootstrap.cc:492] T e6438652703c45d691f528a4322767b9 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:55.867949 2699 ts_tablet_manager.cc:1397] T e6438652703c45d691f528a4322767b9 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.088s user 0.002s sys 0.006s
I20250831 19:54:55.869087 2699 raft_consensus.cc:357] T e6438652703c45d691f528a4322767b9 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:55.869868 2699 raft_consensus.cc:383] T e6438652703c45d691f528a4322767b9 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:55.870005 2699 raft_consensus.cc:738] T e6438652703c45d691f528a4322767b9 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:55.870339 2699 consensus_queue.cc:260] T e6438652703c45d691f528a4322767b9 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:55.870913 2699 ts_tablet_manager.cc:1428] T e6438652703c45d691f528a4322767b9 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20250831 19:54:55.871232 2699 tablet_bootstrap.cc:492] T bd12184dd70f451fbd9a2025d2c00758 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:55.879112 2957 ts_tablet_manager.cc:1918] T 539e87d86bf7448c978743375bdb3a79 P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:55.883353 2957 log.cc:1199] T 539e87d86bf7448c978743375bdb3a79 P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/539e87d86bf7448c978743375bdb3a79
I20250831 19:54:55.885233 3067 tablet.cc:1722] T b67e0472244e4d79b8dfb7e7474b96b7 P de831f40fa1348a48a1f0260f4130197: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250831 19:54:55.885576 2699 tablet_bootstrap.cc:654] T bd12184dd70f451fbd9a2025d2c00758 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:55.884191 3070 tablet.cc:1722] T b67e0472244e4d79b8dfb7e7474b96b7 P 89aa85d59c53436ebdf3074b13d14825: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250831 19:54:55.883848 2957 ts_tablet_manager.cc:1939] T 539e87d86bf7448c978743375bdb3a79 P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
I20250831 19:54:55.902603 3070 tablet.cc:1722] T 9fc4297f4d704acda823360fe6d406cf P 89aa85d59c53436ebdf3074b13d14825: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:55.902829 2104 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet 539e87d86bf7448c978743375bdb3a79 (table default.table_28a8f98e8e534694b9e17ec734373e90 [id=7963cab6b62d4957a18ed7af45c202c6]) successfully deleted
I20250831 19:54:55.903385 3067 tablet.cc:1722] T 9fc4297f4d704acda823360fe6d406cf P de831f40fa1348a48a1f0260f4130197: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:55.904922 3068 tablet.cc:1722] T 9fc4297f4d704acda823360fe6d406cf P 2441fafe1d62429386f4631ad423567d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:55.919881 2699 tablet_bootstrap.cc:492] T bd12184dd70f451fbd9a2025d2c00758 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:55.920048 2699 ts_tablet_manager.cc:1397] T bd12184dd70f451fbd9a2025d2c00758 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.049s user 0.004s sys 0.010s
I20250831 19:54:55.920774 2699 raft_consensus.cc:357] T bd12184dd70f451fbd9a2025d2c00758 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:55.920949 2699 raft_consensus.cc:383] T bd12184dd70f451fbd9a2025d2c00758 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:55.921059 2699 raft_consensus.cc:738] T bd12184dd70f451fbd9a2025d2c00758 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:55.921949 2699 consensus_queue.cc:260] T bd12184dd70f451fbd9a2025d2c00758 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:55.928123 2699 ts_tablet_manager.cc:1428] T bd12184dd70f451fbd9a2025d2c00758 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.008s user 0.000s sys 0.003s
I20250831 19:54:55.934621 3068 tablet.cc:1722] T b67e0472244e4d79b8dfb7e7474b96b7 P 2441fafe1d62429386f4631ad423567d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250831 19:54:55.941787 2778 consensus_queue.cc:1035] T 27a32ae2ed1a4b94b1a2e6a9aa9d0d8c P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:55.958685 3081 raft_consensus.cc:491] T 5ed927d4935143968fb89a73730eb8a1 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:55.958818 3081 raft_consensus.cc:513] T 5ed927d4935143968fb89a73730eb8a1 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:55.959324 3081 leader_election.cc:290] T 5ed927d4935143968fb89a73730eb8a1 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:55.959901 1771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5ed927d4935143968fb89a73730eb8a1" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:55.960101 1771 raft_consensus.cc:2466] T 5ed927d4935143968fb89a73730eb8a1 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 0.
I20250831 19:54:55.960549 1570 leader_election.cc:304] T 5ed927d4935143968fb89a73730eb8a1 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:55.961068 3018 raft_consensus.cc:2802] T 5ed927d4935143968fb89a73730eb8a1 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:55.961176 3018 raft_consensus.cc:491] T 5ed927d4935143968fb89a73730eb8a1 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:55.961247 3018 raft_consensus.cc:3058] T 5ed927d4935143968fb89a73730eb8a1 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:55.961835 1903 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5ed927d4935143968fb89a73730eb8a1" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:55.962054 1903 raft_consensus.cc:2466] T 5ed927d4935143968fb89a73730eb8a1 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 0.
I20250831 19:54:55.964609 3018 raft_consensus.cc:513] T 5ed927d4935143968fb89a73730eb8a1 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:55.967585 1903 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5ed927d4935143968fb89a73730eb8a1" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:54:55.967778 1903 raft_consensus.cc:3058] T 5ed927d4935143968fb89a73730eb8a1 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:55.969516 3018 leader_election.cc:290] T 5ed927d4935143968fb89a73730eb8a1 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Requested vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:55.970520 1771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5ed927d4935143968fb89a73730eb8a1" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197"
I20250831 19:54:55.970693 1771 raft_consensus.cc:3058] T 5ed927d4935143968fb89a73730eb8a1 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:55.971622 2122 catalog_manager.cc:2706] deleted HMS catalog entry for table default.table_b5294d0b8f564e31865783000a954688 [id=ee93396a22b546038473cc2df15fdc87]
I20250831 19:54:55.973212 1771 raft_consensus.cc:2466] T 5ed927d4935143968fb89a73730eb8a1 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1.
I20250831 19:54:55.973878 1570 leader_election.cc:304] T 5ed927d4935143968fb89a73730eb8a1 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:55.974448 3081 raft_consensus.cc:2802] T 5ed927d4935143968fb89a73730eb8a1 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:55.974575 3081 raft_consensus.cc:695] T 5ed927d4935143968fb89a73730eb8a1 P 89aa85d59c53436ebdf3074b13d14825 [term 1 LEADER]: Becoming Leader. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Running, Role: LEADER
I20250831 19:54:55.974793 3081 consensus_queue.cc:237] T 5ed927d4935143968fb89a73730eb8a1 P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:55.982142 1903 raft_consensus.cc:2466] T 5ed927d4935143968fb89a73730eb8a1 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1.
I20250831 19:54:55.988505 3018 consensus_queue.cc:1035] T 43b456d5ee8d40e1a8999565cec2d230 P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:55.990747 3018 raft_consensus.cc:491] T fae02e9ed1434c7c82f6c5faa3a1acec P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:55.991253 3018 raft_consensus.cc:513] T fae02e9ed1434c7c82f6c5faa3a1acec P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:55.992475 1904 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "fae02e9ed1434c7c82f6c5faa3a1acec" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:55.992699 1904 raft_consensus.cc:2466] T fae02e9ed1434c7c82f6c5faa3a1acec P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 0.
I20250831 19:54:55.993323 1568 leader_election.cc:304] T fae02e9ed1434c7c82f6c5faa3a1acec P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:54:55.993506 1771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "fae02e9ed1434c7c82f6c5faa3a1acec" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:55.993606 2995 raft_consensus.cc:2802] T fae02e9ed1434c7c82f6c5faa3a1acec P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:55.993697 2995 raft_consensus.cc:491] T fae02e9ed1434c7c82f6c5faa3a1acec P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:55.993717 1771 raft_consensus.cc:2466] T fae02e9ed1434c7c82f6c5faa3a1acec P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 0.
I20250831 19:54:55.993779 2995 raft_consensus.cc:3058] T fae02e9ed1434c7c82f6c5faa3a1acec P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:55.994529 3018 leader_election.cc:290] T fae02e9ed1434c7c82f6c5faa3a1acec P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:55.996644 2995 raft_consensus.cc:513] T fae02e9ed1434c7c82f6c5faa3a1acec P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:55.997239 2995 leader_election.cc:290] T fae02e9ed1434c7c82f6c5faa3a1acec P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Requested vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:55.998055 1904 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "fae02e9ed1434c7c82f6c5faa3a1acec" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:54:55.998237 1904 raft_consensus.cc:3058] T fae02e9ed1434c7c82f6c5faa3a1acec P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:56.001152 1904 raft_consensus.cc:2466] T fae02e9ed1434c7c82f6c5faa3a1acec P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1.
I20250831 19:54:56.002066 1771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "fae02e9ed1434c7c82f6c5faa3a1acec" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197"
I20250831 19:54:56.002238 1771 raft_consensus.cc:3058] T fae02e9ed1434c7c82f6c5faa3a1acec P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:56.002458 1568 leader_election.cc:304] T fae02e9ed1434c7c82f6c5faa3a1acec P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:54:56.002792 2995 raft_consensus.cc:2802] T fae02e9ed1434c7c82f6c5faa3a1acec P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:56.002955 2995 raft_consensus.cc:695] T fae02e9ed1434c7c82f6c5faa3a1acec P 89aa85d59c53436ebdf3074b13d14825 [term 1 LEADER]: Becoming Leader. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Running, Role: LEADER
I20250831 19:54:56.002988 2943 consensus_queue.cc:1035] T 7afc8e9259a548fe946265ea513fde2f P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:56.003355 2995 consensus_queue.cc:237] T fae02e9ed1434c7c82f6c5faa3a1acec P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:56.005349 1771 raft_consensus.cc:2466] T fae02e9ed1434c7c82f6c5faa3a1acec P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1.
I20250831 19:54:56.018581 3018 consensus_queue.cc:1035] T 43b456d5ee8d40e1a8999565cec2d230 P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250831 19:54:56.031213 2121 catalog_manager.cc:3460] renamed table default.table_371cc4850a3443e09f9541001b3bbb0c [id=1df66f6230794e939a25c0f2254d6e17] in HMS: new name default.table_c7390b7344da4c3fbf7f2f502b096669
I20250831 19:54:56.035315 2186 catalog_manager.cc:2747] Deleting table default.table_b5294d0b8f564e31865783000a954688 [id=ee93396a22b546038473cc2df15fdc87] in response to Hive Metastore notification log event 146
I20250831 19:54:56.043483 2186 catalog_manager.cc:5869] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Sending DeleteTablet for 3 replicas of tablet b7d78b564652422ba145265d74a06afc
I20250831 19:54:56.046671 1749 tablet_service.cc:1515] Processing DeleteTablet for tablet b7d78b564652422ba145265d74a06afc with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:56 UTC) from {username='slave'} at 127.0.0.1:50674
I20250831 19:54:56.046856 1883 tablet_service.cc:1515] Processing DeleteTablet for tablet b7d78b564652422ba145265d74a06afc with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:56 UTC) from {username='slave'} at 127.0.0.1:45906
I20250831 19:54:56.046922 2959 tablet_replica.cc:331] T b7d78b564652422ba145265d74a06afc P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:54:56.047134 2959 raft_consensus.cc:2241] T b7d78b564652422ba145265d74a06afc P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: Raft consensus shutting down.
I20250831 19:54:56.047165 2958 tablet_replica.cc:331] T b7d78b564652422ba145265d74a06afc P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:54:56.047343 2958 raft_consensus.cc:2241] T b7d78b564652422ba145265d74a06afc P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:56.047390 2959 raft_consensus.cc:2270] T b7d78b564652422ba145265d74a06afc P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:56.047590 2958 raft_consensus.cc:2270] T b7d78b564652422ba145265d74a06afc P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:56.047920 2959 ts_tablet_manager.cc:1905] T b7d78b564652422ba145265d74a06afc P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:56.048105 2958 ts_tablet_manager.cc:1905] T b7d78b564652422ba145265d74a06afc P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:56.050236 1614 tablet_service.cc:1515] Processing DeleteTablet for tablet b7d78b564652422ba145265d74a06afc with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:56 UTC) from {username='slave'} at 127.0.0.1:51022
I20250831 19:54:56.050483 2957 tablet_replica.cc:331] T b7d78b564652422ba145265d74a06afc P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:54:56.050678 2957 raft_consensus.cc:2241] T b7d78b564652422ba145265d74a06afc P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:56.050863 2957 raft_consensus.cc:2270] T b7d78b564652422ba145265d74a06afc P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:56.051339 2957 ts_tablet_manager.cc:1905] T b7d78b564652422ba145265d74a06afc P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:56.054188 2959 ts_tablet_manager.cc:1918] T b7d78b564652422ba145265d74a06afc P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250831 19:54:56.054312 2959 log.cc:1199] T b7d78b564652422ba145265d74a06afc P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/b7d78b564652422ba145265d74a06afc
I20250831 19:54:56.054695 2959 ts_tablet_manager.cc:1939] T b7d78b564652422ba145265d74a06afc P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
I20250831 19:54:56.055209 2958 ts_tablet_manager.cc:1918] T b7d78b564652422ba145265d74a06afc P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250831 19:54:56.055316 2958 log.cc:1199] T b7d78b564652422ba145265d74a06afc P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/b7d78b564652422ba145265d74a06afc
I20250831 19:54:56.055600 2105 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet b7d78b564652422ba145265d74a06afc (table default.table_b5294d0b8f564e31865783000a954688 [id=ee93396a22b546038473cc2df15fdc87]) successfully deleted
I20250831 19:54:56.055759 2958 ts_tablet_manager.cc:1939] T b7d78b564652422ba145265d74a06afc P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:54:56.056607 2101 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet b7d78b564652422ba145265d74a06afc (table default.table_b5294d0b8f564e31865783000a954688 [id=ee93396a22b546038473cc2df15fdc87]) successfully deleted
I20250831 19:54:56.057175 2957 ts_tablet_manager.cc:1918] T b7d78b564652422ba145265d74a06afc P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250831 19:54:56.057315 2957 log.cc:1199] T b7d78b564652422ba145265d74a06afc P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/b7d78b564652422ba145265d74a06afc
I20250831 19:54:56.057847 2957 ts_tablet_manager.cc:1939] T b7d78b564652422ba145265d74a06afc P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
W20250831 19:54:56.058766 2126 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_dbf76772503b48c3a9083efbcbbb62a3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250831 19:54:56.059525 2104 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet b7d78b564652422ba145265d74a06afc (table default.table_b5294d0b8f564e31865783000a954688 [id=ee93396a22b546038473cc2df15fdc87]) successfully deleted
W20250831 19:54:56.060222 2124 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_3f81774719a24ce68cce90f20487fa97 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250831 19:54:56.061141 2125 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_06c3d3b006e64e1b8e20c6d64625ea64 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250831 19:54:56.061964 2119 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:36958 (request call id 156) took 1880 ms. Trace:
I20250831 19:54:56.062090 2119 rpcz_store.cc:276] 0831 19:54:54.181495 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:54.810390 (+628895us) service_pool.cc:225] Handling call
0831 19:54:55.268615 (+458225us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:56.061927 (+793312us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":27,"Hive Metastore.run_cpu_time_us":209,"Hive Metastore.run_wall_time_us":179992}
I20250831 19:54:56.068450 2778 consensus_queue.cc:1035] T 7afc8e9259a548fe946265ea513fde2f P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:56.068922 2123 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:36958 (request call id 153) took 2013 ms. Trace:
I20250831 19:54:56.069010 2123 rpcz_store.cc:276] 0831 19:54:54.054942 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:54.579930 (+524988us) service_pool.cc:225] Handling call
0831 19:54:55.268939 (+689009us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:56.068869 (+799930us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":179818,"Hive Metastore.run_cpu_time_us":215,"Hive Metastore.run_wall_time_us":73752}
I20250831 19:54:56.069325 2123 master_service.cc:948] ReplaceTablet: received request to replace tablet b7d78b564652422ba145265d74a06afc from {username='slave'} at 127.0.0.1:36958
I20250831 19:54:56.069664 2123 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:36958 (request call id 168) took 1394 ms. Trace:
I20250831 19:54:56.069758 2123 rpcz_store.cc:276] 0831 19:54:54.674874 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:56.069234 (+1394360us) service_pool.cc:225] Handling call
0831 19:54:56.069636 (+ 402us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250831 19:54:56.070051 2123 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36958:
name: "default.Table_6c90d2f731914735837fa73efe73971b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:56.075328 2117 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:36958 (request call id 157) took 1893 ms. Trace:
I20250831 19:54:56.075439 2117 rpcz_store.cc:276] 0831 19:54:54.181624 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:54.816406 (+634782us) service_pool.cc:225] Handling call
0831 19:54:55.276627 (+460221us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:56.074854 (+798227us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:56.075078 (+ 224us) catalog_manager.cc:3683] Apply alter schema
0831 19:54:56.075274 (+ 196us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":271585,"Hive Metastore.run_cpu_time_us":591,"Hive Metastore.run_wall_time_us":67933}
I20250831 19:54:56.075805 2120 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:36958 (request call id 158) took 1893 ms. Trace:
I20250831 19:54:56.075912 2120 rpcz_store.cc:276] 0831 19:54:54.182500 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:54.874401 (+691901us) service_pool.cc:225] Handling call
0831 19:54:55.284301 (+409900us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:56.075276 (+790975us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:56.075522 (+ 246us) catalog_manager.cc:3683] Apply alter schema
0831 19:54:56.075758 (+ 236us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":331854,"Hive Metastore.run_cpu_time_us":671,"Hive Metastore.run_wall_time_us":162760}
W20250831 19:54:56.079401 2118 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_4dba59fc46824095bd698aa0ccc13224 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250831 19:54:56.082580 2119 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36958:
name: "default.Table_13fd718b01d445dbb3955c7804421b1e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:56.086160 2120 catalog_manager.cc:5674] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237) does not have the latest schema for tablet 5ed927d4935143968fb89a73730eb8a1 (table default.table_207ac87518bc487184a89bb52cd204b3 [id=f48af5bc3eff4c819be4aeeff4128c2a]). Expected version 1 got 0
I20250831 19:54:56.086410 2120 catalog_manager.cc:5674] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237) does not have the latest schema for tablet e6438652703c45d691f528a4322767b9 (table default.table_d3002519e6964bb484d995d871e766c9 [id=1137b2754d104964bbe5bbaa4a0578b8]). Expected version 3 got 0
I20250831 19:54:56.089919 2117 catalog_manager.cc:6127] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: default.table_9e316239c779453a9a3a3b8b84d62adc [id=10598630389746d2886e5687fe074fd7] alter complete (version 1)
I20250831 19:54:56.094957 2117 catalog_manager.cc:6127] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: default.table_4e12fc12cae640b99d4f3794151b6915 [id=ba4c5ecf4ae94ede9bfb83af2ee894ab] alter complete (version 2)
I20250831 19:54:56.098112 2117 catalog_manager.cc:5582] T bd12184dd70f451fbd9a2025d2c00758 P 89aa85d59c53436ebdf3074b13d14825 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193). New cstate: current_term: 1 leader_uuid: "89aa85d59c53436ebdf3074b13d14825" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: HEALTHY } } }
I20250831 19:54:56.103870 2117 catalog_manager.cc:5582] T fae02e9ed1434c7c82f6c5faa3a1acec P 89aa85d59c53436ebdf3074b13d14825 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193). New cstate: current_term: 1 leader_uuid: "89aa85d59c53436ebdf3074b13d14825" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: HEALTHY } } }
I20250831 19:54:56.104434 3067 tablet.cc:1722] T 98c37cdff24447039bf0b8d832dbb8e5 P de831f40fa1348a48a1f0260f4130197: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250831 19:54:56.105659 3151 tablet.cc:1722] T 98c37cdff24447039bf0b8d832dbb8e5 P 2441fafe1d62429386f4631ad423567d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250831 19:54:56.104552 2120 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36958:
name: "default.Table_930d37393d93428bb6c9407bbd479a71"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:56.109889 2117 catalog_manager.cc:5582] T 5ed927d4935143968fb89a73730eb8a1 P 89aa85d59c53436ebdf3074b13d14825 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193). New cstate: current_term: 1 leader_uuid: "89aa85d59c53436ebdf3074b13d14825" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: HEALTHY } } }
I20250831 19:54:56.111065 2117 catalog_manager.cc:5674] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197) does not have the latest schema for tablet 5ed927d4935143968fb89a73730eb8a1 (table default.table_207ac87518bc487184a89bb52cd204b3 [id=f48af5bc3eff4c819be4aeeff4128c2a]). Expected version 1 got 0
I20250831 19:54:56.112159 3070 tablet.cc:1722] T 98c37cdff24447039bf0b8d832dbb8e5 P 89aa85d59c53436ebdf3074b13d14825: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250831 19:54:56.122792 2126 catalog_manager.cc:2149] created HMS catalog entry for table [id=1c606e303bbe40afaf2ec496b8680b4c]
I20250831 19:54:56.128095 2126 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:36958 (request call id 164) took 1675 ms. Trace:
I20250831 19:54:56.128194 2126 rpcz_store.cc:276] 0831 19:54:54.453077 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:55.342653 (+889576us) service_pool.cc:225] Handling call
0831 19:54:56.058880 (+716227us) catalog_manager.cc:2076] Acquired catalog manager lock
0831 19:54:56.059314 (+ 434us) catalog_manager.cc:2122] Created new table and tablet info
0831 19:54:56.122766 (+ 63452us) catalog_manager.cc:2148] Created new table in HMS catalog
0831 19:54:56.127855 (+ 5089us) catalog_manager.cc:2182] Wrote table and tablets to system table
0831 19:54:56.127955 (+ 100us) catalog_manager.cc:2216] Inserted table and tablets into CatalogManager maps
0831 19:54:56.128046 (+ 91us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:56.123605 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:56.123695 (+ 90us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:56.123699 (+ 4us) write_op.cc:435] Acquired schema lock
0831 19:54:56.123701 (+ 2us) tablet.cc:660] Decoding operations
0831 19:54:56.123770 (+ 69us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:56.123779 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:56.123783 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:56.123856 (+ 73us) tablet.cc:699] Row locks acquired
0831 19:54:56.123858 (+ 2us) write_op.cc:260] PREPARE: finished
0831 19:54:56.123887 (+ 29us) write_op.cc:270] Start()
0831 19:54:56.123914 (+ 27us) write_op.cc:276] Timestamp: P: 1756670096123851 usec, L: 0
0831 19:54:56.123918 (+ 4us) op_driver.cc:348] REPLICATION: starting
0831 19:54:56.124392 (+ 474us) log.cc:844] Serialized 433 byte log entry
0831 19:54:56.127228 (+ 2836us) op_driver.cc:464] REPLICATION: finished
0831 19:54:56.127399 (+ 171us) write_op.cc:301] APPLY: starting
0831 19:54:56.127410 (+ 11us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:56.127442 (+ 32us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:56.127467 (+ 25us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:56.127587 (+ 120us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:56.127615 (+ 28us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0831 19:54:56.127622 (+ 7us) write_op.cc:312] APPLY: finished
0831 19:54:56.127685 (+ 63us) log.cc:844] Serialized 29 byte log entry
0831 19:54:56.127734 (+ 49us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:56.127749 (+ 15us) write_op.cc:454] Released schema lock
0831 19:54:56.127755 (+ 6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"Hive Metastore.queue_time_us":295,"Hive Metastore.run_cpu_time_us":247,"Hive Metastore.run_wall_time_us":62812,"child_traces":[["op",{"apply.queue_time_us":127,"apply.run_cpu_time_us":399,"apply.run_wall_time_us":399,"num_ops":2,"prepare.queue_time_us":318,"raft.queue_time_us":29,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":160,"replication_time_us":3289,"spinlock_wait_cycles":771968}]]}
I20250831 19:54:56.140187 2126 catalog_manager.cc:6127] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: default.table_c7390b7344da4c3fbf7f2f502b096669 [id=1df66f6230794e939a25c0f2254d6e17] alter complete (version 2)
I20250831 19:54:56.142490 2126 master_service.cc:948] ReplaceTablet: received request to replace tablet 769d6c67c8184282b90bda6c16a93dde from {username='slave'} at 127.0.0.1:36958
I20250831 19:54:56.147893 2126 catalog_manager.cc:5869] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Sending DeleteTablet for 3 replicas of tablet 769d6c67c8184282b90bda6c16a93dde
I20250831 19:54:56.148634 1749 tablet_service.cc:1515] Processing DeleteTablet for tablet 769d6c67c8184282b90bda6c16a93dde with delete_type TABLET_DATA_DELETED (replaced by tablet bec4c2ee742e4e6ab5f98fb3a1c36aca) from {username='slave'} at 127.0.0.1:50674
I20250831 19:54:56.148910 2959 tablet_replica.cc:331] T 769d6c67c8184282b90bda6c16a93dde P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:54:56.149093 2959 raft_consensus.cc:2241] T 769d6c67c8184282b90bda6c16a93dde P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: Raft consensus shutting down.
I20250831 19:54:56.149379 2959 raft_consensus.cc:2270] T 769d6c67c8184282b90bda6c16a93dde P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:56.149364 1883 tablet_service.cc:1515] Processing DeleteTablet for tablet 769d6c67c8184282b90bda6c16a93dde with delete_type TABLET_DATA_DELETED (replaced by tablet bec4c2ee742e4e6ab5f98fb3a1c36aca) from {username='slave'} at 127.0.0.1:45906
I20250831 19:54:56.149530 2126 catalog_manager.cc:6652] ReplaceTablet: tablet 769d6c67c8184282b90bda6c16a93dde deleted and replaced by tablet bec4c2ee742e4e6ab5f98fb3a1c36aca
I20250831 19:54:56.149843 1614 tablet_service.cc:1515] Processing DeleteTablet for tablet 769d6c67c8184282b90bda6c16a93dde with delete_type TABLET_DATA_DELETED (replaced by tablet bec4c2ee742e4e6ab5f98fb3a1c36aca) from {username='slave'} at 127.0.0.1:51022
I20250831 19:54:56.149883 2958 tablet_replica.cc:331] T 769d6c67c8184282b90bda6c16a93dde P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:54:56.149923 2959 ts_tablet_manager.cc:1905] T 769d6c67c8184282b90bda6c16a93dde P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:56.150064 2957 tablet_replica.cc:331] T 769d6c67c8184282b90bda6c16a93dde P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:54:56.150068 2958 raft_consensus.cc:2241] T 769d6c67c8184282b90bda6c16a93dde P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:56.150213 2958 raft_consensus.cc:2270] T 769d6c67c8184282b90bda6c16a93dde P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:56.150249 2957 raft_consensus.cc:2241] T 769d6c67c8184282b90bda6c16a93dde P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:56.150404 2957 raft_consensus.cc:2270] T 769d6c67c8184282b90bda6c16a93dde P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:56.150679 2958 ts_tablet_manager.cc:1905] T 769d6c67c8184282b90bda6c16a93dde P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:56.150885 2957 ts_tablet_manager.cc:1905] T 769d6c67c8184282b90bda6c16a93dde P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:56.151607 2979 raft_consensus.cc:491] T bd12184dd70f451fbd9a2025d2c00758 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:56.151742 2979 raft_consensus.cc:513] T bd12184dd70f451fbd9a2025d2c00758 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:56.152330 2979 leader_election.cc:290] T bd12184dd70f451fbd9a2025d2c00758 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:56.149685 2126 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:36958 (request call id 172) took 1152 ms. Trace:
I20250831 19:54:56.152983 2126 rpcz_store.cc:276] 0831 19:54:54.996776 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:56.142431 (+1145655us) service_pool.cc:225] Handling call
0831 19:54:56.149598 (+ 7167us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:56.143442 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:56.143527 (+ 85us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:56.143532 (+ 5us) write_op.cc:435] Acquired schema lock
0831 19:54:56.143534 (+ 2us) tablet.cc:660] Decoding operations
0831 19:54:56.143615 (+ 81us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:56.143624 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:56.143628 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:56.143687 (+ 59us) tablet.cc:699] Row locks acquired
0831 19:54:56.143690 (+ 3us) write_op.cc:260] PREPARE: finished
0831 19:54:56.143711 (+ 21us) write_op.cc:270] Start()
0831 19:54:56.143732 (+ 21us) write_op.cc:276] Timestamp: P: 1756670096143676 usec, L: 0
0831 19:54:56.143735 (+ 3us) op_driver.cc:348] REPLICATION: starting
0831 19:54:56.143862 (+ 127us) log.cc:844] Serialized 656 byte log entry
0831 19:54:56.145697 (+ 1835us) op_driver.cc:464] REPLICATION: finished
0831 19:54:56.145958 (+ 261us) write_op.cc:301] APPLY: starting
0831 19:54:56.145969 (+ 11us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:56.145999 (+ 30us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:56.146025 (+ 26us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:56.146095 (+ 70us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:56.146132 (+ 37us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0831 19:54:56.146138 (+ 6us) write_op.cc:312] APPLY: finished
0831 19:54:56.146185 (+ 47us) log.cc:844] Serialized 29 byte log entry
0831 19:54:56.146232 (+ 47us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:56.146245 (+ 13us) write_op.cc:454] Released schema lock
0831 19:54:56.146249 (+ 4us) write_op.cc:341] FINISH: Updating metrics
0831 19:54:56.146296 (+ 47us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:56.146299 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":226,"apply.run_cpu_time_us":333,"apply.run_wall_time_us":333,"num_ops":2,"prepare.queue_time_us":36,"prepare.run_cpu_time_us":511,"prepare.run_wall_time_us":2133,"raft.queue_time_us":48,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":171,"replication_time_us":1942}]]}
I20250831 19:54:56.154060 2126 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36958:
name: "default.Table_5bc22ff7931245ad82121fb433351a08"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:56.155655 2959 ts_tablet_manager.cc:1918] T 769d6c67c8184282b90bda6c16a93dde P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:56.155783 1771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bd12184dd70f451fbd9a2025d2c00758" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:56.156051 1771 raft_consensus.cc:2391] T bd12184dd70f451fbd9a2025d2c00758 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2441fafe1d62429386f4631ad423567d in current term 1: Already voted for candidate 89aa85d59c53436ebdf3074b13d14825 in this term.
I20250831 19:54:56.156379 1633 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bd12184dd70f451fbd9a2025d2c00758" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:56.156777 2957 ts_tablet_manager.cc:1918] T 769d6c67c8184282b90bda6c16a93dde P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:56.156916 2957 log.cc:1199] T 769d6c67c8184282b90bda6c16a93dde P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/769d6c67c8184282b90bda6c16a93dde
I20250831 19:54:56.157347 2957 ts_tablet_manager.cc:1939] T 769d6c67c8184282b90bda6c16a93dde P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
I20250831 19:54:56.157547 1842 leader_election.cc:304] T bd12184dd70f451fbd9a2025d2c00758 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2441fafe1d62429386f4631ad423567d; no voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197
I20250831 19:54:56.157935 2979 raft_consensus.cc:3058] T bd12184dd70f451fbd9a2025d2c00758 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:56.159905 2124 catalog_manager.cc:2149] created HMS catalog entry for table [id=08d05283df4c4408954c3793beaa4adb]
I20250831 19:54:56.160717 2979 raft_consensus.cc:2747] T bd12184dd70f451fbd9a2025d2c00758 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250831 19:54:56.162135 1749 tablet_service.cc:1468] Processing CreateTablet for tablet 5a080bbabe8840c3ba954bdc0626dc39 (DEFAULT_TABLE table=default.table_dbf76772503b48c3a9083efbcbbb62a3 [id=1c606e303bbe40afaf2ec496b8680b4c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:56.162150 1883 tablet_service.cc:1468] Processing CreateTablet for tablet 5a080bbabe8840c3ba954bdc0626dc39 (DEFAULT_TABLE table=default.table_dbf76772503b48c3a9083efbcbbb62a3 [id=1c606e303bbe40afaf2ec496b8680b4c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:56.162497 1883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a080bbabe8840c3ba954bdc0626dc39. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:56.162518 1749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a080bbabe8840c3ba954bdc0626dc39. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:56.167269 1614 tablet_service.cc:1468] Processing CreateTablet for tablet 5a080bbabe8840c3ba954bdc0626dc39 (DEFAULT_TABLE table=default.table_dbf76772503b48c3a9083efbcbbb62a3 [id=1c606e303bbe40afaf2ec496b8680b4c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:56.167641 1614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a080bbabe8840c3ba954bdc0626dc39. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:56.170264 2995 consensus_queue.cc:1035] T eed712e77ad740ae95050fe589f3a61a P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:56.170900 2104 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet 769d6c67c8184282b90bda6c16a93dde (table default.table_13cea908832146dab4b8b794752b1a79 [id=61032a0c11594321b1e4cb5ba3394c18]) successfully deleted
I20250831 19:54:56.165335 2117 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36958:
name: "default.Table_65ae80244c21495fad7b9e506a44ebcc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:56.177311 2958 ts_tablet_manager.cc:1918] T 769d6c67c8184282b90bda6c16a93dde P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:56.177428 2958 log.cc:1199] T 769d6c67c8184282b90bda6c16a93dde P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/769d6c67c8184282b90bda6c16a93dde
I20250831 19:54:56.177840 2958 ts_tablet_manager.cc:1939] T 769d6c67c8184282b90bda6c16a93dde P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:54:56.179081 2101 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet 769d6c67c8184282b90bda6c16a93dde (table default.table_13cea908832146dab4b8b794752b1a79 [id=61032a0c11594321b1e4cb5ba3394c18]) successfully deleted
I20250831 19:54:56.179483 2124 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:36958 (request call id 165) took 1724 ms. Trace:
I20250831 19:54:56.179572 2124 rpcz_store.cc:276] 0831 19:54:54.454638 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:55.419344 (+964706us) service_pool.cc:225] Handling call
0831 19:54:56.060305 (+640961us) catalog_manager.cc:2076] Acquired catalog manager lock
0831 19:54:56.060707 (+ 402us) catalog_manager.cc:2122] Created new table and tablet info
0831 19:54:56.159870 (+ 99163us) catalog_manager.cc:2148] Created new table in HMS catalog
0831 19:54:56.179258 (+ 19388us) catalog_manager.cc:2182] Wrote table and tablets to system table
0831 19:54:56.179363 (+ 105us) catalog_manager.cc:2216] Inserted table and tablets into CatalogManager maps
0831 19:54:56.179452 (+ 89us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:56.163374 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:56.163476 (+ 102us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:56.163480 (+ 4us) write_op.cc:435] Acquired schema lock
0831 19:54:56.163494 (+ 14us) tablet.cc:660] Decoding operations
0831 19:54:56.163562 (+ 68us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:56.163572 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:56.163576 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:56.163661 (+ 85us) tablet.cc:699] Row locks acquired
0831 19:54:56.163663 (+ 2us) write_op.cc:260] PREPARE: finished
0831 19:54:56.163691 (+ 28us) write_op.cc:270] Start()
0831 19:54:56.163720 (+ 29us) write_op.cc:276] Timestamp: P: 1756670096163652 usec, L: 0
0831 19:54:56.163723 (+ 3us) op_driver.cc:348] REPLICATION: starting
0831 19:54:56.163875 (+ 152us) log.cc:844] Serialized 433 byte log entry
0831 19:54:56.178304 (+ 14429us) op_driver.cc:464] REPLICATION: finished
0831 19:54:56.178449 (+ 145us) write_op.cc:301] APPLY: starting
0831 19:54:56.178463 (+ 14us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:56.178500 (+ 37us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:56.178526 (+ 26us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:56.178649 (+ 123us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:56.178684 (+ 35us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0831 19:54:56.178695 (+ 11us) write_op.cc:312] APPLY: finished
0831 19:54:56.178763 (+ 68us) log.cc:844] Serialized 29 byte log entry
0831 19:54:56.178838 (+ 75us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:56.178858 (+ 20us) write_op.cc:454] Released schema lock
0831 19:54:56.178865 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0831 19:54:56.178929 (+ 64us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:56.178933 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":61755,"Hive Metastore.run_cpu_time_us":225,"Hive Metastore.run_wall_time_us":37088,"child_traces":[["op",{"apply.queue_time_us":100,"apply.run_cpu_time_us":473,"apply.run_wall_time_us":473,"num_ops":2,"prepare.queue_time_us":3049,"prepare.run_cpu_time_us":581,"prepare.run_wall_time_us":627,"raft.queue_time_us":30,"raft.run_cpu_time_us":4,"raft.run_wall_time_us":5,"replication_time_us":14555}]]}
I20250831 19:54:56.182631 2699 tablet_bootstrap.cc:492] T 5a080bbabe8840c3ba954bdc0626dc39 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:56.184160 2699 tablet_bootstrap.cc:654] T 5a080bbabe8840c3ba954bdc0626dc39 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:56.155802 2959 log.cc:1199] T 769d6c67c8184282b90bda6c16a93dde P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/769d6c67c8184282b90bda6c16a93dde
I20250831 19:54:56.194932 2959 ts_tablet_manager.cc:1939] T 769d6c67c8184282b90bda6c16a93dde P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
I20250831 19:54:56.196118 1883 tablet_service.cc:1468] Processing CreateTablet for tablet bec4c2ee742e4e6ab5f98fb3a1c36aca (DEFAULT_TABLE table=default.table_13cea908832146dab4b8b794752b1a79 [id=61032a0c11594321b1e4cb5ba3394c18]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:56.196540 1883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bec4c2ee742e4e6ab5f98fb3a1c36aca. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:56.196564 1748 tablet_service.cc:1468] Processing CreateTablet for tablet bec4c2ee742e4e6ab5f98fb3a1c36aca (DEFAULT_TABLE table=default.table_13cea908832146dab4b8b794752b1a79 [id=61032a0c11594321b1e4cb5ba3394c18]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:56.196947 1748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bec4c2ee742e4e6ab5f98fb3a1c36aca. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:56.191339 2125 catalog_manager.cc:2149] created HMS catalog entry for table [id=a0fbaa8ae6b54d03abdd641e2e0eb746]
I20250831 19:54:56.201754 2105 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet 769d6c67c8184282b90bda6c16a93dde (table default.table_13cea908832146dab4b8b794752b1a79 [id=61032a0c11594321b1e4cb5ba3394c18]) successfully deleted
I20250831 19:54:56.185425 2124 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_be31f59f9d014d278544a1c9deb8a41a" } new_table_name: "default.Table_617124885d2e4d96b863e0e435bdf695" modify_external_catalogs: true
I20250831 19:54:56.207288 1613 tablet_service.cc:1468] Processing CreateTablet for tablet bec4c2ee742e4e6ab5f98fb3a1c36aca (DEFAULT_TABLE table=default.table_13cea908832146dab4b8b794752b1a79 [id=61032a0c11594321b1e4cb5ba3394c18]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:56.207679 1613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bec4c2ee742e4e6ab5f98fb3a1c36aca. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:56.211671 2122 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:36958 (request call id 159) took 2029 ms. Trace:
I20250831 19:54:56.211752 2122 rpcz_store.cc:276] 0831 19:54:54.182619 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:55.262778 (+1080159us) service_pool.cc:225] Handling call
0831 19:54:55.859398 (+596620us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:56.211624 (+352226us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":38,"Hive Metastore.run_cpu_time_us":264,"Hive Metastore.run_wall_time_us":111794}
I20250831 19:54:56.212177 2122 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_268aaa1457f049d39b6e2eee7f41a1bb" } new_table_name: "default.Table_bced9a3b747a4c33b6fc5b05b2a4dd89" modify_external_catalogs: true
I20250831 19:54:56.212842 2121 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:36958 (request call id 160) took 2030 ms. Trace:
I20250831 19:54:56.212935 2121 rpcz_store.cc:276] 0831 19:54:54.182703 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:55.268219 (+1085516us) service_pool.cc:225] Handling call
0831 19:54:55.859845 (+591626us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:56.212403 (+352558us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:56.212602 (+ 199us) catalog_manager.cc:3683] Apply alter schema
0831 19:54:56.212800 (+ 198us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":111447,"Hive Metastore.run_cpu_time_us":695,"Hive Metastore.run_wall_time_us":59542}
I20250831 19:54:56.213297 2121 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_6c2f9309b58643529114857aae0568f2" } modify_external_catalogs: true
W20250831 19:54:56.214263 2123 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_6c90d2f731914735837fa73efe73971b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250831 19:54:56.214956 2121 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_6c2f9309b58643529114857aae0568f2" } modify_external_catalogs: true
I20250831 19:54:56.217648 3177 tablet_bootstrap.cc:492] T bec4c2ee742e4e6ab5f98fb3a1c36aca P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:56.220151 3178 tablet_bootstrap.cc:492] T bec4c2ee742e4e6ab5f98fb3a1c36aca P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:56.222090 2125 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:36958 (request call id 166) took 1722 ms. Trace:
I20250831 19:54:56.222180 2125 rpcz_store.cc:276] 0831 19:54:54.499859 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:55.420045 (+920186us) service_pool.cc:225] Handling call
0831 19:54:56.061235 (+641190us) catalog_manager.cc:2076] Acquired catalog manager lock
0831 19:54:56.061699 (+ 464us) catalog_manager.cc:2122] Created new table and tablet info
0831 19:54:56.191311 (+129612us) catalog_manager.cc:2148] Created new table in HMS catalog
0831 19:54:56.221819 (+ 30508us) catalog_manager.cc:2182] Wrote table and tablets to system table
0831 19:54:56.221936 (+ 117us) catalog_manager.cc:2216] Inserted table and tablets into CatalogManager maps
0831 19:54:56.222038 (+ 102us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:56.205617 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:56.205709 (+ 92us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:56.205713 (+ 4us) write_op.cc:435] Acquired schema lock
0831 19:54:56.205715 (+ 2us) tablet.cc:660] Decoding operations
0831 19:54:56.205794 (+ 79us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:56.205803 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:56.205807 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:56.205877 (+ 70us) tablet.cc:699] Row locks acquired
0831 19:54:56.205879 (+ 2us) write_op.cc:260] PREPARE: finished
0831 19:54:56.205907 (+ 28us) write_op.cc:270] Start()
0831 19:54:56.205932 (+ 25us) write_op.cc:276] Timestamp: P: 1756670096205864 usec, L: 0
0831 19:54:56.205935 (+ 3us) op_driver.cc:348] REPLICATION: starting
0831 19:54:56.206072 (+ 137us) log.cc:844] Serialized 433 byte log entry
0831 19:54:56.217879 (+ 11807us) op_driver.cc:464] REPLICATION: finished
0831 19:54:56.220923 (+ 3044us) write_op.cc:301] APPLY: starting
0831 19:54:56.220940 (+ 17us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:56.220982 (+ 42us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:56.221020 (+ 38us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:56.221144 (+ 124us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:56.221179 (+ 35us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0831 19:54:56.221188 (+ 9us) write_op.cc:312] APPLY: finished
0831 19:54:56.221256 (+ 68us) log.cc:844] Serialized 29 byte log entry
0831 19:54:56.221318 (+ 62us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:56.221333 (+ 15us) write_op.cc:454] Released schema lock
0831 19:54:56.221338 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0831 19:54:56.221390 (+ 52us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:56.221393 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":97885,"Hive Metastore.run_cpu_time_us":220,"Hive Metastore.run_wall_time_us":31473,"child_traces":[["op",{"apply.queue_time_us":2989,"apply.run_cpu_time_us":469,"apply.run_wall_time_us":469,"num_ops":2,"prepare.queue_time_us":5859,"prepare.run_cpu_time_us":547,"prepare.run_wall_time_us":548,"raft.queue_time_us":50,"raft.run_cpu_time_us":4,"raft.run_wall_time_us":4,"replication_time_us":11921}]]}
I20250831 19:54:56.223798 3178 tablet_bootstrap.cc:654] T bec4c2ee742e4e6ab5f98fb3a1c36aca P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:56.227761 3177 tablet_bootstrap.cc:654] T bec4c2ee742e4e6ab5f98fb3a1c36aca P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:56.233909 3177 tablet_bootstrap.cc:492] T bec4c2ee742e4e6ab5f98fb3a1c36aca P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:56.234088 3177 ts_tablet_manager.cc:1397] T bec4c2ee742e4e6ab5f98fb3a1c36aca P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.017s user 0.003s sys 0.004s
I20250831 19:54:56.234998 3177 raft_consensus.cc:357] T bec4c2ee742e4e6ab5f98fb3a1c36aca P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:56.235309 3177 raft_consensus.cc:383] T bec4c2ee742e4e6ab5f98fb3a1c36aca P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:56.235455 3177 raft_consensus.cc:738] T bec4c2ee742e4e6ab5f98fb3a1c36aca P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:56.235738 3177 consensus_queue.cc:260] T bec4c2ee742e4e6ab5f98fb3a1c36aca P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:56.235900 3178 tablet_bootstrap.cc:492] T bec4c2ee742e4e6ab5f98fb3a1c36aca P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:56.236464 3178 ts_tablet_manager.cc:1397] T bec4c2ee742e4e6ab5f98fb3a1c36aca P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.016s user 0.000s sys 0.005s
I20250831 19:54:56.237185 3177 ts_tablet_manager.cc:1428] T bec4c2ee742e4e6ab5f98fb3a1c36aca P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20250831 19:54:56.237401 3178 raft_consensus.cc:357] T bec4c2ee742e4e6ab5f98fb3a1c36aca P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:56.238488 3178 raft_consensus.cc:383] T bec4c2ee742e4e6ab5f98fb3a1c36aca P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:56.238699 3178 raft_consensus.cc:738] T bec4c2ee742e4e6ab5f98fb3a1c36aca P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:56.239094 3178 consensus_queue.cc:260] T bec4c2ee742e4e6ab5f98fb3a1c36aca P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:56.241820 1883 tablet_service.cc:1468] Processing CreateTablet for tablet 8ebf42e07edf40f9b95b0304a912b9b8 (DEFAULT_TABLE table=default.table_3f81774719a24ce68cce90f20487fa97 [id=08d05283df4c4408954c3793beaa4adb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:56.242242 1883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ebf42e07edf40f9b95b0304a912b9b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:56.242641 1749 tablet_service.cc:1468] Processing CreateTablet for tablet 8ebf42e07edf40f9b95b0304a912b9b8 (DEFAULT_TABLE table=default.table_3f81774719a24ce68cce90f20487fa97 [id=08d05283df4c4408954c3793beaa4adb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:56.243037 1749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ebf42e07edf40f9b95b0304a912b9b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:56.243891 1903 raft_consensus.cc:3058] T 326c4af4214a4ea6a9ae784525758630 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:56.242288 1614 tablet_service.cc:1468] Processing CreateTablet for tablet 8ebf42e07edf40f9b95b0304a912b9b8 (DEFAULT_TABLE table=default.table_3f81774719a24ce68cce90f20487fa97 [id=08d05283df4c4408954c3793beaa4adb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:56.244935 1614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ebf42e07edf40f9b95b0304a912b9b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:56.245640 3177 tablet_bootstrap.cc:492] T 5a080bbabe8840c3ba954bdc0626dc39 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:56.247208 3177 tablet_bootstrap.cc:654] T 5a080bbabe8840c3ba954bdc0626dc39 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:56.248703 2995 consensus_queue.cc:1035] T 326c4af4214a4ea6a9ae784525758630 P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:56.254544 3178 ts_tablet_manager.cc:1428] T bec4c2ee742e4e6ab5f98fb3a1c36aca P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.018s user 0.001s sys 0.000s
I20250831 19:54:56.255311 3178 tablet_bootstrap.cc:492] T 5a080bbabe8840c3ba954bdc0626dc39 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:56.257750 3178 tablet_bootstrap.cc:654] T 5a080bbabe8840c3ba954bdc0626dc39 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:56.262125 3177 tablet_bootstrap.cc:492] T 5a080bbabe8840c3ba954bdc0626dc39 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:56.262275 3177 ts_tablet_manager.cc:1397] T 5a080bbabe8840c3ba954bdc0626dc39 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.017s user 0.004s sys 0.004s
I20250831 19:54:56.262930 3177 raft_consensus.cc:357] T 5a080bbabe8840c3ba954bdc0626dc39 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:56.263145 3177 raft_consensus.cc:383] T 5a080bbabe8840c3ba954bdc0626dc39 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:56.263219 3177 raft_consensus.cc:738] T 5a080bbabe8840c3ba954bdc0626dc39 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:56.263927 3177 consensus_queue.cc:260] T 5a080bbabe8840c3ba954bdc0626dc39 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:56.264582 3177 ts_tablet_manager.cc:1428] T 5a080bbabe8840c3ba954bdc0626dc39 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250831 19:54:56.273663 2699 tablet_bootstrap.cc:492] T 5a080bbabe8840c3ba954bdc0626dc39 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:56.273831 2699 ts_tablet_manager.cc:1397] T 5a080bbabe8840c3ba954bdc0626dc39 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.091s user 0.012s sys 0.008s
I20250831 19:54:56.275439 2699 raft_consensus.cc:357] T 5a080bbabe8840c3ba954bdc0626dc39 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:56.275655 2699 raft_consensus.cc:383] T 5a080bbabe8840c3ba954bdc0626dc39 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:56.275729 2699 raft_consensus.cc:738] T 5a080bbabe8840c3ba954bdc0626dc39 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:56.276700 2699 consensus_queue.cc:260] T 5a080bbabe8840c3ba954bdc0626dc39 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:56.278832 2699 ts_tablet_manager.cc:1428] T 5a080bbabe8840c3ba954bdc0626dc39 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20250831 19:54:56.283329 2699 tablet_bootstrap.cc:492] T bec4c2ee742e4e6ab5f98fb3a1c36aca P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:56.290719 2979 raft_consensus.cc:491] T 93bfd2c663634436a61211a406c9f92f P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:56.290861 2979 raft_consensus.cc:513] T 93bfd2c663634436a61211a406c9f92f P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:56.291566 2979 leader_election.cc:290] T 93bfd2c663634436a61211a406c9f92f P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:56.293386 1633 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "93bfd2c663634436a61211a406c9f92f" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:56.294389 1633 raft_consensus.cc:2391] T 93bfd2c663634436a61211a406c9f92f P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2441fafe1d62429386f4631ad423567d in current term 1: Already voted for candidate de831f40fa1348a48a1f0260f4130197 in this term.
I20250831 19:54:56.295406 1771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "93bfd2c663634436a61211a406c9f92f" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:56.295900 1842 leader_election.cc:304] T 93bfd2c663634436a61211a406c9f92f P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2441fafe1d62429386f4631ad423567d; no voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197
I20250831 19:54:56.296401 2979 raft_consensus.cc:3058] T 93bfd2c663634436a61211a406c9f92f P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:56.299471 2979 raft_consensus.cc:2747] T 93bfd2c663634436a61211a406c9f92f P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250831 19:54:56.300143 2699 tablet_bootstrap.cc:654] T bec4c2ee742e4e6ab5f98fb3a1c36aca P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:56.305317 3177 tablet_bootstrap.cc:492] T 8ebf42e07edf40f9b95b0304a912b9b8 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:56.306988 3177 tablet_bootstrap.cc:654] T 8ebf42e07edf40f9b95b0304a912b9b8 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:56.307996 2125 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_82715a1a3cf44ab586f6ab0f19723f2b" } modify_external_catalogs: true
I20250831 19:54:56.308226 2125 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_82715a1a3cf44ab586f6ab0f19723f2b" } modify_external_catalogs: true
I20250831 19:54:56.318804 3177 tablet_bootstrap.cc:492] T 8ebf42e07edf40f9b95b0304a912b9b8 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:56.319011 3177 ts_tablet_manager.cc:1397] T 8ebf42e07edf40f9b95b0304a912b9b8 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.014s user 0.008s sys 0.000s
I20250831 19:54:56.319424 3178 tablet_bootstrap.cc:492] T 5a080bbabe8840c3ba954bdc0626dc39 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:56.319593 3178 ts_tablet_manager.cc:1397] T 5a080bbabe8840c3ba954bdc0626dc39 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.064s user 0.003s sys 0.000s
I20250831 19:54:56.320112 3177 raft_consensus.cc:357] T 8ebf42e07edf40f9b95b0304a912b9b8 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:56.320350 3177 raft_consensus.cc:383] T 8ebf42e07edf40f9b95b0304a912b9b8 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:56.320284 3178 raft_consensus.cc:357] T 5a080bbabe8840c3ba954bdc0626dc39 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:56.320475 3178 raft_consensus.cc:383] T 5a080bbabe8840c3ba954bdc0626dc39 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:56.320569 3178 raft_consensus.cc:738] T 5a080bbabe8840c3ba954bdc0626dc39 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:56.320796 3178 consensus_queue.cc:260] T 5a080bbabe8840c3ba954bdc0626dc39 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:56.321274 3178 ts_tablet_manager.cc:1428] T 5a080bbabe8840c3ba954bdc0626dc39 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20250831 19:54:56.321659 1883 tablet_service.cc:1468] Processing CreateTablet for tablet a6a3938379c64baba6f5f2c1a2f7087a (DEFAULT_TABLE table=default.table_06c3d3b006e64e1b8e20c6d64625ea64 [id=a0fbaa8ae6b54d03abdd641e2e0eb746]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:56.321678 1748 tablet_service.cc:1468] Processing CreateTablet for tablet a6a3938379c64baba6f5f2c1a2f7087a (DEFAULT_TABLE table=default.table_06c3d3b006e64e1b8e20c6d64625ea64 [id=a0fbaa8ae6b54d03abdd641e2e0eb746]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:56.321769 1614 tablet_service.cc:1468] Processing CreateTablet for tablet a6a3938379c64baba6f5f2c1a2f7087a (DEFAULT_TABLE table=default.table_06c3d3b006e64e1b8e20c6d64625ea64 [id=a0fbaa8ae6b54d03abdd641e2e0eb746]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:56.322544 1883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6a3938379c64baba6f5f2c1a2f7087a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:56.323045 1748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6a3938379c64baba6f5f2c1a2f7087a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:56.325194 2995 consensus_queue.cc:1035] T eed712e77ad740ae95050fe589f3a61a P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:56.327343 2995 consensus_queue.cc:1035] T 326c4af4214a4ea6a9ae784525758630 P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:56.328600 3177 raft_consensus.cc:738] T 8ebf42e07edf40f9b95b0304a912b9b8 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:56.328922 3177 consensus_queue.cc:260] T 8ebf42e07edf40f9b95b0304a912b9b8 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:56.330156 3177 ts_tablet_manager.cc:1428] T 8ebf42e07edf40f9b95b0304a912b9b8 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.011s user 0.001s sys 0.001s
I20250831 19:54:56.332237 3177 tablet_bootstrap.cc:492] T a6a3938379c64baba6f5f2c1a2f7087a P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:56.334020 3177 tablet_bootstrap.cc:654] T a6a3938379c64baba6f5f2c1a2f7087a P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:56.337908 2699 tablet_bootstrap.cc:492] T bec4c2ee742e4e6ab5f98fb3a1c36aca P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:56.338063 2699 ts_tablet_manager.cc:1397] T bec4c2ee742e4e6ab5f98fb3a1c36aca P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.059s user 0.001s sys 0.009s
I20250831 19:54:56.338902 2699 raft_consensus.cc:357] T bec4c2ee742e4e6ab5f98fb3a1c36aca P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:56.339069 2699 raft_consensus.cc:383] T bec4c2ee742e4e6ab5f98fb3a1c36aca P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:56.339167 2699 raft_consensus.cc:738] T bec4c2ee742e4e6ab5f98fb3a1c36aca P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:56.339390 2699 consensus_queue.cc:260] T bec4c2ee742e4e6ab5f98fb3a1c36aca P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:56.340185 2118 catalog_manager.cc:2149] created HMS catalog entry for table [id=d340aa6d78a5421f9e03785004d551c7]
I20250831 19:54:56.340869 2995 raft_consensus.cc:491] T bec4c2ee742e4e6ab5f98fb3a1c36aca P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:56.341029 2995 raft_consensus.cc:513] T bec4c2ee742e4e6ab5f98fb3a1c36aca P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:56.341701 2995 leader_election.cc:290] T bec4c2ee742e4e6ab5f98fb3a1c36aca P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:56.342254 1904 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bec4c2ee742e4e6ab5f98fb3a1c36aca" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:56.342451 1904 raft_consensus.cc:2466] T bec4c2ee742e4e6ab5f98fb3a1c36aca P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 0.
I20250831 19:54:56.342839 1568 leader_election.cc:304] T bec4c2ee742e4e6ab5f98fb3a1c36aca P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:54:56.343429 1769 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bec4c2ee742e4e6ab5f98fb3a1c36aca" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:56.343647 1769 raft_consensus.cc:2466] T bec4c2ee742e4e6ab5f98fb3a1c36aca P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 0.
I20250831 19:54:56.343982 2995 raft_consensus.cc:2802] T bec4c2ee742e4e6ab5f98fb3a1c36aca P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:56.344079 2995 raft_consensus.cc:491] T bec4c2ee742e4e6ab5f98fb3a1c36aca P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:56.344183 2995 raft_consensus.cc:3058] T bec4c2ee742e4e6ab5f98fb3a1c36aca P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:56.345402 2118 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:36958 (request call id 167) took 1708 ms. Trace:
I20250831 19:54:56.345551 2118 rpcz_store.cc:276] 0831 19:54:54.636753 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:55.708046 (+1071293us) service_pool.cc:225] Handling call
0831 19:54:56.079499 (+371453us) catalog_manager.cc:2076] Acquired catalog manager lock
0831 19:54:56.079970 (+ 471us) catalog_manager.cc:2122] Created new table and tablet info
0831 19:54:56.340130 (+260160us) catalog_manager.cc:2148] Created new table in HMS catalog
0831 19:54:56.345163 (+ 5033us) catalog_manager.cc:2182] Wrote table and tablets to system table
0831 19:54:56.345268 (+ 105us) catalog_manager.cc:2216] Inserted table and tablets into CatalogManager maps
0831 19:54:56.345367 (+ 99us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:56.340925 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:56.341047 (+ 122us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:56.341053 (+ 6us) write_op.cc:435] Acquired schema lock
0831 19:54:56.341056 (+ 3us) tablet.cc:660] Decoding operations
0831 19:54:56.341155 (+ 99us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:56.341170 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:56.341177 (+ 7us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:56.341257 (+ 80us) tablet.cc:699] Row locks acquired
0831 19:54:56.341260 (+ 3us) write_op.cc:260] PREPARE: finished
0831 19:54:56.341294 (+ 34us) write_op.cc:270] Start()
0831 19:54:56.341327 (+ 33us) write_op.cc:276] Timestamp: P: 1756670096341236 usec, L: 0
0831 19:54:56.341331 (+ 4us) op_driver.cc:348] REPLICATION: starting
0831 19:54:56.341528 (+ 197us) log.cc:844] Serialized 433 byte log entry
0831 19:54:56.344103 (+ 2575us) op_driver.cc:464] REPLICATION: finished
0831 19:54:56.344241 (+ 138us) write_op.cc:301] APPLY: starting
0831 19:54:56.344260 (+ 19us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:56.344303 (+ 43us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:56.344325 (+ 22us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:56.344429 (+ 104us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:56.344461 (+ 32us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0831 19:54:56.344467 (+ 6us) write_op.cc:312] APPLY: finished
0831 19:54:56.344538 (+ 71us) log.cc:844] Serialized 29 byte log entry
0831 19:54:56.344618 (+ 80us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:56.344638 (+ 20us) write_op.cc:454] Released schema lock
0831 19:54:56.344645 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0831 19:54:56.344710 (+ 65us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:56.344714 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":116254,"Hive Metastore.run_cpu_time_us":244,"Hive Metastore.run_wall_time_us":143632,"child_traces":[["op",{"apply.queue_time_us":89,"apply.run_cpu_time_us":464,"apply.run_wall_time_us":463,"num_ops":2,"prepare.queue_time_us":51,"prepare.run_cpu_time_us":717,"prepare.run_wall_time_us":717,"raft.queue_time_us":459,"raft.run_cpu_time_us":245,"raft.run_wall_time_us":247,"replication_time_us":2744}]]}
I20250831 19:54:56.347412 2943 consensus_queue.cc:1035] T 93bfd2c663634436a61211a406c9f92f P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:56.348728 1614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6a3938379c64baba6f5f2c1a2f7087a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:56.351727 2699 ts_tablet_manager.cc:1428] T bec4c2ee742e4e6ab5f98fb3a1c36aca P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.014s user 0.000s sys 0.002s
I20250831 19:54:56.352046 2699 tablet_bootstrap.cc:492] T 8ebf42e07edf40f9b95b0304a912b9b8 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:56.354435 2699 tablet_bootstrap.cc:654] T 8ebf42e07edf40f9b95b0304a912b9b8 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:56.355458 3081 raft_consensus.cc:491] T e6438652703c45d691f528a4322767b9 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:56.355600 3081 raft_consensus.cc:513] T e6438652703c45d691f528a4322767b9 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:56.356186 3081 leader_election.cc:290] T e6438652703c45d691f528a4322767b9 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:56.356717 1769 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e6438652703c45d691f528a4322767b9" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:56.356921 1769 raft_consensus.cc:2466] T e6438652703c45d691f528a4322767b9 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 0.
I20250831 19:54:56.357417 1570 leader_election.cc:304] T e6438652703c45d691f528a4322767b9 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:56.357947 1902 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e6438652703c45d691f528a4322767b9" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:56.358126 1902 raft_consensus.cc:2466] T e6438652703c45d691f528a4322767b9 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 0.
W20250831 19:54:56.358578 2117 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_65ae80244c21495fad7b9e506a44ebcc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250831 19:54:56.358683 2119 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_13fd718b01d445dbb3955c7804421b1e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250831 19:54:56.358855 3178 tablet_bootstrap.cc:492] T 8ebf42e07edf40f9b95b0304a912b9b8 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
W20250831 19:54:56.359716 2120 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_930d37393d93428bb6c9407bbd479a71 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250831 19:54:56.360448 3178 tablet_bootstrap.cc:654] T 8ebf42e07edf40f9b95b0304a912b9b8 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
W20250831 19:54:56.360543 2126 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_5bc22ff7931245ad82121fb433351a08 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250831 19:54:56.362392 3081 raft_consensus.cc:2802] T e6438652703c45d691f528a4322767b9 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:56.362498 3081 raft_consensus.cc:491] T e6438652703c45d691f528a4322767b9 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:56.362571 3081 raft_consensus.cc:3058] T e6438652703c45d691f528a4322767b9 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:56.365170 3081 raft_consensus.cc:513] T e6438652703c45d691f528a4322767b9 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:56.365782 3081 leader_election.cc:290] T e6438652703c45d691f528a4322767b9 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Requested vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:56.366976 2995 raft_consensus.cc:513] T bec4c2ee742e4e6ab5f98fb3a1c36aca P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:56.369139 1884 tablet_service.cc:1468] Processing CreateTablet for tablet f7a7fad8a2ca4da297070dd3b49bc2d8 (DEFAULT_TABLE table=default.table_4dba59fc46824095bd698aa0ccc13224 [id=d340aa6d78a5421f9e03785004d551c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:56.369632 1884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7a7fad8a2ca4da297070dd3b49bc2d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:56.370509 1614 tablet_service.cc:1468] Processing CreateTablet for tablet f7a7fad8a2ca4da297070dd3b49bc2d8 (DEFAULT_TABLE table=default.table_4dba59fc46824095bd698aa0ccc13224 [id=d340aa6d78a5421f9e03785004d551c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:56.370891 1614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7a7fad8a2ca4da297070dd3b49bc2d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:56.373992 1748 tablet_service.cc:1468] Processing CreateTablet for tablet f7a7fad8a2ca4da297070dd3b49bc2d8 (DEFAULT_TABLE table=default.table_4dba59fc46824095bd698aa0ccc13224 [id=d340aa6d78a5421f9e03785004d551c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:56.374424 1748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7a7fad8a2ca4da297070dd3b49bc2d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:56.375353 2118 master_service.cc:948] ReplaceTablet: received request to replace tablet 326c4af4214a4ea6a9ae784525758630 from {username='slave'} at 127.0.0.1:36958
I20250831 19:54:56.377974 1902 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e6438652703c45d691f528a4322767b9" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:54:56.378171 1902 raft_consensus.cc:3058] T e6438652703c45d691f528a4322767b9 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:56.380509 1902 raft_consensus.cc:2466] T e6438652703c45d691f528a4322767b9 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1.
I20250831 19:54:56.381470 1568 leader_election.cc:304] T e6438652703c45d691f528a4322767b9 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:54:56.381781 3081 raft_consensus.cc:2802] T e6438652703c45d691f528a4322767b9 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:56.382073 3081 raft_consensus.cc:695] T e6438652703c45d691f528a4322767b9 P 89aa85d59c53436ebdf3074b13d14825 [term 1 LEADER]: Becoming Leader. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Running, Role: LEADER
I20250831 19:54:56.382339 3081 consensus_queue.cc:237] T e6438652703c45d691f528a4322767b9 P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:56.383008 1770 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e6438652703c45d691f528a4322767b9" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197"
I20250831 19:54:56.383191 1770 raft_consensus.cc:3058] T e6438652703c45d691f528a4322767b9 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:56.384886 3178 tablet_bootstrap.cc:492] T 8ebf42e07edf40f9b95b0304a912b9b8 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:56.384917 2995 leader_election.cc:290] T bec4c2ee742e4e6ab5f98fb3a1c36aca P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Requested vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:56.384683 2118 catalog_manager.cc:5869] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Sending DeleteTablet for 3 replicas of tablet 326c4af4214a4ea6a9ae784525758630
I20250831 19:54:56.385010 3178 ts_tablet_manager.cc:1397] T 8ebf42e07edf40f9b95b0304a912b9b8 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.026s user 0.002s sys 0.000s
I20250831 19:54:56.385491 2778 consensus_queue.cc:1035] T 93bfd2c663634436a61211a406c9f92f P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:56.385764 3178 raft_consensus.cc:357] T 8ebf42e07edf40f9b95b0304a912b9b8 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:56.385906 3178 raft_consensus.cc:383] T 8ebf42e07edf40f9b95b0304a912b9b8 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:56.385978 3178 raft_consensus.cc:738] T 8ebf42e07edf40f9b95b0304a912b9b8 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:56.386107 1769 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bec4c2ee742e4e6ab5f98fb3a1c36aca" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197"
I20250831 19:54:56.386178 1886 tablet_service.cc:1515] Processing DeleteTablet for tablet 326c4af4214a4ea6a9ae784525758630 with delete_type TABLET_DATA_DELETED (replaced by tablet 701cef9d6fd04a99986b871760397f1e) from {username='slave'} at 127.0.0.1:45906
I20250831 19:54:56.386262 1769 raft_consensus.cc:3058] T bec4c2ee742e4e6ab5f98fb3a1c36aca P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:56.386197 3178 consensus_queue.cc:260] T 8ebf42e07edf40f9b95b0304a912b9b8 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:56.386564 2958 tablet_replica.cc:331] T 326c4af4214a4ea6a9ae784525758630 P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:54:56.386781 2958 raft_consensus.cc:2241] T 326c4af4214a4ea6a9ae784525758630 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:56.386904 1770 raft_consensus.cc:2466] T e6438652703c45d691f528a4322767b9 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1.
I20250831 19:54:56.386966 2958 raft_consensus.cc:2270] T 326c4af4214a4ea6a9ae784525758630 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:56.387959 2958 ts_tablet_manager.cc:1905] T 326c4af4214a4ea6a9ae784525758630 P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:56.392899 1614 tablet_service.cc:1515] Processing DeleteTablet for tablet 326c4af4214a4ea6a9ae784525758630 with delete_type TABLET_DATA_DELETED (replaced by tablet 701cef9d6fd04a99986b871760397f1e) from {username='slave'} at 127.0.0.1:51022
I20250831 19:54:56.393162 2957 tablet_replica.cc:331] T 326c4af4214a4ea6a9ae784525758630 P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:54:56.393417 3178 ts_tablet_manager.cc:1428] T 8ebf42e07edf40f9b95b0304a912b9b8 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.008s user 0.000s sys 0.002s
I20250831 19:54:56.393715 3178 tablet_bootstrap.cc:492] T a6a3938379c64baba6f5f2c1a2f7087a P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:56.394043 2957 raft_consensus.cc:2241] T 326c4af4214a4ea6a9ae784525758630 P 89aa85d59c53436ebdf3074b13d14825 [term 1 LEADER]: Raft consensus shutting down.
I20250831 19:54:56.394328 2957 raft_consensus.cc:2270] T 326c4af4214a4ea6a9ae784525758630 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:56.395079 2957 ts_tablet_manager.cc:1905] T 326c4af4214a4ea6a9ae784525758630 P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:56.397814 1748 tablet_service.cc:1515] Processing DeleteTablet for tablet 326c4af4214a4ea6a9ae784525758630 with delete_type TABLET_DATA_DELETED (replaced by tablet 701cef9d6fd04a99986b871760397f1e) from {username='slave'} at 127.0.0.1:50674
I20250831 19:54:56.398077 2959 tablet_replica.cc:331] T 326c4af4214a4ea6a9ae784525758630 P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:54:56.398123 1749 tablet_service.cc:1468] Processing CreateTablet for tablet 701cef9d6fd04a99986b871760397f1e (DEFAULT_TABLE table=default.table_0498f784ecd944168cd0cbd019307408 [id=003066b121574814b254d138ec66c64c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:56.398483 1749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 701cef9d6fd04a99986b871760397f1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:56.400403 3178 tablet_bootstrap.cc:654] T a6a3938379c64baba6f5f2c1a2f7087a P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:56.403121 2118 catalog_manager.cc:6652] ReplaceTablet: tablet 326c4af4214a4ea6a9ae784525758630 deleted and replaced by tablet 701cef9d6fd04a99986b871760397f1e
I20250831 19:54:56.401926 2957 ts_tablet_manager.cc:1918] T 326c4af4214a4ea6a9ae784525758630 P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:56.405539 2957 log.cc:1199] T 326c4af4214a4ea6a9ae784525758630 P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/326c4af4214a4ea6a9ae784525758630
I20250831 19:54:56.406031 2957 ts_tablet_manager.cc:1939] T 326c4af4214a4ea6a9ae784525758630 P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
I20250831 19:54:56.411226 1769 raft_consensus.cc:2466] T bec4c2ee742e4e6ab5f98fb3a1c36aca P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1.
I20250831 19:54:56.415319 2118 master_service.cc:948] ReplaceTablet: received request to replace tablet 5b6497a1ef3d4c5b84dc2bbbbfafd586 from {username='slave'} at 127.0.0.1:36958
I20250831 19:54:56.418211 2104 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet 326c4af4214a4ea6a9ae784525758630 (table default.table_0498f784ecd944168cd0cbd019307408 [id=003066b121574814b254d138ec66c64c]) successfully deleted
I20250831 19:54:56.418607 1614 tablet_service.cc:1468] Processing CreateTablet for tablet 701cef9d6fd04a99986b871760397f1e (DEFAULT_TABLE table=default.table_0498f784ecd944168cd0cbd019307408 [id=003066b121574814b254d138ec66c64c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:56.418696 1570 leader_election.cc:304] T bec4c2ee742e4e6ab5f98fb3a1c36aca P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:56.418977 1614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 701cef9d6fd04a99986b871760397f1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:56.419456 2995 raft_consensus.cc:2802] T bec4c2ee742e4e6ab5f98fb3a1c36aca P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:56.419739 2995 raft_consensus.cc:695] T bec4c2ee742e4e6ab5f98fb3a1c36aca P 89aa85d59c53436ebdf3074b13d14825 [term 1 LEADER]: Becoming Leader. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Running, Role: LEADER
I20250831 19:54:56.420028 2995 consensus_queue.cc:237] T bec4c2ee742e4e6ab5f98fb3a1c36aca P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:56.426420 2118 catalog_manager.cc:5869] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Sending DeleteTablet for 3 replicas of tablet 5b6497a1ef3d4c5b84dc2bbbbfafd586
I20250831 19:54:56.426075 3178 tablet_bootstrap.cc:492] T a6a3938379c64baba6f5f2c1a2f7087a P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:56.427253 3178 ts_tablet_manager.cc:1397] T a6a3938379c64baba6f5f2c1a2f7087a P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.034s user 0.005s sys 0.001s
I20250831 19:54:56.427429 1749 tablet_service.cc:1515] Processing DeleteTablet for tablet 5b6497a1ef3d4c5b84dc2bbbbfafd586 with delete_type TABLET_DATA_DELETED (replaced by tablet 6952ee3fe766450993142c673d9509e8) from {username='slave'} at 127.0.0.1:50674
I20250831 19:54:56.428323 3178 raft_consensus.cc:357] T a6a3938379c64baba6f5f2c1a2f7087a P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:56.428618 3178 raft_consensus.cc:383] T a6a3938379c64baba6f5f2c1a2f7087a P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:56.428745 3178 raft_consensus.cc:738] T a6a3938379c64baba6f5f2c1a2f7087a P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:56.429025 3178 consensus_queue.cc:260] T a6a3938379c64baba6f5f2c1a2f7087a P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:56.429708 3178 ts_tablet_manager.cc:1428] T a6a3938379c64baba6f5f2c1a2f7087a P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250831 19:54:56.430183 3178 tablet_bootstrap.cc:492] T f7a7fad8a2ca4da297070dd3b49bc2d8 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:56.434229 3178 tablet_bootstrap.cc:654] T f7a7fad8a2ca4da297070dd3b49bc2d8 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:56.436762 1749 tablet_service.cc:1468] Processing CreateTablet for tablet 6952ee3fe766450993142c673d9509e8 (DEFAULT_TABLE table=default.table_f6d2041746f14f4a84962c26b1df1118 [id=59220fba0aa647bca189db2218f3e28f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:56.437340 1749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6952ee3fe766450993142c673d9509e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:56.437817 1614 tablet_service.cc:1515] Processing DeleteTablet for tablet 5b6497a1ef3d4c5b84dc2bbbbfafd586 with delete_type TABLET_DATA_DELETED (replaced by tablet 6952ee3fe766450993142c673d9509e8) from {username='slave'} at 127.0.0.1:51022
I20250831 19:54:56.438148 2957 tablet_replica.cc:331] T 5b6497a1ef3d4c5b84dc2bbbbfafd586 P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:54:56.438377 2957 raft_consensus.cc:2241] T 5b6497a1ef3d4c5b84dc2bbbbfafd586 P 89aa85d59c53436ebdf3074b13d14825 [term 1 LEADER]: Raft consensus shutting down.
I20250831 19:54:56.438700 2957 raft_consensus.cc:2270] T 5b6497a1ef3d4c5b84dc2bbbbfafd586 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:56.439242 2957 ts_tablet_manager.cc:1905] T 5b6497a1ef3d4c5b84dc2bbbbfafd586 P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:56.394994 1886 tablet_service.cc:1468] Processing CreateTablet for tablet 701cef9d6fd04a99986b871760397f1e (DEFAULT_TABLE table=default.table_0498f784ecd944168cd0cbd019307408 [id=003066b121574814b254d138ec66c64c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:56.427116 1885 tablet_service.cc:1515] Processing DeleteTablet for tablet 5b6497a1ef3d4c5b84dc2bbbbfafd586 with delete_type TABLET_DATA_DELETED (replaced by tablet 6952ee3fe766450993142c673d9509e8) from {username='slave'} at 127.0.0.1:45906
I20250831 19:54:56.401747 1902 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bec4c2ee742e4e6ab5f98fb3a1c36aca" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:54:56.440794 1886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 701cef9d6fd04a99986b871760397f1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:56.440798 1902 raft_consensus.cc:3058] T bec4c2ee742e4e6ab5f98fb3a1c36aca P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:56.441509 2118 catalog_manager.cc:6652] ReplaceTablet: tablet 5b6497a1ef3d4c5b84dc2bbbbfafd586 deleted and replaced by tablet 6952ee3fe766450993142c673d9509e8
I20250831 19:54:56.441751 1613 tablet_service.cc:1468] Processing CreateTablet for tablet 6952ee3fe766450993142c673d9509e8 (DEFAULT_TABLE table=default.table_f6d2041746f14f4a84962c26b1df1118 [id=59220fba0aa647bca189db2218f3e28f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:56.442091 1613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6952ee3fe766450993142c673d9509e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:56.442152 2118 master_service.cc:948] ReplaceTablet: received request to replace tablet bde481a8e8fc4b1f82453a4e50ded47c from {username='slave'} at 127.0.0.1:36958
I20250831 19:54:56.444341 1902 raft_consensus.cc:2466] T bec4c2ee742e4e6ab5f98fb3a1c36aca P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1.
I20250831 19:54:56.393419 2958 ts_tablet_manager.cc:1918] T 326c4af4214a4ea6a9ae784525758630 P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:56.448362 2958 log.cc:1199] T 326c4af4214a4ea6a9ae784525758630 P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/326c4af4214a4ea6a9ae784525758630
I20250831 19:54:56.448762 2958 ts_tablet_manager.cc:1939] T 326c4af4214a4ea6a9ae784525758630 P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:54:56.449328 2958 tablet_replica.cc:331] T 5b6497a1ef3d4c5b84dc2bbbbfafd586 P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:54:56.449563 2958 raft_consensus.cc:2241] T 5b6497a1ef3d4c5b84dc2bbbbfafd586 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:56.449749 2958 raft_consensus.cc:2270] T 5b6497a1ef3d4c5b84dc2bbbbfafd586 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:56.450060 2101 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet 326c4af4214a4ea6a9ae784525758630 (table default.table_0498f784ecd944168cd0cbd019307408 [id=003066b121574814b254d138ec66c64c]) successfully deleted
I20250831 19:54:56.450270 2958 ts_tablet_manager.cc:1905] T 5b6497a1ef3d4c5b84dc2bbbbfafd586 P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:56.451479 2699 tablet_bootstrap.cc:492] T 8ebf42e07edf40f9b95b0304a912b9b8 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:56.451669 2699 ts_tablet_manager.cc:1397] T 8ebf42e07edf40f9b95b0304a912b9b8 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.100s user 0.000s sys 0.004s
I20250831 19:54:56.452494 2699 raft_consensus.cc:357] T 8ebf42e07edf40f9b95b0304a912b9b8 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:56.452798 2699 raft_consensus.cc:383] T 8ebf42e07edf40f9b95b0304a912b9b8 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:56.452929 2699 raft_consensus.cc:738] T 8ebf42e07edf40f9b95b0304a912b9b8 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:56.453260 2957 ts_tablet_manager.cc:1918] T 5b6497a1ef3d4c5b84dc2bbbbfafd586 P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:56.453397 2957 log.cc:1199] T 5b6497a1ef3d4c5b84dc2bbbbfafd586 P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/5b6497a1ef3d4c5b84dc2bbbbfafd586
I20250831 19:54:56.453238 2699 consensus_queue.cc:260] T 8ebf42e07edf40f9b95b0304a912b9b8 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:56.453958 2118 catalog_manager.cc:5869] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Sending DeleteTablet for 3 replicas of tablet bde481a8e8fc4b1f82453a4e50ded47c
I20250831 19:54:56.457007 2699 ts_tablet_manager.cc:1428] T 8ebf42e07edf40f9b95b0304a912b9b8 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.005s user 0.000s sys 0.001s
I20250831 19:54:56.456470 2123 catalog_manager.cc:2149] created HMS catalog entry for table [id=69ff45f06b4641a987204b04e7586cb7]
I20250831 19:54:56.457168 2957 ts_tablet_manager.cc:1939] T 5b6497a1ef3d4c5b84dc2bbbbfafd586 P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
I20250831 19:54:56.462270 2123 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:36958 (request call id 169) took 1711 ms. Trace:
I20250831 19:54:56.462376 2123 rpcz_store.cc:276] 0831 19:54:54.751195 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:56.069916 (+1318721us) service_pool.cc:225] Handling call
0831 19:54:56.214365 (+144449us) catalog_manager.cc:2076] Acquired catalog manager lock
0831 19:54:56.214794 (+ 429us) catalog_manager.cc:2122] Created new table and tablet info
0831 19:54:56.456442 (+241648us) catalog_manager.cc:2148] Created new table in HMS catalog
0831 19:54:56.461978 (+ 5536us) catalog_manager.cc:2182] Wrote table and tablets to system table
0831 19:54:56.462100 (+ 122us) catalog_manager.cc:2216] Inserted table and tablets into CatalogManager maps
0831 19:54:56.462210 (+ 110us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:56.457916 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:56.458015 (+ 99us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:56.458019 (+ 4us) write_op.cc:435] Acquired schema lock
0831 19:54:56.458022 (+ 3us) tablet.cc:660] Decoding operations
0831 19:54:56.458101 (+ 79us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:56.458111 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:56.458115 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:56.458190 (+ 75us) tablet.cc:699] Row locks acquired
0831 19:54:56.458192 (+ 2us) write_op.cc:260] PREPARE: finished
0831 19:54:56.458242 (+ 50us) write_op.cc:270] Start()
0831 19:54:56.458274 (+ 32us) write_op.cc:276] Timestamp: P: 1756670096458219 usec, L: 0
0831 19:54:56.458279 (+ 5us) op_driver.cc:348] REPLICATION: starting
0831 19:54:56.458468 (+ 189us) log.cc:844] Serialized 433 byte log entry
0831 19:54:56.460999 (+ 2531us) op_driver.cc:464] REPLICATION: finished
0831 19:54:56.461140 (+ 141us) write_op.cc:301] APPLY: starting
0831 19:54:56.461156 (+ 16us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:56.461216 (+ 60us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:56.461247 (+ 31us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:56.461370 (+ 123us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:56.461411 (+ 41us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0831 19:54:56.461421 (+ 10us) write_op.cc:312] APPLY: finished
0831 19:54:56.461691 (+ 270us) log.cc:844] Serialized 29 byte log entry
0831 19:54:56.461755 (+ 64us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:56.461775 (+ 20us) write_op.cc:454] Released schema lock
0831 19:54:56.461782 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0831 19:54:56.461860 (+ 78us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:56.461865 (+ 5us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":135372,"Hive Metastore.run_cpu_time_us":237,"Hive Metastore.run_wall_time_us":105954,"child_traces":[["op",{"apply.queue_time_us":92,"apply.run_cpu_time_us":542,"apply.run_wall_time_us":710,"num_ops":2,"prepare.queue_time_us":313,"prepare.run_cpu_time_us":666,"prepare.run_wall_time_us":667,"raft.queue_time_us":398,"raft.run_cpu_time_us":232,"raft.run_wall_time_us":231,"replication_time_us":2691}]]}
I20250831 19:54:56.463372 2123 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36958:
name: "default.Table_20d403c55682499a9ba3267b85aecde7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:56.464202 2104 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet 5b6497a1ef3d4c5b84dc2bbbbfafd586 (table default.table_f6d2041746f14f4a84962c26b1df1118 [id=59220fba0aa647bca189db2218f3e28f]) successfully deleted
I20250831 19:54:56.479489 1748 tablet_service.cc:1468] Processing CreateTablet for tablet 876f49b43408443da6a867c03df891b9 (DEFAULT_TABLE table=default.table_6c90d2f731914735837fa73efe73971b [id=69ff45f06b4641a987204b04e7586cb7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:56.479789 3178 tablet_bootstrap.cc:492] T f7a7fad8a2ca4da297070dd3b49bc2d8 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:56.479889 1748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 876f49b43408443da6a867c03df891b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:56.479933 3178 ts_tablet_manager.cc:1397] T f7a7fad8a2ca4da297070dd3b49bc2d8 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.050s user 0.010s sys 0.007s
I20250831 19:54:56.481418 3178 raft_consensus.cc:357] T f7a7fad8a2ca4da297070dd3b49bc2d8 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:56.481664 3178 raft_consensus.cc:383] T f7a7fad8a2ca4da297070dd3b49bc2d8 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:56.481747 3178 raft_consensus.cc:738] T f7a7fad8a2ca4da297070dd3b49bc2d8 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:56.481985 3178 consensus_queue.cc:260] T f7a7fad8a2ca4da297070dd3b49bc2d8 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:56.483491 3178 ts_tablet_manager.cc:1428] T f7a7fad8a2ca4da297070dd3b49bc2d8 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20250831 19:54:56.484002 3178 tablet_bootstrap.cc:492] T 701cef9d6fd04a99986b871760397f1e P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:56.487205 1751 tablet_service.cc:1468] Processing CreateTablet for tablet f42849cccf8a45ed95794eac0e3922e7 (DEFAULT_TABLE table=default.table_afb8eb0248714122aa74efa2d6fcfce4 [id=fe54e4791a0d4e3c9a36e1968988ea0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:56.487605 1751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f42849cccf8a45ed95794eac0e3922e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:56.487646 1614 tablet_service.cc:1468] Processing CreateTablet for tablet 876f49b43408443da6a867c03df891b9 (DEFAULT_TABLE table=default.table_6c90d2f731914735837fa73efe73971b [id=69ff45f06b4641a987204b04e7586cb7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:56.487980 1614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 876f49b43408443da6a867c03df891b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:56.493508 2959 raft_consensus.cc:2241] T 326c4af4214a4ea6a9ae784525758630 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:56.493835 2959 raft_consensus.cc:2270] T 326c4af4214a4ea6a9ae784525758630 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:56.495580 2699 tablet_bootstrap.cc:492] T a6a3938379c64baba6f5f2c1a2f7087a P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:56.496093 3178 tablet_bootstrap.cc:654] T 701cef9d6fd04a99986b871760397f1e P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:56.496735 1748 tablet_service.cc:1515] Processing DeleteTablet for tablet bde481a8e8fc4b1f82453a4e50ded47c with delete_type TABLET_DATA_DELETED (replaced by tablet f42849cccf8a45ed95794eac0e3922e7) from {username='slave'} at 127.0.0.1:50674
I20250831 19:54:56.497586 3081 raft_consensus.cc:491] T 8ebf42e07edf40f9b95b0304a912b9b8 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:56.497720 3081 raft_consensus.cc:513] T 8ebf42e07edf40f9b95b0304a912b9b8 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:56.498215 3081 leader_election.cc:290] T 8ebf42e07edf40f9b95b0304a912b9b8 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:56.498824 1885 tablet_service.cc:1515] Processing DeleteTablet for tablet bde481a8e8fc4b1f82453a4e50ded47c with delete_type TABLET_DATA_DELETED (replaced by tablet f42849cccf8a45ed95794eac0e3922e7) from {username='slave'} at 127.0.0.1:45906
I20250831 19:54:56.499583 2118 catalog_manager.cc:6652] ReplaceTablet: tablet bde481a8e8fc4b1f82453a4e50ded47c deleted and replaced by tablet f42849cccf8a45ed95794eac0e3922e7
I20250831 19:54:56.501525 2979 raft_consensus.cc:491] T 65026496c5b14baab6f66dce4a6d0fc2 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:56.501684 2979 raft_consensus.cc:513] T 65026496c5b14baab6f66dce4a6d0fc2 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:56.502239 2979 leader_election.cc:290] T 65026496c5b14baab6f66dce4a6d0fc2 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:56.502795 1632 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "65026496c5b14baab6f66dce4a6d0fc2" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:56.505874 2699 tablet_bootstrap.cc:654] T a6a3938379c64baba6f5f2c1a2f7087a P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:56.458149 1884 tablet_service.cc:1468] Processing CreateTablet for tablet 6952ee3fe766450993142c673d9509e8 (DEFAULT_TABLE table=default.table_f6d2041746f14f4a84962c26b1df1118 [id=59220fba0aa647bca189db2218f3e28f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:56.512966 1884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6952ee3fe766450993142c673d9509e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:56.477010 1883 tablet_service.cc:1468] Processing CreateTablet for tablet 876f49b43408443da6a867c03df891b9 (DEFAULT_TABLE table=default.table_6c90d2f731914735837fa73efe73971b [id=69ff45f06b4641a987204b04e7586cb7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:56.516799 1883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 876f49b43408443da6a867c03df891b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:56.517272 2118 catalog_manager.cc:5582] T e6438652703c45d691f528a4322767b9 P 89aa85d59c53436ebdf3074b13d14825 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193). New cstate: current_term: 1 leader_uuid: "89aa85d59c53436ebdf3074b13d14825" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: HEALTHY } } }
I20250831 19:54:56.518435 2118 catalog_manager.cc:5674] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197) does not have the latest schema for tablet e6438652703c45d691f528a4322767b9 (table default.table_d3002519e6964bb484d995d871e766c9 [id=1137b2754d104964bbe5bbaa4a0578b8]). Expected version 3 got 0
I20250831 19:54:56.486936 1886 tablet_service.cc:1468] Processing CreateTablet for tablet f42849cccf8a45ed95794eac0e3922e7 (DEFAULT_TABLE table=default.table_afb8eb0248714122aa74efa2d6fcfce4 [id=fe54e4791a0d4e3c9a36e1968988ea0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:56.498775 1902 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8ebf42e07edf40f9b95b0304a912b9b8" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:56.519171 1902 raft_consensus.cc:2466] T 8ebf42e07edf40f9b95b0304a912b9b8 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 0.
I20250831 19:54:56.519627 1568 leader_election.cc:304] T 8ebf42e07edf40f9b95b0304a912b9b8 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:54:56.519865 1886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f42849cccf8a45ed95794eac0e3922e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:56.520043 3081 raft_consensus.cc:2802] T 8ebf42e07edf40f9b95b0304a912b9b8 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:56.520145 3081 raft_consensus.cc:491] T 8ebf42e07edf40f9b95b0304a912b9b8 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:56.520268 3081 raft_consensus.cc:3058] T 8ebf42e07edf40f9b95b0304a912b9b8 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:56.523479 2117 catalog_manager.cc:2149] created HMS catalog entry for table [id=09c2744c9575474bba2df5503541accc]
I20250831 19:54:56.525826 1769 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8ebf42e07edf40f9b95b0304a912b9b8" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:56.526718 1769 raft_consensus.cc:2466] T 8ebf42e07edf40f9b95b0304a912b9b8 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 0.
I20250831 19:54:56.527127 3018 raft_consensus.cc:491] T f7a7fad8a2ca4da297070dd3b49bc2d8 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:56.527266 3018 raft_consensus.cc:513] T f7a7fad8a2ca4da297070dd3b49bc2d8 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:56.527915 3018 leader_election.cc:290] T f7a7fad8a2ca4da297070dd3b49bc2d8 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:56.528472 1902 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f7a7fad8a2ca4da297070dd3b49bc2d8" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:56.528784 2117 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:36958 (request call id 174) took 1172 ms. Trace:
W20250831 19:54:56.528995 1568 leader_election.cc:343] T f7a7fad8a2ca4da297070dd3b49bc2d8 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): Illegal state: must be running to vote when last-logged opid is not known
I20250831 19:54:56.528903 2117 rpcz_store.cc:276] 0831 19:54:55.356113 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:56.165130 (+809017us) service_pool.cc:225] Handling call
0831 19:54:56.358681 (+193551us) catalog_manager.cc:2076] Acquired catalog manager lock
0831 19:54:56.359217 (+ 536us) catalog_manager.cc:2122] Created new table and tablet info
0831 19:54:56.523439 (+164222us) catalog_manager.cc:2148] Created new table in HMS catalog
0831 19:54:56.528542 (+ 5103us) catalog_manager.cc:2182] Wrote table and tablets to system table
0831 19:54:56.528656 (+ 114us) catalog_manager.cc:2216] Inserted table and tablets into CatalogManager maps
0831 19:54:56.528751 (+ 95us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:56.524050 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:56.524166 (+ 116us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:56.524173 (+ 7us) write_op.cc:435] Acquired schema lock
0831 19:54:56.524175 (+ 2us) tablet.cc:660] Decoding operations
0831 19:54:56.524262 (+ 87us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:56.524275 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:56.524279 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:56.524359 (+ 80us) tablet.cc:699] Row locks acquired
0831 19:54:56.524361 (+ 2us) write_op.cc:260] PREPARE: finished
0831 19:54:56.524398 (+ 37us) write_op.cc:270] Start()
0831 19:54:56.524443 (+ 45us) write_op.cc:276] Timestamp: P: 1756670096524368 usec, L: 0
0831 19:54:56.524446 (+ 3us) op_driver.cc:348] REPLICATION: starting
0831 19:54:56.524615 (+ 169us) log.cc:844] Serialized 433 byte log entry
0831 19:54:56.527404 (+ 2789us) op_driver.cc:464] REPLICATION: finished
0831 19:54:56.527531 (+ 127us) write_op.cc:301] APPLY: starting
0831 19:54:56.527566 (+ 35us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:56.527629 (+ 63us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:56.527659 (+ 30us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:56.527776 (+ 117us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:56.527812 (+ 36us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0831 19:54:56.527829 (+ 17us) write_op.cc:312] APPLY: finished
0831 19:54:56.527906 (+ 77us) log.cc:844] Serialized 29 byte log entry
0831 19:54:56.527986 (+ 80us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:56.528006 (+ 20us) write_op.cc:454] Released schema lock
0831 19:54:56.528011 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0831 19:54:56.528076 (+ 65us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:56.528079 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":111755,"Hive Metastore.run_cpu_time_us":242,"Hive Metastore.run_wall_time_us":52042,"child_traces":[["op",{"apply.queue_time_us":81,"apply.run_cpu_time_us":538,"apply.run_wall_time_us":537,"num_ops":2,"prepare.queue_time_us":48,"prepare.run_cpu_time_us":677,"prepare.run_wall_time_us":677,"raft.queue_time_us":416,"raft.run_cpu_time_us":257,"raft.run_wall_time_us":257,"replication_time_us":2931}]]}
I20250831 19:54:56.529608 1614 tablet_service.cc:1468] Processing CreateTablet for tablet f42849cccf8a45ed95794eac0e3922e7 (DEFAULT_TABLE table=default.table_afb8eb0248714122aa74efa2d6fcfce4 [id=fe54e4791a0d4e3c9a36e1968988ea0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:56.529793 1769 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f7a7fad8a2ca4da297070dd3b49bc2d8" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:56.530103 1614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f42849cccf8a45ed95794eac0e3922e7. 1 dirs total, 0 dirs full, 0 dirs failed
W20250831 19:54:56.530390 1570 leader_election.cc:343] T f7a7fad8a2ca4da297070dd3b49bc2d8 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): Illegal state: must be running to vote when last-logged opid is not known
I20250831 19:54:56.530504 1570 leader_election.cc:304] T f7a7fad8a2ca4da297070dd3b49bc2d8 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825; no voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197
I20250831 19:54:56.530727 3018 raft_consensus.cc:2747] T f7a7fad8a2ca4da297070dd3b49bc2d8 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250831 19:54:56.533628 1613 tablet_service.cc:1515] Processing DeleteTablet for tablet bde481a8e8fc4b1f82453a4e50ded47c with delete_type TABLET_DATA_DELETED (replaced by tablet f42849cccf8a45ed95794eac0e3922e7) from {username='slave'} at 127.0.0.1:51022
I20250831 19:54:56.533762 2117 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_62a803bf234d4af29aa61db8fba3d765" } modify_external_catalogs: true
I20250831 19:54:56.533965 2117 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_62a803bf234d4af29aa61db8fba3d765" } modify_external_catalogs: true
I20250831 19:54:56.534061 2957 tablet_replica.cc:331] T bde481a8e8fc4b1f82453a4e50ded47c P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:54:56.534240 2957 raft_consensus.cc:2241] T bde481a8e8fc4b1f82453a4e50ded47c P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:56.534392 2957 raft_consensus.cc:2270] T bde481a8e8fc4b1f82453a4e50ded47c P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:56.522971 3081 raft_consensus.cc:513] T 8ebf42e07edf40f9b95b0304a912b9b8 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:56.534929 2957 ts_tablet_manager.cc:1905] T bde481a8e8fc4b1f82453a4e50ded47c P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:56.535619 1902 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8ebf42e07edf40f9b95b0304a912b9b8" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:54:56.535687 3081 leader_election.cc:290] T 8ebf42e07edf40f9b95b0304a912b9b8 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Requested vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:56.535782 1902 raft_consensus.cc:3058] T 8ebf42e07edf40f9b95b0304a912b9b8 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:56.538084 1902 raft_consensus.cc:2466] T 8ebf42e07edf40f9b95b0304a912b9b8 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1.
I20250831 19:54:56.538446 1568 leader_election.cc:304] T 8ebf42e07edf40f9b95b0304a912b9b8 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:54:56.538708 3081 raft_consensus.cc:2802] T 8ebf42e07edf40f9b95b0304a912b9b8 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:56.538880 3081 raft_consensus.cc:695] T 8ebf42e07edf40f9b95b0304a912b9b8 P 89aa85d59c53436ebdf3074b13d14825 [term 1 LEADER]: Becoming Leader. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Running, Role: LEADER
I20250831 19:54:56.538931 1769 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8ebf42e07edf40f9b95b0304a912b9b8" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197"
I20250831 19:54:56.539199 1769 raft_consensus.cc:3058] T 8ebf42e07edf40f9b95b0304a912b9b8 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:56.539142 3081 consensus_queue.cc:237] T 8ebf42e07edf40f9b95b0304a912b9b8 P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:56.540647 2699 tablet_bootstrap.cc:492] T a6a3938379c64baba6f5f2c1a2f7087a P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:56.540795 2699 ts_tablet_manager.cc:1397] T a6a3938379c64baba6f5f2c1a2f7087a P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.045s user 0.003s sys 0.001s
I20250831 19:54:56.541074 2957 ts_tablet_manager.cc:1918] T bde481a8e8fc4b1f82453a4e50ded47c P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:56.541198 2957 log.cc:1199] T bde481a8e8fc4b1f82453a4e50ded47c P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/bde481a8e8fc4b1f82453a4e50ded47c
I20250831 19:54:56.541452 2699 raft_consensus.cc:357] T a6a3938379c64baba6f5f2c1a2f7087a P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:56.541638 2699 raft_consensus.cc:383] T a6a3938379c64baba6f5f2c1a2f7087a P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:56.541746 2699 raft_consensus.cc:738] T a6a3938379c64baba6f5f2c1a2f7087a P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:56.541776 1769 raft_consensus.cc:2466] T 8ebf42e07edf40f9b95b0304a912b9b8 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1.
I20250831 19:54:56.542064 2699 consensus_queue.cc:260] T a6a3938379c64baba6f5f2c1a2f7087a P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:56.542936 1771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "65026496c5b14baab6f66dce4a6d0fc2" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:56.543202 1771 raft_consensus.cc:2391] T 65026496c5b14baab6f66dce4a6d0fc2 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2441fafe1d62429386f4631ad423567d in current term 1: Already voted for candidate 89aa85d59c53436ebdf3074b13d14825 in this term.
I20250831 19:54:56.543377 2699 ts_tablet_manager.cc:1428] T a6a3938379c64baba6f5f2c1a2f7087a P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250831 19:54:56.543663 1842 leader_election.cc:304] T 65026496c5b14baab6f66dce4a6d0fc2 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2441fafe1d62429386f4631ad423567d; no voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197
I20250831 19:54:56.543763 2699 tablet_bootstrap.cc:492] T f7a7fad8a2ca4da297070dd3b49bc2d8 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:56.543906 2979 raft_consensus.cc:3058] T 65026496c5b14baab6f66dce4a6d0fc2 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:56.544761 2957 ts_tablet_manager.cc:1939] T bde481a8e8fc4b1f82453a4e50ded47c P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
W20250831 19:54:56.545152 3205 log.cc:927] Time spent T bec4c2ee742e4e6ab5f98fb3a1c36aca P 89aa85d59c53436ebdf3074b13d14825: Append to log took a long time: real 0.059s user 0.000s sys 0.000s
I20250831 19:54:56.546295 2979 raft_consensus.cc:2747] T 65026496c5b14baab6f66dce4a6d0fc2 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250831 19:54:56.548153 2104 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet bde481a8e8fc4b1f82453a4e50ded47c (table default.table_afb8eb0248714122aa74efa2d6fcfce4 [id=fe54e4791a0d4e3c9a36e1968988ea0d]) successfully deleted
I20250831 19:54:56.548406 2778 consensus_queue.cc:1035] T 172f71a8fe554a5b8bfdb2a5bc109abc P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:56.552582 2959 ts_tablet_manager.cc:1905] T 326c4af4214a4ea6a9ae784525758630 P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:56.558135 2959 ts_tablet_manager.cc:1918] T 326c4af4214a4ea6a9ae784525758630 P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:56.558326 2959 log.cc:1199] T 326c4af4214a4ea6a9ae784525758630 P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/326c4af4214a4ea6a9ae784525758630
I20250831 19:54:56.558773 2959 ts_tablet_manager.cc:1939] T 326c4af4214a4ea6a9ae784525758630 P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
I20250831 19:54:56.559852 2105 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet 326c4af4214a4ea6a9ae784525758630 (table default.table_0498f784ecd944168cd0cbd019307408 [id=003066b121574814b254d138ec66c64c]) successfully deleted
I20250831 19:54:56.560217 2959 tablet_replica.cc:331] T 5b6497a1ef3d4c5b84dc2bbbbfafd586 P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:54:56.560441 2959 raft_consensus.cc:2241] T 5b6497a1ef3d4c5b84dc2bbbbfafd586 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:56.560845 2959 raft_consensus.cc:2270] T 5b6497a1ef3d4c5b84dc2bbbbfafd586 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:56.561537 2959 ts_tablet_manager.cc:1905] T 5b6497a1ef3d4c5b84dc2bbbbfafd586 P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:56.564287 1749 tablet_service.cc:1468] Processing CreateTablet for tablet 3081636d94084a8aa3905f40edf34b0f (DEFAULT_TABLE table=default.table_65ae80244c21495fad7b9e506a44ebcc [id=09c2744c9575474bba2df5503541accc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:56.564725 1749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3081636d94084a8aa3905f40edf34b0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:56.567975 2959 ts_tablet_manager.cc:1918] T 5b6497a1ef3d4c5b84dc2bbbbfafd586 P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:56.568660 1614 tablet_service.cc:1468] Processing CreateTablet for tablet 3081636d94084a8aa3905f40edf34b0f (DEFAULT_TABLE table=default.table_65ae80244c21495fad7b9e506a44ebcc [id=09c2744c9575474bba2df5503541accc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:56.569056 1614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3081636d94084a8aa3905f40edf34b0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:56.573689 2699 tablet_bootstrap.cc:654] T f7a7fad8a2ca4da297070dd3b49bc2d8 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:56.575744 1884 tablet_service.cc:1468] Processing CreateTablet for tablet 3081636d94084a8aa3905f40edf34b0f (DEFAULT_TABLE table=default.table_65ae80244c21495fad7b9e506a44ebcc [id=09c2744c9575474bba2df5503541accc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:56.580646 2118 catalog_manager.cc:5582] T 8ebf42e07edf40f9b95b0304a912b9b8 P 89aa85d59c53436ebdf3074b13d14825 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193). New cstate: current_term: 1 leader_uuid: "89aa85d59c53436ebdf3074b13d14825" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: UNKNOWN } } }
I20250831 19:54:56.581609 2118 catalog_manager.cc:5582] T bec4c2ee742e4e6ab5f98fb3a1c36aca P 89aa85d59c53436ebdf3074b13d14825 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193). New cstate: current_term: 1 leader_uuid: "89aa85d59c53436ebdf3074b13d14825" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: HEALTHY } } }
I20250831 19:54:56.593732 1884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3081636d94084a8aa3905f40edf34b0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:56.480934 2958 ts_tablet_manager.cc:1918] T 5b6497a1ef3d4c5b84dc2bbbbfafd586 P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:56.595873 2958 log.cc:1199] T 5b6497a1ef3d4c5b84dc2bbbbfafd586 P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/5b6497a1ef3d4c5b84dc2bbbbfafd586
I20250831 19:54:56.595976 2119 catalog_manager.cc:2149] created HMS catalog entry for table [id=096152b885a04bfd9cced171fb8a12af]
I20250831 19:54:56.596333 2958 ts_tablet_manager.cc:1939] T 5b6497a1ef3d4c5b84dc2bbbbfafd586 P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:54:56.589423 2778 consensus_queue.cc:1035] T 172f71a8fe554a5b8bfdb2a5bc109abc P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:56.597373 2101 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet 5b6497a1ef3d4c5b84dc2bbbbfafd586 (table default.table_f6d2041746f14f4a84962c26b1df1118 [id=59220fba0aa647bca189db2218f3e28f]) successfully deleted
I20250831 19:54:56.590952 3177 tablet_bootstrap.cc:492] T a6a3938379c64baba6f5f2c1a2f7087a P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:56.597827 2959 log.cc:1199] T 5b6497a1ef3d4c5b84dc2bbbbfafd586 P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/5b6497a1ef3d4c5b84dc2bbbbfafd586
I20250831 19:54:56.597980 3177 ts_tablet_manager.cc:1397] T a6a3938379c64baba6f5f2c1a2f7087a P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.266s user 0.016s sys 0.028s
I20250831 19:54:56.598271 2959 ts_tablet_manager.cc:1939] T 5b6497a1ef3d4c5b84dc2bbbbfafd586 P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
I20250831 19:54:56.598907 3177 raft_consensus.cc:357] T a6a3938379c64baba6f5f2c1a2f7087a P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:56.599145 3177 raft_consensus.cc:383] T a6a3938379c64baba6f5f2c1a2f7087a P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:56.599174 2105 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet 5b6497a1ef3d4c5b84dc2bbbbfafd586 (table default.table_f6d2041746f14f4a84962c26b1df1118 [id=59220fba0aa647bca189db2218f3e28f]) successfully deleted
I20250831 19:54:56.599249 3177 raft_consensus.cc:738] T a6a3938379c64baba6f5f2c1a2f7087a P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:56.599526 3177 consensus_queue.cc:260] T a6a3938379c64baba6f5f2c1a2f7087a P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:56.601644 2119 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:36958 (request call id 170) took 1807 ms. Trace:
I20250831 19:54:56.601769 2119 rpcz_store.cc:276] 0831 19:54:54.794349 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:56.082400 (+1288051us) service_pool.cc:225] Handling call
0831 19:54:56.358786 (+276386us) catalog_manager.cc:2076] Acquired catalog manager lock
0831 19:54:56.359344 (+ 558us) catalog_manager.cc:2122] Created new table and tablet info
0831 19:54:56.595944 (+236600us) catalog_manager.cc:2148] Created new table in HMS catalog
0831 19:54:56.601323 (+ 5379us) catalog_manager.cc:2182] Wrote table and tablets to system table
0831 19:54:56.601420 (+ 97us) catalog_manager.cc:2216] Inserted table and tablets into CatalogManager maps
0831 19:54:56.601571 (+ 151us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:56.596639 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:56.596741 (+ 102us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:56.596745 (+ 4us) write_op.cc:435] Acquired schema lock
0831 19:54:56.596747 (+ 2us) tablet.cc:660] Decoding operations
0831 19:54:56.596838 (+ 91us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:56.596848 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:56.596852 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:56.596917 (+ 65us) tablet.cc:699] Row locks acquired
0831 19:54:56.596919 (+ 2us) write_op.cc:260] PREPARE: finished
0831 19:54:56.596948 (+ 29us) write_op.cc:270] Start()
0831 19:54:56.596973 (+ 25us) write_op.cc:276] Timestamp: P: 1756670096596913 usec, L: 0
0831 19:54:56.596976 (+ 3us) op_driver.cc:348] REPLICATION: starting
0831 19:54:56.597122 (+ 146us) log.cc:844] Serialized 433 byte log entry
0831 19:54:56.599954 (+ 2832us) op_driver.cc:464] REPLICATION: finished
0831 19:54:56.600068 (+ 114us) write_op.cc:301] APPLY: starting
0831 19:54:56.600082 (+ 14us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:56.600122 (+ 40us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:56.600143 (+ 21us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:56.600240 (+ 97us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:56.600274 (+ 34us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0831 19:54:56.600280 (+ 6us) write_op.cc:312] APPLY: finished
0831 19:54:56.600341 (+ 61us) log.cc:844] Serialized 29 byte log entry
0831 19:54:56.600393 (+ 52us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:56.600408 (+ 15us) write_op.cc:454] Released schema lock
0831 19:54:56.600414 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0831 19:54:56.600474 (+ 60us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:56.600478 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":163746,"Hive Metastore.run_cpu_time_us":247,"Hive Metastore.run_wall_time_us":72409,"child_traces":[["op",{"apply.queue_time_us":77,"apply.run_cpu_time_us":397,"apply.run_wall_time_us":396,"num_ops":2,"prepare.queue_time_us":47,"prepare.run_cpu_time_us":585,"prepare.run_wall_time_us":585,"raft.queue_time_us":1032,"raft.run_cpu_time_us":280,"raft.run_wall_time_us":280,"replication_time_us":2953,"spinlock_wait_cycles":120576}]]}
I20250831 19:54:56.604555 3177 ts_tablet_manager.cc:1428] T a6a3938379c64baba6f5f2c1a2f7087a P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20250831 19:54:56.605188 3177 tablet_bootstrap.cc:492] T f7a7fad8a2ca4da297070dd3b49bc2d8 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:56.606786 3177 tablet_bootstrap.cc:654] T f7a7fad8a2ca4da297070dd3b49bc2d8 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:56.614058 2119 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_56778a4f18cc4ab29dfda4ed17259cc5" } modify_external_catalogs: true
I20250831 19:54:56.614492 2119 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_56778a4f18cc4ab29dfda4ed17259cc5" } modify_external_catalogs: true
I20250831 19:54:56.615535 1613 tablet_service.cc:1468] Processing CreateTablet for tablet eb97839972ba4bda89287c30da49bb40 (DEFAULT_TABLE table=default.table_13fd718b01d445dbb3955c7804421b1e [id=096152b885a04bfd9cced171fb8a12af]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:56.615605 1769 raft_consensus.cc:1273] T 5ed927d4935143968fb89a73730eb8a1 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Refusing update from remote peer 89aa85d59c53436ebdf3074b13d14825: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250831 19:54:56.615940 1613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb97839972ba4bda89287c30da49bb40. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:56.616009 1749 tablet_service.cc:1468] Processing CreateTablet for tablet eb97839972ba4bda89287c30da49bb40 (DEFAULT_TABLE table=default.table_13fd718b01d445dbb3955c7804421b1e [id=096152b885a04bfd9cced171fb8a12af]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:56.616333 1749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb97839972ba4bda89287c30da49bb40. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:56.616593 3177 tablet_bootstrap.cc:492] T f7a7fad8a2ca4da297070dd3b49bc2d8 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:56.616716 3177 ts_tablet_manager.cc:1397] T f7a7fad8a2ca4da297070dd3b49bc2d8 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.012s user 0.005s sys 0.000s
I20250831 19:54:56.617165 3081 consensus_queue.cc:1035] T 5ed927d4935143968fb89a73730eb8a1 P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:56.617745 3177 raft_consensus.cc:357] T f7a7fad8a2ca4da297070dd3b49bc2d8 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:56.617796 3081 consensus_queue.cc:1035] T bd12184dd70f451fbd9a2025d2c00758 P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:56.617910 3177 raft_consensus.cc:383] T f7a7fad8a2ca4da297070dd3b49bc2d8 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:56.617995 3177 raft_consensus.cc:738] T f7a7fad8a2ca4da297070dd3b49bc2d8 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:56.618197 3177 consensus_queue.cc:260] T f7a7fad8a2ca4da297070dd3b49bc2d8 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:56.596558 2699 tablet_bootstrap.cc:492] T f7a7fad8a2ca4da297070dd3b49bc2d8 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:56.618520 2699 ts_tablet_manager.cc:1397] T f7a7fad8a2ca4da297070dd3b49bc2d8 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.075s user 0.000s sys 0.003s
I20250831 19:54:56.618784 1904 raft_consensus.cc:1273] T 5ed927d4935143968fb89a73730eb8a1 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Refusing update from remote peer 89aa85d59c53436ebdf3074b13d14825: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250831 19:54:56.619174 3177 ts_tablet_manager.cc:1428] T f7a7fad8a2ca4da297070dd3b49bc2d8 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250831 19:54:56.619405 3177 tablet_bootstrap.cc:492] T 701cef9d6fd04a99986b871760397f1e P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:56.620151 3081 consensus_queue.cc:1035] T 5ed927d4935143968fb89a73730eb8a1 P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:56.621584 2699 raft_consensus.cc:357] T f7a7fad8a2ca4da297070dd3b49bc2d8 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:56.622072 2699 raft_consensus.cc:383] T f7a7fad8a2ca4da297070dd3b49bc2d8 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:56.622174 2699 raft_consensus.cc:738] T f7a7fad8a2ca4da297070dd3b49bc2d8 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:56.622774 2699 consensus_queue.cc:260] T f7a7fad8a2ca4da297070dd3b49bc2d8 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:56.623263 1883 tablet_service.cc:1468] Processing CreateTablet for tablet eb97839972ba4bda89287c30da49bb40 (DEFAULT_TABLE table=default.table_13fd718b01d445dbb3955c7804421b1e [id=096152b885a04bfd9cced171fb8a12af]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:56.624078 2699 ts_tablet_manager.cc:1428] T f7a7fad8a2ca4da297070dd3b49bc2d8 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20250831 19:54:56.613020 1886 tablet_service.cc:1515] Processing DeleteTablet for tablet 326c4af4214a4ea6a9ae784525758630 with delete_type TABLET_DATA_DELETED (replaced by tablet 701cef9d6fd04a99986b871760397f1e) from {username='slave'} at 127.0.0.1:45906
I20250831 19:54:56.597272 2958 tablet_replica.cc:331] T bde481a8e8fc4b1f82453a4e50ded47c P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:54:56.630825 2958 raft_consensus.cc:2241] T bde481a8e8fc4b1f82453a4e50ded47c P 2441fafe1d62429386f4631ad423567d [term 1 LEADER]: Raft consensus shutting down.
I20250831 19:54:56.631278 2958 raft_consensus.cc:2270] T bde481a8e8fc4b1f82453a4e50ded47c P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:56.631906 2958 ts_tablet_manager.cc:1905] T bde481a8e8fc4b1f82453a4e50ded47c P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:56.632787 1883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb97839972ba4bda89287c30da49bb40. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:56.633234 2699 tablet_bootstrap.cc:492] T 701cef9d6fd04a99986b871760397f1e P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:56.637171 2699 tablet_bootstrap.cc:654] T 701cef9d6fd04a99986b871760397f1e P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:56.638684 3177 tablet_bootstrap.cc:654] T 701cef9d6fd04a99986b871760397f1e P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:56.648059 2959 tablet_replica.cc:331] T bde481a8e8fc4b1f82453a4e50ded47c P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:54:56.648993 3178 tablet_bootstrap.cc:492] T 701cef9d6fd04a99986b871760397f1e P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:56.649139 3178 ts_tablet_manager.cc:1397] T 701cef9d6fd04a99986b871760397f1e P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.165s user 0.023s sys 0.027s
I20250831 19:54:56.650002 3178 raft_consensus.cc:357] T 701cef9d6fd04a99986b871760397f1e P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:56.650214 3178 raft_consensus.cc:383] T 701cef9d6fd04a99986b871760397f1e P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:56.650305 3178 raft_consensus.cc:738] T 701cef9d6fd04a99986b871760397f1e P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:56.650605 3178 consensus_queue.cc:260] T 701cef9d6fd04a99986b871760397f1e P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:56.650972 2959 raft_consensus.cc:2241] T bde481a8e8fc4b1f82453a4e50ded47c P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:56.651405 3178 ts_tablet_manager.cc:1428] T 701cef9d6fd04a99986b871760397f1e P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250831 19:54:56.652314 3178 tablet_bootstrap.cc:492] T 6952ee3fe766450993142c673d9509e8 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:56.654372 3178 tablet_bootstrap.cc:654] T 6952ee3fe766450993142c673d9509e8 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:56.662531 3162 consensus_queue.cc:1035] T bd12184dd70f451fbd9a2025d2c00758 P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:56.668942 3178 tablet_bootstrap.cc:492] T 6952ee3fe766450993142c673d9509e8 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:56.669083 3178 ts_tablet_manager.cc:1397] T 6952ee3fe766450993142c673d9509e8 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.017s user 0.001s sys 0.004s
I20250831 19:54:56.670130 2959 raft_consensus.cc:2270] T bde481a8e8fc4b1f82453a4e50ded47c P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:56.670138 3178 raft_consensus.cc:357] T 6952ee3fe766450993142c673d9509e8 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:56.670320 3178 raft_consensus.cc:383] T 6952ee3fe766450993142c673d9509e8 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:56.670411 3178 raft_consensus.cc:738] T 6952ee3fe766450993142c673d9509e8 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:56.670631 3178 consensus_queue.cc:260] T 6952ee3fe766450993142c673d9509e8 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:56.671640 2979 raft_consensus.cc:491] T f7a7fad8a2ca4da297070dd3b49bc2d8 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:56.671782 2979 raft_consensus.cc:513] T f7a7fad8a2ca4da297070dd3b49bc2d8 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:56.671880 3178 ts_tablet_manager.cc:1428] T 6952ee3fe766450993142c673d9509e8 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20250831 19:54:56.672448 2979 leader_election.cc:290] T f7a7fad8a2ca4da297070dd3b49bc2d8 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:56.672915 3178 tablet_bootstrap.cc:492] T 876f49b43408443da6a867c03df891b9 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:56.673511 3225 tablet.cc:1722] T 5ed927d4935143968fb89a73730eb8a1 P 89aa85d59c53436ebdf3074b13d14825: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:56.674412 2979 raft_consensus.cc:491] T 5a080bbabe8840c3ba954bdc0626dc39 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:56.674559 2979 raft_consensus.cc:513] T 5a080bbabe8840c3ba954bdc0626dc39 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:56.675122 2979 leader_election.cc:290] T 5a080bbabe8840c3ba954bdc0626dc39 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:56.675609 1632 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5a080bbabe8840c3ba954bdc0626dc39" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:56.675894 1632 raft_consensus.cc:2466] T 5a080bbabe8840c3ba954bdc0626dc39 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 0.
I20250831 19:54:56.676294 1841 leader_election.cc:304] T 5a080bbabe8840c3ba954bdc0626dc39 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:54:56.676616 2979 raft_consensus.cc:2802] T 5a080bbabe8840c3ba954bdc0626dc39 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:56.676715 2979 raft_consensus.cc:491] T 5a080bbabe8840c3ba954bdc0626dc39 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:56.676803 2979 raft_consensus.cc:3058] T 5a080bbabe8840c3ba954bdc0626dc39 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:56.677457 2699 tablet_bootstrap.cc:492] T 701cef9d6fd04a99986b871760397f1e P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:56.677588 2699 ts_tablet_manager.cc:1397] T 701cef9d6fd04a99986b871760397f1e P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.044s user 0.000s sys 0.004s
I20250831 19:54:56.679422 2979 raft_consensus.cc:513] T 5a080bbabe8840c3ba954bdc0626dc39 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:56.679826 3226 tablet.cc:1722] T 5ed927d4935143968fb89a73730eb8a1 P 2441fafe1d62429386f4631ad423567d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:56.679922 3178 tablet_bootstrap.cc:654] T 876f49b43408443da6a867c03df891b9 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:56.680680 1632 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5a080bbabe8840c3ba954bdc0626dc39" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:54:56.680918 1632 raft_consensus.cc:3058] T 5a080bbabe8840c3ba954bdc0626dc39 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:56.683409 1632 raft_consensus.cc:2466] T 5a080bbabe8840c3ba954bdc0626dc39 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 1.
I20250831 19:54:56.681298 2699 raft_consensus.cc:357] T 701cef9d6fd04a99986b871760397f1e P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:56.684320 2699 raft_consensus.cc:383] T 701cef9d6fd04a99986b871760397f1e P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:56.683878 1841 leader_election.cc:304] T 5a080bbabe8840c3ba954bdc0626dc39 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:54:56.684427 2699 raft_consensus.cc:738] T 701cef9d6fd04a99986b871760397f1e P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:56.684612 2896 raft_consensus.cc:2802] T 5a080bbabe8840c3ba954bdc0626dc39 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:56.684656 2699 consensus_queue.cc:260] T 701cef9d6fd04a99986b871760397f1e P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:56.684859 1633 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f7a7fad8a2ca4da297070dd3b49bc2d8" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:56.685014 1633 raft_consensus.cc:2466] T f7a7fad8a2ca4da297070dd3b49bc2d8 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 0.
I20250831 19:54:56.688732 2958 ts_tablet_manager.cc:1918] T bde481a8e8fc4b1f82453a4e50ded47c P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:56.688992 2958 log.cc:1199] T bde481a8e8fc4b1f82453a4e50ded47c P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/bde481a8e8fc4b1f82453a4e50ded47c
I20250831 19:54:56.689054 2118 catalog_manager.cc:5674] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237) does not have the latest schema for tablet 5ed927d4935143968fb89a73730eb8a1 (table default.table_207ac87518bc487184a89bb52cd204b3 [id=f48af5bc3eff4c819be4aeeff4128c2a]). Expected version 1 got 0
I20250831 19:54:56.689365 2958 ts_tablet_manager.cc:1939] T bde481a8e8fc4b1f82453a4e50ded47c P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:54:56.690313 2101 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet bde481a8e8fc4b1f82453a4e50ded47c (table default.table_afb8eb0248714122aa74efa2d6fcfce4 [id=fe54e4791a0d4e3c9a36e1968988ea0d]) successfully deleted
I20250831 19:54:56.690778 1841 leader_election.cc:304] T f7a7fad8a2ca4da297070dd3b49bc2d8 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:54:56.695484 3162 raft_consensus.cc:491] T a6a3938379c64baba6f5f2c1a2f7087a P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:56.695652 3162 raft_consensus.cc:513] T a6a3938379c64baba6f5f2c1a2f7087a P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:56.696295 3162 leader_election.cc:290] T a6a3938379c64baba6f5f2c1a2f7087a P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:56.697382 1769 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f7a7fad8a2ca4da297070dd3b49bc2d8" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:56.697566 1770 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5a080bbabe8840c3ba954bdc0626dc39" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:56.697844 1770 raft_consensus.cc:2466] T 5a080bbabe8840c3ba954bdc0626dc39 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 0.
I20250831 19:54:56.697952 1769 raft_consensus.cc:2466] T f7a7fad8a2ca4da297070dd3b49bc2d8 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 0.
I20250831 19:54:56.698206 2896 raft_consensus.cc:695] T 5a080bbabe8840c3ba954bdc0626dc39 P 2441fafe1d62429386f4631ad423567d [term 1 LEADER]: Becoming Leader. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Running, Role: LEADER
I20250831 19:54:56.698262 1772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5a080bbabe8840c3ba954bdc0626dc39" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197"
I20250831 19:54:56.698405 1772 raft_consensus.cc:3058] T 5a080bbabe8840c3ba954bdc0626dc39 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:56.698477 3233 raft_consensus.cc:2802] T f7a7fad8a2ca4da297070dd3b49bc2d8 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:56.698571 2896 consensus_queue.cc:237] T 5a080bbabe8840c3ba954bdc0626dc39 P 2441fafe1d62429386f4631ad423567d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:56.701277 1772 raft_consensus.cc:2466] T 5a080bbabe8840c3ba954bdc0626dc39 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 1.
I20250831 19:54:56.701503 1768 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a6a3938379c64baba6f5f2c1a2f7087a" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:56.701684 1768 raft_consensus.cc:2466] T a6a3938379c64baba6f5f2c1a2f7087a P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 0.
I20250831 19:54:56.702389 1570 leader_election.cc:304] T a6a3938379c64baba6f5f2c1a2f7087a P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:56.702698 2959 ts_tablet_manager.cc:1905] T bde481a8e8fc4b1f82453a4e50ded47c P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:56.703225 2995 raft_consensus.cc:2802] T a6a3938379c64baba6f5f2c1a2f7087a P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:56.703351 2995 raft_consensus.cc:491] T a6a3938379c64baba6f5f2c1a2f7087a P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:56.703485 2995 raft_consensus.cc:3058] T a6a3938379c64baba6f5f2c1a2f7087a P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:56.703685 3178 tablet_bootstrap.cc:492] T 876f49b43408443da6a867c03df891b9 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:56.703835 3178 ts_tablet_manager.cc:1397] T 876f49b43408443da6a867c03df891b9 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.031s user 0.003s sys 0.001s
I20250831 19:54:56.704588 3178 raft_consensus.cc:357] T 876f49b43408443da6a867c03df891b9 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:56.704768 3178 raft_consensus.cc:383] T 876f49b43408443da6a867c03df891b9 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:56.704833 3178 raft_consensus.cc:738] T 876f49b43408443da6a867c03df891b9 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:56.705034 3178 consensus_queue.cc:260] T 876f49b43408443da6a867c03df891b9 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:56.705509 3178 ts_tablet_manager.cc:1428] T 876f49b43408443da6a867c03df891b9 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250831 19:54:56.705803 3178 tablet_bootstrap.cc:492] T f42849cccf8a45ed95794eac0e3922e7 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:56.683976 2979 leader_election.cc:290] T 5a080bbabe8840c3ba954bdc0626dc39 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 election: Requested vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
W20250831 19:54:56.709344 2101 catalog_manager.cc:4895] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): delete failed for tablet 326c4af4214a4ea6a9ae784525758630 because the tablet was not found. No further retry: Not found: Tablet not found: 326c4af4214a4ea6a9ae784525758630
I20250831 19:54:56.709868 2995 raft_consensus.cc:513] T a6a3938379c64baba6f5f2c1a2f7087a P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:56.710698 1902 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a6a3938379c64baba6f5f2c1a2f7087a" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:54:56.710915 1902 raft_consensus.cc:3058] T a6a3938379c64baba6f5f2c1a2f7087a P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:56.715552 1902 raft_consensus.cc:2466] T a6a3938379c64baba6f5f2c1a2f7087a P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1.
I20250831 19:54:56.716536 1568 leader_election.cc:304] T a6a3938379c64baba6f5f2c1a2f7087a P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:54:56.716784 3162 raft_consensus.cc:2802] T a6a3938379c64baba6f5f2c1a2f7087a P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:56.716918 3162 raft_consensus.cc:695] T a6a3938379c64baba6f5f2c1a2f7087a P 89aa85d59c53436ebdf3074b13d14825 [term 1 LEADER]: Becoming Leader. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Running, Role: LEADER
I20250831 19:54:56.717136 3162 consensus_queue.cc:237] T a6a3938379c64baba6f5f2c1a2f7087a P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:54:56.717769 1903 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a6a3938379c64baba6f5f2c1a2f7087a" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:56.717926 1903 raft_consensus.cc:2374] T a6a3938379c64baba6f5f2c1a2f7087a P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1. Re-sending same reply.
I20250831 19:54:56.719389 2699 ts_tablet_manager.cc:1428] T 701cef9d6fd04a99986b871760397f1e P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.042s user 0.000s sys 0.002s
I20250831 19:54:56.719646 2699 tablet_bootstrap.cc:492] T f42849cccf8a45ed95794eac0e3922e7 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:56.723855 2959 ts_tablet_manager.cc:1918] T bde481a8e8fc4b1f82453a4e50ded47c P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:56.723985 2959 log.cc:1199] T bde481a8e8fc4b1f82453a4e50ded47c P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/bde481a8e8fc4b1f82453a4e50ded47c
I20250831 19:54:56.724320 2959 ts_tablet_manager.cc:1939] T bde481a8e8fc4b1f82453a4e50ded47c P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
I20250831 19:54:56.725194 2105 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet bde481a8e8fc4b1f82453a4e50ded47c (table default.table_afb8eb0248714122aa74efa2d6fcfce4 [id=fe54e4791a0d4e3c9a36e1968988ea0d]) successfully deleted
I20250831 19:54:56.728076 3178 tablet_bootstrap.cc:654] T f42849cccf8a45ed95794eac0e3922e7 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:56.728255 3177 tablet_bootstrap.cc:492] T 701cef9d6fd04a99986b871760397f1e P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:56.728437 3177 ts_tablet_manager.cc:1397] T 701cef9d6fd04a99986b871760397f1e P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.109s user 0.009s sys 0.002s
I20250831 19:54:56.729750 3177 raft_consensus.cc:357] T 701cef9d6fd04a99986b871760397f1e P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:56.732017 2120 catalog_manager.cc:2149] created HMS catalog entry for table [id=921f83cf8ea14fd68e86ce2b90aac92c]
I20250831 19:54:56.732776 2118 catalog_manager.cc:5674] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475) does not have the latest schema for tablet 5ed927d4935143968fb89a73730eb8a1 (table default.table_207ac87518bc487184a89bb52cd204b3 [id=f48af5bc3eff4c819be4aeeff4128c2a]). Expected version 1 got 0
I20250831 19:54:56.734354 2995 leader_election.cc:290] T a6a3938379c64baba6f5f2c1a2f7087a P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Requested vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:56.735602 2995 raft_consensus.cc:491] T 701cef9d6fd04a99986b871760397f1e P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:56.735740 2995 raft_consensus.cc:513] T 701cef9d6fd04a99986b871760397f1e P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:56.736658 1904 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "701cef9d6fd04a99986b871760397f1e" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:56.736846 1904 raft_consensus.cc:2466] T 701cef9d6fd04a99986b871760397f1e P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 0.
I20250831 19:54:56.737351 1568 leader_election.cc:304] T 701cef9d6fd04a99986b871760397f1e P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:54:56.737668 2120 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:36958 (request call id 171) took 1747 ms. Trace:
I20250831 19:54:56.737946 3018 raft_consensus.cc:2802] T 701cef9d6fd04a99986b871760397f1e P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:56.738039 3018 raft_consensus.cc:491] T 701cef9d6fd04a99986b871760397f1e P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:56.738106 3018 raft_consensus.cc:3058] T 701cef9d6fd04a99986b871760397f1e P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:56.738197 2699 tablet_bootstrap.cc:654] T f42849cccf8a45ed95794eac0e3922e7 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:56.737751 2120 rpcz_store.cc:276] 0831 19:54:54.990432 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:56.104395 (+1113963us) service_pool.cc:225] Handling call
0831 19:54:56.359794 (+255399us) catalog_manager.cc:2076] Acquired catalog manager lock
0831 19:54:56.360202 (+ 408us) catalog_manager.cc:2122] Created new table and tablet info
0831 19:54:56.731978 (+371776us) catalog_manager.cc:2148] Created new table in HMS catalog
0831 19:54:56.737340 (+ 5362us) catalog_manager.cc:2182] Wrote table and tablets to system table
0831 19:54:56.737517 (+ 177us) catalog_manager.cc:2216] Inserted table and tablets into CatalogManager maps
0831 19:54:56.737624 (+ 107us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:56.732787 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:56.732900 (+ 113us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:56.732906 (+ 6us) write_op.cc:435] Acquired schema lock
0831 19:54:56.732908 (+ 2us) tablet.cc:660] Decoding operations
0831 19:54:56.732999 (+ 91us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:56.733015 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:56.733021 (+ 6us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:56.733118 (+ 97us) tablet.cc:699] Row locks acquired
0831 19:54:56.733121 (+ 3us) write_op.cc:260] PREPARE: finished
0831 19:54:56.733173 (+ 52us) write_op.cc:270] Start()
0831 19:54:56.733214 (+ 41us) write_op.cc:276] Timestamp: P: 1756670096733119 usec, L: 0
0831 19:54:56.733218 (+ 4us) op_driver.cc:348] REPLICATION: starting
0831 19:54:56.733405 (+ 187us) log.cc:844] Serialized 433 byte log entry
0831 19:54:56.736402 (+ 2997us) op_driver.cc:464] REPLICATION: finished
0831 19:54:56.736505 (+ 103us) write_op.cc:301] APPLY: starting
0831 19:54:56.736517 (+ 12us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:56.736595 (+ 78us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:56.736614 (+ 19us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:56.736698 (+ 84us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:56.736728 (+ 30us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0831 19:54:56.736734 (+ 6us) write_op.cc:312] APPLY: finished
0831 19:54:56.736801 (+ 67us) log.cc:844] Serialized 29 byte log entry
0831 19:54:56.736853 (+ 52us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:56.736873 (+ 20us) write_op.cc:454] Released schema lock
0831 19:54:56.736880 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0831 19:54:56.736954 (+ 74us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:56.736957 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":235372,"Hive Metastore.run_cpu_time_us":287,"Hive Metastore.run_wall_time_us":136212,"child_traces":[["op",{"apply.queue_time_us":64,"apply.run_cpu_time_us":438,"apply.run_wall_time_us":437,"num_ops":2,"prepare.queue_time_us":77,"prepare.run_cpu_time_us":743,"prepare.run_wall_time_us":753,"raft.queue_time_us":361,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":200,"replication_time_us":3159}]]}
I20250831 19:54:56.740502 3018 raft_consensus.cc:513] T 701cef9d6fd04a99986b871760397f1e P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:56.741241 3018 leader_election.cc:290] T 701cef9d6fd04a99986b871760397f1e P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Requested vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:56.743294 1902 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "701cef9d6fd04a99986b871760397f1e" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:54:56.743466 1902 raft_consensus.cc:3058] T 701cef9d6fd04a99986b871760397f1e P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:56.743433 2118 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_c714288d42d74e799fc5e0c60cb920fa" } new_table_name: "default.Table_1dd756d1d1c14b878105f242f44b087e" modify_external_catalogs: true
I20250831 19:54:56.747864 3018 consensus_queue.cc:1035] T 65026496c5b14baab6f66dce4a6d0fc2 P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:56.748867 1904 raft_consensus.cc:1273] T e6438652703c45d691f528a4322767b9 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Refusing update from remote peer 89aa85d59c53436ebdf3074b13d14825: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250831 19:54:56.751543 3018 consensus_queue.cc:1035] T e6438652703c45d691f528a4322767b9 P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:56.757591 1883 tablet_service.cc:1468] Processing CreateTablet for tablet dc6c1d165b5a484ab98ac55cd2330139 (DEFAULT_TABLE table=default.table_930d37393d93428bb6c9407bbd479a71 [id=921f83cf8ea14fd68e86ce2b90aac92c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:56.758033 1883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc6c1d165b5a484ab98ac55cd2330139. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:56.758603 1614 tablet_service.cc:1468] Processing CreateTablet for tablet dc6c1d165b5a484ab98ac55cd2330139 (DEFAULT_TABLE table=default.table_930d37393d93428bb6c9407bbd479a71 [id=921f83cf8ea14fd68e86ce2b90aac92c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:56.758958 1614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc6c1d165b5a484ab98ac55cd2330139. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:56.760360 2120 catalog_manager.cc:5582] T 5a080bbabe8840c3ba954bdc0626dc39 P 2441fafe1d62429386f4631ad423567d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2441fafe1d62429386f4631ad423567d (127.1.1.195). New cstate: current_term: 1 leader_uuid: "2441fafe1d62429386f4631ad423567d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: UNKNOWN } } }
I20250831 19:54:56.765758 1902 raft_consensus.cc:2466] T 701cef9d6fd04a99986b871760397f1e P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1.
I20250831 19:54:56.773049 1568 leader_election.cc:304] T 701cef9d6fd04a99986b871760397f1e P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:54:56.733896 1772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a6a3938379c64baba6f5f2c1a2f7087a" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197"
I20250831 19:54:56.743368 1768 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "701cef9d6fd04a99986b871760397f1e" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197"
I20250831 19:54:56.748943 1769 raft_consensus.cc:1273] T e6438652703c45d691f528a4322767b9 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Refusing update from remote peer 89aa85d59c53436ebdf3074b13d14825: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250831 19:54:56.757723 1749 tablet_service.cc:1468] Processing CreateTablet for tablet dc6c1d165b5a484ab98ac55cd2330139 (DEFAULT_TABLE table=default.table_930d37393d93428bb6c9407bbd479a71 [id=921f83cf8ea14fd68e86ce2b90aac92c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:56.773439 3018 raft_consensus.cc:2802] T 701cef9d6fd04a99986b871760397f1e P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:56.773731 3018 raft_consensus.cc:695] T 701cef9d6fd04a99986b871760397f1e P 89aa85d59c53436ebdf3074b13d14825 [term 1 LEADER]: Becoming Leader. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Running, Role: LEADER
I20250831 19:54:56.773787 1749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc6c1d165b5a484ab98ac55cd2330139. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:56.774017 3018 consensus_queue.cc:237] T 701cef9d6fd04a99986b871760397f1e P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:56.786192 3081 consensus_queue.cc:1035] T e6438652703c45d691f528a4322767b9 P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:56.786724 2995 leader_election.cc:290] T 701cef9d6fd04a99986b871760397f1e P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:56.787569 1769 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "701cef9d6fd04a99986b871760397f1e" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:56.790719 3245 tablet.cc:1722] T 5ed927d4935143968fb89a73730eb8a1 P de831f40fa1348a48a1f0260f4130197: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:56.698582 3233 raft_consensus.cc:491] T f7a7fad8a2ca4da297070dd3b49bc2d8 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:56.793176 3233 raft_consensus.cc:3058] T f7a7fad8a2ca4da297070dd3b49bc2d8 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:56.798789 3233 raft_consensus.cc:513] T f7a7fad8a2ca4da297070dd3b49bc2d8 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:56.806092 1772 raft_consensus.cc:3058] T a6a3938379c64baba6f5f2c1a2f7087a P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:56.807448 2126 catalog_manager.cc:2149] created HMS catalog entry for table [id=acf00823fd974ac6bcbff016c1296aa5]
I20250831 19:54:56.812965 2126 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:36958 (request call id 173) took 1718 ms. Trace:
I20250831 19:54:56.813097 2126 rpcz_store.cc:276] 0831 19:54:55.094482 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:56.153880 (+1059398us) service_pool.cc:225] Handling call
0831 19:54:56.360623 (+206743us) catalog_manager.cc:2076] Acquired catalog manager lock
0831 19:54:56.361022 (+ 399us) catalog_manager.cc:2122] Created new table and tablet info
0831 19:54:56.807408 (+446386us) catalog_manager.cc:2148] Created new table in HMS catalog
0831 19:54:56.812721 (+ 5313us) catalog_manager.cc:2182] Wrote table and tablets to system table
0831 19:54:56.812822 (+ 101us) catalog_manager.cc:2216] Inserted table and tablets into CatalogManager maps
0831 19:54:56.812926 (+ 104us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:56.808210 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:56.808349 (+ 139us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:56.808358 (+ 9us) write_op.cc:435] Acquired schema lock
0831 19:54:56.808362 (+ 4us) tablet.cc:660] Decoding operations
0831 19:54:56.808500 (+ 138us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:56.808516 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:56.808537 (+ 21us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:56.808645 (+ 108us) tablet.cc:699] Row locks acquired
0831 19:54:56.808649 (+ 4us) write_op.cc:260] PREPARE: finished
0831 19:54:56.808691 (+ 42us) write_op.cc:270] Start()
0831 19:54:56.808731 (+ 40us) write_op.cc:276] Timestamp: P: 1756670096808631 usec, L: 0
0831 19:54:56.808737 (+ 6us) op_driver.cc:348] REPLICATION: starting
0831 19:54:56.808932 (+ 195us) log.cc:844] Serialized 433 byte log entry
0831 19:54:56.812040 (+ 3108us) op_driver.cc:464] REPLICATION: finished
0831 19:54:56.812162 (+ 122us) write_op.cc:301] APPLY: starting
0831 19:54:56.812176 (+ 14us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:56.812219 (+ 43us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:56.812241 (+ 22us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:56.812346 (+ 105us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:56.812377 (+ 31us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0831 19:54:56.812384 (+ 7us) write_op.cc:312] APPLY: finished
0831 19:54:56.812463 (+ 79us) log.cc:844] Serialized 29 byte log entry
0831 19:54:56.812537 (+ 74us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:56.812564 (+ 27us) write_op.cc:454] Released schema lock
0831 19:54:56.812571 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0831 19:54:56.812634 (+ 63us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:56.812637 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":370810,"Hive Metastore.run_cpu_time_us":292,"Hive Metastore.run_wall_time_us":75324,"child_traces":[["op",{"apply.queue_time_us":80,"apply.run_cpu_time_us":462,"apply.run_wall_time_us":463,"num_ops":2,"prepare.queue_time_us":48,"prepare.run_cpu_time_us":850,"prepare.run_wall_time_us":852,"raft.queue_time_us":625,"raft.run_cpu_time_us":311,"raft.run_wall_time_us":311,"replication_time_us":3276,"spinlock_wait_cycles":80128}]]}
I20250831 19:54:56.815937 2126 catalog_manager.cc:5674] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475) does not have the latest schema for tablet 5ed927d4935143968fb89a73730eb8a1 (table default.table_207ac87518bc487184a89bb52cd204b3 [id=f48af5bc3eff4c819be4aeeff4128c2a]). Expected version 1 got 0
I20250831 19:54:56.817986 3226 tablet.cc:1722] T e6438652703c45d691f528a4322767b9 P 2441fafe1d62429386f4631ad423567d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250831 19:54:56.819590 3225 tablet.cc:1722] T e6438652703c45d691f528a4322767b9 P 89aa85d59c53436ebdf3074b13d14825: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250831 19:54:56.822984 2126 catalog_manager.cc:5582] T a6a3938379c64baba6f5f2c1a2f7087a P 89aa85d59c53436ebdf3074b13d14825 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193). New cstate: current_term: 1 leader_uuid: "89aa85d59c53436ebdf3074b13d14825" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: UNKNOWN } } }
I20250831 19:54:56.824680 2126 catalog_manager.cc:5582] T 701cef9d6fd04a99986b871760397f1e P 89aa85d59c53436ebdf3074b13d14825 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193). New cstate: current_term: 1 leader_uuid: "89aa85d59c53436ebdf3074b13d14825" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: HEALTHY } } }
I20250831 19:54:56.825824 1772 raft_consensus.cc:2466] T a6a3938379c64baba6f5f2c1a2f7087a P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1.
I20250831 19:54:56.830050 1633 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f7a7fad8a2ca4da297070dd3b49bc2d8" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:54:56.830294 1633 raft_consensus.cc:3058] T f7a7fad8a2ca4da297070dd3b49bc2d8 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:56.830469 1771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f7a7fad8a2ca4da297070dd3b49bc2d8" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197"
I20250831 19:54:56.833168 1633 raft_consensus.cc:2466] T f7a7fad8a2ca4da297070dd3b49bc2d8 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 1.
I20250831 19:54:56.833614 1841 leader_election.cc:304] T f7a7fad8a2ca4da297070dd3b49bc2d8 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:54:56.833964 3236 raft_consensus.cc:2802] T f7a7fad8a2ca4da297070dd3b49bc2d8 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:56.834232 3236 raft_consensus.cc:695] T f7a7fad8a2ca4da297070dd3b49bc2d8 P 2441fafe1d62429386f4631ad423567d [term 1 LEADER]: Becoming Leader. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Running, Role: LEADER
I20250831 19:54:56.834456 1771 raft_consensus.cc:3058] T f7a7fad8a2ca4da297070dd3b49bc2d8 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:56.834640 3236 consensus_queue.cc:237] T f7a7fad8a2ca4da297070dd3b49bc2d8 P 2441fafe1d62429386f4631ad423567d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:56.847172 3233 leader_election.cc:290] T f7a7fad8a2ca4da297070dd3b49bc2d8 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 election: Requested vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:56.849776 2995 consensus_queue.cc:1035] T 65026496c5b14baab6f66dce4a6d0fc2 P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:56.855507 1883 tablet_service.cc:1468] Processing CreateTablet for tablet c47f69c5eeda4044b5c0f796375c013b (DEFAULT_TABLE table=default.table_5bc22ff7931245ad82121fb433351a08 [id=acf00823fd974ac6bcbff016c1296aa5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:56.855613 1749 tablet_service.cc:1468] Processing CreateTablet for tablet c47f69c5eeda4044b5c0f796375c013b (DEFAULT_TABLE table=default.table_5bc22ff7931245ad82121fb433351a08 [id=acf00823fd974ac6bcbff016c1296aa5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:56.855954 1883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c47f69c5eeda4044b5c0f796375c013b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:56.856022 1749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c47f69c5eeda4044b5c0f796375c013b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:56.861053 1614 tablet_service.cc:1468] Processing CreateTablet for tablet c47f69c5eeda4044b5c0f796375c013b (DEFAULT_TABLE table=default.table_5bc22ff7931245ad82121fb433351a08 [id=acf00823fd974ac6bcbff016c1296aa5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:56.861464 1614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c47f69c5eeda4044b5c0f796375c013b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:56.876235 3162 raft_consensus.cc:491] T 876f49b43408443da6a867c03df891b9 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:56.876401 3162 raft_consensus.cc:513] T 876f49b43408443da6a867c03df891b9 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:56.876973 3162 leader_election.cc:290] T 876f49b43408443da6a867c03df891b9 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:56.877496 1904 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "876f49b43408443da6a867c03df891b9" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
W20250831 19:54:56.878042 1568 leader_election.cc:343] T 876f49b43408443da6a867c03df891b9 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): Illegal state: must be running to vote when last-logged opid is not known
I20250831 19:54:56.879488 1772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "876f49b43408443da6a867c03df891b9" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
W20250831 19:54:56.879959 1570 leader_election.cc:343] T 876f49b43408443da6a867c03df891b9 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): Illegal state: must be running to vote when last-logged opid is not known
I20250831 19:54:56.880102 1570 leader_election.cc:304] T 876f49b43408443da6a867c03df891b9 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825; no voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197
I20250831 19:54:56.880523 2995 raft_consensus.cc:2747] T 876f49b43408443da6a867c03df891b9 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250831 19:54:56.874625 3177 raft_consensus.cc:383] T 701cef9d6fd04a99986b871760397f1e P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:56.883189 3177 raft_consensus.cc:738] T 701cef9d6fd04a99986b871760397f1e P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:56.887818 3177 consensus_queue.cc:260] T 701cef9d6fd04a99986b871760397f1e P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:56.888059 1768 raft_consensus.cc:3058] T 701cef9d6fd04a99986b871760397f1e P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:56.891108 1768 raft_consensus.cc:2466] T 701cef9d6fd04a99986b871760397f1e P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1.
I20250831 19:54:56.892902 2778 raft_consensus.cc:491] T 701cef9d6fd04a99986b871760397f1e P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:56.893049 2778 raft_consensus.cc:513] T 701cef9d6fd04a99986b871760397f1e P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:56.893921 2778 leader_election.cc:290] T 701cef9d6fd04a99986b871760397f1e P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:56.894529 1904 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "701cef9d6fd04a99986b871760397f1e" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:56.894764 1904 raft_consensus.cc:2466] T 701cef9d6fd04a99986b871760397f1e P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:54:56.894996 1633 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "701cef9d6fd04a99986b871760397f1e" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:56.895133 1705 leader_election.cc:304] T 701cef9d6fd04a99986b871760397f1e P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:56.895437 2778 raft_consensus.cc:2802] T 701cef9d6fd04a99986b871760397f1e P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20250831 19:54:56.895555 2778 raft_consensus.cc:491] T 701cef9d6fd04a99986b871760397f1e P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:56.895665 2778 raft_consensus.cc:3058] T 701cef9d6fd04a99986b871760397f1e P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Advancing to term 2
I20250831 19:54:56.896812 2124 catalog_manager.cc:3460] renamed table default.table_be31f59f9d014d278544a1c9deb8a41a [id=0fc929ad819b48a9af984f8c301bad2b] in HMS: new name default.table_617124885d2e4d96b863e0e435bdf695
I20250831 19:54:56.898068 2778 raft_consensus.cc:513] T 701cef9d6fd04a99986b871760397f1e P de831f40fa1348a48a1f0260f4130197 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:56.899209 1633 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "701cef9d6fd04a99986b871760397f1e" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:54:56.899299 1771 raft_consensus.cc:2466] T f7a7fad8a2ca4da297070dd3b49bc2d8 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 1.
I20250831 19:54:56.899943 2778 leader_election.cc:290] T 701cef9d6fd04a99986b871760397f1e P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 2 election: Requested vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:56.900527 1903 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "701cef9d6fd04a99986b871760397f1e" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:54:56.900713 1903 raft_consensus.cc:3058] T 701cef9d6fd04a99986b871760397f1e P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Advancing to term 2
W20250831 19:54:56.909576 2123 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_20d403c55682499a9ba3267b85aecde7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250831 19:54:56.913322 1903 raft_consensus.cc:2466] T 701cef9d6fd04a99986b871760397f1e P 2441fafe1d62429386f4631ad423567d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 2.
I20250831 19:54:56.914057 3177 ts_tablet_manager.cc:1428] T 701cef9d6fd04a99986b871760397f1e P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.186s user 0.003s sys 0.000s
I20250831 19:54:56.914381 3177 tablet_bootstrap.cc:492] T 876f49b43408443da6a867c03df891b9 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:56.914459 1705 leader_election.cc:304] T 701cef9d6fd04a99986b871760397f1e P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters: 89aa85d59c53436ebdf3074b13d14825
I20250831 19:54:56.915354 2778 raft_consensus.cc:2802] T 701cef9d6fd04a99986b871760397f1e P de831f40fa1348a48a1f0260f4130197 [term 2 FOLLOWER]: Leader election won for term 2
I20250831 19:54:56.915499 2778 raft_consensus.cc:695] T 701cef9d6fd04a99986b871760397f1e P de831f40fa1348a48a1f0260f4130197 [term 2 LEADER]: Becoming Leader. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Running, Role: LEADER
I20250831 19:54:56.915791 2778 consensus_queue.cc:237] T 701cef9d6fd04a99986b871760397f1e P de831f40fa1348a48a1f0260f4130197 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:56.916338 3177 tablet_bootstrap.cc:654] T 876f49b43408443da6a867c03df891b9 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:56.948378 2126 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_486ee0377a714038aaf8f3f5b1ad7f79" } new_table_name: "default.Table_1d644a2c8bd54f89964228704cd693e6" modify_external_catalogs: true
I20250831 19:54:56.951112 2120 catalog_manager.cc:5674] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237) does not have the latest schema for tablet e6438652703c45d691f528a4322767b9 (table default.table_d3002519e6964bb484d995d871e766c9 [id=1137b2754d104964bbe5bbaa4a0578b8]). Expected version 3 got 0
I20250831 19:54:56.952458 2120 master_service.cc:948] ReplaceTablet: received request to replace tablet 98c37cdff24447039bf0b8d832dbb8e5 from {username='slave'} at 127.0.0.1:36958
I20250831 19:54:56.954736 2699 tablet_bootstrap.cc:492] T f42849cccf8a45ed95794eac0e3922e7 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:56.954893 2699 ts_tablet_manager.cc:1397] T f42849cccf8a45ed95794eac0e3922e7 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.235s user 0.015s sys 0.056s
I20250831 19:54:56.955576 2699 raft_consensus.cc:357] T f42849cccf8a45ed95794eac0e3922e7 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:56.955781 2699 raft_consensus.cc:383] T f42849cccf8a45ed95794eac0e3922e7 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:56.955861 2699 raft_consensus.cc:738] T f42849cccf8a45ed95794eac0e3922e7 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:56.956347 2699 consensus_queue.cc:260] T f42849cccf8a45ed95794eac0e3922e7 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:56.956784 3245 tablet.cc:1722] T e6438652703c45d691f528a4322767b9 P de831f40fa1348a48a1f0260f4130197: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250831 19:54:56.958642 2699 ts_tablet_manager.cc:1428] T f42849cccf8a45ed95794eac0e3922e7 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20250831 19:54:56.958979 2699 tablet_bootstrap.cc:492] T 6952ee3fe766450993142c673d9509e8 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:56.961570 2699 tablet_bootstrap.cc:654] T 6952ee3fe766450993142c673d9509e8 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:56.963075 3178 tablet_bootstrap.cc:492] T f42849cccf8a45ed95794eac0e3922e7 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:56.963213 3178 ts_tablet_manager.cc:1397] T f42849cccf8a45ed95794eac0e3922e7 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.257s user 0.015s sys 0.057s
I20250831 19:54:56.963882 3178 raft_consensus.cc:357] T f42849cccf8a45ed95794eac0e3922e7 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:56.964035 3178 raft_consensus.cc:383] T f42849cccf8a45ed95794eac0e3922e7 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:56.964108 3178 raft_consensus.cc:738] T f42849cccf8a45ed95794eac0e3922e7 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:56.964344 3178 consensus_queue.cc:260] T f42849cccf8a45ed95794eac0e3922e7 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:56.966719 3178 ts_tablet_manager.cc:1428] T f42849cccf8a45ed95794eac0e3922e7 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20250831 19:54:56.966974 3178 tablet_bootstrap.cc:492] T 3081636d94084a8aa3905f40edf34b0f P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:56.971225 3178 tablet_bootstrap.cc:654] T 3081636d94084a8aa3905f40edf34b0f P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:56.981978 2120 catalog_manager.cc:5869] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Sending DeleteTablet for 3 replicas of tablet 98c37cdff24447039bf0b8d832dbb8e5
I20250831 19:54:56.982908 1883 tablet_service.cc:1515] Processing DeleteTablet for tablet 98c37cdff24447039bf0b8d832dbb8e5 with delete_type TABLET_DATA_DELETED (replaced by tablet d56dcc30166043c68c3f1c05e7f7bde0) from {username='slave'} at 127.0.0.1:45906
I20250831 19:54:56.983142 1614 tablet_service.cc:1515] Processing DeleteTablet for tablet 98c37cdff24447039bf0b8d832dbb8e5 with delete_type TABLET_DATA_DELETED (replaced by tablet d56dcc30166043c68c3f1c05e7f7bde0) from {username='slave'} at 127.0.0.1:51022
I20250831 19:54:56.983392 2957 tablet_replica.cc:331] T 98c37cdff24447039bf0b8d832dbb8e5 P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:54:56.983410 2958 tablet_replica.cc:331] T 98c37cdff24447039bf0b8d832dbb8e5 P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:54:56.983441 1749 tablet_service.cc:1515] Processing DeleteTablet for tablet 98c37cdff24447039bf0b8d832dbb8e5 with delete_type TABLET_DATA_DELETED (replaced by tablet d56dcc30166043c68c3f1c05e7f7bde0) from {username='slave'} at 127.0.0.1:50674
I20250831 19:54:56.983615 2957 raft_consensus.cc:2241] T 98c37cdff24447039bf0b8d832dbb8e5 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:56.983633 2958 raft_consensus.cc:2241] T 98c37cdff24447039bf0b8d832dbb8e5 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:56.983786 2957 raft_consensus.cc:2270] T 98c37cdff24447039bf0b8d832dbb8e5 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:56.983810 2958 raft_consensus.cc:2270] T 98c37cdff24447039bf0b8d832dbb8e5 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:56.984071 2959 tablet_replica.cc:331] T 98c37cdff24447039bf0b8d832dbb8e5 P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:54:56.984254 2959 raft_consensus.cc:2241] T 98c37cdff24447039bf0b8d832dbb8e5 P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: Raft consensus shutting down.
I20250831 19:54:56.984544 2959 raft_consensus.cc:2270] T 98c37cdff24447039bf0b8d832dbb8e5 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:56.986326 2959 ts_tablet_manager.cc:1905] T 98c37cdff24447039bf0b8d832dbb8e5 P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:56.989199 3177 tablet_bootstrap.cc:492] T 876f49b43408443da6a867c03df891b9 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:56.989337 3177 ts_tablet_manager.cc:1397] T 876f49b43408443da6a867c03df891b9 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.075s user 0.003s sys 0.001s
I20250831 19:54:56.989862 2957 ts_tablet_manager.cc:1905] T 98c37cdff24447039bf0b8d832dbb8e5 P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:56.990099 3177 raft_consensus.cc:357] T 876f49b43408443da6a867c03df891b9 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:56.990271 3177 raft_consensus.cc:383] T 876f49b43408443da6a867c03df891b9 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:56.990371 3177 raft_consensus.cc:738] T 876f49b43408443da6a867c03df891b9 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:56.992568 3177 consensus_queue.cc:260] T 876f49b43408443da6a867c03df891b9 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:56.993778 2958 ts_tablet_manager.cc:1905] T 98c37cdff24447039bf0b8d832dbb8e5 P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:56.994976 3177 ts_tablet_manager.cc:1428] T 876f49b43408443da6a867c03df891b9 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20250831 19:54:56.995110 1614 tablet_service.cc:1468] Processing CreateTablet for tablet d56dcc30166043c68c3f1c05e7f7bde0 (DEFAULT_TABLE table=default.table_c7390b7344da4c3fbf7f2f502b096669 [id=1df66f6230794e939a25c0f2254d6e17]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:56.995234 3177 tablet_bootstrap.cc:492] T f42849cccf8a45ed95794eac0e3922e7 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:56.995471 1614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d56dcc30166043c68c3f1c05e7f7bde0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:56.996685 3177 tablet_bootstrap.cc:654] T f42849cccf8a45ed95794eac0e3922e7 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:56.997908 1883 tablet_service.cc:1468] Processing CreateTablet for tablet d56dcc30166043c68c3f1c05e7f7bde0 (DEFAULT_TABLE table=default.table_c7390b7344da4c3fbf7f2f502b096669 [id=1df66f6230794e939a25c0f2254d6e17]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:56.998234 1883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d56dcc30166043c68c3f1c05e7f7bde0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:56.999619 3226 tablet.cc:1722] T 4be6edd110374d2bb941e26defc7302f P 2441fafe1d62429386f4631ad423567d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250831 19:54:57.000430 3245 tablet.cc:1722] T 4be6edd110374d2bb941e26defc7302f P de831f40fa1348a48a1f0260f4130197: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250831 19:54:57.000993 1749 tablet_service.cc:1468] Processing CreateTablet for tablet d56dcc30166043c68c3f1c05e7f7bde0 (DEFAULT_TABLE table=default.table_c7390b7344da4c3fbf7f2f502b096669 [id=1df66f6230794e939a25c0f2254d6e17]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:57.001332 1749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d56dcc30166043c68c3f1c05e7f7bde0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:57.002213 2120 catalog_manager.cc:6652] ReplaceTablet: tablet 98c37cdff24447039bf0b8d832dbb8e5 deleted and replaced by tablet d56dcc30166043c68c3f1c05e7f7bde0
I20250831 19:54:57.010556 2959 ts_tablet_manager.cc:1918] T 98c37cdff24447039bf0b8d832dbb8e5 P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20250831 19:54:57.010668 2959 log.cc:1199] T 98c37cdff24447039bf0b8d832dbb8e5 P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/98c37cdff24447039bf0b8d832dbb8e5
I20250831 19:54:57.011042 2959 ts_tablet_manager.cc:1939] T 98c37cdff24447039bf0b8d832dbb8e5 P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
I20250831 19:54:57.011976 2105 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet 98c37cdff24447039bf0b8d832dbb8e5 (table default.table_c7390b7344da4c3fbf7f2f502b096669 [id=1df66f6230794e939a25c0f2254d6e17]) successfully deleted
I20250831 19:54:57.013705 2957 ts_tablet_manager.cc:1918] T 98c37cdff24447039bf0b8d832dbb8e5 P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20250831 19:54:57.013854 2957 log.cc:1199] T 98c37cdff24447039bf0b8d832dbb8e5 P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/98c37cdff24447039bf0b8d832dbb8e5
I20250831 19:54:57.014210 2957 ts_tablet_manager.cc:1939] T 98c37cdff24447039bf0b8d832dbb8e5 P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
I20250831 19:54:57.018393 2958 ts_tablet_manager.cc:1918] T 98c37cdff24447039bf0b8d832dbb8e5 P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20250831 19:54:57.018519 2958 log.cc:1199] T 98c37cdff24447039bf0b8d832dbb8e5 P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/98c37cdff24447039bf0b8d832dbb8e5
I20250831 19:54:57.018883 2958 ts_tablet_manager.cc:1939] T 98c37cdff24447039bf0b8d832dbb8e5 P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:54:57.019707 2101 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet 98c37cdff24447039bf0b8d832dbb8e5 (table default.table_c7390b7344da4c3fbf7f2f502b096669 [id=1df66f6230794e939a25c0f2254d6e17]) successfully deleted
I20250831 19:54:57.021503 2104 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet 98c37cdff24447039bf0b8d832dbb8e5 (table default.table_c7390b7344da4c3fbf7f2f502b096669 [id=1df66f6230794e939a25c0f2254d6e17]) successfully deleted
I20250831 19:54:57.023412 2699 tablet_bootstrap.cc:492] T 6952ee3fe766450993142c673d9509e8 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:57.023530 2699 ts_tablet_manager.cc:1397] T 6952ee3fe766450993142c673d9509e8 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.065s user 0.005s sys 0.001s
I20250831 19:54:57.024196 2699 raft_consensus.cc:357] T 6952ee3fe766450993142c673d9509e8 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:57.024344 2699 raft_consensus.cc:383] T 6952ee3fe766450993142c673d9509e8 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:57.024926 2699 raft_consensus.cc:738] T 6952ee3fe766450993142c673d9509e8 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:57.027341 3178 tablet_bootstrap.cc:492] T 3081636d94084a8aa3905f40edf34b0f P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:57.027489 3178 ts_tablet_manager.cc:1397] T 3081636d94084a8aa3905f40edf34b0f P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.061s user 0.005s sys 0.001s
I20250831 19:54:57.028257 2120 catalog_manager.cc:5674] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475) does not have the latest schema for tablet e6438652703c45d691f528a4322767b9 (table default.table_d3002519e6964bb484d995d871e766c9 [id=1137b2754d104964bbe5bbaa4a0578b8]). Expected version 3 got 0
I20250831 19:54:57.028316 3178 raft_consensus.cc:357] T 3081636d94084a8aa3905f40edf34b0f P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:57.028503 3178 raft_consensus.cc:383] T 3081636d94084a8aa3905f40edf34b0f P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:57.028577 3178 raft_consensus.cc:738] T 3081636d94084a8aa3905f40edf34b0f P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:57.028950 3178 consensus_queue.cc:260] T 3081636d94084a8aa3905f40edf34b0f P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:57.029413 3178 ts_tablet_manager.cc:1428] T 3081636d94084a8aa3905f40edf34b0f P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20250831 19:54:57.029618 2955 rpc_server.cc:307] RPC server started. Bound to: 127.1.1.254:34259
I20250831 19:54:57.030776 2699 consensus_queue.cc:260] T 6952ee3fe766450993142c673d9509e8 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:57.032368 2699 ts_tablet_manager.cc:1428] T 6952ee3fe766450993142c673d9509e8 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20250831 19:54:57.032534 3274 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.1.254:34259 every 8 connection(s)
I20250831 19:54:57.034139 3178 tablet_bootstrap.cc:492] T eb97839972ba4bda89287c30da49bb40 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:57.033231 2955 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-0/data/info.pb
I20250831 19:54:57.035766 3178 tablet_bootstrap.cc:654] T eb97839972ba4bda89287c30da49bb40 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:57.037843 3177 tablet_bootstrap.cc:492] T f42849cccf8a45ed95794eac0e3922e7 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:57.038111 3177 ts_tablet_manager.cc:1397] T f42849cccf8a45ed95794eac0e3922e7 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.043s user 0.000s sys 0.003s
I20250831 19:54:57.038530 1031 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskfwTdIj/build/asan/bin/kudu as pid 2955
I20250831 19:54:57.038949 3177 raft_consensus.cc:357] T f42849cccf8a45ed95794eac0e3922e7 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:57.039127 3177 raft_consensus.cc:383] T f42849cccf8a45ed95794eac0e3922e7 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:57.039199 3177 raft_consensus.cc:738] T f42849cccf8a45ed95794eac0e3922e7 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:57.039427 3177 consensus_queue.cc:260] T f42849cccf8a45ed95794eac0e3922e7 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:57.039928 3177 ts_tablet_manager.cc:1428] T f42849cccf8a45ed95794eac0e3922e7 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20250831 19:54:57.053941 3177 tablet_bootstrap.cc:492] T 6952ee3fe766450993142c673d9509e8 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:57.055891 3177 tablet_bootstrap.cc:654] T 6952ee3fe766450993142c673d9509e8 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:57.058799 3178 tablet_bootstrap.cc:492] T eb97839972ba4bda89287c30da49bb40 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:57.058939 3178 ts_tablet_manager.cc:1397] T eb97839972ba4bda89287c30da49bb40 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.025s user 0.001s sys 0.002s
I20250831 19:54:57.059268 3225 tablet.cc:1722] T 4be6edd110374d2bb941e26defc7302f P 89aa85d59c53436ebdf3074b13d14825: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250831 19:54:57.059695 3178 raft_consensus.cc:357] T eb97839972ba4bda89287c30da49bb40 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:57.059859 3178 raft_consensus.cc:383] T eb97839972ba4bda89287c30da49bb40 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:57.059938 3178 raft_consensus.cc:738] T eb97839972ba4bda89287c30da49bb40 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:57.061312 3178 consensus_queue.cc:260] T eb97839972ba4bda89287c30da49bb40 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:57.061846 3178 ts_tablet_manager.cc:1428] T eb97839972ba4bda89287c30da49bb40 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20250831 19:54:57.062139 3178 tablet_bootstrap.cc:492] T dc6c1d165b5a484ab98ac55cd2330139 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:57.064824 2120 catalog_manager.cc:5582] T f7a7fad8a2ca4da297070dd3b49bc2d8 P 2441fafe1d62429386f4631ad423567d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2441fafe1d62429386f4631ad423567d (127.1.1.195). New cstate: current_term: 1 leader_uuid: "2441fafe1d62429386f4631ad423567d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: UNKNOWN } } }
I20250831 19:54:57.067759 3178 tablet_bootstrap.cc:654] T dc6c1d165b5a484ab98ac55cd2330139 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:57.077692 2699 tablet_bootstrap.cc:492] T 876f49b43408443da6a867c03df891b9 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:57.079967 2699 tablet_bootstrap.cc:654] T 876f49b43408443da6a867c03df891b9 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:57.095842 3177 tablet_bootstrap.cc:492] T 6952ee3fe766450993142c673d9509e8 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:57.095988 3177 ts_tablet_manager.cc:1397] T 6952ee3fe766450993142c673d9509e8 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.042s user 0.010s sys 0.004s
I20250831 19:54:57.097592 3177 raft_consensus.cc:357] T 6952ee3fe766450993142c673d9509e8 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:57.097757 3177 raft_consensus.cc:383] T 6952ee3fe766450993142c673d9509e8 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:57.097841 3177 raft_consensus.cc:738] T 6952ee3fe766450993142c673d9509e8 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:57.098062 3177 consensus_queue.cc:260] T 6952ee3fe766450993142c673d9509e8 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:57.098495 3177 ts_tablet_manager.cc:1428] T 6952ee3fe766450993142c673d9509e8 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250831 19:54:57.105556 3177 tablet_bootstrap.cc:492] T 3081636d94084a8aa3905f40edf34b0f P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:57.106024 3162 consensus_queue.cc:1035] T fae02e9ed1434c7c82f6c5faa3a1acec P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:57.107110 3177 tablet_bootstrap.cc:654] T 3081636d94084a8aa3905f40edf34b0f P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:57.117949 2699 tablet_bootstrap.cc:492] T 876f49b43408443da6a867c03df891b9 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:57.118775 2699 ts_tablet_manager.cc:1397] T 876f49b43408443da6a867c03df891b9 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.041s user 0.002s sys 0.005s
I20250831 19:54:57.119643 3178 tablet_bootstrap.cc:492] T dc6c1d165b5a484ab98ac55cd2330139 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:57.119839 3178 ts_tablet_manager.cc:1397] T dc6c1d165b5a484ab98ac55cd2330139 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.058s user 0.006s sys 0.012s
I20250831 19:54:57.120464 2699 raft_consensus.cc:357] T 876f49b43408443da6a867c03df891b9 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:57.120649 3178 raft_consensus.cc:357] T dc6c1d165b5a484ab98ac55cd2330139 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:57.120859 3178 raft_consensus.cc:383] T dc6c1d165b5a484ab98ac55cd2330139 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:57.120936 3178 raft_consensus.cc:738] T dc6c1d165b5a484ab98ac55cd2330139 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:57.121073 2699 raft_consensus.cc:383] T 876f49b43408443da6a867c03df891b9 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:57.121256 2699 raft_consensus.cc:738] T 876f49b43408443da6a867c03df891b9 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:57.121206 3178 consensus_queue.cc:260] T dc6c1d165b5a484ab98ac55cd2330139 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:57.126251 3162 consensus_queue.cc:1035] T fae02e9ed1434c7c82f6c5faa3a1acec P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:57.127187 2120 catalog_manager.cc:5582] T 701cef9d6fd04a99986b871760397f1e P de831f40fa1348a48a1f0260f4130197 reported cstate change: term changed from 1 to 2, leader changed from 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193) to de831f40fa1348a48a1f0260f4130197 (127.1.1.194). New cstate: current_term: 2 leader_uuid: "de831f40fa1348a48a1f0260f4130197" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: UNKNOWN } } }
I20250831 19:54:57.128759 2699 consensus_queue.cc:260] T 876f49b43408443da6a867c03df891b9 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:57.129251 2699 ts_tablet_manager.cc:1428] T 876f49b43408443da6a867c03df891b9 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.010s user 0.001s sys 0.000s
I20250831 19:54:57.129591 2699 tablet_bootstrap.cc:492] T 3081636d94084a8aa3905f40edf34b0f P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:57.131109 1952 heartbeater.cc:344] Connected to a master server at 127.1.1.254:34259
I20250831 19:54:57.131462 2699 tablet_bootstrap.cc:654] T 3081636d94084a8aa3905f40edf34b0f P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:57.131937 3275 sys_catalog.cc:263] Verifying existing consensus state
I20250831 19:54:57.137856 3178 ts_tablet_manager.cc:1428] T dc6c1d165b5a484ab98ac55cd2330139 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.018s user 0.001s sys 0.001s
I20250831 19:54:57.143824 3178 tablet_bootstrap.cc:492] T c47f69c5eeda4044b5c0f796375c013b P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:57.157240 1680 heartbeater.cc:344] Connected to a master server at 127.1.1.254:34259
I20250831 19:54:57.163663 1818 heartbeater.cc:344] Connected to a master server at 127.1.1.254:34259
I20250831 19:54:57.164070 3177 tablet_bootstrap.cc:492] T 3081636d94084a8aa3905f40edf34b0f P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:57.165078 3178 tablet_bootstrap.cc:654] T c47f69c5eeda4044b5c0f796375c013b P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:57.166172 3177 ts_tablet_manager.cc:1397] T 3081636d94084a8aa3905f40edf34b0f P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.061s user 0.003s sys 0.007s
I20250831 19:54:57.166975 3177 raft_consensus.cc:357] T 3081636d94084a8aa3905f40edf34b0f P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:57.167129 3177 raft_consensus.cc:383] T 3081636d94084a8aa3905f40edf34b0f P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:57.167186 3177 raft_consensus.cc:738] T 3081636d94084a8aa3905f40edf34b0f P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:57.170964 2122 catalog_manager.cc:3460] renamed table default.table_268aaa1457f049d39b6e2eee7f41a1bb [id=2b57fa1ef98f4029bc75e981255c74da] in HMS: new name default.table_bced9a3b747a4c33b6fc5b05b2a4dd89
I20250831 19:54:57.178992 1818 heartbeater.cc:344] Connected to a master server at 127.1.1.254:34259
I20250831 19:54:57.183903 2120 catalog_manager.cc:6127] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: default.table_617124885d2e4d96b863e0e435bdf695 [id=0fc929ad819b48a9af984f8c301bad2b] alter complete (version 2)
I20250831 19:54:57.178862 3177 consensus_queue.cc:260] T 3081636d94084a8aa3905f40edf34b0f P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:57.188920 3275 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3: Bootstrap starting.
I20250831 19:54:57.212227 3177 ts_tablet_manager.cc:1428] T 3081636d94084a8aa3905f40edf34b0f P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.046s user 0.001s sys 0.001s
I20250831 19:54:57.212651 3177 tablet_bootstrap.cc:492] T eb97839972ba4bda89287c30da49bb40 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:57.214902 3177 tablet_bootstrap.cc:654] T eb97839972ba4bda89287c30da49bb40 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:57.222141 2699 tablet_bootstrap.cc:492] T 3081636d94084a8aa3905f40edf34b0f P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:57.222312 2699 ts_tablet_manager.cc:1397] T 3081636d94084a8aa3905f40edf34b0f P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.093s user 0.015s sys 0.010s
I20250831 19:54:57.223100 2699 raft_consensus.cc:357] T 3081636d94084a8aa3905f40edf34b0f P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:57.223312 2699 raft_consensus.cc:383] T 3081636d94084a8aa3905f40edf34b0f P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:57.223409 2699 raft_consensus.cc:738] T 3081636d94084a8aa3905f40edf34b0f P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:57.223848 3178 tablet_bootstrap.cc:492] T c47f69c5eeda4044b5c0f796375c013b P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:57.223989 3178 ts_tablet_manager.cc:1397] T c47f69c5eeda4044b5c0f796375c013b P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.080s user 0.003s sys 0.000s
I20250831 19:54:57.224749 3178 raft_consensus.cc:357] T c47f69c5eeda4044b5c0f796375c013b P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:57.224936 3178 raft_consensus.cc:383] T c47f69c5eeda4044b5c0f796375c013b P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:57.225028 3178 raft_consensus.cc:738] T c47f69c5eeda4044b5c0f796375c013b P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:57.225234 3178 consensus_queue.cc:260] T c47f69c5eeda4044b5c0f796375c013b P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:57.241590 2699 consensus_queue.cc:260] T 3081636d94084a8aa3905f40edf34b0f P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:57.242147 2699 ts_tablet_manager.cc:1428] T 3081636d94084a8aa3905f40edf34b0f P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.020s user 0.001s sys 0.001s
I20250831 19:54:57.242506 2699 tablet_bootstrap.cc:492] T eb97839972ba4bda89287c30da49bb40 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:57.242903 3178 ts_tablet_manager.cc:1428] T c47f69c5eeda4044b5c0f796375c013b P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.019s user 0.002s sys 0.000s
I20250831 19:54:57.243664 3177 tablet_bootstrap.cc:492] T eb97839972ba4bda89287c30da49bb40 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:57.243809 3177 ts_tablet_manager.cc:1397] T eb97839972ba4bda89287c30da49bb40 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.031s user 0.005s sys 0.010s
I20250831 19:54:57.244164 2699 tablet_bootstrap.cc:654] T eb97839972ba4bda89287c30da49bb40 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:57.244554 3177 raft_consensus.cc:357] T eb97839972ba4bda89287c30da49bb40 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:57.244745 3177 raft_consensus.cc:383] T eb97839972ba4bda89287c30da49bb40 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:57.244815 3177 raft_consensus.cc:738] T eb97839972ba4bda89287c30da49bb40 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:57.246474 3178 tablet_bootstrap.cc:492] T d56dcc30166043c68c3f1c05e7f7bde0 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:57.247714 3233 raft_consensus.cc:491] T 6952ee3fe766450993142c673d9509e8 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:57.247864 3233 raft_consensus.cc:513] T 6952ee3fe766450993142c673d9509e8 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:57.248649 3233 leader_election.cc:290] T 6952ee3fe766450993142c673d9509e8 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:57.248970 1769 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6952ee3fe766450993142c673d9509e8" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:57.249163 1769 raft_consensus.cc:2466] T 6952ee3fe766450993142c673d9509e8 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 0.
I20250831 19:54:57.249243 1633 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6952ee3fe766450993142c673d9509e8" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:57.249408 1633 raft_consensus.cc:2466] T 6952ee3fe766450993142c673d9509e8 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 0.
I20250831 19:54:57.249787 1842 leader_election.cc:304] T 6952ee3fe766450993142c673d9509e8 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:57.253351 3233 raft_consensus.cc:2802] T 6952ee3fe766450993142c673d9509e8 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:57.253427 3233 raft_consensus.cc:491] T 6952ee3fe766450993142c673d9509e8 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:57.253528 3233 raft_consensus.cc:3058] T 6952ee3fe766450993142c673d9509e8 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:57.255978 1680 heartbeater.cc:344] Connected to a master server at 127.1.1.254:34259
I20250831 19:54:57.258680 3178 tablet_bootstrap.cc:654] T d56dcc30166043c68c3f1c05e7f7bde0 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:57.260888 3233 raft_consensus.cc:513] T 6952ee3fe766450993142c673d9509e8 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:57.263283 1769 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6952ee3fe766450993142c673d9509e8" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197"
I20250831 19:54:57.263489 1769 raft_consensus.cc:3058] T 6952ee3fe766450993142c673d9509e8 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:57.264175 3233 leader_election.cc:290] T 6952ee3fe766450993142c673d9509e8 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 election: Requested vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:57.265934 1769 raft_consensus.cc:2466] T 6952ee3fe766450993142c673d9509e8 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 1.
I20250831 19:54:57.266631 1842 leader_election.cc:304] T 6952ee3fe766450993142c673d9509e8 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:57.263996 1633 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6952ee3fe766450993142c673d9509e8" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:54:57.267000 1633 raft_consensus.cc:3058] T 6952ee3fe766450993142c673d9509e8 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:57.268086 3233 raft_consensus.cc:2802] T 6952ee3fe766450993142c673d9509e8 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:57.268677 3233 raft_consensus.cc:695] T 6952ee3fe766450993142c673d9509e8 P 2441fafe1d62429386f4631ad423567d [term 1 LEADER]: Becoming Leader. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Running, Role: LEADER
I20250831 19:54:57.269562 1633 raft_consensus.cc:2466] T 6952ee3fe766450993142c673d9509e8 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 1.
I20250831 19:54:57.269609 3177 consensus_queue.cc:260] T eb97839972ba4bda89287c30da49bb40 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:57.269234 3233 consensus_queue.cc:237] T 6952ee3fe766450993142c673d9509e8 P 2441fafe1d62429386f4631ad423567d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:57.284710 3177 ts_tablet_manager.cc:1428] T eb97839972ba4bda89287c30da49bb40 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.041s user 0.001s sys 0.001s
I20250831 19:54:57.296625 3177 tablet_bootstrap.cc:492] T dc6c1d165b5a484ab98ac55cd2330139 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:57.298341 3177 tablet_bootstrap.cc:654] T dc6c1d165b5a484ab98ac55cd2330139 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:57.308605 3178 tablet_bootstrap.cc:492] T d56dcc30166043c68c3f1c05e7f7bde0 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:57.309407 3178 ts_tablet_manager.cc:1397] T d56dcc30166043c68c3f1c05e7f7bde0 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.063s user 0.006s sys 0.001s
I20250831 19:54:57.312805 2699 tablet_bootstrap.cc:492] T eb97839972ba4bda89287c30da49bb40 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:57.313004 2699 ts_tablet_manager.cc:1397] T eb97839972ba4bda89287c30da49bb40 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.071s user 0.010s sys 0.020s
I20250831 19:54:57.313748 2699 raft_consensus.cc:357] T eb97839972ba4bda89287c30da49bb40 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:57.313428 3178 raft_consensus.cc:357] T d56dcc30166043c68c3f1c05e7f7bde0 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:57.313961 2699 raft_consensus.cc:383] T eb97839972ba4bda89287c30da49bb40 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:57.314033 2699 raft_consensus.cc:738] T eb97839972ba4bda89287c30da49bb40 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:57.314117 3178 raft_consensus.cc:383] T d56dcc30166043c68c3f1c05e7f7bde0 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:57.314258 2699 consensus_queue.cc:260] T eb97839972ba4bda89287c30da49bb40 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:57.314422 3178 raft_consensus.cc:738] T d56dcc30166043c68c3f1c05e7f7bde0 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:57.314754 2699 ts_tablet_manager.cc:1428] T eb97839972ba4bda89287c30da49bb40 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250831 19:54:57.315047 2699 tablet_bootstrap.cc:492] T dc6c1d165b5a484ab98ac55cd2330139 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:57.311049 2778 raft_consensus.cc:491] T 876f49b43408443da6a867c03df891b9 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:57.316694 2778 raft_consensus.cc:513] T 876f49b43408443da6a867c03df891b9 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:57.317502 2778 leader_election.cc:290] T 876f49b43408443da6a867c03df891b9 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:57.318238 1903 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "876f49b43408443da6a867c03df891b9" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:57.318420 1903 raft_consensus.cc:2466] T 876f49b43408443da6a867c03df891b9 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 0.
I20250831 19:54:57.319625 1633 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "876f49b43408443da6a867c03df891b9" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:57.319805 1633 raft_consensus.cc:2466] T 876f49b43408443da6a867c03df891b9 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 0.
I20250831 19:54:57.315383 3178 consensus_queue.cc:260] T d56dcc30166043c68c3f1c05e7f7bde0 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:57.320359 1705 leader_election.cc:304] T 876f49b43408443da6a867c03df891b9 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:57.321097 2778 raft_consensus.cc:2802] T 876f49b43408443da6a867c03df891b9 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:57.321195 2778 raft_consensus.cc:491] T 876f49b43408443da6a867c03df891b9 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:57.321293 2778 raft_consensus.cc:3058] T 876f49b43408443da6a867c03df891b9 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:57.323374 2120 catalog_manager.cc:5582] T 6952ee3fe766450993142c673d9509e8 P 2441fafe1d62429386f4631ad423567d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2441fafe1d62429386f4631ad423567d (127.1.1.195). New cstate: current_term: 1 leader_uuid: "2441fafe1d62429386f4631ad423567d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: UNKNOWN } } }
I20250831 19:54:57.323870 2778 raft_consensus.cc:513] T 876f49b43408443da6a867c03df891b9 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:57.324852 1903 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "876f49b43408443da6a867c03df891b9" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:54:57.325008 1903 raft_consensus.cc:3058] T 876f49b43408443da6a867c03df891b9 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:57.327575 1903 raft_consensus.cc:2466] T 876f49b43408443da6a867c03df891b9 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:54:57.328356 1705 leader_election.cc:304] T 876f49b43408443da6a867c03df891b9 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:57.328608 2943 raft_consensus.cc:2802] T 876f49b43408443da6a867c03df891b9 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:57.328713 2699 tablet_bootstrap.cc:654] T dc6c1d165b5a484ab98ac55cd2330139 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:57.330653 2778 leader_election.cc:290] T 876f49b43408443da6a867c03df891b9 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Requested vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:57.332208 1633 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "876f49b43408443da6a867c03df891b9" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:54:57.332376 1633 raft_consensus.cc:3058] T 876f49b43408443da6a867c03df891b9 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:57.334906 1633 raft_consensus.cc:2466] T 876f49b43408443da6a867c03df891b9 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:54:57.338238 3178 ts_tablet_manager.cc:1428] T d56dcc30166043c68c3f1c05e7f7bde0 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.028s user 0.003s sys 0.000s
I20250831 19:54:57.342746 2120 catalog_manager.cc:5674] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197) does not have the latest schema for tablet d56dcc30166043c68c3f1c05e7f7bde0 (table default.table_c7390b7344da4c3fbf7f2f502b096669 [id=1df66f6230794e939a25c0f2254d6e17]). Expected version 2 got 0
W20250831 19:54:57.346689 2120 catalog_manager.cc:5774] Failed to send AlterTable RPC for tablet d56dcc30166043c68c3f1c05e7f7bde0 (table default.table_c7390b7344da4c3fbf7f2f502b096669 [id=1df66f6230794e939a25c0f2254d6e17], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet d56dcc30166043c68c3f1c05e7f7bde0 consensus state has no leader
I20250831 19:54:57.349196 2943 raft_consensus.cc:695] T 876f49b43408443da6a867c03df891b9 P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: Becoming Leader. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Running, Role: LEADER
I20250831 19:54:57.349649 2943 consensus_queue.cc:237] T 876f49b43408443da6a867c03df891b9 P de831f40fa1348a48a1f0260f4130197 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:57.352514 2699 tablet_bootstrap.cc:492] T dc6c1d165b5a484ab98ac55cd2330139 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:57.352512 2120 catalog_manager.cc:5674] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197) does not have the latest schema for tablet d56dcc30166043c68c3f1c05e7f7bde0 (table default.table_c7390b7344da4c3fbf7f2f502b096669 [id=1df66f6230794e939a25c0f2254d6e17]). Expected version 2 got 0
I20250831 19:54:57.352677 2699 ts_tablet_manager.cc:1397] T dc6c1d165b5a484ab98ac55cd2330139 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.038s user 0.007s sys 0.000s
I20250831 19:54:57.356047 2699 raft_consensus.cc:357] T dc6c1d165b5a484ab98ac55cd2330139 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:57.356225 2699 raft_consensus.cc:383] T dc6c1d165b5a484ab98ac55cd2330139 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:57.356312 2699 raft_consensus.cc:738] T dc6c1d165b5a484ab98ac55cd2330139 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:57.356530 2699 consensus_queue.cc:260] T dc6c1d165b5a484ab98ac55cd2330139 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:57.357371 3177 tablet_bootstrap.cc:492] T dc6c1d165b5a484ab98ac55cd2330139 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:57.357586 3177 ts_tablet_manager.cc:1397] T dc6c1d165b5a484ab98ac55cd2330139 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.061s user 0.000s sys 0.006s
I20250831 19:54:57.358359 3177 raft_consensus.cc:357] T dc6c1d165b5a484ab98ac55cd2330139 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:57.358367 2120 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36958:
name: "default.Table_dbeae8f9a2c34da78b7e284664c00cd1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:57.365756 2699 ts_tablet_manager.cc:1428] T dc6c1d165b5a484ab98ac55cd2330139 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.013s user 0.002s sys 0.000s
I20250831 19:54:57.366083 2699 tablet_bootstrap.cc:492] T c47f69c5eeda4044b5c0f796375c013b P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:57.367410 3177 raft_consensus.cc:383] T dc6c1d165b5a484ab98ac55cd2330139 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20250831 19:54:57.367532 2101 catalog_manager.cc:4726] Async tablet task AlterTable RPC for tablet d56dcc30166043c68c3f1c05e7f7bde0 (table default.table_c7390b7344da4c3fbf7f2f502b096669 [id=1df66f6230794e939a25c0f2254d6e17], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet d56dcc30166043c68c3f1c05e7f7bde0 consensus state has no leader
I20250831 19:54:57.367733 2699 tablet_bootstrap.cc:654] T c47f69c5eeda4044b5c0f796375c013b P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:57.369182 3177 raft_consensus.cc:738] T dc6c1d165b5a484ab98ac55cd2330139 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:57.369527 3177 consensus_queue.cc:260] T dc6c1d165b5a484ab98ac55cd2330139 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:57.373354 3275 log.cc:826] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3: Log is configured to *not* fsync() on all Append() calls
I20250831 19:54:57.375577 3177 ts_tablet_manager.cc:1428] T dc6c1d165b5a484ab98ac55cd2330139 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.018s user 0.001s sys 0.000s
I20250831 19:54:57.375998 3177 tablet_bootstrap.cc:492] T c47f69c5eeda4044b5c0f796375c013b P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:57.387909 2943 raft_consensus.cc:491] T f42849cccf8a45ed95794eac0e3922e7 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:57.388137 2943 raft_consensus.cc:513] T f42849cccf8a45ed95794eac0e3922e7 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:57.389309 1903 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f42849cccf8a45ed95794eac0e3922e7" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:57.389551 1903 raft_consensus.cc:2466] T f42849cccf8a45ed95794eac0e3922e7 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 0.
I20250831 19:54:57.390130 1705 leader_election.cc:304] T f42849cccf8a45ed95794eac0e3922e7 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:57.390637 2943 leader_election.cc:290] T f42849cccf8a45ed95794eac0e3922e7 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:57.390820 2943 raft_consensus.cc:2802] T f42849cccf8a45ed95794eac0e3922e7 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:57.391260 1633 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f42849cccf8a45ed95794eac0e3922e7" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:57.391532 1633 raft_consensus.cc:2466] T f42849cccf8a45ed95794eac0e3922e7 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 0.
I20250831 19:54:57.391531 2943 raft_consensus.cc:491] T f42849cccf8a45ed95794eac0e3922e7 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:57.391630 2943 raft_consensus.cc:3058] T f42849cccf8a45ed95794eac0e3922e7 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:57.394263 2943 raft_consensus.cc:513] T f42849cccf8a45ed95794eac0e3922e7 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:57.395282 1903 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f42849cccf8a45ed95794eac0e3922e7" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:54:57.395490 1903 raft_consensus.cc:3058] T f42849cccf8a45ed95794eac0e3922e7 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:57.398638 1903 raft_consensus.cc:2466] T f42849cccf8a45ed95794eac0e3922e7 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:54:57.399051 1705 leader_election.cc:304] T f42849cccf8a45ed95794eac0e3922e7 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:57.399390 3295 raft_consensus.cc:2802] T f42849cccf8a45ed95794eac0e3922e7 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:57.399682 3295 raft_consensus.cc:695] T f42849cccf8a45ed95794eac0e3922e7 P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: Becoming Leader. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Running, Role: LEADER
I20250831 19:54:57.400060 3295 consensus_queue.cc:237] T f42849cccf8a45ed95794eac0e3922e7 P de831f40fa1348a48a1f0260f4130197 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:57.401521 2943 leader_election.cc:290] T f42849cccf8a45ed95794eac0e3922e7 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Requested vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:57.401986 3177 tablet_bootstrap.cc:654] T c47f69c5eeda4044b5c0f796375c013b P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:57.401986 1633 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f42849cccf8a45ed95794eac0e3922e7" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:54:57.402194 1633 raft_consensus.cc:3058] T f42849cccf8a45ed95794eac0e3922e7 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:57.405998 2121 catalog_manager.cc:2706] deleted HMS catalog entry for table default.table_6c2f9309b58643529114857aae0568f2 [id=ad7bb166843e423ea7e50a1d18710fa1]
I20250831 19:54:57.405642 1633 raft_consensus.cc:2466] T f42849cccf8a45ed95794eac0e3922e7 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:54:57.420189 2699 tablet_bootstrap.cc:492] T c47f69c5eeda4044b5c0f796375c013b P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:57.420420 2699 ts_tablet_manager.cc:1397] T c47f69c5eeda4044b5c0f796375c013b P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.054s user 0.008s sys 0.008s
I20250831 19:54:57.422567 2699 raft_consensus.cc:357] T c47f69c5eeda4044b5c0f796375c013b P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:57.422827 2699 raft_consensus.cc:383] T c47f69c5eeda4044b5c0f796375c013b P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:57.422950 2699 raft_consensus.cc:738] T c47f69c5eeda4044b5c0f796375c013b P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:57.423251 2699 consensus_queue.cc:260] T c47f69c5eeda4044b5c0f796375c013b P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:57.434091 3177 tablet_bootstrap.cc:492] T c47f69c5eeda4044b5c0f796375c013b P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:57.434283 3177 ts_tablet_manager.cc:1397] T c47f69c5eeda4044b5c0f796375c013b P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.058s user 0.003s sys 0.000s
I20250831 19:54:57.436465 3177 raft_consensus.cc:357] T c47f69c5eeda4044b5c0f796375c013b P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:57.436713 3177 raft_consensus.cc:383] T c47f69c5eeda4044b5c0f796375c013b P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:57.436865 3177 raft_consensus.cc:738] T c47f69c5eeda4044b5c0f796375c013b P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:57.437186 3177 consensus_queue.cc:260] T c47f69c5eeda4044b5c0f796375c013b P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:57.439445 3177 ts_tablet_manager.cc:1428] T c47f69c5eeda4044b5c0f796375c013b P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20250831 19:54:57.439770 3177 tablet_bootstrap.cc:492] T d56dcc30166043c68c3f1c05e7f7bde0 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:57.441519 3177 tablet_bootstrap.cc:654] T d56dcc30166043c68c3f1c05e7f7bde0 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:57.447896 1818 heartbeater.cc:344] Connected to a master server at 127.1.1.254:34259
I20250831 19:54:57.447948 2699 ts_tablet_manager.cc:1428] T c47f69c5eeda4044b5c0f796375c013b P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.027s user 0.001s sys 0.001s
I20250831 19:54:57.455801 1952 heartbeater.cc:344] Connected to a master server at 127.1.1.254:34259
I20250831 19:54:57.462082 2699 tablet_bootstrap.cc:492] T d56dcc30166043c68c3f1c05e7f7bde0 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:57.463447 3177 tablet_bootstrap.cc:492] T d56dcc30166043c68c3f1c05e7f7bde0 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:57.463716 2699 tablet_bootstrap.cc:654] T d56dcc30166043c68c3f1c05e7f7bde0 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:57.463699 3177 ts_tablet_manager.cc:1397] T d56dcc30166043c68c3f1c05e7f7bde0 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.024s user 0.004s sys 0.000s
I20250831 19:54:57.465034 3177 raft_consensus.cc:357] T d56dcc30166043c68c3f1c05e7f7bde0 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:57.465299 3177 raft_consensus.cc:383] T d56dcc30166043c68c3f1c05e7f7bde0 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:57.465407 3177 raft_consensus.cc:738] T d56dcc30166043c68c3f1c05e7f7bde0 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:57.465742 3177 consensus_queue.cc:260] T d56dcc30166043c68c3f1c05e7f7bde0 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:57.466461 3177 ts_tablet_manager.cc:1428] T d56dcc30166043c68c3f1c05e7f7bde0 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20250831 19:54:57.468674 3162 raft_consensus.cc:491] T c47f69c5eeda4044b5c0f796375c013b P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:57.468825 3162 raft_consensus.cc:513] T c47f69c5eeda4044b5c0f796375c013b P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:57.469538 3162 leader_election.cc:290] T c47f69c5eeda4044b5c0f796375c013b P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237)
I20250831 19:54:57.472143 1769 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c47f69c5eeda4044b5c0f796375c013b" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:57.472309 1769 raft_consensus.cc:2466] T c47f69c5eeda4044b5c0f796375c013b P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 0.
I20250831 19:54:57.472997 1904 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c47f69c5eeda4044b5c0f796375c013b" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:57.473186 1904 raft_consensus.cc:2466] T c47f69c5eeda4044b5c0f796375c013b P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 0.
I20250831 19:54:57.473989 1568 leader_election.cc:304] T c47f69c5eeda4044b5c0f796375c013b P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:54:57.474476 2995 raft_consensus.cc:2802] T c47f69c5eeda4044b5c0f796375c013b P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:57.474562 2995 raft_consensus.cc:491] T c47f69c5eeda4044b5c0f796375c013b P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:57.474673 2995 raft_consensus.cc:3058] T c47f69c5eeda4044b5c0f796375c013b P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:57.477017 2995 raft_consensus.cc:513] T c47f69c5eeda4044b5c0f796375c013b P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:57.478796 1769 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c47f69c5eeda4044b5c0f796375c013b" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197"
I20250831 19:54:57.478961 1769 raft_consensus.cc:3058] T c47f69c5eeda4044b5c0f796375c013b P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:57.481352 1769 raft_consensus.cc:2466] T c47f69c5eeda4044b5c0f796375c013b P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1.
I20250831 19:54:57.489979 2995 leader_election.cc:290] T c47f69c5eeda4044b5c0f796375c013b P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Requested vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237)
I20250831 19:54:57.490345 1904 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c47f69c5eeda4044b5c0f796375c013b" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:54:57.490514 1904 raft_consensus.cc:3058] T c47f69c5eeda4044b5c0f796375c013b P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:57.490197 1570 leader_election.cc:304] T c47f69c5eeda4044b5c0f796375c013b P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:57.492168 3162 raft_consensus.cc:2802] T c47f69c5eeda4044b5c0f796375c013b P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:57.492311 3162 raft_consensus.cc:695] T c47f69c5eeda4044b5c0f796375c013b P 89aa85d59c53436ebdf3074b13d14825 [term 1 LEADER]: Becoming Leader. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Running, Role: LEADER
I20250831 19:54:57.492537 3162 consensus_queue.cc:237] T c47f69c5eeda4044b5c0f796375c013b P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:57.493139 1904 raft_consensus.cc:2466] T c47f69c5eeda4044b5c0f796375c013b P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1.
I20250831 19:54:57.506068 2699 tablet_bootstrap.cc:492] T d56dcc30166043c68c3f1c05e7f7bde0 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:57.506235 2699 ts_tablet_manager.cc:1397] T d56dcc30166043c68c3f1c05e7f7bde0 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.044s user 0.014s sys 0.019s
I20250831 19:54:57.507004 2699 raft_consensus.cc:357] T d56dcc30166043c68c3f1c05e7f7bde0 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:57.507189 2699 raft_consensus.cc:383] T d56dcc30166043c68c3f1c05e7f7bde0 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:57.507287 2699 raft_consensus.cc:738] T d56dcc30166043c68c3f1c05e7f7bde0 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:57.507510 2699 consensus_queue.cc:260] T d56dcc30166043c68c3f1c05e7f7bde0 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:57.508647 2699 ts_tablet_manager.cc:1428] T d56dcc30166043c68c3f1c05e7f7bde0 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20250831 19:54:57.532106 2125 catalog_manager.cc:2706] deleted HMS catalog entry for table default.table_82715a1a3cf44ab586f6ab0f19723f2b [id=79e1655e710d4e6ebb6a25f871ba8eeb]
I20250831 19:54:57.548300 3162 consensus_queue.cc:1035] T 8ebf42e07edf40f9b95b0304a912b9b8 P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:57.549088 2186 catalog_manager.cc:2747] Deleting table default.table_6c2f9309b58643529114857aae0568f2 [id=ad7bb166843e423ea7e50a1d18710fa1] in response to Hive Metastore notification log event 159
I20250831 19:54:57.553627 3233 consensus_queue.cc:1035] T 5a080bbabe8840c3ba954bdc0626dc39 P 2441fafe1d62429386f4631ad423567d [LEADER]: Connected to new peer: Peer: permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:57.554163 3162 consensus_queue.cc:1035] T a6a3938379c64baba6f5f2c1a2f7087a P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:57.559739 2186 catalog_manager.cc:5869] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Sending DeleteTablet for 3 replicas of tablet 05cda604dad041cfaad94d1b43d6b14d
I20250831 19:54:57.560492 1883 tablet_service.cc:1515] Processing DeleteTablet for tablet 05cda604dad041cfaad94d1b43d6b14d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:57 UTC) from {username='slave'} at 127.0.0.1:45906
I20250831 19:54:57.560619 1749 tablet_service.cc:1515] Processing DeleteTablet for tablet 05cda604dad041cfaad94d1b43d6b14d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:57 UTC) from {username='slave'} at 127.0.0.1:50674
I20250831 19:54:57.564404 1614 tablet_service.cc:1515] Processing DeleteTablet for tablet 05cda604dad041cfaad94d1b43d6b14d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:57 UTC) from {username='slave'} at 127.0.0.1:51022
I20250831 19:54:57.565188 2186 catalog_manager.cc:2747] Deleting table default.table_82715a1a3cf44ab586f6ab0f19723f2b [id=79e1655e710d4e6ebb6a25f871ba8eeb] in response to Hive Metastore notification log event 160
I20250831 19:54:57.580554 2186 catalog_manager.cc:5869] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Sending DeleteTablet for 3 replicas of tablet c5cfcb0956e44a1c9e64acc4d1ed568c
I20250831 19:54:57.582078 1884 tablet_service.cc:1515] Processing DeleteTablet for tablet c5cfcb0956e44a1c9e64acc4d1ed568c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:57 UTC) from {username='slave'} at 127.0.0.1:45906
I20250831 19:54:57.582198 1748 tablet_service.cc:1515] Processing DeleteTablet for tablet c5cfcb0956e44a1c9e64acc4d1ed568c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:57 UTC) from {username='slave'} at 127.0.0.1:50674
I20250831 19:54:57.583436 1613 tablet_service.cc:1515] Processing DeleteTablet for tablet c5cfcb0956e44a1c9e64acc4d1ed568c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:57 UTC) from {username='slave'} at 127.0.0.1:51022
I20250831 19:54:57.583563 3312 tablet_replica.cc:331] T 05cda604dad041cfaad94d1b43d6b14d P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:54:57.583818 3312 raft_consensus.cc:2241] T 05cda604dad041cfaad94d1b43d6b14d P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:57.584064 3312 raft_consensus.cc:2270] T 05cda604dad041cfaad94d1b43d6b14d P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:57.584625 3312 ts_tablet_manager.cc:1905] T 05cda604dad041cfaad94d1b43d6b14d P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:57.585458 2124 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:36958 (request call id 175) took 2120 ms. Trace:
I20250831 19:54:57.585597 2124 rpcz_store.cc:276] 0831 19:54:55.464748 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:56.185260 (+720512us) service_pool.cc:225] Handling call
0831 19:54:56.361148 (+175888us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:57.584878 (+1223730us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:57.585133 (+ 255us) catalog_manager.cc:3683] Apply alter schema
0831 19:54:57.585394 (+ 261us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":445977,"Hive Metastore.run_cpu_time_us":698,"Hive Metastore.run_wall_time_us":89340}
I20250831 19:54:57.590322 3310 tablet_replica.cc:331] T 05cda604dad041cfaad94d1b43d6b14d P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:54:57.590656 3310 raft_consensus.cc:2241] T 05cda604dad041cfaad94d1b43d6b14d P 2441fafe1d62429386f4631ad423567d [term 1 LEADER]: Raft consensus shutting down.
I20250831 19:54:57.591079 3310 raft_consensus.cc:2270] T 05cda604dad041cfaad94d1b43d6b14d P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:57.592059 2124 catalog_manager.cc:5582] T 876f49b43408443da6a867c03df891b9 P de831f40fa1348a48a1f0260f4130197 reported cstate change: term changed from 0 to 1, leader changed from <none> to de831f40fa1348a48a1f0260f4130197 (127.1.1.194). New cstate: current_term: 1 leader_uuid: "de831f40fa1348a48a1f0260f4130197" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: UNKNOWN } } }
I20250831 19:54:57.593637 2995 consensus_queue.cc:1035] T a6a3938379c64baba6f5f2c1a2f7087a P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:57.597997 3310 ts_tablet_manager.cc:1905] T 05cda604dad041cfaad94d1b43d6b14d P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:57.604144 3162 consensus_queue.cc:1035] T bec4c2ee742e4e6ab5f98fb3a1c36aca P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:57.608978 2995 consensus_queue.cc:1035] T 8ebf42e07edf40f9b95b0304a912b9b8 P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:57.621568 2124 catalog_manager.cc:5582] T c47f69c5eeda4044b5c0f796375c013b P 89aa85d59c53436ebdf3074b13d14825 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193). New cstate: current_term: 1 leader_uuid: "89aa85d59c53436ebdf3074b13d14825" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: HEALTHY } } }
I20250831 19:54:57.637540 3162 consensus_queue.cc:1035] T bec4c2ee742e4e6ab5f98fb3a1c36aca P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:57.641012 3311 tablet_replica.cc:331] T 05cda604dad041cfaad94d1b43d6b14d P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:54:57.648882 3233 raft_consensus.cc:491] T d56dcc30166043c68c3f1c05e7f7bde0 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:57.649053 3233 raft_consensus.cc:513] T d56dcc30166043c68c3f1c05e7f7bde0 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:57.649695 3233 leader_election.cc:290] T d56dcc30166043c68c3f1c05e7f7bde0 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:57.649935 3311 raft_consensus.cc:2241] T 05cda604dad041cfaad94d1b43d6b14d P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:57.650213 3311 raft_consensus.cc:2270] T 05cda604dad041cfaad94d1b43d6b14d P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:57.651186 1633 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d56dcc30166043c68c3f1c05e7f7bde0" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:57.651402 1633 raft_consensus.cc:2466] T d56dcc30166043c68c3f1c05e7f7bde0 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 0.
I20250831 19:54:57.651777 1841 leader_election.cc:304] T d56dcc30166043c68c3f1c05e7f7bde0 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:54:57.652204 3233 raft_consensus.cc:2802] T d56dcc30166043c68c3f1c05e7f7bde0 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:57.652313 3233 raft_consensus.cc:491] T d56dcc30166043c68c3f1c05e7f7bde0 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:57.652434 3233 raft_consensus.cc:3058] T d56dcc30166043c68c3f1c05e7f7bde0 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:57.655174 3233 raft_consensus.cc:513] T d56dcc30166043c68c3f1c05e7f7bde0 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:57.655884 3233 leader_election.cc:290] T d56dcc30166043c68c3f1c05e7f7bde0 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 election: Requested vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:57.656880 1633 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d56dcc30166043c68c3f1c05e7f7bde0" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:54:57.657035 1633 raft_consensus.cc:3058] T d56dcc30166043c68c3f1c05e7f7bde0 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:57.659584 1633 raft_consensus.cc:2466] T d56dcc30166043c68c3f1c05e7f7bde0 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 1.
I20250831 19:54:57.659968 1841 leader_election.cc:304] T d56dcc30166043c68c3f1c05e7f7bde0 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:54:57.660336 3233 raft_consensus.cc:2802] T d56dcc30166043c68c3f1c05e7f7bde0 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:57.660509 3233 raft_consensus.cc:695] T d56dcc30166043c68c3f1c05e7f7bde0 P 2441fafe1d62429386f4631ad423567d [term 1 LEADER]: Becoming Leader. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Running, Role: LEADER
I20250831 19:54:57.660777 3233 consensus_queue.cc:237] T d56dcc30166043c68c3f1c05e7f7bde0 P 2441fafe1d62429386f4631ad423567d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:57.661093 3311 ts_tablet_manager.cc:1905] T 05cda604dad041cfaad94d1b43d6b14d P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:57.665510 1768 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d56dcc30166043c68c3f1c05e7f7bde0" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197"
I20250831 19:54:57.665750 1768 raft_consensus.cc:3058] T d56dcc30166043c68c3f1c05e7f7bde0 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:57.668642 1768 raft_consensus.cc:2466] T d56dcc30166043c68c3f1c05e7f7bde0 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 1.
I20250831 19:54:57.669376 1772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d56dcc30166043c68c3f1c05e7f7bde0" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:57.671221 1772 raft_consensus.cc:2374] T d56dcc30166043c68c3f1c05e7f7bde0 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 1. Re-sending same reply.
I20250831 19:54:57.672906 3295 raft_consensus.cc:491] T 3081636d94084a8aa3905f40edf34b0f P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:57.673058 3295 raft_consensus.cc:513] T 3081636d94084a8aa3905f40edf34b0f P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:57.673707 3295 leader_election.cc:290] T 3081636d94084a8aa3905f40edf34b0f P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:57.674664 1633 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3081636d94084a8aa3905f40edf34b0f" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:57.675618 1633 raft_consensus.cc:2466] T 3081636d94084a8aa3905f40edf34b0f P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 0.
I20250831 19:54:57.676054 1706 leader_election.cc:304] T 3081636d94084a8aa3905f40edf34b0f P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:57.676401 3295 raft_consensus.cc:2802] T 3081636d94084a8aa3905f40edf34b0f P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:57.676486 3295 raft_consensus.cc:491] T 3081636d94084a8aa3905f40edf34b0f P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:57.676587 3295 raft_consensus.cc:3058] T 3081636d94084a8aa3905f40edf34b0f P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:57.679219 3295 raft_consensus.cc:513] T 3081636d94084a8aa3905f40edf34b0f P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:57.680399 3295 leader_election.cc:290] T 3081636d94084a8aa3905f40edf34b0f P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Requested vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:57.682606 1903 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3081636d94084a8aa3905f40edf34b0f" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:54:57.683216 1903 raft_consensus.cc:3058] T 3081636d94084a8aa3905f40edf34b0f P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:57.685868 1906 raft_consensus.cc:1273] T 701cef9d6fd04a99986b871760397f1e P 2441fafe1d62429386f4631ad423567d [term 2 FOLLOWER]: Refusing update from remote peer de831f40fa1348a48a1f0260f4130197: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20250831 19:54:57.685882 1904 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3081636d94084a8aa3905f40edf34b0f" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:57.686350 3295 consensus_queue.cc:1035] T 701cef9d6fd04a99986b871760397f1e P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:57.688604 3311 ts_tablet_manager.cc:1918] T 05cda604dad041cfaad94d1b43d6b14d P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250831 19:54:57.688705 3311 log.cc:1199] T 05cda604dad041cfaad94d1b43d6b14d P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/05cda604dad041cfaad94d1b43d6b14d
I20250831 19:54:57.689110 3311 ts_tablet_manager.cc:1939] T 05cda604dad041cfaad94d1b43d6b14d P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
I20250831 19:54:57.684958 2124 catalog_manager.cc:5674] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475) does not have the latest schema for tablet d56dcc30166043c68c3f1c05e7f7bde0 (table default.table_c7390b7344da4c3fbf7f2f502b096669 [id=1df66f6230794e939a25c0f2254d6e17]). Expected version 2 got 0
I20250831 19:54:57.689766 2105 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet 05cda604dad041cfaad94d1b43d6b14d (table default.table_6c2f9309b58643529114857aae0568f2 [id=ad7bb166843e423ea7e50a1d18710fa1]) successfully deleted
I20250831 19:54:57.690400 2124 catalog_manager.cc:5582] T f42849cccf8a45ed95794eac0e3922e7 P de831f40fa1348a48a1f0260f4130197 reported cstate change: term changed from 0 to 1, leader changed from <none> to de831f40fa1348a48a1f0260f4130197 (127.1.1.194). New cstate: current_term: 1 leader_uuid: "de831f40fa1348a48a1f0260f4130197" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: UNKNOWN } } }
I20250831 19:54:57.692962 1633 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3081636d94084a8aa3905f40edf34b0f" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:54:57.693218 1633 raft_consensus.cc:3058] T 3081636d94084a8aa3905f40edf34b0f P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:57.695173 3311 tablet_replica.cc:331] T c5cfcb0956e44a1c9e64acc4d1ed568c P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:54:57.697430 1633 raft_consensus.cc:2466] T 3081636d94084a8aa3905f40edf34b0f P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:54:57.702044 1903 raft_consensus.cc:2466] T 3081636d94084a8aa3905f40edf34b0f P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:54:57.702384 1706 leader_election.cc:304] T 3081636d94084a8aa3905f40edf34b0f P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:57.702705 3295 raft_consensus.cc:2802] T 3081636d94084a8aa3905f40edf34b0f P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:57.702850 3295 raft_consensus.cc:695] T 3081636d94084a8aa3905f40edf34b0f P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: Becoming Leader. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Running, Role: LEADER
I20250831 19:54:57.702972 3311 raft_consensus.cc:2241] T c5cfcb0956e44a1c9e64acc4d1ed568c P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:57.703145 3295 consensus_queue.cc:237] T 3081636d94084a8aa3905f40edf34b0f P de831f40fa1348a48a1f0260f4130197 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:57.703662 3311 raft_consensus.cc:2270] T c5cfcb0956e44a1c9e64acc4d1ed568c P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:57.704267 3311 ts_tablet_manager.cc:1905] T c5cfcb0956e44a1c9e64acc4d1ed568c P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:57.707808 2123 catalog_manager.cc:2149] created HMS catalog entry for table [id=5b8cc2293fc545e7bedbf645db8dd2ce]
I20250831 19:54:57.707782 1769 raft_consensus.cc:1238] T 701cef9d6fd04a99986b871760397f1e P de831f40fa1348a48a1f0260f4130197 [term 2 LEADER]: Rejecting Update request from peer 89aa85d59c53436ebdf3074b13d14825 for earlier term 1. Current term is 2. Ops: []
I20250831 19:54:57.711920 3018 consensus_queue.cc:1046] T 701cef9d6fd04a99986b871760397f1e P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:57.712216 3018 consensus_queue.cc:1230] T 701cef9d6fd04a99986b871760397f1e P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Peer de831f40fa1348a48a1f0260f4130197 log is divergent from this leader: its last log entry 2.1 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 0
I20250831 19:54:57.712350 3018 raft_consensus.cc:3053] T 701cef9d6fd04a99986b871760397f1e P 89aa85d59c53436ebdf3074b13d14825 [term 1 LEADER]: Stepping down as leader of term 1
I20250831 19:54:57.712445 3018 raft_consensus.cc:738] T 701cef9d6fd04a99986b871760397f1e P 89aa85d59c53436ebdf3074b13d14825 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Running, Role: LEADER
I20250831 19:54:57.712745 3018 consensus_queue.cc:260] T 701cef9d6fd04a99986b871760397f1e P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:57.713105 3018 raft_consensus.cc:3058] T 701cef9d6fd04a99986b871760397f1e P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Advancing to term 2
I20250831 19:54:57.713961 2123 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:36958 (request call id 182) took 1955 ms. Trace:
I20250831 19:54:57.714079 2123 rpcz_store.cc:276] 0831 19:54:55.758629 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:56.463142 (+704513us) service_pool.cc:225] Handling call
0831 19:54:56.946025 (+482883us) catalog_manager.cc:2076] Acquired catalog manager lock
0831 19:54:56.946662 (+ 637us) catalog_manager.cc:2122] Created new table and tablet info
0831 19:54:57.707748 (+761086us) catalog_manager.cc:2148] Created new table in HMS catalog
0831 19:54:57.713720 (+ 5972us) catalog_manager.cc:2182] Wrote table and tablets to system table
0831 19:54:57.713830 (+ 110us) catalog_manager.cc:2216] Inserted table and tablets into CatalogManager maps
0831 19:54:57.713925 (+ 95us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:57.708594 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:57.708754 (+ 160us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:57.708761 (+ 7us) write_op.cc:435] Acquired schema lock
0831 19:54:57.708765 (+ 4us) tablet.cc:660] Decoding operations
0831 19:54:57.708872 (+ 107us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:57.708887 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:57.708893 (+ 6us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:57.708983 (+ 90us) tablet.cc:699] Row locks acquired
0831 19:54:57.708986 (+ 3us) write_op.cc:260] PREPARE: finished
0831 19:54:57.709020 (+ 34us) write_op.cc:270] Start()
0831 19:54:57.709053 (+ 33us) write_op.cc:276] Timestamp: P: 1756670097708975 usec, L: 0
0831 19:54:57.709059 (+ 6us) op_driver.cc:348] REPLICATION: starting
0831 19:54:57.709232 (+ 173us) log.cc:844] Serialized 433 byte log entry
0831 19:54:57.712423 (+ 3191us) op_driver.cc:464] REPLICATION: finished
0831 19:54:57.712542 (+ 119us) write_op.cc:301] APPLY: starting
0831 19:54:57.712572 (+ 30us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:57.712623 (+ 51us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:57.712659 (+ 36us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:57.712782 (+ 123us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:57.712823 (+ 41us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0831 19:54:57.712834 (+ 11us) write_op.cc:312] APPLY: finished
0831 19:54:57.712912 (+ 78us) log.cc:844] Serialized 29 byte log entry
0831 19:54:57.712974 (+ 62us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:57.712994 (+ 20us) write_op.cc:454] Released schema lock
0831 19:54:57.713002 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0831 19:54:57.713073 (+ 71us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:57.713080 (+ 7us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":591680,"Hive Metastore.run_cpu_time_us":289,"Hive Metastore.run_wall_time_us":169024,"child_traces":[["op",{"apply.queue_time_us":68,"apply.run_cpu_time_us":521,"apply.run_wall_time_us":520,"num_ops":2,"prepare.queue_time_us":96,"prepare.run_cpu_time_us":735,"prepare.run_wall_time_us":744,"raft.queue_time_us":416,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":222,"replication_time_us":3331}]]}
I20250831 19:54:57.734879 1749 tablet_service.cc:1468] Processing CreateTablet for tablet c515598ee89b4f1a8839c28c7e7bc0c9 (DEFAULT_TABLE table=default.table_20d403c55682499a9ba3267b85aecde7 [id=5b8cc2293fc545e7bedbf645db8dd2ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:57.735666 3233 consensus_queue.cc:1035] T 5a080bbabe8840c3ba954bdc0626dc39 P 2441fafe1d62429386f4631ad423567d [LEADER]: Connected to new peer: Peer: permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:57.736471 1613 tablet_service.cc:1468] Processing CreateTablet for tablet c515598ee89b4f1a8839c28c7e7bc0c9 (DEFAULT_TABLE table=default.table_20d403c55682499a9ba3267b85aecde7 [id=5b8cc2293fc545e7bedbf645db8dd2ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:57.736858 1613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c515598ee89b4f1a8839c28c7e7bc0c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:57.737016 1749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c515598ee89b4f1a8839c28c7e7bc0c9. 1 dirs total, 0 dirs full, 0 dirs failed
W20250831 19:54:57.743098 1842 consensus_peers.cc:489] T c5cfcb0956e44a1c9e64acc4d1ed568c P 2441fafe1d62429386f4631ad423567d -> Peer de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): Couldn't send request to peer de831f40fa1348a48a1f0260f4130197. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20250831 19:54:57.747203 3177 tablet_bootstrap.cc:492] T c515598ee89b4f1a8839c28c7e7bc0c9 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:57.748768 3177 tablet_bootstrap.cc:654] T c515598ee89b4f1a8839c28c7e7bc0c9 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:57.749629 3178 tablet_bootstrap.cc:492] T c515598ee89b4f1a8839c28c7e7bc0c9 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:57.751336 3178 tablet_bootstrap.cc:654] T c515598ee89b4f1a8839c28c7e7bc0c9 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:57.760610 2124 catalog_manager.cc:5674] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237) does not have the latest schema for tablet d56dcc30166043c68c3f1c05e7f7bde0 (table default.table_c7390b7344da4c3fbf7f2f502b096669 [id=1df66f6230794e939a25c0f2254d6e17]). Expected version 2 got 0
I20250831 19:54:57.763236 3312 ts_tablet_manager.cc:1918] T 05cda604dad041cfaad94d1b43d6b14d P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250831 19:54:57.763404 3312 log.cc:1199] T 05cda604dad041cfaad94d1b43d6b14d P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/05cda604dad041cfaad94d1b43d6b14d
I20250831 19:54:57.763897 3312 ts_tablet_manager.cc:1939] T 05cda604dad041cfaad94d1b43d6b14d P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
I20250831 19:54:57.764374 3312 tablet_replica.cc:331] T c5cfcb0956e44a1c9e64acc4d1ed568c P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:54:57.764650 3312 raft_consensus.cc:2241] T c5cfcb0956e44a1c9e64acc4d1ed568c P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:57.764880 3312 raft_consensus.cc:2270] T c5cfcb0956e44a1c9e64acc4d1ed568c P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:57.765152 3177 tablet_bootstrap.cc:492] T c515598ee89b4f1a8839c28c7e7bc0c9 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:57.765282 3177 ts_tablet_manager.cc:1397] T c515598ee89b4f1a8839c28c7e7bc0c9 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.018s user 0.007s sys 0.002s
I20250831 19:54:57.765607 3312 ts_tablet_manager.cc:1905] T c5cfcb0956e44a1c9e64acc4d1ed568c P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:57.766042 3177 raft_consensus.cc:357] T c515598ee89b4f1a8839c28c7e7bc0c9 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:57.766244 3177 raft_consensus.cc:383] T c515598ee89b4f1a8839c28c7e7bc0c9 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:57.766359 3177 raft_consensus.cc:738] T c515598ee89b4f1a8839c28c7e7bc0c9 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:57.766575 3177 consensus_queue.cc:260] T c515598ee89b4f1a8839c28c7e7bc0c9 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:57.767134 3177 ts_tablet_manager.cc:1428] T c515598ee89b4f1a8839c28c7e7bc0c9 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250831 19:54:57.765978 2104 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet 05cda604dad041cfaad94d1b43d6b14d (table default.table_6c2f9309b58643529114857aae0568f2 [id=ad7bb166843e423ea7e50a1d18710fa1]) successfully deleted
I20250831 19:54:57.783243 2123 catalog_manager.cc:5582] T 3081636d94084a8aa3905f40edf34b0f P de831f40fa1348a48a1f0260f4130197 reported cstate change: term changed from 0 to 1, leader changed from <none> to de831f40fa1348a48a1f0260f4130197 (127.1.1.194). New cstate: current_term: 1 leader_uuid: "de831f40fa1348a48a1f0260f4130197" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: UNKNOWN } } }
I20250831 19:54:57.784528 3233 consensus_queue.cc:1035] T f7a7fad8a2ca4da297070dd3b49bc2d8 P 2441fafe1d62429386f4631ad423567d [LEADER]: Connected to new peer: Peer: permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:57.787567 3330 tablet.cc:1722] T 7afc8e9259a548fe946265ea513fde2f P de831f40fa1348a48a1f0260f4130197: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:57.789438 2124 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36958:
name: "default.Table_4c0155db27d445829ea2e453cd3ad0f3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:57.789880 3331 tablet.cc:1722] T 7afc8e9259a548fe946265ea513fde2f P 89aa85d59c53436ebdf3074b13d14825: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:57.794124 3311 ts_tablet_manager.cc:1918] T c5cfcb0956e44a1c9e64acc4d1ed568c P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:57.795030 3310 ts_tablet_manager.cc:1918] T 05cda604dad041cfaad94d1b43d6b14d P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250831 19:54:57.795186 3310 log.cc:1199] T 05cda604dad041cfaad94d1b43d6b14d P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/05cda604dad041cfaad94d1b43d6b14d
I20250831 19:54:57.795658 3310 ts_tablet_manager.cc:1939] T 05cda604dad041cfaad94d1b43d6b14d P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:54:57.796144 3310 tablet_replica.cc:331] T c5cfcb0956e44a1c9e64acc4d1ed568c P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:54:57.797384 2123 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_265519e91af542d1836f224e15cd5e60" } modify_external_catalogs: true
I20250831 19:54:57.797678 2123 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_265519e91af542d1836f224e15cd5e60" } modify_external_catalogs: true
I20250831 19:54:57.799093 3018 raft_consensus.cc:491] T eb97839972ba4bda89287c30da49bb40 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:57.799259 3018 raft_consensus.cc:513] T eb97839972ba4bda89287c30da49bb40 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:57.799633 3310 raft_consensus.cc:2241] T c5cfcb0956e44a1c9e64acc4d1ed568c P 2441fafe1d62429386f4631ad423567d [term 1 LEADER]: Raft consensus shutting down.
I20250831 19:54:57.799851 3018 leader_election.cc:290] T eb97839972ba4bda89287c30da49bb40 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:57.799930 3310 raft_consensus.cc:2270] T c5cfcb0956e44a1c9e64acc4d1ed568c P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:57.800341 3311 log.cc:1199] T c5cfcb0956e44a1c9e64acc4d1ed568c P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/c5cfcb0956e44a1c9e64acc4d1ed568c
I20250831 19:54:57.800532 3310 ts_tablet_manager.cc:1905] T c5cfcb0956e44a1c9e64acc4d1ed568c P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:57.800822 3311 ts_tablet_manager.cc:1939] T c5cfcb0956e44a1c9e64acc4d1ed568c P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
I20250831 19:54:57.801354 2105 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet c5cfcb0956e44a1c9e64acc4d1ed568c (table default.table_82715a1a3cf44ab586f6ab0f19723f2b [id=79e1655e710d4e6ebb6a25f871ba8eeb]) successfully deleted
I20250831 19:54:57.811645 1902 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "eb97839972ba4bda89287c30da49bb40" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:57.811936 1902 raft_consensus.cc:2466] T eb97839972ba4bda89287c30da49bb40 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 0.
I20250831 19:54:57.812290 1768 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "eb97839972ba4bda89287c30da49bb40" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:57.812541 1768 raft_consensus.cc:2466] T eb97839972ba4bda89287c30da49bb40 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 0.
I20250831 19:54:57.813409 1570 leader_election.cc:304] T eb97839972ba4bda89287c30da49bb40 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:57.813740 3018 raft_consensus.cc:2802] T eb97839972ba4bda89287c30da49bb40 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:57.813829 3018 raft_consensus.cc:491] T eb97839972ba4bda89287c30da49bb40 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:57.813943 3018 raft_consensus.cc:3058] T eb97839972ba4bda89287c30da49bb40 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:57.816763 3018 raft_consensus.cc:513] T eb97839972ba4bda89287c30da49bb40 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:57.817472 3018 leader_election.cc:290] T eb97839972ba4bda89287c30da49bb40 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Requested vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:57.817989 1768 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "eb97839972ba4bda89287c30da49bb40" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197"
I20250831 19:54:57.818200 1768 raft_consensus.cc:3058] T eb97839972ba4bda89287c30da49bb40 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:57.819473 1902 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "eb97839972ba4bda89287c30da49bb40" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:54:57.819700 1902 raft_consensus.cc:3058] T eb97839972ba4bda89287c30da49bb40 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:57.820461 3233 consensus_queue.cc:1035] T f7a7fad8a2ca4da297070dd3b49bc2d8 P 2441fafe1d62429386f4631ad423567d [LEADER]: Connected to new peer: Peer: permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250831 19:54:57.823015 1902 raft_consensus.cc:2466] T eb97839972ba4bda89287c30da49bb40 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1.
I20250831 19:54:57.824669 1768 raft_consensus.cc:2466] T eb97839972ba4bda89287c30da49bb40 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1.
I20250831 19:54:57.825270 1570 leader_election.cc:304] T eb97839972ba4bda89287c30da49bb40 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:57.825606 3081 raft_consensus.cc:2802] T eb97839972ba4bda89287c30da49bb40 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:57.825734 3081 raft_consensus.cc:695] T eb97839972ba4bda89287c30da49bb40 P 89aa85d59c53436ebdf3074b13d14825 [term 1 LEADER]: Becoming Leader. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Running, Role: LEADER
I20250831 19:54:57.825830 1633 raft_consensus.cc:1273] T 701cef9d6fd04a99986b871760397f1e P 89aa85d59c53436ebdf3074b13d14825 [term 2 FOLLOWER]: Refusing update from remote peer de831f40fa1348a48a1f0260f4130197: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20250831 19:54:57.825971 1633 pending_rounds.cc:85] T 701cef9d6fd04a99986b871760397f1e P 89aa85d59c53436ebdf3074b13d14825: Aborting all ops after (but not including) 0
I20250831 19:54:57.826013 3081 consensus_queue.cc:237] T eb97839972ba4bda89287c30da49bb40 P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:57.826074 1633 pending_rounds.cc:107] T 701cef9d6fd04a99986b871760397f1e P 89aa85d59c53436ebdf3074b13d14825: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20250831 19:54:57.826205 1633 raft_consensus.cc:2887] T 701cef9d6fd04a99986b871760397f1e P 89aa85d59c53436ebdf3074b13d14825 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20250831 19:54:57.837786 2778 consensus_queue.cc:1035] T 701cef9d6fd04a99986b871760397f1e P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:57.842286 2117 catalog_manager.cc:2706] deleted HMS catalog entry for table default.table_62a803bf234d4af29aa61db8fba3d765 [id=3ce07674f6334eb0a2a5fe731a620e25]
I20250831 19:54:57.850791 3178 tablet_bootstrap.cc:492] T c515598ee89b4f1a8839c28c7e7bc0c9 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:57.857302 3333 tablet.cc:1722] T 7afc8e9259a548fe946265ea513fde2f P 2441fafe1d62429386f4631ad423567d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:57.857621 3178 ts_tablet_manager.cc:1397] T c515598ee89b4f1a8839c28c7e7bc0c9 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.108s user 0.007s sys 0.004s
I20250831 19:54:57.858526 3178 raft_consensus.cc:357] T c515598ee89b4f1a8839c28c7e7bc0c9 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:57.858944 2101 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet 05cda604dad041cfaad94d1b43d6b14d (table default.table_6c2f9309b58643529114857aae0568f2 [id=ad7bb166843e423ea7e50a1d18710fa1]) successfully deleted
I20250831 19:54:57.859506 1883 tablet_service.cc:1468] Processing CreateTablet for tablet c515598ee89b4f1a8839c28c7e7bc0c9 (DEFAULT_TABLE table=default.table_20d403c55682499a9ba3267b85aecde7 [id=5b8cc2293fc545e7bedbf645db8dd2ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:57.859923 1883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c515598ee89b4f1a8839c28c7e7bc0c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:57.862334 3178 raft_consensus.cc:383] T c515598ee89b4f1a8839c28c7e7bc0c9 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:57.862444 3178 raft_consensus.cc:738] T c515598ee89b4f1a8839c28c7e7bc0c9 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:57.862680 3178 consensus_queue.cc:260] T c515598ee89b4f1a8839c28c7e7bc0c9 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:57.863201 3178 ts_tablet_manager.cc:1428] T c515598ee89b4f1a8839c28c7e7bc0c9 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20250831 19:54:57.866951 2699 tablet_bootstrap.cc:492] T c515598ee89b4f1a8839c28c7e7bc0c9 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:57.868539 2699 tablet_bootstrap.cc:654] T c515598ee89b4f1a8839c28c7e7bc0c9 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:57.871102 3310 ts_tablet_manager.cc:1918] T c5cfcb0956e44a1c9e64acc4d1ed568c P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:57.871284 3310 log.cc:1199] T c5cfcb0956e44a1c9e64acc4d1ed568c P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/c5cfcb0956e44a1c9e64acc4d1ed568c
I20250831 19:54:57.871727 3310 ts_tablet_manager.cc:1939] T c5cfcb0956e44a1c9e64acc4d1ed568c P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:54:57.856128 3312 ts_tablet_manager.cc:1918] T c5cfcb0956e44a1c9e64acc4d1ed568c P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:57.872288 3312 log.cc:1199] T c5cfcb0956e44a1c9e64acc4d1ed568c P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/c5cfcb0956e44a1c9e64acc4d1ed568c
I20250831 19:54:57.872768 3312 ts_tablet_manager.cc:1939] T c5cfcb0956e44a1c9e64acc4d1ed568c P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
I20250831 19:54:57.873801 2101 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet c5cfcb0956e44a1c9e64acc4d1ed568c (table default.table_82715a1a3cf44ab586f6ab0f19723f2b [id=79e1655e710d4e6ebb6a25f871ba8eeb]) successfully deleted
I20250831 19:54:57.874102 2104 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet c5cfcb0956e44a1c9e64acc4d1ed568c (table default.table_82715a1a3cf44ab586f6ab0f19723f2b [id=79e1655e710d4e6ebb6a25f871ba8eeb]) successfully deleted
I20250831 19:54:57.874334 3323 raft_consensus.cc:491] T dc6c1d165b5a484ab98ac55cd2330139 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:57.874516 3323 raft_consensus.cc:513] T dc6c1d165b5a484ab98ac55cd2330139 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:57.875483 1772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "dc6c1d165b5a484ab98ac55cd2330139" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:57.875538 1631 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "dc6c1d165b5a484ab98ac55cd2330139" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:57.875696 1631 raft_consensus.cc:2466] T dc6c1d165b5a484ab98ac55cd2330139 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 0.
I20250831 19:54:57.875711 1772 raft_consensus.cc:2466] T dc6c1d165b5a484ab98ac55cd2330139 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 0.
I20250831 19:54:57.876048 1841 leader_election.cc:304] T dc6c1d165b5a484ab98ac55cd2330139 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:54:57.876394 3323 leader_election.cc:290] T dc6c1d165b5a484ab98ac55cd2330139 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:57.876681 3323 raft_consensus.cc:2802] T dc6c1d165b5a484ab98ac55cd2330139 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:57.876811 3323 raft_consensus.cc:491] T dc6c1d165b5a484ab98ac55cd2330139 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:57.876925 3323 raft_consensus.cc:3058] T dc6c1d165b5a484ab98ac55cd2330139 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:57.884635 3323 raft_consensus.cc:513] T dc6c1d165b5a484ab98ac55cd2330139 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:57.889861 1633 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "dc6c1d165b5a484ab98ac55cd2330139" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:54:57.890092 1633 raft_consensus.cc:3058] T dc6c1d165b5a484ab98ac55cd2330139 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:57.890781 1772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "dc6c1d165b5a484ab98ac55cd2330139" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197"
I20250831 19:54:57.891007 1772 raft_consensus.cc:3058] T dc6c1d165b5a484ab98ac55cd2330139 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:57.890615 3323 leader_election.cc:290] T dc6c1d165b5a484ab98ac55cd2330139 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 election: Requested vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:57.893312 1772 raft_consensus.cc:2466] T dc6c1d165b5a484ab98ac55cd2330139 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 1.
I20250831 19:54:57.898701 2699 tablet_bootstrap.cc:492] T c515598ee89b4f1a8839c28c7e7bc0c9 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:57.898857 2699 ts_tablet_manager.cc:1397] T c515598ee89b4f1a8839c28c7e7bc0c9 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.032s user 0.006s sys 0.006s
I20250831 19:54:57.899936 2699 raft_consensus.cc:357] T c515598ee89b4f1a8839c28c7e7bc0c9 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:57.900121 2699 raft_consensus.cc:383] T c515598ee89b4f1a8839c28c7e7bc0c9 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:57.900192 2699 raft_consensus.cc:738] T c515598ee89b4f1a8839c28c7e7bc0c9 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:57.900398 2699 consensus_queue.cc:260] T c515598ee89b4f1a8839c28c7e7bc0c9 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:57.900947 2699 ts_tablet_manager.cc:1428] T c515598ee89b4f1a8839c28c7e7bc0c9 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250831 19:54:57.907088 1842 leader_election.cc:304] T dc6c1d165b5a484ab98ac55cd2330139 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:57.910712 3323 raft_consensus.cc:2802] T dc6c1d165b5a484ab98ac55cd2330139 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:57.910880 3323 raft_consensus.cc:695] T dc6c1d165b5a484ab98ac55cd2330139 P 2441fafe1d62429386f4631ad423567d [term 1 LEADER]: Becoming Leader. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Running, Role: LEADER
I20250831 19:54:57.911144 3323 consensus_queue.cc:237] T dc6c1d165b5a484ab98ac55cd2330139 P 2441fafe1d62429386f4631ad423567d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:57.915683 1633 raft_consensus.cc:2466] T dc6c1d165b5a484ab98ac55cd2330139 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 1.
I20250831 19:54:57.987792 2119 catalog_manager.cc:2706] deleted HMS catalog entry for table default.table_56778a4f18cc4ab29dfda4ed17259cc5 [id=7d61ab3e027645ebb701e9f5c60c659e]
I20250831 19:54:58.113358 2118 catalog_manager.cc:3460] renamed table default.table_c714288d42d74e799fc5e0c60cb920fa [id=aabaa79336954b3ab0450dcff3afa7bf] in HMS: new name default.table_1dd756d1d1c14b878105f242f44b087e
I20250831 19:54:58.117997 2186 catalog_manager.cc:2747] Deleting table default.table_62a803bf234d4af29aa61db8fba3d765 [id=3ce07674f6334eb0a2a5fe731a620e25] in response to Hive Metastore notification log event 162
I20250831 19:54:58.129071 2186 catalog_manager.cc:5869] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Sending DeleteTablet for 3 replicas of tablet 65026496c5b14baab6f66dce4a6d0fc2
I20250831 19:54:58.130342 2186 catalog_manager.cc:2747] Deleting table default.table_56778a4f18cc4ab29dfda4ed17259cc5 [id=7d61ab3e027645ebb701e9f5c60c659e] in response to Hive Metastore notification log event 163
I20250831 19:54:58.135330 1749 tablet_service.cc:1515] Processing DeleteTablet for tablet 65026496c5b14baab6f66dce4a6d0fc2 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:58 UTC) from {username='slave'} at 127.0.0.1:50674
I20250831 19:54:58.135589 3311 tablet_replica.cc:331] T 65026496c5b14baab6f66dce4a6d0fc2 P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:54:58.135768 3311 raft_consensus.cc:2241] T 65026496c5b14baab6f66dce4a6d0fc2 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:58.135951 3311 raft_consensus.cc:2270] T 65026496c5b14baab6f66dce4a6d0fc2 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:58.136449 3311 ts_tablet_manager.cc:1905] T 65026496c5b14baab6f66dce4a6d0fc2 P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:58.142560 1883 tablet_service.cc:1515] Processing DeleteTablet for tablet 65026496c5b14baab6f66dce4a6d0fc2 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:58 UTC) from {username='slave'} at 127.0.0.1:45906
I20250831 19:54:58.142844 3310 tablet_replica.cc:331] T 65026496c5b14baab6f66dce4a6d0fc2 P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:54:58.143021 3310 raft_consensus.cc:2241] T 65026496c5b14baab6f66dce4a6d0fc2 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:58.143203 3310 raft_consensus.cc:2270] T 65026496c5b14baab6f66dce4a6d0fc2 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:58.143740 3310 ts_tablet_manager.cc:1905] T 65026496c5b14baab6f66dce4a6d0fc2 P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:58.147585 1613 tablet_service.cc:1515] Processing DeleteTablet for tablet 65026496c5b14baab6f66dce4a6d0fc2 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:58 UTC) from {username='slave'} at 127.0.0.1:51022
I20250831 19:54:58.147895 3312 tablet_replica.cc:331] T 65026496c5b14baab6f66dce4a6d0fc2 P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:54:58.148074 3312 raft_consensus.cc:2241] T 65026496c5b14baab6f66dce4a6d0fc2 P 89aa85d59c53436ebdf3074b13d14825 [term 1 LEADER]: Raft consensus shutting down.
I20250831 19:54:58.148394 3312 raft_consensus.cc:2270] T 65026496c5b14baab6f66dce4a6d0fc2 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:58.148926 3312 ts_tablet_manager.cc:1905] T 65026496c5b14baab6f66dce4a6d0fc2 P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:58.151402 3310 ts_tablet_manager.cc:1918] T 65026496c5b14baab6f66dce4a6d0fc2 P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:58.151553 3310 log.cc:1199] T 65026496c5b14baab6f66dce4a6d0fc2 P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/65026496c5b14baab6f66dce4a6d0fc2
I20250831 19:54:58.152155 3310 ts_tablet_manager.cc:1939] T 65026496c5b14baab6f66dce4a6d0fc2 P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:54:58.153569 2101 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet 65026496c5b14baab6f66dce4a6d0fc2 (table default.table_62a803bf234d4af29aa61db8fba3d765 [id=3ce07674f6334eb0a2a5fe731a620e25]) successfully deleted
I20250831 19:54:58.154760 2186 catalog_manager.cc:5869] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Sending DeleteTablet for 3 replicas of tablet 172f71a8fe554a5b8bfdb2a5bc109abc
I20250831 19:54:58.156880 1883 tablet_service.cc:1515] Processing DeleteTablet for tablet 172f71a8fe554a5b8bfdb2a5bc109abc with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:58 UTC) from {username='slave'} at 127.0.0.1:45906
I20250831 19:54:58.156978 1749 tablet_service.cc:1515] Processing DeleteTablet for tablet 172f71a8fe554a5b8bfdb2a5bc109abc with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:58 UTC) from {username='slave'} at 127.0.0.1:50674
I20250831 19:54:58.157119 3310 tablet_replica.cc:331] T 172f71a8fe554a5b8bfdb2a5bc109abc P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:54:58.157677 3310 raft_consensus.cc:2241] T 172f71a8fe554a5b8bfdb2a5bc109abc P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:58.157724 1613 tablet_service.cc:1515] Processing DeleteTablet for tablet 172f71a8fe554a5b8bfdb2a5bc109abc with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:58 UTC) from {username='slave'} at 127.0.0.1:51022
I20250831 19:54:58.157945 3310 raft_consensus.cc:2270] T 172f71a8fe554a5b8bfdb2a5bc109abc P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:58.158703 3310 ts_tablet_manager.cc:1905] T 172f71a8fe554a5b8bfdb2a5bc109abc P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:58.166721 3311 ts_tablet_manager.cc:1918] T 65026496c5b14baab6f66dce4a6d0fc2 P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:58.166904 3311 log.cc:1199] T 65026496c5b14baab6f66dce4a6d0fc2 P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/65026496c5b14baab6f66dce4a6d0fc2
I20250831 19:54:58.167160 3312 ts_tablet_manager.cc:1918] T 65026496c5b14baab6f66dce4a6d0fc2 P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:58.167215 3310 ts_tablet_manager.cc:1918] T 172f71a8fe554a5b8bfdb2a5bc109abc P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:58.167438 3310 log.cc:1199] T 172f71a8fe554a5b8bfdb2a5bc109abc P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/172f71a8fe554a5b8bfdb2a5bc109abc
I20250831 19:54:58.167629 3312 log.cc:1199] T 65026496c5b14baab6f66dce4a6d0fc2 P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/65026496c5b14baab6f66dce4a6d0fc2
I20250831 19:54:58.167867 3311 ts_tablet_manager.cc:1939] T 65026496c5b14baab6f66dce4a6d0fc2 P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
I20250831 19:54:58.168061 3310 ts_tablet_manager.cc:1939] T 172f71a8fe554a5b8bfdb2a5bc109abc P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:54:58.169112 2105 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet 65026496c5b14baab6f66dce4a6d0fc2 (table default.table_62a803bf234d4af29aa61db8fba3d765 [id=3ce07674f6334eb0a2a5fe731a620e25]) successfully deleted
I20250831 19:54:58.169236 2101 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet 172f71a8fe554a5b8bfdb2a5bc109abc (table default.table_56778a4f18cc4ab29dfda4ed17259cc5 [id=7d61ab3e027645ebb701e9f5c60c659e]) successfully deleted
I20250831 19:54:58.169690 3312 ts_tablet_manager.cc:1939] T 65026496c5b14baab6f66dce4a6d0fc2 P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
I20250831 19:54:58.170646 3311 tablet_replica.cc:331] T 172f71a8fe554a5b8bfdb2a5bc109abc P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:54:58.170655 2104 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet 65026496c5b14baab6f66dce4a6d0fc2 (table default.table_62a803bf234d4af29aa61db8fba3d765 [id=3ce07674f6334eb0a2a5fe731a620e25]) successfully deleted
I20250831 19:54:58.170858 3311 raft_consensus.cc:2241] T 172f71a8fe554a5b8bfdb2a5bc109abc P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: Raft consensus shutting down.
I20250831 19:54:58.170876 3312 tablet_replica.cc:331] T 172f71a8fe554a5b8bfdb2a5bc109abc P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:54:58.171072 3312 raft_consensus.cc:2241] T 172f71a8fe554a5b8bfdb2a5bc109abc P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:58.171121 3311 raft_consensus.cc:2270] T 172f71a8fe554a5b8bfdb2a5bc109abc P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:58.171231 3312 raft_consensus.cc:2270] T 172f71a8fe554a5b8bfdb2a5bc109abc P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:58.171572 3311 ts_tablet_manager.cc:1905] T 172f71a8fe554a5b8bfdb2a5bc109abc P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:58.171710 3312 ts_tablet_manager.cc:1905] T 172f71a8fe554a5b8bfdb2a5bc109abc P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:58.173225 2778 raft_consensus.cc:491] T c515598ee89b4f1a8839c28c7e7bc0c9 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:58.173358 2778 raft_consensus.cc:513] T c515598ee89b4f1a8839c28c7e7bc0c9 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:58.173931 2778 leader_election.cc:290] T c515598ee89b4f1a8839c28c7e7bc0c9 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:58.174922 1633 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c515598ee89b4f1a8839c28c7e7bc0c9" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:58.175089 1633 raft_consensus.cc:2466] T c515598ee89b4f1a8839c28c7e7bc0c9 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 0.
I20250831 19:54:58.176180 1906 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c515598ee89b4f1a8839c28c7e7bc0c9" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:58.176331 1906 raft_consensus.cc:2466] T c515598ee89b4f1a8839c28c7e7bc0c9 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 0.
I20250831 19:54:58.176666 1705 leader_election.cc:304] T c515598ee89b4f1a8839c28c7e7bc0c9 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:58.176810 3311 ts_tablet_manager.cc:1918] T 172f71a8fe554a5b8bfdb2a5bc109abc P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:58.176877 2943 raft_consensus.cc:2802] T c515598ee89b4f1a8839c28c7e7bc0c9 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:58.176901 3311 log.cc:1199] T 172f71a8fe554a5b8bfdb2a5bc109abc P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/172f71a8fe554a5b8bfdb2a5bc109abc
I20250831 19:54:58.176929 2943 raft_consensus.cc:491] T c515598ee89b4f1a8839c28c7e7bc0c9 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:58.176993 2943 raft_consensus.cc:3058] T c515598ee89b4f1a8839c28c7e7bc0c9 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:58.177201 3311 ts_tablet_manager.cc:1939] T 172f71a8fe554a5b8bfdb2a5bc109abc P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
I20250831 19:54:58.178107 2105 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet 172f71a8fe554a5b8bfdb2a5bc109abc (table default.table_56778a4f18cc4ab29dfda4ed17259cc5 [id=7d61ab3e027645ebb701e9f5c60c659e]) successfully deleted
I20250831 19:54:58.179144 2943 raft_consensus.cc:513] T c515598ee89b4f1a8839c28c7e7bc0c9 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:58.179723 2943 leader_election.cc:290] T c515598ee89b4f1a8839c28c7e7bc0c9 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Requested vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:58.180884 1633 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c515598ee89b4f1a8839c28c7e7bc0c9" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:54:58.181074 1633 raft_consensus.cc:3058] T c515598ee89b4f1a8839c28c7e7bc0c9 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:58.181397 3323 consensus_queue.cc:1035] T 6952ee3fe766450993142c673d9509e8 P 2441fafe1d62429386f4631ad423567d [LEADER]: Connected to new peer: Peer: permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:58.182878 2121 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:36958 (request call id 177) took 2711 ms. Trace:
I20250831 19:54:58.182996 2121 rpcz_store.cc:276] 0831 19:54:55.471346 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:56.213176 (+741830us) service_pool.cc:225] Handling call
0831 19:54:56.477966 (+264790us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:58.182818 (+1704852us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":692760,"Hive Metastore.run_cpu_time_us":178,"Hive Metastore.run_wall_time_us":234905}
I20250831 19:54:58.183879 3312 ts_tablet_manager.cc:1918] T 172f71a8fe554a5b8bfdb2a5bc109abc P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:58.184545 2122 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:36958 (request call id 176) took 2713 ms. Trace:
I20250831 19:54:58.184631 2125 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:36958 (request call id 178) took 2697 ms. Trace:
I20250831 19:54:58.184665 2122 rpcz_store.cc:276] 0831 19:54:55.471269 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:56.212007 (+740738us) service_pool.cc:225] Handling call
0831 19:54:56.477792 (+265785us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:58.184034 (+1706242us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:58.184272 (+ 238us) catalog_manager.cc:3683] Apply alter schema
0831 19:54:58.184490 (+ 218us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":420981,"Hive Metastore.run_cpu_time_us":584,"Hive Metastore.run_wall_time_us":271870}
I20250831 19:54:58.184751 2125 rpcz_store.cc:276] 0831 19:54:55.487256 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:56.222937 (+735681us) service_pool.cc:225] Handling call
0831 19:54:56.307927 (+ 84990us) spinlock_profiling.cc:243] Waited 84.7 ms on lock 0x616000040c54. stack: 00007f1e3b0dc7d6 00007f1e3b0dc590 00007f1e3a0cf3ad 0000000000972d94 0000000000972d5d 00007f1e49ea714d 00007f1e49ea7243 00007f1e46b66941 00007f1e4e6f1a5d 00007f1e4e87be86 00007f1e456b4466 00007f1e456b4195 00007f1e41e8a2ce 00007f1e41e891ae 00007f1e41e8f3e5 00007f1e41e8fd0f
0831 19:54:56.478111 (+170184us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:58.184584 (+1706473us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":927586,"Hive Metastore.run_cpu_time_us":193,"Hive Metastore.run_wall_time_us":126162,"spinlock_wait_cycles":194815360}
I20250831 19:54:58.185961 2121 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_b90139c92a0d426db7ba39ca376bd8e2" } new_table_name: "default.Table_b63fcfe30c4b42e4aab0afa9159eff8b" modify_external_catalogs: true
I20250831 19:54:58.187289 2125 catalog_manager.cc:5582] T d56dcc30166043c68c3f1c05e7f7bde0 P 2441fafe1d62429386f4631ad423567d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2441fafe1d62429386f4631ad423567d (127.1.1.195). New cstate: current_term: 1 leader_uuid: "2441fafe1d62429386f4631ad423567d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: UNKNOWN } } }
I20250831 19:54:58.187681 2125 catalog_manager.cc:5674] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237) does not have the latest schema for tablet d56dcc30166043c68c3f1c05e7f7bde0 (table default.table_c7390b7344da4c3fbf7f2f502b096669 [id=1df66f6230794e939a25c0f2254d6e17]). Expected version 2 got 0
W20250831 19:54:58.191128 2120 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_dbeae8f9a2c34da78b7e284664c00cd1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250831 19:54:58.193274 1906 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c515598ee89b4f1a8839c28c7e7bc0c9" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:54:58.193430 1906 raft_consensus.cc:3058] T c515598ee89b4f1a8839c28c7e7bc0c9 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:58.195798 1906 raft_consensus.cc:2466] T c515598ee89b4f1a8839c28c7e7bc0c9 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:54:58.198593 1705 leader_election.cc:304] T c515598ee89b4f1a8839c28c7e7bc0c9 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:58.198689 2122 catalog_manager.cc:6127] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: default.table_bced9a3b747a4c33b6fc5b05b2a4dd89 [id=2b57fa1ef98f4029bc75e981255c74da] alter complete (version 1)
I20250831 19:54:58.200023 1680 heartbeater.cc:344] Connected to a master server at 127.1.1.254:34259
I20250831 19:54:58.204185 2125 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36958:
name: "default.Table_30272e2642084b1390e459c21c0bee62"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:58.205302 2122 master_service.cc:948] ReplaceTablet: received request to replace tablet 05cda604dad041cfaad94d1b43d6b14d from {username='slave'} at 127.0.0.1:36958
I20250831 19:54:58.205881 2122 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:36958 (request call id 193) took 1709 ms. Trace:
I20250831 19:54:58.206396 2122 rpcz_store.cc:276] 0831 19:54:56.496332 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:58.205240 (+1708908us) service_pool.cc:225] Handling call
0831 19:54:58.205832 (+ 592us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250831 19:54:58.207484 2122 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36958:
name: "default.Table_fec0d0e06479419886c036a37df0cfdf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:58.213864 2943 raft_consensus.cc:2802] T c515598ee89b4f1a8839c28c7e7bc0c9 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:58.213995 2943 raft_consensus.cc:695] T c515598ee89b4f1a8839c28c7e7bc0c9 P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: Becoming Leader. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Running, Role: LEADER
I20250831 19:54:58.214219 2943 consensus_queue.cc:237] T c515598ee89b4f1a8839c28c7e7bc0c9 P de831f40fa1348a48a1f0260f4130197 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:58.217093 1633 raft_consensus.cc:2466] T c515598ee89b4f1a8839c28c7e7bc0c9 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:54:58.257109 3275 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3: Bootstrap replayed 1/1 log segments. Stats: ops{read=277 overwritten=0 applied=276 ignored=0} inserts{seen=184 ignored=0} mutations{seen=244 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20250831 19:54:58.257964 3275 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3: Bootstrap complete.
I20250831 19:54:58.260711 3333 tablet.cc:1722] T 7a217324e97b43e5a7ec540e3b9f70a5 P 2441fafe1d62429386f4631ad423567d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250831 19:54:58.265197 3312 log.cc:1199] T 172f71a8fe554a5b8bfdb2a5bc109abc P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/172f71a8fe554a5b8bfdb2a5bc109abc
I20250831 19:54:58.265136 3275 raft_consensus.cc:357] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [term 3 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } }
I20250831 19:54:58.266203 3312 ts_tablet_manager.cc:1939] T 172f71a8fe554a5b8bfdb2a5bc109abc P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
I20250831 19:54:58.269135 2104 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet 172f71a8fe554a5b8bfdb2a5bc109abc (table default.table_56778a4f18cc4ab29dfda4ed17259cc5 [id=7d61ab3e027645ebb701e9f5c60c659e]) successfully deleted
I20250831 19:54:58.269588 3331 tablet.cc:1722] T 7a217324e97b43e5a7ec540e3b9f70a5 P 89aa85d59c53436ebdf3074b13d14825: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250831 19:54:58.276578 3323 consensus_queue.cc:1035] T 6952ee3fe766450993142c673d9509e8 P 2441fafe1d62429386f4631ad423567d [LEADER]: Connected to new peer: Peer: permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:58.282912 3295 consensus_queue.cc:1035] T 876f49b43408443da6a867c03df891b9 P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:58.287488 2778 consensus_queue.cc:1035] T f42849cccf8a45ed95794eac0e3922e7 P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:58.291904 2778 consensus_queue.cc:1035] T 876f49b43408443da6a867c03df891b9 P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:58.378119 3295 consensus_queue.cc:1035] T f42849cccf8a45ed95794eac0e3922e7 P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:58.387723 1818 heartbeater.cc:344] Connected to a master server at 127.1.1.254:34259
I20250831 19:54:58.400663 3081 consensus_queue.cc:1035] T c47f69c5eeda4044b5c0f796375c013b P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:58.402783 2126 catalog_manager.cc:3460] renamed table default.table_486ee0377a714038aaf8f3f5b1ad7f79 [id=028e873d141c4006aca7d45be88d9ae3] in HMS: new name default.table_1d644a2c8bd54f89964228704cd693e6
I20250831 19:54:58.406257 3356 tablet.cc:1722] T 7a217324e97b43e5a7ec540e3b9f70a5 P de831f40fa1348a48a1f0260f4130197: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250831 19:54:58.413883 3275 raft_consensus.cc:738] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c830f6055d64a3b8a9f78b405ad8aa3, State: Initialized, Role: FOLLOWER
I20250831 19:54:58.414800 3275 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 276, Last appended: 3.277, Last appended by leader: 277, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } }
I20250831 19:54:58.425217 3358 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } } }
I20250831 19:54:58.425505 3358 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [sys.catalog]: This master's current role is: FOLLOWER
I20250831 19:54:58.427297 3275 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [sys.catalog]: configured and running, proceeding with master startup.
I20250831 19:54:58.433275 3081 consensus_queue.cc:1035] T c47f69c5eeda4044b5c0f796375c013b P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:58.434892 3215 raft_consensus.cc:1215] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [term 3 FOLLOWER]: Deduplicated request from leader. Original: 3.276->[3.277-3.453] Dedup: 3.277->[3.278-3.453]
I20250831 19:54:58.441478 2120 catalog_manager.cc:2149] created HMS catalog entry for table [id=1aaaa30dc3cd4d8497bc2a18ab02ec3d]
W20250831 19:54:58.446103 2124 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_4c0155db27d445829ea2e453cd3ad0f3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250831 19:54:58.446372 2117 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:36958 (request call id 183) took 2181 ms. Trace:
I20250831 19:54:58.446497 2117 rpcz_store.cc:276] 0831 19:54:56.264485 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:56.533644 (+269159us) service_pool.cc:225] Handling call
0831 19:54:57.583984 (+1050340us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:58.446297 (+862313us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":123384,"Hive Metastore.run_cpu_time_us":233,"Hive Metastore.run_wall_time_us":134554}
I20250831 19:54:58.449539 2119 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:36958 (request call id 184) took 2170 ms. Trace:
I20250831 19:54:58.449677 2119 rpcz_store.cc:276] 0831 19:54:56.278964 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:56.613924 (+334960us) service_pool.cc:225] Handling call
0831 19:54:57.584271 (+970347us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:58.449492 (+865221us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":257750,"Hive Metastore.run_cpu_time_us":185,"Hive Metastore.run_wall_time_us":145412}
I20250831 19:54:58.450126 2118 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:36958 (request call id 185) took 2168 ms. Trace:
I20250831 19:54:58.450219 2118 rpcz_store.cc:276] 0831 19:54:56.281630 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:56.743270 (+461640us) service_pool.cc:225] Handling call
0831 19:54:57.584495 (+841225us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:58.449572 (+865077us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:58.449811 (+ 239us) catalog_manager.cc:3683] Apply alter schema
0831 19:54:58.450070 (+ 259us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":402923,"Hive Metastore.run_cpu_time_us":605,"Hive Metastore.run_wall_time_us":125496}
I20250831 19:54:58.452344 2119 catalog_manager.cc:5582] T c515598ee89b4f1a8839c28c7e7bc0c9 P de831f40fa1348a48a1f0260f4130197 reported cstate change: term changed from 0 to 1, leader changed from <none> to de831f40fa1348a48a1f0260f4130197 (127.1.1.194). New cstate: current_term: 1 leader_uuid: "de831f40fa1348a48a1f0260f4130197" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: UNKNOWN } } }
I20250831 19:54:58.456305 2120 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:36958 (request call id 188) took 2118 ms. Trace:
I20250831 19:54:58.456413 2120 rpcz_store.cc:276] 0831 19:54:56.337925 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:57.358212 (+1020287us) service_pool.cc:225] Handling call
0831 19:54:58.191222 (+833010us) catalog_manager.cc:2076] Acquired catalog manager lock
0831 19:54:58.191673 (+ 451us) catalog_manager.cc:2122] Created new table and tablet info
0831 19:54:58.441414 (+249741us) catalog_manager.cc:2148] Created new table in HMS catalog
0831 19:54:58.456049 (+ 14635us) catalog_manager.cc:2182] Wrote table and tablets to system table
0831 19:54:58.456148 (+ 99us) catalog_manager.cc:2216] Inserted table and tablets into CatalogManager maps
0831 19:54:58.456239 (+ 91us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:58.442422 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:58.442595 (+ 173us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:58.442604 (+ 9us) write_op.cc:435] Acquired schema lock
0831 19:54:58.442608 (+ 4us) tablet.cc:660] Decoding operations
0831 19:54:58.442736 (+ 128us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:58.442753 (+ 17us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:58.442760 (+ 7us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:58.442892 (+ 132us) tablet.cc:699] Row locks acquired
0831 19:54:58.442896 (+ 4us) write_op.cc:260] PREPARE: finished
0831 19:54:58.442939 (+ 43us) write_op.cc:270] Start()
0831 19:54:58.442982 (+ 43us) write_op.cc:276] Timestamp: P: 1756670098442861 usec, L: 0
0831 19:54:58.442988 (+ 6us) op_driver.cc:348] REPLICATION: starting
0831 19:54:58.443219 (+ 231us) log.cc:844] Serialized 433 byte log entry
0831 19:54:58.455249 (+ 12030us) op_driver.cc:464] REPLICATION: finished
0831 19:54:58.455367 (+ 118us) write_op.cc:301] APPLY: starting
0831 19:54:58.455385 (+ 18us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:58.455441 (+ 56us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:58.455477 (+ 36us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:58.455608 (+ 131us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:58.455644 (+ 36us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0831 19:54:58.455655 (+ 11us) write_op.cc:312] APPLY: finished
0831 19:54:58.455740 (+ 85us) log.cc:844] Serialized 29 byte log entry
0831 19:54:58.455826 (+ 86us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:58.455848 (+ 22us) write_op.cc:454] Released schema lock
0831 19:54:58.455856 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0831 19:54:58.455937 (+ 81us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:58.455943 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":210813,"Hive Metastore.run_cpu_time_us":280,"Hive Metastore.run_wall_time_us":38722,"child_traces":[["op",{"apply.queue_time_us":63,"apply.run_cpu_time_us":557,"apply.run_wall_time_us":557,"num_ops":2,"prepare.queue_time_us":59,"prepare.run_cpu_time_us":929,"prepare.run_wall_time_us":929,"raft.queue_time_us":76,"raft.run_cpu_time_us":255,"raft.run_wall_time_us":255,"replication_time_us":12224}]]}
I20250831 19:54:58.457316 2120 master_service.cc:948] ReplaceTablet: received request to replace tablet 5ed927d4935143968fb89a73730eb8a1 from {username='slave'} at 127.0.0.1:36958
I20250831 19:54:58.482249 2120 catalog_manager.cc:5869] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Sending DeleteTablet for 3 replicas of tablet 5ed927d4935143968fb89a73730eb8a1
I20250831 19:54:58.483265 1883 tablet_service.cc:1515] Processing DeleteTablet for tablet 5ed927d4935143968fb89a73730eb8a1 with delete_type TABLET_DATA_DELETED (replaced by tablet 61101a699bb84b62af4e7a0cae243d4e) from {username='slave'} at 127.0.0.1:45906
I20250831 19:54:58.483489 3310 tablet_replica.cc:331] T 5ed927d4935143968fb89a73730eb8a1 P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:54:58.483645 3310 raft_consensus.cc:2241] T 5ed927d4935143968fb89a73730eb8a1 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:58.483803 3310 raft_consensus.cc:2270] T 5ed927d4935143968fb89a73730eb8a1 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:58.484274 3310 ts_tablet_manager.cc:1905] T 5ed927d4935143968fb89a73730eb8a1 P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:58.488145 1613 tablet_service.cc:1515] Processing DeleteTablet for tablet 5ed927d4935143968fb89a73730eb8a1 with delete_type TABLET_DATA_DELETED (replaced by tablet 61101a699bb84b62af4e7a0cae243d4e) from {username='slave'} at 127.0.0.1:51022
I20250831 19:54:58.488430 3312 tablet_replica.cc:331] T 5ed927d4935143968fb89a73730eb8a1 P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:54:58.488619 3312 raft_consensus.cc:2241] T 5ed927d4935143968fb89a73730eb8a1 P 89aa85d59c53436ebdf3074b13d14825 [term 1 LEADER]: Raft consensus shutting down.
I20250831 19:54:58.488947 3312 raft_consensus.cc:2270] T 5ed927d4935143968fb89a73730eb8a1 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:58.489518 3312 ts_tablet_manager.cc:1905] T 5ed927d4935143968fb89a73730eb8a1 P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:58.490170 1749 tablet_service.cc:1515] Processing DeleteTablet for tablet 5ed927d4935143968fb89a73730eb8a1 with delete_type TABLET_DATA_DELETED (replaced by tablet 61101a699bb84b62af4e7a0cae243d4e) from {username='slave'} at 127.0.0.1:50674
I20250831 19:54:58.490440 3311 tablet_replica.cc:331] T 5ed927d4935143968fb89a73730eb8a1 P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:54:58.494235 3311 raft_consensus.cc:2241] T 5ed927d4935143968fb89a73730eb8a1 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:58.494474 3311 raft_consensus.cc:2270] T 5ed927d4935143968fb89a73730eb8a1 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:58.495167 3311 ts_tablet_manager.cc:1905] T 5ed927d4935143968fb89a73730eb8a1 P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:58.495211 3312 ts_tablet_manager.cc:1918] T 5ed927d4935143968fb89a73730eb8a1 P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250831 19:54:58.495303 3312 log.cc:1199] T 5ed927d4935143968fb89a73730eb8a1 P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/5ed927d4935143968fb89a73730eb8a1
I20250831 19:54:58.495627 3312 ts_tablet_manager.cc:1939] T 5ed927d4935143968fb89a73730eb8a1 P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
I20250831 19:54:58.497645 2104 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet 5ed927d4935143968fb89a73730eb8a1 (table default.table_207ac87518bc487184a89bb52cd204b3 [id=f48af5bc3eff4c819be4aeeff4128c2a]) successfully deleted
I20250831 19:54:58.500558 3352 consensus_queue.cc:1035] T 3081636d94084a8aa3905f40edf34b0f P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:58.511978 2120 catalog_manager.cc:6652] ReplaceTablet: tablet 5ed927d4935143968fb89a73730eb8a1 deleted and replaced by tablet 61101a699bb84b62af4e7a0cae243d4e
I20250831 19:54:58.512207 2120 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:36958 (request call id 195) took 1899 ms. Trace:
I20250831 19:54:58.525283 1633 raft_consensus.cc:1273] T d56dcc30166043c68c3f1c05e7f7bde0 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Refusing update from remote peer 2441fafe1d62429386f4631ad423567d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250831 19:54:58.526451 1772 raft_consensus.cc:1273] T d56dcc30166043c68c3f1c05e7f7bde0 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Refusing update from remote peer 2441fafe1d62429386f4631ad423567d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250831 19:54:58.526714 3323 consensus_queue.cc:1035] T d56dcc30166043c68c3f1c05e7f7bde0 P 2441fafe1d62429386f4631ad423567d [LEADER]: Connected to new peer: Peer: permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:58.527347 3323 consensus_queue.cc:1035] T d56dcc30166043c68c3f1c05e7f7bde0 P 2441fafe1d62429386f4631ad423567d [LEADER]: Connected to new peer: Peer: permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:58.542258 2123 catalog_manager.cc:2706] deleted HMS catalog entry for table default.table_265519e91af542d1836f224e15cd5e60 [id=67d77a3f228b4f1da86b97cac2fc4aac]
I20250831 19:54:58.543098 2119 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36958:
name: "default.Table_75aa254646a24998b06bc2c45a479df2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:58.512368 2120 rpcz_store.cc:276] 0831 19:54:56.612536 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:58.457230 (+1844694us) service_pool.cc:225] Handling call
0831 19:54:58.512166 (+ 54936us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:58.465162 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:58.465282 (+ 120us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:58.465289 (+ 7us) write_op.cc:435] Acquired schema lock
0831 19:54:58.465293 (+ 4us) tablet.cc:660] Decoding operations
0831 19:54:58.465445 (+ 152us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:58.465456 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:58.465461 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:58.465535 (+ 74us) tablet.cc:699] Row locks acquired
0831 19:54:58.465539 (+ 4us) write_op.cc:260] PREPARE: finished
0831 19:54:58.465575 (+ 36us) write_op.cc:270] Start()
0831 19:54:58.465608 (+ 33us) write_op.cc:276] Timestamp: P: 1756670098465552 usec, L: 0
0831 19:54:58.465613 (+ 5us) op_driver.cc:348] REPLICATION: starting
0831 19:54:58.465790 (+ 177us) log.cc:844] Serialized 656 byte log entry
0831 19:54:58.472338 (+ 6548us) op_driver.cc:464] REPLICATION: finished
0831 19:54:58.472831 (+ 493us) write_op.cc:301] APPLY: starting
0831 19:54:58.472848 (+ 17us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:58.472892 (+ 44us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:58.472923 (+ 31us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:58.473047 (+ 124us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:58.473136 (+ 89us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0831 19:54:58.473147 (+ 11us) write_op.cc:312] APPLY: finished
0831 19:54:58.473215 (+ 68us) log.cc:844] Serialized 29 byte log entry
0831 19:54:58.473275 (+ 60us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:58.473297 (+ 22us) write_op.cc:454] Released schema lock
0831 19:54:58.473304 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0831 19:54:58.473376 (+ 72us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:58.473382 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":421,"apply.run_cpu_time_us":549,"apply.run_wall_time_us":549,"num_ops":2,"prepare.queue_time_us":6600,"prepare.run_cpu_time_us":720,"prepare.run_wall_time_us":720,"replication_time_us":6694}]]}
I20250831 19:54:58.544749 2120 master_service.cc:948] ReplaceTablet: received request to replace tablet b67e0472244e4d79b8dfb7e7474b96b7 from {username='slave'} at 127.0.0.1:36958
I20250831 19:54:58.548944 3333 tablet.cc:1722] T d56dcc30166043c68c3f1c05e7f7bde0 P 2441fafe1d62429386f4631ad423567d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250831 19:54:58.549935 3356 tablet.cc:1722] T d56dcc30166043c68c3f1c05e7f7bde0 P de831f40fa1348a48a1f0260f4130197: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250831 19:54:58.575047 2124 catalog_manager.cc:2149] created HMS catalog entry for table [id=7d31bd8f26c94d15b09cf05778a2f253]
I20250831 19:54:58.574985 1749 tablet_service.cc:1468] Processing CreateTablet for tablet a9d383f8caed44958fb3fa6ed1ca580e (DEFAULT_TABLE table=default.table_dbeae8f9a2c34da78b7e284664c00cd1 [id=1aaaa30dc3cd4d8497bc2a18ab02ec3d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:58.576175 2117 catalog_manager.cc:5582] T dc6c1d165b5a484ab98ac55cd2330139 P 2441fafe1d62429386f4631ad423567d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2441fafe1d62429386f4631ad423567d (127.1.1.195). New cstate: current_term: 1 leader_uuid: "2441fafe1d62429386f4631ad423567d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: UNKNOWN } } }
I20250831 19:54:58.576541 1883 tablet_service.cc:1468] Processing CreateTablet for tablet a9d383f8caed44958fb3fa6ed1ca580e (DEFAULT_TABLE table=default.table_dbeae8f9a2c34da78b7e284664c00cd1 [id=1aaaa30dc3cd4d8497bc2a18ab02ec3d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:58.576949 1883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9d383f8caed44958fb3fa6ed1ca580e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:58.581856 1613 tablet_service.cc:1468] Processing CreateTablet for tablet a9d383f8caed44958fb3fa6ed1ca580e (DEFAULT_TABLE table=default.table_dbeae8f9a2c34da78b7e284664c00cd1 [id=1aaaa30dc3cd4d8497bc2a18ab02ec3d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:58.582345 1613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9d383f8caed44958fb3fa6ed1ca580e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:58.586463 3358 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a4d46bc3ef5a4fbb8c9e4349c86c54a5. Latest consensus state: current_term: 3 leader_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } } }
I20250831 19:54:58.586689 3358 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [sys.catalog]: This master's current role is: FOLLOWER
I20250831 19:54:58.590736 2124 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:36958 (request call id 189) took 2193 ms. Trace:
I20250831 19:54:58.590883 2124 rpcz_store.cc:276] 0831 19:54:56.397353 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:57.789218 (+1391865us) service_pool.cc:225] Handling call
0831 19:54:58.446208 (+656990us) catalog_manager.cc:2076] Acquired catalog manager lock
0831 19:54:58.446700 (+ 492us) catalog_manager.cc:2122] Created new table and tablet info
0831 19:54:58.574992 (+128292us) catalog_manager.cc:2148] Created new table in HMS catalog
0831 19:54:58.590508 (+ 15516us) catalog_manager.cc:2182] Wrote table and tablets to system table
0831 19:54:58.590615 (+ 107us) catalog_manager.cc:2216] Inserted table and tablets into CatalogManager maps
0831 19:54:58.590699 (+ 84us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:58.575823 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:58.575914 (+ 91us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:58.575919 (+ 5us) write_op.cc:435] Acquired schema lock
0831 19:54:58.575921 (+ 2us) tablet.cc:660] Decoding operations
0831 19:54:58.575994 (+ 73us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:58.576002 (+ 8us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:58.576006 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:58.576072 (+ 66us) tablet.cc:699] Row locks acquired
0831 19:54:58.576075 (+ 3us) write_op.cc:260] PREPARE: finished
0831 19:54:58.576287 (+ 212us) write_op.cc:270] Start()
0831 19:54:58.576314 (+ 27us) write_op.cc:276] Timestamp: P: 1756670098576254 usec, L: 0
0831 19:54:58.576318 (+ 4us) op_driver.cc:348] REPLICATION: starting
0831 19:54:58.576468 (+ 150us) log.cc:844] Serialized 433 byte log entry
0831 19:54:58.589554 (+ 13086us) op_driver.cc:464] REPLICATION: finished
0831 19:54:58.589648 (+ 94us) write_op.cc:301] APPLY: starting
0831 19:54:58.589663 (+ 15us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:58.589698 (+ 35us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:58.589727 (+ 29us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:58.589845 (+ 118us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:58.589873 (+ 28us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0831 19:54:58.589881 (+ 8us) write_op.cc:312] APPLY: finished
0831 19:54:58.589940 (+ 59us) log.cc:844] Serialized 29 byte log entry
0831 19:54:58.590001 (+ 61us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:58.590015 (+ 14us) write_op.cc:454] Released schema lock
0831 19:54:58.590020 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0831 19:54:58.590083 (+ 63us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:58.590087 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":95201,"Hive Metastore.run_cpu_time_us":257,"Hive Metastore.run_wall_time_us":32898,"child_traces":[["op",{"apply.queue_time_us":47,"apply.run_cpu_time_us":426,"apply.run_wall_time_us":426,"num_ops":2,"prepare.queue_time_us":163,"prepare.run_cpu_time_us":555,"prepare.run_wall_time_us":2001,"replication_time_us":13203}]]}
W20250831 19:54:58.594810 2125 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_30272e2642084b1390e459c21c0bee62 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250831 19:54:58.595163 2122 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_fec0d0e06479419886c036a37df0cfdf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250831 19:54:58.598399 2126 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:36958 (request call id 186) took 2314 ms. Trace:
I20250831 19:54:58.598522 2126 rpcz_store.cc:276] 0831 19:54:56.281733 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:56.948162 (+666429us) service_pool.cc:225] Handling call
0831 19:54:58.183819 (+1235657us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:58.592099 (+408280us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:58.595554 (+ 3455us) catalog_manager.cc:3683] Apply alter schema
0831 19:54:58.595778 (+ 224us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":6747,"Hive Metastore.run_cpu_time_us":618,"Hive Metastore.run_wall_time_us":211805}
I20250831 19:54:58.599727 2126 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36958:
name: "default.Table_1d29197c8463471d898f54b5dadaefc2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:58.600347 2117 master_service.cc:948] ReplaceTablet: received request to replace tablet 43b456d5ee8d40e1a8999565cec2d230 from {username='slave'} at 127.0.0.1:36958
I20250831 19:54:58.605259 3215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48016 (request call id 0) took 1378 ms. Trace:
I20250831 19:54:58.608655 2186 catalog_manager.cc:2747] Deleting table default.table_265519e91af542d1836f224e15cd5e60 [id=67d77a3f228b4f1da86b97cac2fc4aac] in response to Hive Metastore notification log event 167
I20250831 19:54:58.616323 2120 catalog_manager.cc:5869] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Sending DeleteTablet for 3 replicas of tablet b67e0472244e4d79b8dfb7e7474b96b7
I20250831 19:54:58.616734 1614 tablet_service.cc:1468] Processing CreateTablet for tablet 61101a699bb84b62af4e7a0cae243d4e (DEFAULT_TABLE table=default.table_207ac87518bc487184a89bb52cd204b3 [id=f48af5bc3eff4c819be4aeeff4128c2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:58.616906 2120 catalog_manager.cc:6652] ReplaceTablet: tablet b67e0472244e4d79b8dfb7e7474b96b7 deleted and replaced by tablet 06c27385b0b8460c9ea4f1d96ecb2966
I20250831 19:54:58.617031 2120 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:36958 (request call id 197) took 1900 ms. Trace:
I20250831 19:54:58.617139 1614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61101a699bb84b62af4e7a0cae243d4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:58.617276 3372 tablet_bootstrap.cc:492] T a9d383f8caed44958fb3fa6ed1ca580e P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:58.617556 1751 tablet_service.cc:1515] Processing DeleteTablet for tablet b67e0472244e4d79b8dfb7e7474b96b7 with delete_type TABLET_DATA_DELETED (replaced by tablet 06c27385b0b8460c9ea4f1d96ecb2966) from {username='slave'} at 127.0.0.1:50674
I20250831 19:54:58.617681 1748 tablet_service.cc:1468] Processing CreateTablet for tablet 61101a699bb84b62af4e7a0cae243d4e (DEFAULT_TABLE table=default.table_207ac87518bc487184a89bb52cd204b3 [id=f48af5bc3eff4c819be4aeeff4128c2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:58.617763 1609 tablet_service.cc:1515] Processing DeleteTablet for tablet b67e0472244e4d79b8dfb7e7474b96b7 with delete_type TABLET_DATA_DELETED (replaced by tablet 06c27385b0b8460c9ea4f1d96ecb2966) from {username='slave'} at 127.0.0.1:51022
I20250831 19:54:58.618400 1884 tablet_service.cc:1468] Processing CreateTablet for tablet 61101a699bb84b62af4e7a0cae243d4e (DEFAULT_TABLE table=default.table_207ac87518bc487184a89bb52cd204b3 [id=f48af5bc3eff4c819be4aeeff4128c2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:58.618721 1884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61101a699bb84b62af4e7a0cae243d4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:58.621536 3312 tablet_replica.cc:331] T b67e0472244e4d79b8dfb7e7474b96b7 P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:54:58.621690 3312 raft_consensus.cc:2241] T b67e0472244e4d79b8dfb7e7474b96b7 P 89aa85d59c53436ebdf3074b13d14825 [term 1 LEADER]: Raft consensus shutting down.
I20250831 19:54:58.621968 3312 raft_consensus.cc:2270] T b67e0472244e4d79b8dfb7e7474b96b7 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:58.622489 3312 ts_tablet_manager.cc:1905] T b67e0472244e4d79b8dfb7e7474b96b7 P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:58.625080 3372 tablet_bootstrap.cc:654] T a9d383f8caed44958fb3fa6ed1ca580e P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:58.625550 1886 tablet_service.cc:1515] Processing DeleteTablet for tablet b67e0472244e4d79b8dfb7e7474b96b7 with delete_type TABLET_DATA_DELETED (replaced by tablet 06c27385b0b8460c9ea4f1d96ecb2966) from {username='slave'} at 127.0.0.1:45906
I20250831 19:54:58.626693 2117 catalog_manager.cc:5869] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Sending DeleteTablet for 3 replicas of tablet 43b456d5ee8d40e1a8999565cec2d230
I20250831 19:54:58.627169 2117 catalog_manager.cc:6652] ReplaceTablet: tablet 43b456d5ee8d40e1a8999565cec2d230 deleted and replaced by tablet 8afbd19c84f14fbb8f957c2f10d97a4c
I20250831 19:54:58.627296 2117 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:36958 (request call id 198) took 1908 ms. Trace:
I20250831 19:54:58.627506 1609 tablet_service.cc:1515] Processing DeleteTablet for tablet 43b456d5ee8d40e1a8999565cec2d230 with delete_type TABLET_DATA_DELETED (replaced by tablet 8afbd19c84f14fbb8f957c2f10d97a4c) from {username='slave'} at 127.0.0.1:51022
I20250831 19:54:58.627377 2117 rpcz_store.cc:276] 0831 19:54:56.719039 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:58.595883 (+1876844us) service_pool.cc:225] Handling call
0831 19:54:58.627251 (+ 31368us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:58.601536 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:58.601640 (+ 104us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:58.601644 (+ 4us) write_op.cc:435] Acquired schema lock
0831 19:54:58.601647 (+ 3us) tablet.cc:660] Decoding operations
0831 19:54:58.601724 (+ 77us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:58.601732 (+ 8us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:58.601735 (+ 3us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:58.601797 (+ 62us) tablet.cc:699] Row locks acquired
0831 19:54:58.601799 (+ 2us) write_op.cc:260] PREPARE: finished
0831 19:54:58.601826 (+ 27us) write_op.cc:270] Start()
0831 19:54:58.601851 (+ 25us) write_op.cc:276] Timestamp: P: 1756670098601792 usec, L: 0
0831 19:54:58.601854 (+ 3us) op_driver.cc:348] REPLICATION: starting
0831 19:54:58.602005 (+ 151us) log.cc:844] Serialized 656 byte log entry
0831 19:54:58.625337 (+ 23332us) op_driver.cc:464] REPLICATION: finished
0831 19:54:58.625953 (+ 616us) write_op.cc:301] APPLY: starting
0831 19:54:58.625968 (+ 15us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:58.626004 (+ 36us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:58.626033 (+ 29us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:58.626119 (+ 86us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:58.626169 (+ 50us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0831 19:54:58.626176 (+ 7us) write_op.cc:312] APPLY: finished
0831 19:54:58.626238 (+ 62us) log.cc:844] Serialized 29 byte log entry
0831 19:54:58.626297 (+ 59us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:58.626311 (+ 14us) write_op.cc:454] Released schema lock
0831 19:54:58.626317 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0831 19:54:58.626378 (+ 61us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:58.626382 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":551,"apply.run_cpu_time_us":425,"apply.run_wall_time_us":426,"num_ops":2,"prepare.queue_time_us":43,"prepare.run_cpu_time_us":529,"prepare.run_wall_time_us":529,"replication_time_us":23430,"spinlock_wait_cycles":768}]]}
I20250831 19:54:58.629184 3312 ts_tablet_manager.cc:1918] T b67e0472244e4d79b8dfb7e7474b96b7 P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20250831 19:54:58.629287 3312 log.cc:1199] T b67e0472244e4d79b8dfb7e7474b96b7 P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/b67e0472244e4d79b8dfb7e7474b96b7
I20250831 19:54:58.630177 1886 tablet_service.cc:1515] Processing DeleteTablet for tablet 43b456d5ee8d40e1a8999565cec2d230 with delete_type TABLET_DATA_DELETED (replaced by tablet 8afbd19c84f14fbb8f957c2f10d97a4c) from {username='slave'} at 127.0.0.1:45906
I20250831 19:54:58.630256 1751 tablet_service.cc:1515] Processing DeleteTablet for tablet 43b456d5ee8d40e1a8999565cec2d230 with delete_type TABLET_DATA_DELETED (replaced by tablet 8afbd19c84f14fbb8f957c2f10d97a4c) from {username='slave'} at 127.0.0.1:50674
I20250831 19:54:58.630897 1749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9d383f8caed44958fb3fa6ed1ca580e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:58.631072 3312 ts_tablet_manager.cc:1939] T b67e0472244e4d79b8dfb7e7474b96b7 P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
I20250831 19:54:58.631505 3312 tablet_replica.cc:331] T 43b456d5ee8d40e1a8999565cec2d230 P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:54:58.631654 3312 raft_consensus.cc:2241] T 43b456d5ee8d40e1a8999565cec2d230 P 89aa85d59c53436ebdf3074b13d14825 [term 1 LEADER]: Raft consensus shutting down.
I20250831 19:54:58.631911 3312 raft_consensus.cc:2270] T 43b456d5ee8d40e1a8999565cec2d230 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:58.632475 3312 ts_tablet_manager.cc:1905] T 43b456d5ee8d40e1a8999565cec2d230 P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:58.633680 1748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61101a699bb84b62af4e7a0cae243d4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:58.637832 2104 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet b67e0472244e4d79b8dfb7e7474b96b7 (table default.table_4e12fc12cae640b99d4f3794151b6915 [id=ba4c5ecf4ae94ede9bfb83af2ee894ab]) successfully deleted
I20250831 19:54:58.639153 3372 tablet_bootstrap.cc:492] T a9d383f8caed44958fb3fa6ed1ca580e P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:58.639348 3372 ts_tablet_manager.cc:1397] T a9d383f8caed44958fb3fa6ed1ca580e P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.022s user 0.003s sys 0.000s
I20250831 19:54:58.639612 3312 ts_tablet_manager.cc:1918] T 43b456d5ee8d40e1a8999565cec2d230 P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:58.640275 3312 log.cc:1199] T 43b456d5ee8d40e1a8999565cec2d230 P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/43b456d5ee8d40e1a8999565cec2d230
I20250831 19:54:58.640802 3312 ts_tablet_manager.cc:1939] T 43b456d5ee8d40e1a8999565cec2d230 P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
I20250831 19:54:58.642007 2104 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet 43b456d5ee8d40e1a8999565cec2d230 (table default.table_c48f1c99f3174cb8acca698339447ed9 [id=f707909e6af44750a5fc5e3b15af0b24]) successfully deleted
I20250831 19:54:58.640280 3372 raft_consensus.cc:357] T a9d383f8caed44958fb3fa6ed1ca580e P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:58.642590 3372 raft_consensus.cc:383] T a9d383f8caed44958fb3fa6ed1ca580e P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:58.642714 3372 raft_consensus.cc:738] T a9d383f8caed44958fb3fa6ed1ca580e P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:58.642999 3372 consensus_queue.cc:260] T a9d383f8caed44958fb3fa6ed1ca580e P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:58.643699 3372 ts_tablet_manager.cc:1428] T a9d383f8caed44958fb3fa6ed1ca580e P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20250831 19:54:58.643999 3372 tablet_bootstrap.cc:492] T 61101a699bb84b62af4e7a0cae243d4e P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:58.645629 3372 tablet_bootstrap.cc:654] T 61101a699bb84b62af4e7a0cae243d4e P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:58.617116 2120 rpcz_store.cc:276] 0831 19:54:56.716780 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:58.544689 (+1827909us) service_pool.cc:225] Handling call
0831 19:54:58.616980 (+ 72291us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:58.557070 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:58.557180 (+ 110us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:58.557186 (+ 6us) write_op.cc:435] Acquired schema lock
0831 19:54:58.557189 (+ 3us) tablet.cc:660] Decoding operations
0831 19:54:58.557297 (+ 108us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:58.557308 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:58.557314 (+ 6us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:58.557389 (+ 75us) tablet.cc:699] Row locks acquired
0831 19:54:58.557392 (+ 3us) write_op.cc:260] PREPARE: finished
0831 19:54:58.557419 (+ 27us) write_op.cc:270] Start()
0831 19:54:58.557465 (+ 46us) write_op.cc:276] Timestamp: P: 1756670098557390 usec, L: 0
0831 19:54:58.557469 (+ 4us) op_driver.cc:348] REPLICATION: starting
0831 19:54:58.557632 (+ 163us) log.cc:844] Serialized 656 byte log entry
0831 19:54:58.575018 (+ 17386us) op_driver.cc:464] REPLICATION: finished
0831 19:54:58.575411 (+ 393us) write_op.cc:301] APPLY: starting
0831 19:54:58.575426 (+ 15us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:58.575819 (+ 393us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:58.575850 (+ 31us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:58.575937 (+ 87us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:58.575983 (+ 46us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0831 19:54:58.575989 (+ 6us) write_op.cc:312] APPLY: finished
0831 19:54:58.576057 (+ 68us) log.cc:844] Serialized 29 byte log entry
0831 19:54:58.576116 (+ 59us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:58.576131 (+ 15us) write_op.cc:454] Released schema lock
0831 19:54:58.576138 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0831 19:54:58.576212 (+ 74us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:58.576217 (+ 5us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":335,"apply.run_cpu_time_us":468,"apply.run_wall_time_us":794,"num_ops":2,"prepare.queue_time_us":10944,"prepare.run_cpu_time_us":640,"prepare.run_wall_time_us":640,"replication_time_us":17524}]]}
I20250831 19:54:58.657835 2120 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36958:
name: "default.Table_dd23f581be78471f98008014d30c3398"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:58.664434 3311 ts_tablet_manager.cc:1918] T 5ed927d4935143968fb89a73730eb8a1 P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250831 19:54:58.665810 3372 tablet_bootstrap.cc:492] T 61101a699bb84b62af4e7a0cae243d4e P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:58.665993 3372 ts_tablet_manager.cc:1397] T 61101a699bb84b62af4e7a0cae243d4e P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.022s user 0.004s sys 0.000s
I20250831 19:54:58.666738 3372 raft_consensus.cc:357] T 61101a699bb84b62af4e7a0cae243d4e P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:58.667052 3372 raft_consensus.cc:383] T 61101a699bb84b62af4e7a0cae243d4e P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:58.667155 3372 raft_consensus.cc:738] T 61101a699bb84b62af4e7a0cae243d4e P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:58.667456 3372 consensus_queue.cc:260] T 61101a699bb84b62af4e7a0cae243d4e P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:58.668128 3372 ts_tablet_manager.cc:1428] T 61101a699bb84b62af4e7a0cae243d4e P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250831 19:54:58.665102 3311 log.cc:1199] T 5ed927d4935143968fb89a73730eb8a1 P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/5ed927d4935143968fb89a73730eb8a1
I20250831 19:54:58.670193 3311 ts_tablet_manager.cc:1939] T 5ed927d4935143968fb89a73730eb8a1 P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
I20250831 19:54:58.672303 2186 catalog_manager.cc:5869] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Sending DeleteTablet for 3 replicas of tablet 2c03497e3cb4480d88d99dde5d6ea22b
I20250831 19:54:58.606297 3215 rpcz_store.cc:276] 0831 19:54:57.226672 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:57.226719 (+ 47us) service_pool.cc:225] Handling call
0831 19:54:58.427911 (+1201192us) raft_consensus.cc:1469] Updating replica for 177 ops
0831 19:54:58.435613 (+ 7702us) raft_consensus.cc:1532] Early marking committed up to index 277
0831 19:54:58.446453 (+ 10840us) raft_consensus.cc:1537] Triggering prepare for 176 ops
0831 19:54:58.446751 (+ 298us) write_op.cc:270] Start()
0831 19:54:58.446793 (+ 42us) write_op.cc:276] Timestamp: P: 1756670092011228 usec, L: 0
0831 19:54:58.447060 (+ 267us) write_op.cc:270] Start()
0831 19:54:58.447101 (+ 41us) write_op.cc:276] Timestamp: P: 1756670092048720 usec, L: 0
0831 19:54:58.447295 (+ 194us) write_op.cc:270] Start()
0831 19:54:58.447314 (+ 19us) write_op.cc:276] Timestamp: P: 1756670092077270 usec, L: 0
0831 19:54:58.447464 (+ 150us) write_op.cc:270] Start()
0831 19:54:58.447483 (+ 19us) write_op.cc:276] Timestamp: P: 1756670092090300 usec, L: 0
0831 19:54:58.447650 (+ 167us) write_op.cc:270] Start()
0831 19:54:58.447669 (+ 19us) write_op.cc:276] Timestamp: P: 1756670092091621 usec, L: 0
0831 19:54:58.448274 (+ 605us) write_op.cc:270] Start()
0831 19:54:58.448292 (+ 18us) write_op.cc:276] Timestamp: P: 1756670092106438 usec, L: 0
0831 19:54:58.448394 (+ 102us) write_op.cc:270] Start()
0831 19:54:58.448426 (+ 32us) write_op.cc:276] Timestamp: P: 1756670092127616 usec, L: 0
0831 19:54:58.448498 (+ 72us) write_op.cc:270] Start()
0831 19:54:58.448509 (+ 11us) write_op.cc:276] Timestamp: P: 1756670092223367 usec, L: 0
0831 19:54:58.448580 (+ 71us) write_op.cc:270] Start()
0831 19:54:58.448592 (+ 12us) write_op.cc:276] Timestamp: P: 1756670092248697 usec, L: 0
0831 19:54:58.448671 (+ 79us) write_op.cc:270] Start()
0831 19:54:58.448683 (+ 12us) write_op.cc:276] Timestamp: P: 1756670092252490 usec, L: 0
0831 19:54:58.448818 (+ 135us) write_op.cc:270] Start()
0831 19:54:58.448842 (+ 24us) write_op.cc:276] Timestamp: P: 1756670092261695 usec, L: 0
0831 19:54:58.448923 (+ 81us) write_op.cc:270] Start()
0831 19:54:58.448934 (+ 11us) write_op.cc:276] Timestamp: P: 1756670092276231 usec, L: 0
0831 19:54:58.449018 (+ 84us) write_op.cc:270] Start()
0831 19:54:58.449028 (+ 10us) write_op.cc:276] Timestamp: P: 1756670092284684 usec, L: 0
0831 19:54:58.449091 (+ 63us) write_op.cc:270] Start()
0831 19:54:58.449100 (+ 9us) write_op.cc:276] Timestamp: P: 1756670092294742 usec, L: 0
0831 19:54:58.449193 (+ 93us) write_op.cc:270] Start()
0831 19:54:58.449211 (+ 18us) write_op.cc:276] Timestamp: P: 1756670092297903 usec, L: 0
0831 19:54:58.449318 (+ 107us) write_op.cc:270] Start()
0831 19:54:58.449334 (+ 16us) write_op.cc:276] Timestamp: P: 1756670092302690 usec, L: 0
0831 19:54:58.449488 (+ 154us) write_op.cc:270] Start()
0831 19:54:58.449510 (+ 22us) write_op.cc:276] Timestamp: P: 1756670092328314 usec, L: 0
0831 19:54:58.449659 (+ 149us) write_op.cc:270] Start()
0831 19:54:58.449682 (+ 23us) write_op.cc:276] Timestamp: P: 1756670092353157 usec, L: 0
0831 19:54:58.449812 (+ 130us) write_op.cc:270] Start()
0831 19:54:58.449836 (+ 24us) write_op.cc:276] Timestamp: P: 1756670092436104 usec, L: 0
0831 19:54:58.449952 (+ 116us) write_op.cc:270] Start()
0831 19:54:58.449968 (+ 16us) write_op.cc:276] Timestamp: P: 1756670092465487 usec, L: 0
0831 19:54:58.450080 (+ 112us) write_op.cc:270] Start()
0831 19:54:58.450099 (+ 19us) write_op.cc:276] Timestamp: P: 1756670092513121 usec, L: 0
0831 19:54:58.450222 (+ 123us) write_op.cc:270] Start()
0831 19:54:58.450240 (+ 18us) write_op.cc:276] Timestamp: P: 1756670092575821 usec, L: 0
0831 19:54:58.450339 (+ 99us) write_op.cc:270] Start()
0831 19:54:58.450356 (+ 17us) write_op.cc:276] Timestamp: P: 1756670092598081 usec, L: 0
0831 19:54:58.450469 (+ 113us) write_op.cc:270] Start()
0831 19:54:58.450486 (+ 17us) write_op.cc:276] Timestamp: P: 1756670092616230 usec, L: 0
0831 19:54:58.450667 (+ 181us) write_op.cc:270] Start()
0831 19:54:58.450686 (+ 19us) write_op.cc:276] Timestamp: P: 1756670092626772 usec, L: 0
0831 19:54:58.450800 (+ 114us) write_op.cc:270] Start()
0831 19:54:58.450816 (+ 16us) write_op.cc:276] Timestamp: P: 1756670092662464 usec, L: 0
0831 19:54:58.450924 (+ 108us) write_op.cc:270] Start()
0831 19:54:58.450940 (+ 16us) write_op.cc:276] Timestamp: P: 1756670092671621 usec, L: 0
0831 19:54:58.451052 (+ 112us) write_op.cc:270] Start()
0831 19:54:58.451068 (+ 16us) write_op.cc:276] Timestamp: P: 1756670092716490 usec, L: 0
0831 19:54:58.451187 (+ 119us) write_op.cc:270] Start()
0831 19:54:58.451203 (+ 16us) write_op.cc:276] Timestamp: P: 1756670092724812 usec, L: 0
0831 19:54:58.451328 (+ 125us) write_op.cc:270] Start()
0831 19:54:58.451344 (+ 16us) write_op.cc:276] Timestamp: P: 1756670092810726 usec, L: 0
0831 19:54:58.451457 (+ 113us) write_op.cc:270] Start()
0831 19:54:58.451474 (+ 17us) write_op.cc:276] Timestamp: P: 1756670092826480 usec, L: 0
0831 19:54:58.451572 (+ 98us) write_op.cc:270] Start()
0831 19:54:58.451590 (+ 18us) write_op.cc:276] Timestamp: P: 1756670092833322 usec, L: 0
0831 19:54:58.451784 (+ 194us) write_op.cc:270] Start()
0831 19:54:58.451801 (+ 17us) write_op.cc:276] Timestamp: P: 1756670092897195 usec, L: 0
0831 19:54:58.451921 (+ 120us) write_op.cc:270] Start()
0831 19:54:58.451937 (+ 16us) write_op.cc:276] Timestamp: P: 1756670092906998 usec, L: 0
0831 19:54:58.452076 (+ 139us) write_op.cc:270] Start()
0831 19:54:58.452106 (+ 30us) write_op.cc:276] Timestamp: P: 1756670092937947 usec, L: 0
0831 19:54:58.452275 (+ 169us) write_op.cc:270] Start()
0831 19:54:58.452299 (+ 24us) write_op.cc:276] Timestamp: P: 1756670092947535 usec, L: 0
0831 19:54:58.452404 (+ 105us) write_op.cc:270] Start()
0831 19:54:58.452419 (+ 15us) write_op.cc:276] Timestamp: P: 1756670092970170 usec, L: 0
0831 19:54:58.452539 (+ 120us) write_op.cc:270] Start()
0831 19:54:58.452555 (+ 16us) write_op.cc:276] Timestamp: P: 1756670092998404 usec, L: 0
0831 19:54:58.452669 (+ 114us) write_op.cc:270] Start()
0831 19:54:58.452685 (+ 16us) write_op.cc:276] Timestamp: P: 1756670093003758 usec, L: 0
0831 19:54:58.452783 (+ 98us) write_op.cc:270] Start()
0831 19:54:58.452798 (+ 15us) write_op.cc:276] Timestamp: P: 1756670093010569 usec, L: 0
0831 19:54:58.452941 (+ 143us) write_op.cc:270] Start()
0831 19:54:58.452957 (+ 16us) write_op.cc:276] Timestamp: P: 1756670093075110 usec, L: 0
0831 19:54:58.453130 (+ 173us) write_op.cc:270] Start()
0831 19:54:58.453148 (+ 18us) write_op.cc:276] Timestamp: P: 1756670093164202 usec, L: 0
0831 19:54:58.453256 (+ 108us) write_op.cc:270] Start()
0831 19:54:58.453272 (+ 16us) write_op.cc:276] Timestamp: P: 1756670093188701 usec, L: 0
0831 19:54:58.453391 (+ 119us) write_op.cc:270] Start()
0831 19:54:58.453406 (+ 15us) write_op.cc:276] Timestamp: P: 1756670093208794 usec, L: 0
0831 19:54:58.453549 (+ 143us) write_op.cc:270] Start()
0831 19:54:58.453577 (+ 28us) write_op.cc:276] Timestamp: P: 1756670093220750 usec, L: 0
0831 19:54:58.453729 (+ 152us) write_op.cc:270] Start()
0831 19:54:58.453744 (+ 15us) write_op.cc:276] Timestamp: P: 1756670093228297 usec, L: 0
0831 19:54:58.453857 (+ 113us) write_op.cc:270] Start()
0831 19:54:58.453872 (+ 15us) write_op.cc:276] Timestamp: P: 1756670093250360 usec, L: 0
0831 19:54:58.453968 (+ 96us) write_op.cc:270] Start()
0831 19:54:58.453982 (+ 14us) write_op.cc:276] Timestamp: P: 1756670093263720 usec, L: 0
0831 19:54:58.454077 (+ 95us) write_op.cc:270] Start()
0831 19:54:58.454092 (+ 15us) write_op.cc:276] Timestamp: P: 1756670093264307 usec, L: 0
0831 19:54:58.454280 (+ 188us) write_op.cc:270] Start()
0831 19:54:58.454301 (+ 21us) write_op.cc:276] Timestamp: P: 1756670093298846 usec, L: 0
0831 19:54:58.454449 (+ 148us) write_op.cc:270] Start()
0831 19:54:58.454467 (+ 18us) write_op.cc:276] Timestamp: P: 1756670093359337 usec, L: 0
0831 19:54:58.454594 (+ 127us) write_op.cc:270] Start()
0831 19:54:58.454613 (+ 19us) write_op.cc:276] Timestamp: P: 1756670093365870 usec, L: 0
0831 19:54:58.454734 (+ 121us) write_op.cc:270] Start()
0831 19:54:58.454753 (+ 19us) write_op.cc:276] Timestamp: P: 1756670093386687 usec, L: 0
0831 19:54:58.454908 (+ 155us) write_op.cc:270] Start()
0831 19:54:58.454937 (+ 29us) write_op.cc:276] Timestamp: P: 1756670093393777 usec, L: 0
0831 19:54:58.455053 (+ 116us) write_op.cc:270] Start()
0831 19:54:58.455070 (+ 17us) write_op.cc:276] Timestamp: P: 1756670093405372 usec, L: 0
0831 19:54:58.455175 (+ 105us) write_op.cc:270] Start()
0831 19:54:58.455191 (+ 16us) write_op.cc:276] Timestamp: P: 1756670093517328 usec, L: 0
0831 19:54:58.455297 (+ 106us) write_op.cc:270] Start()
0831 19:54:58.455314 (+ 17us) write_op.cc:276] Timestamp: P: 1756670093521717 usec, L: 0
0831 19:54:58.455448 (+ 134us) write_op.cc:270] Start()
0831 19:54:58.455465 (+ 17us) write_op.cc:276] Timestamp: P: 1756670093532611 usec, L: 0
0831 19:54:58.455609 (+ 144us) write_op.cc:270] Start()
0831 19:54:58.455628 (+ 19us) write_op.cc:276] Timestamp: P: 1756670093722798 usec, L: 0
0831 19:54:58.455765 (+ 137us) write_op.cc:270] Start()
0831 19:54:58.455822 (+ 57us) write_op.cc:276] Timestamp: P: 1756670093738258 usec, L: 0
0831 19:54:58.455964 (+ 142us) write_op.cc:270] Start()
0831 19:54:58.455983 (+ 19us) write_op.cc:276] Timestamp: P: 1756670093761958 usec, L: 0
0831 19:54:58.456114 (+ 131us) write_op.cc:270] Start()
0831 19:54:58.456130 (+ 16us) write_op.cc:276] Timestamp: P: 1756670093787314 usec, L: 0
0831 19:54:58.456262 (+ 132us) write_op.cc:270] Start()
0831 19:54:58.456316 (+ 54us) write_op.cc:276] Timestamp: P: 1756670093814784 usec, L: 0
0831 19:54:58.456424 (+ 108us) write_op.cc:270] Start()
0831 19:54:58.456440 (+ 16us) write_op.cc:276] Timestamp: P: 1756670093844533 usec, L: 0
0831 19:54:58.456620 (+ 180us) write_op.cc:270] Start()
0831 19:54:58.456645 (+ 25us) write_op.cc:276] Timestamp: P: 1756670093860124 usec, L: 0
0831 19:54:58.456841 (+ 196us) write_op.cc:270] Start()
0831 19:54:58.456873 (+ 32us) write_op.cc:276] Timestamp: P: 1756670093870224 usec, L: 0
0831 19:54:58.457021 (+ 148us) write_op.cc:270] Start()
0831 19:54:58.457045 (+ 24us) write_op.cc:276] Timestamp: P: 1756670093910614 usec, L: 0
0831 19:54:58.457180 (+ 135us) write_op.cc:270] Start()
0831 19:54:58.457201 (+ 21us) write_op.cc:276] Timestamp: P: 1756670093918546 usec, L: 0
0831 19:54:58.457327 (+ 126us) write_op.cc:270] Start()
0831 19:54:58.457347 (+ 20us) write_op.cc:276] Timestamp: P: 1756670093929944 usec, L: 0
0831 19:54:58.461143 (+ 3796us) write_op.cc:270] Start()
0831 19:54:58.461166 (+ 23us) write_op.cc:276] Timestamp: P: 1756670093938980 usec, L: 0
0831 19:54:58.461311 (+ 145us) write_op.cc:270] Start()
0831 19:54:58.461329 (+ 18us) write_op.cc:276] Timestamp: P: 1756670093967048 usec, L: 0
0831 19:54:58.461439 (+ 110us) write_op.cc:270] Start()
0831 19:54:58.461994 (+ 555us) write_op.cc:276] Timestamp: P: 1756670093978792 usec, L: 0
0831 19:54:58.462168 (+ 174us) write_op.cc:270] Start()
0831 19:54:58.462191 (+ 23us) write_op.cc:276] Timestamp: P: 1756670094030292 usec, L: 0
0831 19:54:58.462322 (+ 131us) write_op.cc:270] Start()
0831 19:54:58.462341 (+ 19us) write_op.cc:276] Timestamp: P: 1756670094056751 usec, L: 0
0831 19:54:58.462448 (+ 107us) write_op.cc:270] Start()
0831 19:54:58.462465 (+ 17us) write_op.cc:276] Timestamp: P: 1756670094082518 usec, L: 0
0831 19:54:58.462626 (+ 161us) write_op.cc:270] Start()
0831 19:54:58.462644 (+ 18us) write_op.cc:276] Timestamp: P: 1756670094100054 usec, L: 0
0831 19:54:58.462756 (+ 112us) write_op.cc:270] Start()
0831 19:54:58.462772 (+ 16us) write_op.cc:276] Timestamp: P: 1756670094126605 usec, L: 0
0831 19:54:58.462905 (+ 133us) write_op.cc:270] Start()
0831 19:54:58.463976 (+ 1071us) write_op.cc:276] Timestamp: P: 1756670094177883 usec, L: 0
0831 19:54:58.464189 (+ 213us) write_op.cc:270] Start()
0831 19:54:58.464214 (+ 25us) write_op.cc:276] Timestamp: P: 1756670094226521 usec, L: 0
0831 19:54:58.464348 (+ 134us) write_op.cc:270] Start()
0831 19:54:58.464368 (+ 20us) write_op.cc:276] Timestamp: P: 1756670094247682 usec, L: 0
0831 19:54:58.464494 (+ 126us) write_op.cc:270] Start()
0831 19:54:58.464509 (+ 15us) write_op.cc:276] Timestamp: P: 1756670094251158 usec, L: 0
0831 19:54:58.464609 (+ 100us) write_op.cc:270] Start()
0831 19:54:58.464624 (+ 15us) write_op.cc:276] Timestamp: P: 1756670094272365 usec, L: 0
0831 19:54:58.464720 (+ 96us) write_op.cc:270] Start()
0831 19:54:58.464734 (+ 14us) write_op.cc:276] Timestamp: P: 1756670094281819 usec, L: 0
0831 19:54:58.464870 (+ 136us) write_op.cc:270] Start()
0831 19:54:58.464888 (+ 18us) write_op.cc:276] Timestamp: P: 1756670094293262 usec, L: 0
0831 19:54:58.465043 (+ 155us) write_op.cc:270] Start()
0831 19:54:58.465064 (+ 21us) write_op.cc:276] Timestamp: P: 1756670094324616 usec, L: 0
0831 19:54:58.465208 (+ 144us) write_op.cc:270] Start()
0831 19:54:58.465228 (+ 20us) write_op.cc:276] Timestamp: P: 1756670094367361 usec, L: 0
0831 19:54:58.465355 (+ 127us) write_op.cc:270] Start()
0831 19:54:58.465374 (+ 19us) write_op.cc:276] Timestamp: P: 1756670094424774 usec, L: 0
0831 19:54:58.465524 (+ 150us) write_op.cc:270] Start()
0831 19:54:58.465545 (+ 21us) write_op.cc:276] Timestamp: P: 1756670094435979 usec, L: 0
0831 19:54:58.465673 (+ 128us) write_op.cc:270] Start()
0831 19:54:58.465693 (+ 20us) write_op.cc:276] Timestamp: P: 1756670094451657 usec, L: 0
0831 19:54:58.465816 (+ 123us) write_op.cc:270] Start()
0831 19:54:58.465836 (+ 20us) write_op.cc:276] Timestamp: P: 1756670094462513 usec, L: 0
0831 19:54:58.465966 (+ 130us) write_op.cc:270] Start()
0831 19:54:58.465983 (+ 17us) write_op.cc:276] Timestamp: P: 1756670094497791 usec, L: 0
0831 19:54:58.466144 (+ 161us) write_op.cc:270] Start()
0831 19:54:58.466170 (+ 26us) write_op.cc:276] Timestamp: P: 1756670094542430 usec, L: 0
0831 19:54:58.468711 (+ 2541us) write_op.cc:270] Start()
0831 19:54:58.468733 (+ 22us) write_op.cc:276] Timestamp: P: 1756670094549384 usec, L: 0
0831 19:54:58.468918 (+ 185us) write_op.cc:270] Start()
0831 19:54:58.468939 (+ 21us) write_op.cc:276] Timestamp: P: 1756670094561248 usec, L: 0
0831 19:54:58.469104 (+ 165us) write_op.cc:270] Start()
0831 19:54:58.469128 (+ 24us) write_op.cc:276] Timestamp: P: 1756670094577847 usec, L: 0
0831 19:54:58.469256 (+ 128us) write_op.cc:270] Start()
0831 19:54:58.469272 (+ 16us) write_op.cc:276] Timestamp: P: 1756670094578423 usec, L: 0
0831 19:54:58.469394 (+ 122us) write_op.cc:270] Start()
0831 19:54:58.469409 (+ 15us) write_op.cc:276] Timestamp: P: 1756670094601356 usec, L: 0
0831 19:54:58.469525 (+ 116us) write_op.cc:270] Start()
0831 19:54:58.469552 (+ 27us) write_op.cc:276] Timestamp: P: 1756670094602722 usec, L: 0
0831 19:54:58.469681 (+ 129us) write_op.cc:270] Start()
0831 19:54:58.469697 (+ 16us) write_op.cc:276] Timestamp: P: 1756670094725179 usec, L: 0
0831 19:54:58.469799 (+ 102us) write_op.cc:270] Start()
0831 19:54:58.469814 (+ 15us) write_op.cc:276] Timestamp: P: 1756670094735751 usec, L: 0
0831 19:54:58.469968 (+ 154us) write_op.cc:270] Start()
0831 19:54:58.469986 (+ 18us) write_op.cc:276] Timestamp: P: 1756670094773969 usec, L: 0
0831 19:54:58.470090 (+ 104us) write_op.cc:270] Start()
0831 19:54:58.470113 (+ 23us) write_op.cc:276] Timestamp: P: 1756670094796356 usec, L: 0
0831 19:54:58.470260 (+ 147us) write_op.cc:270] Start()
0831 19:54:58.470280 (+ 20us) write_op.cc:276] Timestamp: P: 1756670094802510 usec, L: 0
0831 19:54:58.470444 (+ 164us) write_op.cc:270] Start()
0831 19:54:58.470465 (+ 21us) write_op.cc:276] Timestamp: P: 1756670094868914 usec, L: 0
0831 19:54:58.470590 (+ 125us) write_op.cc:270] Start()
0831 19:54:58.470604 (+ 14us) write_op.cc:276] Timestamp: P: 1756670094882166 usec, L: 0
0831 19:54:58.470722 (+ 118us) write_op.cc:270] Start()
0831 19:54:58.470736 (+ 14us) write_op.cc:276] Timestamp: P: 1756670095144095 usec, L: 0
0831 19:54:58.470853 (+ 117us) write_op.cc:270] Start()
0831 19:54:58.470871 (+ 18us) write_op.cc:276] Timestamp: P: 1756670095155664 usec, L: 0
0831 19:54:58.470998 (+ 127us) write_op.cc:270] Start()
0831 19:54:58.471014 (+ 16us) write_op.cc:276] Timestamp: P: 1756670095160710 usec, L: 0
0831 19:54:58.471132 (+ 118us) write_op.cc:270] Start()
0831 19:54:58.471149 (+ 17us) write_op.cc:276] Timestamp: P: 1756670095179045 usec, L: 0
0831 19:54:58.471270 (+ 121us) write_op.cc:270] Start()
0831 19:54:58.471287 (+ 17us) write_op.cc:276] Timestamp: P: 1756670095205621 usec, L: 0
0831 19:54:58.471406 (+ 119us) write_op.cc:270] Start()
0831 19:54:58.471423 (+ 17us) write_op.cc:276] Timestamp: P: 1756670095228082 usec, L: 0
0831 19:54:58.471536 (+ 113us) write_op.cc:270] Start()
0831 19:54:58.471557 (+ 21us) write_op.cc:276] Timestamp: P: 1756670095240660 usec, L: 0
0831 19:54:58.471681 (+ 124us) write_op.cc:270] Start()
0831 19:54:58.471704 (+ 23us) write_op.cc:276] Timestamp: P: 1756670095248991 usec, L: 0
0831 19:54:58.471850 (+ 146us) write_op.cc:270] Start()
0831 19:54:58.471871 (+ 21us) write_op.cc:276] Timestamp: P: 1756670095270297 usec, L: 0
0831 19:54:58.472020 (+ 149us) write_op.cc:270] Start()
0831 19:54:58.472040 (+ 20us) write_op.cc:276] Timestamp: P: 1756670095283187 usec, L: 0
0831 19:54:58.472166 (+ 126us) write_op.cc:270] Start()
0831 19:54:58.472186 (+ 20us) write_op.cc:276] Timestamp: P: 1756670095288708 usec, L: 0
0831 19:54:58.472363 (+ 177us) write_op.cc:270] Start()
0831 19:54:58.472378 (+ 15us) write_op.cc:276] Timestamp: P: 1756670095308122 usec, L: 0
0831 19:54:58.472481 (+ 103us) write_op.cc:270] Start()
0831 19:54:58.472496 (+ 15us) write_op.cc:276] Timestamp: P: 1756670095317794 usec, L: 0
0831 19:54:58.472605 (+ 109us) write_op.cc:270] Start()
0831 19:54:58.472621 (+ 16us) write_op.cc:276] Timestamp: P: 1756670095328553 usec, L: 0
0831 19:54:58.472765 (+ 144us) write_op.cc:270] Start()
0831 19:54:58.472790 (+ 25us) write_op.cc:276] Timestamp: P: 1756670095335545 usec, L: 0
0831 19:54:58.472946 (+ 156us) write_op.cc:270] Start()
0831 19:54:58.472968 (+ 22us) write_op.cc:276] Timestamp: P: 1756670095350679 usec, L: 0
0831 19:54:58.477726 (+ 4758us) write_op.cc:270] Start()
0831 19:54:58.477750 (+ 24us) write_op.cc:276] Timestamp: P: 1756670095395509 usec, L: 0
0831 19:54:58.477906 (+ 156us) write_op.cc:270] Start()
0831 19:54:58.477928 (+ 22us) write_op.cc:276] Timestamp: P: 1756670095549793 usec, L: 0
0831 19:54:58.478076 (+ 148us) write_op.cc:270] Start()
0831 19:54:58.478094 (+ 18us) write_op.cc:276] Timestamp: P: 1756670095556581 usec, L: 0
0831 19:54:58.478242 (+ 148us) write_op.cc:270] Start()
0831 19:54:58.478260 (+ 18us) write_op.cc:276] Timestamp: P: 1756670095579594 usec, L: 0
0831 19:54:58.478366 (+ 106us) write_op.cc:270] Start()
0831 19:54:58.478382 (+ 16us) write_op.cc:276] Timestamp: P: 1756670095617472 usec, L: 0
0831 19:54:58.478595 (+ 213us) write_op.cc:270] Start()
0831 19:54:58.478615 (+ 20us) write_op.cc:276] Timestamp: P: 1756670095658017 usec, L: 0
0831 19:54:58.478759 (+ 144us) write_op.cc:270] Start()
0831 19:54:58.478779 (+ 20us) write_op.cc:276] Timestamp: P: 1756670095700319 usec, L: 0
0831 19:54:58.478937 (+ 158us) write_op.cc:270] Start()
0831 19:54:58.478955 (+ 18us) write_op.cc:276] Timestamp: P: 1756670095801260 usec, L: 0
0831 19:54:58.479074 (+ 119us) write_op.cc:270] Start()
0831 19:54:58.479089 (+ 15us) write_op.cc:276] Timestamp: P: 1756670095818388 usec, L: 0
0831 19:54:58.479196 (+ 107us) write_op.cc:270] Start()
0831 19:54:58.479233 (+ 37us) write_op.cc:276] Timestamp: P: 1756670095835531 usec, L: 0
0831 19:54:58.479332 (+ 99us) write_op.cc:270] Start()
0831 19:54:58.479348 (+ 16us) write_op.cc:276] Timestamp: P: 1756670095845755 usec, L: 0
0831 19:54:58.479481 (+ 133us) write_op.cc:270] Start()
0831 19:54:58.479498 (+ 17us) write_op.cc:276] Timestamp: P: 1756670096037144 usec, L: 0
0831 19:54:58.479621 (+ 123us) write_op.cc:270] Start()
0831 19:54:58.479643 (+ 22us) write_op.cc:276] Timestamp: P: 1756670096047490 usec, L: 0
0831 19:54:58.479755 (+ 112us) write_op.cc:270] Start()
0831 19:54:58.479772 (+ 17us) write_op.cc:276] Timestamp: P: 1756670096083970 usec, L: 0
0831 19:54:58.479886 (+ 114us) write_op.cc:270] Start()
0831 19:54:58.479903 (+ 17us) write_op.cc:276] Timestamp: P: 1756670096091154 usec, L: 0
0831 19:54:58.480004 (+ 101us) write_op.cc:270] Start()
0831 19:54:58.480019 (+ 15us) write_op.cc:276] Timestamp: P: 1756670096117927 usec, L: 0
0831 19:54:58.480119 (+ 100us) write_op.cc:270] Start()
0831 19:54:58.480135 (+ 16us) write_op.cc:276] Timestamp: P: 1756670096123851 usec, L: 0
0831 19:54:58.480250 (+ 115us) write_op.cc:270] Start()
0831 19:54:58.480266 (+ 16us) write_op.cc:276] Timestamp: P: 1756670096135988 usec, L: 0
0831 19:54:58.480409 (+ 143us) write_op.cc:270] Start()
0831 19:54:58.480425 (+ 16us) write_op.cc:276] Timestamp: P: 1756670096143676 usec, L: 0
0831 19:54:58.480538 (+ 113us) write_op.cc:270] Start()
0831 19:54:58.480553 (+ 15us) write_op.cc:276] Timestamp: P: 1756670096156532 usec, L: 0
0831 19:54:58.480652 (+ 99us) write_op.cc:270] Start()
0831 19:54:58.480668 (+ 16us) write_op.cc:276] Timestamp: P: 1756670096163652 usec, L: 0
0831 19:54:58.484715 (+ 4047us) write_op.cc:270] Start()
0831 19:54:58.484745 (+ 30us) write_op.cc:276] Timestamp: P: 1756670096190306 usec, L: 0
0831 19:54:58.484926 (+ 181us) write_op.cc:270] Start()
0831 19:54:58.484946 (+ 20us) write_op.cc:276] Timestamp: P: 1756670096197105 usec, L: 0
0831 19:54:58.485067 (+ 121us) write_op.cc:270] Start()
0831 19:54:58.485084 (+ 17us) write_op.cc:276] Timestamp: P: 1756670096205864 usec, L: 0
0831 19:54:58.485218 (+ 134us) write_op.cc:270] Start()
0831 19:54:58.485238 (+ 20us) write_op.cc:276] Timestamp: P: 1756670096209080 usec, L: 0
0831 19:54:58.485353 (+ 115us) write_op.cc:270] Start()
0831 19:54:58.485369 (+ 16us) write_op.cc:276] Timestamp: P: 1756670096311305 usec, L: 0
0831 19:54:58.486547 (+ 1178us) write_op.cc:270] Start()
0831 19:54:58.486571 (+ 24us) write_op.cc:276] Timestamp: P: 1756670096341236 usec, L: 0
0831 19:54:58.486713 (+ 142us) write_op.cc:270] Start()
0831 19:54:58.486732 (+ 19us) write_op.cc:276] Timestamp: P: 1756670096351101 usec, L: 0
0831 19:54:58.486887 (+ 155us) write_op.cc:270] Start()
0831 19:54:58.486905 (+ 18us) write_op.cc:276] Timestamp: P: 1756670096351662 usec, L: 0
0831 19:54:58.487018 (+ 113us) write_op.cc:270] Start()
0831 19:54:58.487039 (+ 21us) write_op.cc:276] Timestamp: P: 1756670096376537 usec, L: 0
0831 19:54:58.487167 (+ 128us) write_op.cc:270] Start()
0831 19:54:58.487184 (+ 17us) write_op.cc:276] Timestamp: P: 1756670096389551 usec, L: 0
0831 19:54:58.487301 (+ 117us) write_op.cc:270] Start()
0831 19:54:58.487317 (+ 16us) write_op.cc:276] Timestamp: P: 1756670096418853 usec, L: 0
0831 19:54:58.487427 (+ 110us) write_op.cc:270] Start()
0831 19:54:58.487444 (+ 17us) write_op.cc:276] Timestamp: P: 1756670096430445 usec, L: 0
0831 19:54:58.487588 (+ 144us) write_op.cc:270] Start()
0831 19:54:58.487608 (+ 20us) write_op.cc:276] Timestamp: P: 1756670096444782 usec, L: 0
0831 19:54:58.487743 (+ 135us) write_op.cc:270] Start()
0831 19:54:58.487761 (+ 18us) write_op.cc:276] Timestamp: P: 1756670096458219 usec, L: 0
0831 19:54:58.487921 (+ 160us) write_op.cc:270] Start()
0831 19:54:58.487940 (+ 19us) write_op.cc:276] Timestamp: P: 1756670096468371 usec, L: 0
0831 19:54:58.488061 (+ 121us) write_op.cc:270] Start()
0831 19:54:58.488080 (+ 19us) write_op.cc:276] Timestamp: P: 1756670096472050 usec, L: 0
0831 19:54:58.488203 (+ 123us) write_op.cc:270] Start()
0831 19:54:58.488222 (+ 19us) write_op.cc:276] Timestamp: P: 1756670096524368 usec, L: 0
0831 19:54:58.500723 (+ 12501us) write_op.cc:270] Start()
0831 19:54:58.500754 (+ 31us) write_op.cc:276] Timestamp: P: 1756670096550901 usec, L: 0
0831 19:54:58.500937 (+ 183us) write_op.cc:270] Start()
0831 19:54:58.507274 (+ 6337us) write_op.cc:276] Timestamp: P: 1756670096558045 usec, L: 0
0831 19:54:58.507477 (+ 203us) write_op.cc:270] Start()
0831 19:54:58.507501 (+ 24us) write_op.cc:276] Timestamp: P: 1756670096585526 usec, L: 0
0831 19:54:58.507695 (+ 194us) write_op.cc:270] Start()
0831 19:54:58.507717 (+ 22us) write_op.cc:276] Timestamp: P: 1756670096596913 usec, L: 0
0831 19:54:58.507868 (+ 151us) write_op.cc:270] Start()
0831 19:54:58.507889 (+ 21us) write_op.cc:276] Timestamp: P: 1756670096604483 usec, L: 0
0831 19:54:58.508056 (+ 167us) write_op.cc:270] Start()
0831 19:54:58.508079 (+ 23us) write_op.cc:276] Timestamp: P: 1756670096733119 usec, L: 0
0831 19:54:58.508203 (+ 124us) write_op.cc:270] Start()
0831 19:54:58.508221 (+ 18us) write_op.cc:276] Timestamp: P: 1756670096750030 usec, L: 0
0831 19:54:58.508379 (+ 158us) write_op.cc:270] Start()
0831 19:54:58.508477 (+ 98us) write_op.cc:276] Timestamp: P: 1756670096761381 usec, L: 0
0831 19:54:58.508667 (+ 190us) write_op.cc:270] Start()
0831 19:54:58.508690 (+ 23us) write_op.cc:276] Timestamp: P: 1756670096808631 usec, L: 0
0831 19:54:58.508874 (+ 184us) write_op.cc:270] Start()
0831 19:54:58.508936 (+ 62us) write_op.cc:276] Timestamp: P: 1756670096837434 usec, L: 0
0831 19:54:58.509128 (+ 192us) write_op.cc:270] Start()
0831 19:54:58.509150 (+ 22us) write_op.cc:276] Timestamp: P: 1756670096847623 usec, L: 0
0831 19:54:58.509290 (+ 140us) write_op.cc:270] Start()
0831 19:54:58.509312 (+ 22us) write_op.cc:276] Timestamp: P: 1756670096901862 usec, L: 0
0831 19:54:58.509489 (+ 177us) write_op.cc:270] Start()
0831 19:54:58.509511 (+ 22us) write_op.cc:276] Timestamp: P: 1756670096956211 usec, L: 0
0831 19:54:58.509672 (+ 161us) write_op.cc:270] Start()
0831 19:54:58.509693 (+ 21us) write_op.cc:276] Timestamp: P: 1756670096987326 usec, L: 0
0831 19:54:58.509819 (+ 126us) write_op.cc:270] Start()
0831 19:54:58.509848 (+ 29us) write_op.cc:276] Timestamp: P: 1756670097082221 usec, L: 0
0831 19:54:58.510030 (+ 182us) write_op.cc:270] Start()
0831 19:54:58.510052 (+ 22us) write_op.cc:276] Timestamp: P: 1756670097142165 usec, L: 0
0831 19:54:58.510192 (+ 140us) write_op.cc:270] Start()
0831 19:54:58.510213 (+ 21us) write_op.cc:276] Timestamp: P: 1756670097172966 usec, L: 0
0831 19:54:58.522161 (+ 11948us) log.cc:844] Serialized 93003 byte log entry
0831 19:54:58.550797 (+ 28636us) raft_consensus.cc:1643] Marking committed up to 453
0831 19:54:58.551811 (+ 1014us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:58.551816 (+ 5us) write_op.cc:454] Released schema lock
0831 19:54:58.561545 (+ 9729us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:58.561549 (+ 4us) write_op.cc:454] Released schema lock
0831 19:54:58.562364 (+ 815us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:58.562368 (+ 4us) write_op.cc:454] Released schema lock
0831 19:54:58.563027 (+ 659us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:58.563032 (+ 5us) write_op.cc:454] Released schema lock
0831 19:54:58.563634 (+ 602us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:58.563638 (+ 4us) write_op.cc:454] Released schema lock
0831 19:54:58.564172 (+ 534us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:58.564176 (+ 4us) write_op.cc:454] Released schema lock
0831 19:54:58.564728 (+ 552us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:58.564732 (+ 4us) write_op.cc:454] Released schema lock
0831 19:54:58.565325 (+ 593us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:58.565330 (+ 5us) write_op.cc:454] Released schema lock
0831 19:54:58.565868 (+ 538us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:58.565872 (+ 4us) write_op.cc:454] Released schema lock
0831 19:54:58.567309 (+ 1437us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:58.567313 (+ 4us) write_op.cc:454] Released schema lock
0831 19:54:58.568184 (+ 871us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:58.568189 (+ 5us) write_op.cc:454] Released schema lock
0831 19:54:58.568711 (+ 522us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:58.568716 (+ 5us) write_op.cc:454] Released schema lock
0831 19:54:58.570222 (+ 1506us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:58.570226 (+ 4us) write_op.cc:454] Released schema lock
0831 19:54:58.570920 (+ 694us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:58.570924 (+ 4us) write_op.cc:454] Released schema lock
0831 19:54:58.571445 (+ 521us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:58.571449 (+ 4us) write_op.cc:454] Released schema lock
0831 19:54:58.571982 (+ 533us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:58.571987 (+ 5us) write_op.cc:454] Released schema lock
0831 19:54:58.573579 (+ 1592us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:58.573582 (+ 3us) write_op.cc:454] Released schema lock
0831 19:54:58.574112 (+ 530us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:58.574115 (+ 3us) write_op.cc:454] Released schema lock
0831 19:54:58.574762 (+ 647us
I20250831 19:54:58.674075 1614 tablet_service.cc:1515] Processing DeleteTablet for tablet 2c03497e3cb4480d88d99dde5d6ea22b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:58 UTC) from {username='slave'} at 127.0.0.1:51022
I20250831 19:54:58.674341 3312 tablet_replica.cc:331] T 2c03497e3cb4480d88d99dde5d6ea22b P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:54:58.674510 3312 raft_consensus.cc:2241] T 2c03497e3cb4480d88d99dde5d6ea22b P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:58.674651 3312 raft_consensus.cc:2270] T 2c03497e3cb4480d88d99dde5d6ea22b P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:58.675139 3312 ts_tablet_manager.cc:1905] T 2c03497e3cb4480d88d99dde5d6ea22b P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:58.675741 1886 tablet_service.cc:1515] Processing DeleteTablet for tablet 2c03497e3cb4480d88d99dde5d6ea22b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:58 UTC) from {username='slave'} at 127.0.0.1:45906
I20250831 19:54:58.674279 1609 tablet_service.cc:1468] Processing CreateTablet for tablet f47cf07c9a4a43048123794e4a51904b (DEFAULT_TABLE table=default.table_4c0155db27d445829ea2e453cd3ad0f3 [id=7d31bd8f26c94d15b09cf05778a2f253]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:58.676013 1884 tablet_service.cc:1468] Processing CreateTablet for tablet f47cf07c9a4a43048123794e4a51904b (DEFAULT_TABLE table=default.table_4c0155db27d445829ea2e453cd3ad0f3 [id=7d31bd8f26c94d15b09cf05778a2f253]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:58.676170 1609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f47cf07c9a4a43048123794e4a51904b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:58.676311 1884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f47cf07c9a4a43048123794e4a51904b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:58.681846 3372 tablet_bootstrap.cc:492] T f47cf07c9a4a43048123794e4a51904b P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:58.683202 3372 tablet_bootstrap.cc:654] T f47cf07c9a4a43048123794e4a51904b P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:58.684092 3310 ts_tablet_manager.cc:1918] T 5ed927d4935143968fb89a73730eb8a1 P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250831 19:54:58.684280 3310 log.cc:1199] T 5ed927d4935143968fb89a73730eb8a1 P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/5ed927d4935143968fb89a73730eb8a1
I20250831 19:54:58.684762 3310 ts_tablet_manager.cc:1939] T 5ed927d4935143968fb89a73730eb8a1 P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:54:58.686175 3310 tablet_replica.cc:331] T b67e0472244e4d79b8dfb7e7474b96b7 P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:54:58.686125 2101 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet 5ed927d4935143968fb89a73730eb8a1 (table default.table_207ac87518bc487184a89bb52cd204b3 [id=f48af5bc3eff4c819be4aeeff4128c2a]) successfully deleted
I20250831 19:54:58.686470 3310 raft_consensus.cc:2241] T b67e0472244e4d79b8dfb7e7474b96b7 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:58.686839 3310 raft_consensus.cc:2270] T b67e0472244e4d79b8dfb7e7474b96b7 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:58.687377 3312 ts_tablet_manager.cc:1918] T 2c03497e3cb4480d88d99dde5d6ea22b P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:58.687518 3312 log.cc:1199] T 2c03497e3cb4480d88d99dde5d6ea22b P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/2c03497e3cb4480d88d99dde5d6ea22b
I20250831 19:54:58.687536 3310 ts_tablet_manager.cc:1905] T b67e0472244e4d79b8dfb7e7474b96b7 P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:58.687942 3312 ts_tablet_manager.cc:1939] T 2c03497e3cb4480d88d99dde5d6ea22b P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
I20250831 19:54:58.688401 2104 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet 2c03497e3cb4480d88d99dde5d6ea22b (table default.table_265519e91af542d1836f224e15cd5e60 [id=67d77a3f228b4f1da86b97cac2fc4aac]) successfully deleted
I20250831 19:54:58.695474 2118 catalog_manager.cc:5582] T eb97839972ba4bda89287c30da49bb40 P 89aa85d59c53436ebdf3074b13d14825 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193). New cstate: current_term: 1 leader_uuid: "89aa85d59c53436ebdf3074b13d14825" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: HEALTHY } } }
I20250831 19:54:58.700377 1614 tablet_service.cc:1468] Processing CreateTablet for tablet 06c27385b0b8460c9ea4f1d96ecb2966 (DEFAULT_TABLE table=default.table_4e12fc12cae640b99d4f3794151b6915 [id=ba4c5ecf4ae94ede9bfb83af2ee894ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:58.700718 1614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06c27385b0b8460c9ea4f1d96ecb2966. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:58.701877 1884 tablet_service.cc:1468] Processing CreateTablet for tablet 8afbd19c84f14fbb8f957c2f10d97a4c (DEFAULT_TABLE table=default.table_c48f1c99f3174cb8acca698339447ed9 [id=f707909e6af44750a5fc5e3b15af0b24]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:58.702178 1884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8afbd19c84f14fbb8f957c2f10d97a4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:58.703706 2837 sys_catalog.cc:455] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } } }
I20250831 19:54:58.703876 1886 tablet_service.cc:1468] Processing CreateTablet for tablet 06c27385b0b8460c9ea4f1d96ecb2966 (DEFAULT_TABLE table=default.table_4e12fc12cae640b99d4f3794151b6915 [id=ba4c5ecf4ae94ede9bfb83af2ee894ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:58.703948 2837 sys_catalog.cc:458] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [sys.catalog]: This master's current role is: LEADER
I20250831 19:54:58.704167 1886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06c27385b0b8460c9ea4f1d96ecb2966. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:58.705922 1609 tablet_service.cc:1468] Processing CreateTablet for tablet 8afbd19c84f14fbb8f957c2f10d97a4c (DEFAULT_TABLE table=default.table_c48f1c99f3174cb8acca698339447ed9 [id=f707909e6af44750a5fc5e3b15af0b24]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:58.706209 1609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8afbd19c84f14fbb8f957c2f10d97a4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:58.715513 2124 catalog_manager.cc:5674] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475) does not have the latest schema for tablet d56dcc30166043c68c3f1c05e7f7bde0 (table default.table_c7390b7344da4c3fbf7f2f502b096669 [id=1df66f6230794e939a25c0f2254d6e17]). Expected version 2 got 0
I20250831 19:54:58.716533 3372 tablet_bootstrap.cc:492] T f47cf07c9a4a43048123794e4a51904b P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:58.716725 3372 ts_tablet_manager.cc:1397] T f47cf07c9a4a43048123794e4a51904b P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.035s user 0.006s sys 0.000s
I20250831 19:54:58.717448 3372 raft_consensus.cc:357] T f47cf07c9a4a43048123794e4a51904b P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:58.717687 3372 raft_consensus.cc:383] T f47cf07c9a4a43048123794e4a51904b P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:58.717775 3372 raft_consensus.cc:738] T f47cf07c9a4a43048123794e4a51904b P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:58.717998 3372 consensus_queue.cc:260] T f47cf07c9a4a43048123794e4a51904b P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:58.718613 3372 ts_tablet_manager.cc:1428] T f47cf07c9a4a43048123794e4a51904b P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250831 19:54:58.719987 2118 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36958:
name: "default.Table_76aceaaac1fb4aaeb55445d641a113d1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:58.721781 3372 tablet_bootstrap.cc:492] T 06c27385b0b8460c9ea4f1d96ecb2966 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:58.723242 3372 tablet_bootstrap.cc:654] T 06c27385b0b8460c9ea4f1d96ecb2966 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:58.725481 2123 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:36958 (request call id 190) took 2310 ms. Trace:
I20250831 19:54:58.725636 2123 rpcz_store.cc:276] 0831 19:54:56.415051 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:57.797203 (+1382152us) service_pool.cc:225] Handling call
0831 19:54:58.446058 (+648855us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:58.725425 (+279367us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":27630,"Hive Metastore.run_cpu_time_us":154,"Hive Metastore.run_wall_time_us":68085}
I20250831 19:54:58.726181 2123 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36958:
name: "default.Table_be7bbefda22d4660a8d257962bfe0979"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250831 19:54:58.727675 2119 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_75aa254646a24998b06bc2c45a479df2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250831 19:54:58.733825 3355 consensus_queue.cc:1035] T eb97839972ba4bda89287c30da49bb40 P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:58.740473 2121 catalog_manager.cc:3460] renamed table default.table_b90139c92a0d426db7ba39ca376bd8e2 [id=690a54011d784c13992fd596584eadb8] in HMS: new name default.table_b63fcfe30c4b42e4aab0afa9159eff8b
I20250831 19:54:58.743878 3372 tablet_bootstrap.cc:492] T 06c27385b0b8460c9ea4f1d96ecb2966 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:58.744050 3372 ts_tablet_manager.cc:1397] T 06c27385b0b8460c9ea4f1d96ecb2966 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.022s user 0.004s sys 0.000s
I20250831 19:54:58.744727 3372 raft_consensus.cc:357] T 06c27385b0b8460c9ea4f1d96ecb2966 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:58.745813 3372 raft_consensus.cc:383] T 06c27385b0b8460c9ea4f1d96ecb2966 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:58.745926 3372 raft_consensus.cc:738] T 06c27385b0b8460c9ea4f1d96ecb2966 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:58.745929 2117 master_service.cc:948] ReplaceTablet: received request to replace tablet d56dcc30166043c68c3f1c05e7f7bde0 from {username='slave'} at 127.0.0.1:36958
I20250831 19:54:58.746160 3372 consensus_queue.cc:260] T 06c27385b0b8460c9ea4f1d96ecb2966 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:58.746619 3372 ts_tablet_manager.cc:1428] T 06c27385b0b8460c9ea4f1d96ecb2966 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250831 19:54:58.746892 3372 tablet_bootstrap.cc:492] T 8afbd19c84f14fbb8f957c2f10d97a4c P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:58.745136 2124 catalog_manager.cc:6127] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: default.table_1dd756d1d1c14b878105f242f44b087e [id=aabaa79336954b3ab0450dcff3afa7bf] alter complete (version 3)
I20250831 19:54:58.748704 2124 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_1dc7d3d86ed047bd8c86e21d7b38f477" } new_table_name: "default.Table_2f8e5422042942d6a683316fbd7ac45d" modify_external_catalogs: true
I20250831 19:54:58.677515 1749 tablet_service.cc:1468] Processing CreateTablet for tablet f47cf07c9a4a43048123794e4a51904b (DEFAULT_TABLE table=default.table_4c0155db27d445829ea2e453cd3ad0f3 [id=7d31bd8f26c94d15b09cf05778a2f253]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:58.752424 1749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f47cf07c9a4a43048123794e4a51904b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:58.753702 3372 tablet_bootstrap.cc:654] T 8afbd19c84f14fbb8f957c2f10d97a4c P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:58.758622 2117 catalog_manager.cc:5869] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Sending DeleteTablet for 3 replicas of tablet d56dcc30166043c68c3f1c05e7f7bde0
I20250831 19:54:58.759184 2117 catalog_manager.cc:6652] ReplaceTablet: tablet d56dcc30166043c68c3f1c05e7f7bde0 deleted and replaced by tablet e47844d025bf42ecbfd2d3f34a31538e
I20250831 19:54:58.759311 2117 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:36958 (request call id 203) took 1546 ms. Trace:
I20250831 19:54:58.759420 2117 rpcz_store.cc:276] 0831 19:54:57.212699 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:58.745836 (+1533137us) service_pool.cc:225] Handling call
0831 19:54:58.759264 (+ 13428us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:58.747042 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:58.747133 (+ 91us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:58.747137 (+ 4us) write_op.cc:435] Acquired schema lock
0831 19:54:58.747139 (+ 2us) tablet.cc:660] Decoding operations
0831 19:54:58.747231 (+ 92us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:58.747243 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:58.747250 (+ 7us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:58.747322 (+ 72us) tablet.cc:699] Row locks acquired
0831 19:54:58.747324 (+ 2us) write_op.cc:260] PREPARE: finished
0831 19:54:58.747354 (+ 30us) write_op.cc:270] Start()
0831 19:54:58.747380 (+ 26us) write_op.cc:276] Timestamp: P: 1756670098747305 usec, L: 0
0831 19:54:58.747383 (+ 3us) op_driver.cc:348] REPLICATION: starting
0831 19:54:58.747618 (+ 235us) log.cc:844] Serialized 656 byte log entry
0831 19:54:58.755909 (+ 8291us) op_driver.cc:464] REPLICATION: finished
0831 19:54:58.757658 (+ 1749us) write_op.cc:301] APPLY: starting
0831 19:54:58.757679 (+ 21us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:58.757753 (+ 74us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:58.757793 (+ 40us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:58.757930 (+ 137us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:58.757993 (+ 63us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0831 19:54:58.758004 (+ 11us) write_op.cc:312] APPLY: finished
0831 19:54:58.758089 (+ 85us) log.cc:844] Serialized 29 byte log entry
0831 19:54:58.758177 (+ 88us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:58.758202 (+ 25us) write_op.cc:454] Released schema lock
0831 19:54:58.758211 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0831 19:54:58.758307 (+ 96us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:58.758313 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":1678,"apply.run_cpu_time_us":628,"apply.run_wall_time_us":629,"num_ops":2,"prepare.queue_time_us":209,"prepare.run_cpu_time_us":665,"prepare.run_wall_time_us":666,"raft.queue_time_us":60,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":188,"replication_time_us":8501,"spinlock_wait_cycles":85376}]]}
I20250831 19:54:58.762385 1747 tablet_service.cc:1515] Processing DeleteTablet for tablet d56dcc30166043c68c3f1c05e7f7bde0 with delete_type TABLET_DATA_DELETED (replaced by tablet e47844d025bf42ecbfd2d3f34a31538e) from {username='slave'} at 127.0.0.1:50674
I20250831 19:54:58.765755 1886 tablet_service.cc:1515] Processing DeleteTablet for tablet d56dcc30166043c68c3f1c05e7f7bde0 with delete_type TABLET_DATA_DELETED (replaced by tablet e47844d025bf42ecbfd2d3f34a31538e) from {username='slave'} at 127.0.0.1:45906
I20250831 19:54:58.681149 3352 consensus_queue.cc:1035] T 3081636d94084a8aa3905f40edf34b0f P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:58.681660 1751 tablet_service.cc:1515] Processing DeleteTablet for tablet 2c03497e3cb4480d88d99dde5d6ea22b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:54:58 UTC) from {username='slave'} at 127.0.0.1:50674
I20250831 19:54:58.694831 1750 tablet_service.cc:1468] Processing CreateTablet for tablet 8afbd19c84f14fbb8f957c2f10d97a4c (DEFAULT_TABLE table=default.table_c48f1c99f3174cb8acca698339447ed9 [id=f707909e6af44750a5fc5e3b15af0b24]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:58.697417 1752 tablet_service.cc:1468] Processing CreateTablet for tablet 06c27385b0b8460c9ea4f1d96ecb2966 (DEFAULT_TABLE table=default.table_4e12fc12cae640b99d4f3794151b6915 [id=ba4c5ecf4ae94ede9bfb83af2ee894ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:58.766434 1750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8afbd19c84f14fbb8f957c2f10d97a4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:58.766630 1752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06c27385b0b8460c9ea4f1d96ecb2966. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:58.771982 3372 tablet_bootstrap.cc:492] T 8afbd19c84f14fbb8f957c2f10d97a4c P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:58.772785 3372 ts_tablet_manager.cc:1397] T 8afbd19c84f14fbb8f957c2f10d97a4c P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.026s user 0.003s sys 0.004s
I20250831 19:54:58.773787 3372 raft_consensus.cc:357] T 8afbd19c84f14fbb8f957c2f10d97a4c P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:58.775488 3372 raft_consensus.cc:383] T 8afbd19c84f14fbb8f957c2f10d97a4c P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:58.776209 3372 raft_consensus.cc:738] T 8afbd19c84f14fbb8f957c2f10d97a4c P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:58.776580 3372 consensus_queue.cc:260] T 8afbd19c84f14fbb8f957c2f10d97a4c P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:58.777613 3372 ts_tablet_manager.cc:1428] T 8afbd19c84f14fbb8f957c2f10d97a4c P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20250831 19:54:58.792765 1750 tablet_service.cc:1468] Processing CreateTablet for tablet e47844d025bf42ecbfd2d3f34a31538e (DEFAULT_TABLE table=default.table_c7390b7344da4c3fbf7f2f502b096669 [id=1df66f6230794e939a25c0f2254d6e17]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:58.793725 1886 tablet_service.cc:1468] Processing CreateTablet for tablet e47844d025bf42ecbfd2d3f34a31538e (DEFAULT_TABLE table=default.table_c7390b7344da4c3fbf7f2f502b096669 [id=1df66f6230794e939a25c0f2254d6e17]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:58.794101 1886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e47844d025bf42ecbfd2d3f34a31538e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:58.794824 1750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e47844d025bf42ecbfd2d3f34a31538e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:58.797619 1613 tablet_service.cc:1515] Processing DeleteTablet for tablet d56dcc30166043c68c3f1c05e7f7bde0 with delete_type TABLET_DATA_DELETED (replaced by tablet e47844d025bf42ecbfd2d3f34a31538e) from {username='slave'} at 127.0.0.1:51022
I20250831 19:54:58.798270 2117 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36958:
name: "default.Table_a9e5115b40204ad6afb299f06aa717a2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:58.801550 3312 tablet_replica.cc:331] T d56dcc30166043c68c3f1c05e7f7bde0 P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:54:58.802366 1609 tablet_service.cc:1468] Processing CreateTablet for tablet e47844d025bf42ecbfd2d3f34a31538e (DEFAULT_TABLE table=default.table_c7390b7344da4c3fbf7f2f502b096669 [id=1df66f6230794e939a25c0f2254d6e17]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:58.802717 1609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e47844d025bf42ecbfd2d3f34a31538e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:58.803243 3233 consensus_queue.cc:1035] T dc6c1d165b5a484ab98ac55cd2330139 P 2441fafe1d62429386f4631ad423567d [LEADER]: Connected to new peer: Peer: permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:58.805768 2105 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet 5ed927d4935143968fb89a73730eb8a1 (table default.table_207ac87518bc487184a89bb52cd204b3 [id=f48af5bc3eff4c819be4aeeff4128c2a]) successfully deleted
I20250831 19:54:58.812623 3311 tablet_replica.cc:331] T b67e0472244e4d79b8dfb7e7474b96b7 P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:54:58.812880 3311 raft_consensus.cc:2241] T b67e0472244e4d79b8dfb7e7474b96b7 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:58.815701 3372 tablet_bootstrap.cc:492] T e47844d025bf42ecbfd2d3f34a31538e P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:58.817453 3372 tablet_bootstrap.cc:654] T e47844d025bf42ecbfd2d3f34a31538e P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:58.820336 3081 consensus_queue.cc:1035] T eb97839972ba4bda89287c30da49bb40 P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:58.830170 3311 raft_consensus.cc:2270] T b67e0472244e4d79b8dfb7e7474b96b7 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:58.839864 3373 tablet_bootstrap.cc:492] T a9d383f8caed44958fb3fa6ed1ca580e P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:58.840008 3322 consensus_queue.cc:1035] T dc6c1d165b5a484ab98ac55cd2330139 P 2441fafe1d62429386f4631ad423567d [LEADER]: Connected to new peer: Peer: permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:58.841406 3373 tablet_bootstrap.cc:654] T a9d383f8caed44958fb3fa6ed1ca580e P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:58.842667 3375 tablet_bootstrap.cc:492] T 61101a699bb84b62af4e7a0cae243d4e P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:58.844221 3375 tablet_bootstrap.cc:654] T 61101a699bb84b62af4e7a0cae243d4e P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:58.852593 3311 ts_tablet_manager.cc:1905] T b67e0472244e4d79b8dfb7e7474b96b7 P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:58.862072 3081 raft_consensus.cc:491] T 61101a699bb84b62af4e7a0cae243d4e P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:58.862208 3081 raft_consensus.cc:513] T 61101a699bb84b62af4e7a0cae243d4e P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:58.862726 3081 leader_election.cc:290] T 61101a699bb84b62af4e7a0cae243d4e P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:58.863605 1902 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "61101a699bb84b62af4e7a0cae243d4e" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:58.863620 1772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "61101a699bb84b62af4e7a0cae243d4e" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
W20250831 19:54:58.864060 1568 leader_election.cc:343] T 61101a699bb84b62af4e7a0cae243d4e P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): Illegal state: must be running to vote when last-logged opid is not known
W20250831 19:54:58.864374 1570 leader_election.cc:343] T 61101a699bb84b62af4e7a0cae243d4e P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): Illegal state: must be running to vote when last-logged opid is not known
I20250831 19:54:58.864498 1570 leader_election.cc:304] T 61101a699bb84b62af4e7a0cae243d4e P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825; no voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197
I20250831 19:54:58.864852 3081 raft_consensus.cc:2747] T 61101a699bb84b62af4e7a0cae243d4e P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250831 19:54:58.881889 3333 tablet.cc:1722] T fae02e9ed1434c7c82f6c5faa3a1acec P 2441fafe1d62429386f4631ad423567d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:58.882416 1952 heartbeater.cc:344] Connected to a master server at 127.1.1.254:34259
I20250831 19:54:58.890368 3372 tablet_bootstrap.cc:492] T e47844d025bf42ecbfd2d3f34a31538e P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:58.891067 3372 ts_tablet_manager.cc:1397] T e47844d025bf42ecbfd2d3f34a31538e P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.075s user 0.010s sys 0.009s
I20250831 19:54:58.893383 3372 raft_consensus.cc:357] T e47844d025bf42ecbfd2d3f34a31538e P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:58.893989 3312 raft_consensus.cc:2241] T d56dcc30166043c68c3f1c05e7f7bde0 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:58.895524 3312 pending_rounds.cc:70] T d56dcc30166043c68c3f1c05e7f7bde0 P 89aa85d59c53436ebdf3074b13d14825: Trying to abort 2 pending ops.
I20250831 19:54:58.895568 3312 pending_rounds.cc:77] T d56dcc30166043c68c3f1c05e7f7bde0 P 89aa85d59c53436ebdf3074b13d14825: Aborting op as it isn't in flight: id { term: 1 index: 2 } timestamp: 7195320723553550336 op_type: ALTER_SCHEMA_OP alter_schema_request { tablet_id: "d56dcc30166043c68c3f1c05e7f7bde0" schema { columns { id: 10 name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } schema_version: 2 new_table_name: "default.table_c7390b7344da4c3fbf7f2f502b096669" dest_uuid: "2441fafe1d62429386f4631ad423567d" new_extra_config { } }
I20250831 19:54:58.895886 3312 pending_rounds.cc:77] T d56dcc30166043c68c3f1c05e7f7bde0 P 89aa85d59c53436ebdf3074b13d14825: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7195320720022052864 op_type: NO_OP noop_request { }
I20250831 19:54:58.895960 3312 raft_consensus.cc:2887] T d56dcc30166043c68c3f1c05e7f7bde0 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20250831 19:54:58.896039 3312 raft_consensus.cc:2270] T d56dcc30166043c68c3f1c05e7f7bde0 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:58.896958 3372 raft_consensus.cc:383] T e47844d025bf42ecbfd2d3f34a31538e P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:58.897073 3372 raft_consensus.cc:738] T e47844d025bf42ecbfd2d3f34a31538e P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:58.897673 3312 ts_tablet_manager.cc:1905] T d56dcc30166043c68c3f1c05e7f7bde0 P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:58.901867 3310 ts_tablet_manager.cc:1918] T b67e0472244e4d79b8dfb7e7474b96b7 P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20250831 19:54:58.901975 3310 log.cc:1199] T b67e0472244e4d79b8dfb7e7474b96b7 P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/b67e0472244e4d79b8dfb7e7474b96b7
I20250831 19:54:58.902290 3310 ts_tablet_manager.cc:1939] T b67e0472244e4d79b8dfb7e7474b96b7 P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:54:58.903225 2101 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet b67e0472244e4d79b8dfb7e7474b96b7 (table default.table_4e12fc12cae640b99d4f3794151b6915 [id=ba4c5ecf4ae94ede9bfb83af2ee894ab]) successfully deleted
I20250831 19:54:58.905424 3356 tablet.cc:1722] T fae02e9ed1434c7c82f6c5faa3a1acec P de831f40fa1348a48a1f0260f4130197: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:58.910468 3312 ts_tablet_manager.cc:1918] T d56dcc30166043c68c3f1c05e7f7bde0 P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250831 19:54:58.910609 3312 log.cc:1199] T d56dcc30166043c68c3f1c05e7f7bde0 P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/d56dcc30166043c68c3f1c05e7f7bde0
I20250831 19:54:58.911016 3312 ts_tablet_manager.cc:1939] T d56dcc30166043c68c3f1c05e7f7bde0 P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
I20250831 19:54:58.911582 2104 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet d56dcc30166043c68c3f1c05e7f7bde0 (table default.table_c7390b7344da4c3fbf7f2f502b096669 [id=1df66f6230794e939a25c0f2254d6e17]) successfully deleted
I20250831 19:54:58.912570 3375 tablet_bootstrap.cc:492] T 61101a699bb84b62af4e7a0cae243d4e P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:58.912735 3375 ts_tablet_manager.cc:1397] T 61101a699bb84b62af4e7a0cae243d4e P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.070s user 0.005s sys 0.000s
W20250831 19:54:58.915041 1841 consensus_peers.cc:489] T d56dcc30166043c68c3f1c05e7f7bde0 P 2441fafe1d62429386f4631ad423567d -> Peer 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): Couldn't send request to peer 89aa85d59c53436ebdf3074b13d14825. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d56dcc30166043c68c3f1c05e7f7bde0. This is attempt 1: this message will repeat every 5th retry.
I20250831 19:54:58.915194 3372 consensus_queue.cc:260] T e47844d025bf42ecbfd2d3f34a31538e P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:58.915885 3372 ts_tablet_manager.cc:1428] T e47844d025bf42ecbfd2d3f34a31538e P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.023s user 0.001s sys 0.000s
I20250831 19:54:58.895040 3394 tablet.cc:1722] T fae02e9ed1434c7c82f6c5faa3a1acec P 89aa85d59c53436ebdf3074b13d14825: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20250831 19:54:58.923992 1706 consensus_peers.cc:489] T 2c03497e3cb4480d88d99dde5d6ea22b P de831f40fa1348a48a1f0260f4130197 -> Peer 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): Couldn't send request to peer 89aa85d59c53436ebdf3074b13d14825. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2c03497e3cb4480d88d99dde5d6ea22b. This is attempt 1: this message will repeat every 5th retry.
I20250831 19:54:58.926721 3311 ts_tablet_manager.cc:1918] T b67e0472244e4d79b8dfb7e7474b96b7 P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20250831 19:54:58.926896 3311 log.cc:1199] T b67e0472244e4d79b8dfb7e7474b96b7 P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/b67e0472244e4d79b8dfb7e7474b96b7
I20250831 19:54:58.928220 3311 ts_tablet_manager.cc:1939] T b67e0472244e4d79b8dfb7e7474b96b7 P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
I20250831 19:54:58.929282 2105 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet b67e0472244e4d79b8dfb7e7474b96b7 (table default.table_4e12fc12cae640b99d4f3794151b6915 [id=ba4c5ecf4ae94ede9bfb83af2ee894ab]) successfully deleted
I20250831 19:54:58.936021 2122 catalog_manager.cc:2149] created HMS catalog entry for table [id=0e44d9b8a8044f2685d97f13e0b15ef3]
I20250831 19:54:58.941704 3375 raft_consensus.cc:357] T 61101a699bb84b62af4e7a0cae243d4e P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:58.941903 3375 raft_consensus.cc:383] T 61101a699bb84b62af4e7a0cae243d4e P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:58.941962 3375 raft_consensus.cc:738] T 61101a699bb84b62af4e7a0cae243d4e P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:58.942165 3311 tablet_replica.cc:331] T 43b456d5ee8d40e1a8999565cec2d230 P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:54:58.942368 2122 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:36958 (request call id 194) took 2363 ms. Trace:
I20250831 19:54:58.942456 3311 raft_consensus.cc:2241] T 43b456d5ee8d40e1a8999565cec2d230 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:58.942585 3311 raft_consensus.cc:2270] T 43b456d5ee8d40e1a8999565cec2d230 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:58.942495 2122 rpcz_store.cc:276] 0831 19:54:56.578806 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:58.207327 (+1628521us) service_pool.cc:225] Handling call
0831 19:54:58.596255 (+388928us) catalog_manager.cc:2076] Acquired catalog manager lock
0831 19:54:58.597701 (+ 1446us) catalog_manager.cc:2122] Created new table and tablet info
0831 19:54:58.935977 (+338276us) catalog_manager.cc:2148] Created new table in HMS catalog
0831 19:54:58.942086 (+ 6109us) catalog_manager.cc:2182] Wrote table and tablets to system table
0831 19:54:58.942201 (+ 115us) catalog_manager.cc:2216] Inserted table and tablets into CatalogManager maps
0831 19:54:58.942325 (+ 124us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:58.936715 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:58.936827 (+ 112us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:58.936833 (+ 6us) write_op.cc:435] Acquired schema lock
0831 19:54:58.936836 (+ 3us) tablet.cc:660] Decoding operations
0831 19:54:58.936924 (+ 88us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:58.936937 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:58.936941 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:58.937018 (+ 77us) tablet.cc:699] Row locks acquired
0831 19:54:58.937021 (+ 3us) write_op.cc:260] PREPARE: finished
0831 19:54:58.937060 (+ 39us) write_op.cc:270] Start()
0831 19:54:58.937098 (+ 38us) write_op.cc:276] Timestamp: P: 1756670098936989 usec, L: 0
0831 19:54:58.937103 (+ 5us) op_driver.cc:348] REPLICATION: starting
0831 19:54:58.937304 (+ 201us) log.cc:844] Serialized 433 byte log entry
0831 19:54:58.940842 (+ 3538us) op_driver.cc:464] REPLICATION: finished
0831 19:54:58.940944 (+ 102us) write_op.cc:301] APPLY: starting
0831 19:54:58.940960 (+ 16us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:58.941004 (+ 44us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:58.941033 (+ 29us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:58.941137 (+ 104us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:58.941172 (+ 35us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0831 19:54:58.941179 (+ 7us) write_op.cc:312] APPLY: finished
0831 19:54:58.941252 (+ 73us) log.cc:844] Serialized 29 byte log entry
0831 19:54:58.941312 (+ 60us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:58.941333 (+ 21us) write_op.cc:454] Released schema lock
0831 19:54:58.941340 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0831 19:54:58.941404 (+ 64us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:58.941407 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":142389,"Hive Metastore.run_cpu_time_us":273,"Hive Metastore.run_wall_time_us":195459,"child_traces":[["op",{"apply.queue_time_us":54,"apply.run_cpu_time_us":452,"apply.run_wall_time_us":452,"num_ops":2,"prepare.queue_time_us":89,"prepare.run_cpu_time_us":702,"prepare.run_wall_time_us":702,"raft.queue_time_us":1126,"raft.run_cpu_time_us":352,"raft.run_wall_time_us":353,"replication_time_us":3710}]]}
I20250831 19:54:58.943037 3311 ts_tablet_manager.cc:1905] T 43b456d5ee8d40e1a8999565cec2d230 P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:58.942150 3375 consensus_queue.cc:260] T 61101a699bb84b62af4e7a0cae243d4e P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:58.958334 3375 ts_tablet_manager.cc:1428] T 61101a699bb84b62af4e7a0cae243d4e P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.045s user 0.001s sys 0.000s
I20250831 19:54:58.959633 1883 tablet_service.cc:1468] Processing CreateTablet for tablet 3667c38e7b8c46ed8205e278c98c4b00 (DEFAULT_TABLE table=default.table_fec0d0e06479419886c036a37df0cfdf [id=0e44d9b8a8044f2685d97f13e0b15ef3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:58.959697 1609 tablet_service.cc:1468] Processing CreateTablet for tablet 3667c38e7b8c46ed8205e278c98c4b00 (DEFAULT_TABLE table=default.table_fec0d0e06479419886c036a37df0cfdf [id=0e44d9b8a8044f2685d97f13e0b15ef3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:58.960093 1609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3667c38e7b8c46ed8205e278c98c4b00. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:58.960270 1750 tablet_service.cc:1468] Processing CreateTablet for tablet 3667c38e7b8c46ed8205e278c98c4b00 (DEFAULT_TABLE table=default.table_fec0d0e06479419886c036a37df0cfdf [id=0e44d9b8a8044f2685d97f13e0b15ef3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:58.960676 1750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3667c38e7b8c46ed8205e278c98c4b00. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:58.969347 1883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3667c38e7b8c46ed8205e278c98c4b00. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:58.973994 2122 catalog_manager.cc:5674] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197) does not have the latest schema for tablet 61101a699bb84b62af4e7a0cae243d4e (table default.table_207ac87518bc487184a89bb52cd204b3 [id=f48af5bc3eff4c819be4aeeff4128c2a]). Expected version 1 got 0
I20250831 19:54:58.974910 3373 tablet_bootstrap.cc:492] T a9d383f8caed44958fb3fa6ed1ca580e P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:58.977597 3372 tablet_bootstrap.cc:492] T 3667c38e7b8c46ed8205e278c98c4b00 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:58.979147 3372 tablet_bootstrap.cc:654] T 3667c38e7b8c46ed8205e278c98c4b00 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:58.984300 3373 ts_tablet_manager.cc:1397] T a9d383f8caed44958fb3fa6ed1ca580e P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.145s user 0.005s sys 0.000s
I20250831 19:54:58.985159 3373 raft_consensus.cc:357] T a9d383f8caed44958fb3fa6ed1ca580e P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:58.986433 1609 tablet_service.cc:1515] Processing DeleteTablet for tablet d56dcc30166043c68c3f1c05e7f7bde0 with delete_type TABLET_DATA_DELETED (replaced by tablet e47844d025bf42ecbfd2d3f34a31538e) from {username='slave'} at 127.0.0.1:51022
W20250831 19:54:58.986968 2104 catalog_manager.cc:4895] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): delete failed for tablet d56dcc30166043c68c3f1c05e7f7bde0 because the tablet was not found. No further retry: Not found: Tablet not found: d56dcc30166043c68c3f1c05e7f7bde0
I20250831 19:54:58.987170 3373 raft_consensus.cc:383] T a9d383f8caed44958fb3fa6ed1ca580e P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:58.987314 3373 raft_consensus.cc:738] T a9d383f8caed44958fb3fa6ed1ca580e P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:58.987571 3373 consensus_queue.cc:260] T a9d383f8caed44958fb3fa6ed1ca580e P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
W20250831 19:54:58.989288 2122 catalog_manager.cc:5774] Failed to send AlterTable RPC for tablet 61101a699bb84b62af4e7a0cae243d4e (table default.table_207ac87518bc487184a89bb52cd204b3 [id=f48af5bc3eff4c819be4aeeff4128c2a], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 61101a699bb84b62af4e7a0cae243d4e consensus state has no leader
I20250831 19:54:58.992362 3375 tablet_bootstrap.cc:492] T a9d383f8caed44958fb3fa6ed1ca580e P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:58.992473 3310 tablet_replica.cc:331] T 43b456d5ee8d40e1a8999565cec2d230 P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:54:58.992710 3310 raft_consensus.cc:2241] T 43b456d5ee8d40e1a8999565cec2d230 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:58.994441 3375 tablet_bootstrap.cc:654] T a9d383f8caed44958fb3fa6ed1ca580e P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:58.995199 3310 raft_consensus.cc:2270] T 43b456d5ee8d40e1a8999565cec2d230 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:58.996055 2122 catalog_manager.cc:5674] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475) does not have the latest schema for tablet 61101a699bb84b62af4e7a0cae243d4e (table default.table_207ac87518bc487184a89bb52cd204b3 [id=f48af5bc3eff4c819be4aeeff4128c2a]). Expected version 1 got 0
I20250831 19:54:59.003907 3310 ts_tablet_manager.cc:1905] T 43b456d5ee8d40e1a8999565cec2d230 P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:58.993949 3373 ts_tablet_manager.cc:1428] T a9d383f8caed44958fb3fa6ed1ca580e P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.010s user 0.001s sys 0.000s
I20250831 19:54:59.008522 2122 catalog_manager.cc:6127] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: default.table_1d644a2c8bd54f89964228704cd693e6 [id=028e873d141c4006aca7d45be88d9ae3] alter complete (version 1)
I20250831 19:54:59.008903 3373 tablet_bootstrap.cc:492] T 61101a699bb84b62af4e7a0cae243d4e P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:59.010752 3373 tablet_bootstrap.cc:654] T 61101a699bb84b62af4e7a0cae243d4e P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:59.024367 2122 catalog_manager.cc:5674] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197) does not have the latest schema for tablet 06c27385b0b8460c9ea4f1d96ecb2966 (table default.table_4e12fc12cae640b99d4f3794151b6915 [id=ba4c5ecf4ae94ede9bfb83af2ee894ab]). Expected version 2 got 0
I20250831 19:54:59.027133 2122 catalog_manager.cc:5674] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197) does not have the latest schema for tablet e47844d025bf42ecbfd2d3f34a31538e (table default.table_c7390b7344da4c3fbf7f2f502b096669 [id=1df66f6230794e939a25c0f2254d6e17]). Expected version 2 got 0
I20250831 19:54:58.999801 3311 ts_tablet_manager.cc:1918] T 43b456d5ee8d40e1a8999565cec2d230 P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:59.029868 3311 log.cc:1199] T 43b456d5ee8d40e1a8999565cec2d230 P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/43b456d5ee8d40e1a8999565cec2d230
I20250831 19:54:59.030231 3311 ts_tablet_manager.cc:1939] T 43b456d5ee8d40e1a8999565cec2d230 P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
I20250831 19:54:59.031101 2105 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet 43b456d5ee8d40e1a8999565cec2d230 (table default.table_c48f1c99f3174cb8acca698339447ed9 [id=f707909e6af44750a5fc5e3b15af0b24]) successfully deleted
I20250831 19:54:59.031605 3372 tablet_bootstrap.cc:492] T 3667c38e7b8c46ed8205e278c98c4b00 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:59.031646 3375 tablet_bootstrap.cc:492] T a9d383f8caed44958fb3fa6ed1ca580e P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
W20250831 19:54:59.031682 2122 catalog_manager.cc:5774] Failed to send AlterTable RPC for tablet 06c27385b0b8460c9ea4f1d96ecb2966 (table default.table_4e12fc12cae640b99d4f3794151b6915 [id=ba4c5ecf4ae94ede9bfb83af2ee894ab], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet 06c27385b0b8460c9ea4f1d96ecb2966 consensus state has no leader
I20250831 19:54:59.031786 3372 ts_tablet_manager.cc:1397] T 3667c38e7b8c46ed8205e278c98c4b00 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.054s user 0.003s sys 0.000s
I20250831 19:54:59.031811 3375 ts_tablet_manager.cc:1397] T a9d383f8caed44958fb3fa6ed1ca580e P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.040s user 0.003s sys 0.000s
W20250831 19:54:59.031927 2122 catalog_manager.cc:5774] Failed to send AlterTable RPC for tablet e47844d025bf42ecbfd2d3f34a31538e (table default.table_c7390b7344da4c3fbf7f2f502b096669 [id=1df66f6230794e939a25c0f2254d6e17], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet e47844d025bf42ecbfd2d3f34a31538e consensus state has no leader
I20250831 19:54:59.032572 3375 raft_consensus.cc:357] T a9d383f8caed44958fb3fa6ed1ca580e P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:59.032788 3375 raft_consensus.cc:383] T a9d383f8caed44958fb3fa6ed1ca580e P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:59.032876 3375 raft_consensus.cc:738] T a9d383f8caed44958fb3fa6ed1ca580e P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:59.033123 3375 consensus_queue.cc:260] T a9d383f8caed44958fb3fa6ed1ca580e P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:59.033658 3375 ts_tablet_manager.cc:1428] T a9d383f8caed44958fb3fa6ed1ca580e P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250831 19:54:59.034662 3311 tablet_replica.cc:331] T d56dcc30166043c68c3f1c05e7f7bde0 P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:54:59.034929 3311 raft_consensus.cc:2241] T d56dcc30166043c68c3f1c05e7f7bde0 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:59.035514 3372 raft_consensus.cc:357] T 3667c38e7b8c46ed8205e278c98c4b00 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:59.035738 3372 raft_consensus.cc:383] T 3667c38e7b8c46ed8205e278c98c4b00 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:59.035827 3372 raft_consensus.cc:738] T 3667c38e7b8c46ed8205e278c98c4b00 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:59.036113 3372 consensus_queue.cc:260] T 3667c38e7b8c46ed8205e278c98c4b00 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:59.038182 3311 raft_consensus.cc:2270] T d56dcc30166043c68c3f1c05e7f7bde0 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:59.038838 3310 ts_tablet_manager.cc:1918] T 43b456d5ee8d40e1a8999565cec2d230 P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:59.038971 3375 tablet_bootstrap.cc:492] T 8afbd19c84f14fbb8f957c2f10d97a4c P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:59.039088 3310 log.cc:1199] T 43b456d5ee8d40e1a8999565cec2d230 P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/43b456d5ee8d40e1a8999565cec2d230
I20250831 19:54:59.039495 3310 ts_tablet_manager.cc:1939] T 43b456d5ee8d40e1a8999565cec2d230 P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:54:59.040359 2101 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet 43b456d5ee8d40e1a8999565cec2d230 (table default.table_c48f1c99f3174cb8acca698339447ed9 [id=f707909e6af44750a5fc5e3b15af0b24]) successfully deleted
I20250831 19:54:59.041188 1818 heartbeater.cc:344] Connected to a master server at 127.1.1.254:34259
I20250831 19:54:59.042146 3372 ts_tablet_manager.cc:1428] T 3667c38e7b8c46ed8205e278c98c4b00 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.010s user 0.001s sys 0.000s
I20250831 19:54:59.044330 3310 tablet_replica.cc:331] T 2c03497e3cb4480d88d99dde5d6ea22b P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:54:59.044524 3310 raft_consensus.cc:2241] T 2c03497e3cb4480d88d99dde5d6ea22b P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:59.044718 3310 raft_consensus.cc:2270] T 2c03497e3cb4480d88d99dde5d6ea22b P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:59.045245 3310 ts_tablet_manager.cc:1905] T 2c03497e3cb4480d88d99dde5d6ea22b P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:59.048255 1680 heartbeater.cc:344] Connected to a master server at 127.1.1.254:34259
W20250831 19:54:59.050665 2105 catalog_manager.cc:4726] Async tablet task AlterTable RPC for tablet 61101a699bb84b62af4e7a0cae243d4e (table default.table_207ac87518bc487184a89bb52cd204b3 [id=f48af5bc3eff4c819be4aeeff4128c2a], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 61101a699bb84b62af4e7a0cae243d4e consensus state has no leader
I20250831 19:54:59.051127 3375 tablet_bootstrap.cc:654] T 8afbd19c84f14fbb8f957c2f10d97a4c P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:59.051937 2122 catalog_manager.cc:5674] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475) does not have the latest schema for tablet 61101a699bb84b62af4e7a0cae243d4e (table default.table_207ac87518bc487184a89bb52cd204b3 [id=f48af5bc3eff4c819be4aeeff4128c2a]). Expected version 1 got 0
I20250831 19:54:59.054323 3373 tablet_bootstrap.cc:492] T 61101a699bb84b62af4e7a0cae243d4e P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:59.054500 3373 ts_tablet_manager.cc:1397] T 61101a699bb84b62af4e7a0cae243d4e P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.046s user 0.003s sys 0.000s
I20250831 19:54:59.055294 3373 raft_consensus.cc:357] T 61101a699bb84b62af4e7a0cae243d4e P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:59.055534 3373 raft_consensus.cc:383] T 61101a699bb84b62af4e7a0cae243d4e P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:59.055626 3373 raft_consensus.cc:738] T 61101a699bb84b62af4e7a0cae243d4e P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:59.055652 2125 catalog_manager.cc:2149] created HMS catalog entry for table [id=957ba0c5f36f4524a898d3126ed9ec26]
I20250831 19:54:59.055929 3373 consensus_queue.cc:260] T 61101a699bb84b62af4e7a0cae243d4e P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:59.057934 3373 ts_tablet_manager.cc:1428] T 61101a699bb84b62af4e7a0cae243d4e P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20250831 19:54:59.058075 3355 raft_consensus.cc:491] T a9d383f8caed44958fb3fa6ed1ca580e P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:59.058249 3373 tablet_bootstrap.cc:492] T f47cf07c9a4a43048123794e4a51904b P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:59.058190 3355 raft_consensus.cc:513] T a9d383f8caed44958fb3fa6ed1ca580e P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:59.058768 3355 leader_election.cc:290] T a9d383f8caed44958fb3fa6ed1ca580e P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:59.060437 3373 tablet_bootstrap.cc:654] T f47cf07c9a4a43048123794e4a51904b P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:59.061800 3311 ts_tablet_manager.cc:1905] T d56dcc30166043c68c3f1c05e7f7bde0 P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:59.062422 1904 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a9d383f8caed44958fb3fa6ed1ca580e" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:59.062585 1904 raft_consensus.cc:2466] T a9d383f8caed44958fb3fa6ed1ca580e P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 0.
I20250831 19:54:59.063086 1769 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a9d383f8caed44958fb3fa6ed1ca580e" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:59.063242 1769 raft_consensus.cc:2466] T a9d383f8caed44958fb3fa6ed1ca580e P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 0.
I20250831 19:54:59.063133 1568 leader_election.cc:304] T a9d383f8caed44958fb3fa6ed1ca580e P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:54:59.063657 3355 raft_consensus.cc:2802] T a9d383f8caed44958fb3fa6ed1ca580e P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:59.063838 3355 raft_consensus.cc:491] T a9d383f8caed44958fb3fa6ed1ca580e P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:59.064021 3355 raft_consensus.cc:3058] T a9d383f8caed44958fb3fa6ed1ca580e P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:59.069236 3295 consensus_queue.cc:1035] T c515598ee89b4f1a8839c28c7e7bc0c9 P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:59.069864 3355 raft_consensus.cc:513] T a9d383f8caed44958fb3fa6ed1ca580e P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:59.070875 1904 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a9d383f8caed44958fb3fa6ed1ca580e" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:54:59.071045 1904 raft_consensus.cc:3058] T a9d383f8caed44958fb3fa6ed1ca580e P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:59.073768 1904 raft_consensus.cc:2466] T a9d383f8caed44958fb3fa6ed1ca580e P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1.
I20250831 19:54:59.074177 1568 leader_election.cc:304] T a9d383f8caed44958fb3fa6ed1ca580e P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:54:59.074766 3081 raft_consensus.cc:2802] T a9d383f8caed44958fb3fa6ed1ca580e P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:59.074898 3081 raft_consensus.cc:695] T a9d383f8caed44958fb3fa6ed1ca580e P 89aa85d59c53436ebdf3074b13d14825 [term 1 LEADER]: Becoming Leader. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Running, Role: LEADER
I20250831 19:54:59.075132 3081 consensus_queue.cc:237] T a9d383f8caed44958fb3fa6ed1ca580e P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:59.076078 3355 leader_election.cc:290] T a9d383f8caed44958fb3fa6ed1ca580e P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Requested vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:59.078364 3162 raft_consensus.cc:491] T f47cf07c9a4a43048123794e4a51904b P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:59.078467 3162 raft_consensus.cc:513] T f47cf07c9a4a43048123794e4a51904b P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:59.078934 3162 leader_election.cc:290] T f47cf07c9a4a43048123794e4a51904b P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237)
I20250831 19:54:59.080163 2125 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:36958 (request call id 192) took 2654 ms. Trace:
I20250831 19:54:59.080260 2125 rpcz_store.cc:276] 0831 19:54:56.425328 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:58.204041 (+1778713us) service_pool.cc:225] Handling call
0831 19:54:58.596087 (+392046us) catalog_manager.cc:2076] Acquired catalog manager lock
0831 19:54:58.598258 (+ 2171us) catalog_manager.cc:2122] Created new table and tablet info
0831 19:54:59.055630 (+457372us) catalog_manager.cc:2148] Created new table in HMS catalog
0831 19:54:59.079405 (+ 23775us) catalog_manager.cc:2182] Wrote table and tablets to system table
0831 19:54:59.079505 (+ 100us) catalog_manager.cc:2216] Inserted table and tablets into CatalogManager maps
0831 19:54:59.079615 (+ 110us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:59.063492 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:59.063588 (+ 96us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:59.063594 (+ 6us) write_op.cc:435] Acquired schema lock
0831 19:54:59.063598 (+ 4us) tablet.cc:660] Decoding operations
0831 19:54:59.063687 (+ 89us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:59.063697 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:59.063702 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:59.063762 (+ 60us) tablet.cc:699] Row locks acquired
0831 19:54:59.063764 (+ 2us) write_op.cc:260] PREPARE: finished
0831 19:54:59.063796 (+ 32us) write_op.cc:270] Start()
0831 19:54:59.063825 (+ 29us) write_op.cc:276] Timestamp: P: 1756670099063771 usec, L: 0
0831 19:54:59.063828 (+ 3us) op_driver.cc:348] REPLICATION: starting
0831 19:54:59.063997 (+ 169us) log.cc:844] Serialized 433 byte log entry
0831 19:54:59.074036 (+ 10039us) op_driver.cc:464] REPLICATION: finished
0831 19:54:59.074143 (+ 107us) write_op.cc:301] APPLY: starting
0831 19:54:59.074158 (+ 15us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:59.074199 (+ 41us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:59.074235 (+ 36us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:59.074344 (+ 109us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:59.074380 (+ 36us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0831 19:54:59.074389 (+ 9us) write_op.cc:312] APPLY: finished
0831 19:54:59.074484 (+ 95us) log.cc:844] Serialized 29 byte log entry
0831 19:54:59.074540 (+ 56us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:59.074559 (+ 19us) write_op.cc:454] Released schema lock
0831 19:54:59.074567 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0831 19:54:59.074642 (+ 75us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:59.074647 (+ 5us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":337400,"Hive Metastore.run_cpu_time_us":353,"Hive Metastore.run_wall_time_us":119615,"child_traces":[["op",{"apply.queue_time_us":57,"apply.run_cpu_time_us":488,"apply.run_wall_time_us":488,"num_ops":2,"prepare.queue_time_us":7273,"prepare.run_cpu_time_us":615,"prepare.run_wall_time_us":615,"raft.queue_time_us":1118,"raft.run_cpu_time_us":507,"raft.run_wall_time_us":506,"replication_time_us":10174}]]}
I20250831 19:54:59.084595 3310 ts_tablet_manager.cc:1918] T 2c03497e3cb4480d88d99dde5d6ea22b P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:59.084723 3310 log.cc:1199] T 2c03497e3cb4480d88d99dde5d6ea22b P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/2c03497e3cb4480d88d99dde5d6ea22b
I20250831 19:54:59.085049 3310 ts_tablet_manager.cc:1939] T 2c03497e3cb4480d88d99dde5d6ea22b P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:54:59.085656 1768 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f47cf07c9a4a43048123794e4a51904b" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:59.086081 1769 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a9d383f8caed44958fb3fa6ed1ca580e" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197"
I20250831 19:54:59.086212 1769 raft_consensus.cc:3058] T a9d383f8caed44958fb3fa6ed1ca580e P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:59.088729 1769 raft_consensus.cc:2466] T a9d383f8caed44958fb3fa6ed1ca580e P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1.
I20250831 19:54:59.091146 2101 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet 2c03497e3cb4480d88d99dde5d6ea22b (table default.table_265519e91af542d1836f224e15cd5e60 [id=67d77a3f228b4f1da86b97cac2fc4aac]) successfully deleted
I20250831 19:54:59.094285 3352 consensus_queue.cc:1035] T c515598ee89b4f1a8839c28c7e7bc0c9 P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250831 19:54:59.099480 1570 leader_election.cc:343] T f47cf07c9a4a43048123794e4a51904b P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): Illegal state: must be running to vote when last-logged opid is not known
I20250831 19:54:59.100250 1904 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f47cf07c9a4a43048123794e4a51904b" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
W20250831 19:54:59.100736 1568 leader_election.cc:343] T f47cf07c9a4a43048123794e4a51904b P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): Illegal state: must be running to vote when last-logged opid is not known
I20250831 19:54:59.100832 1568 leader_election.cc:304] T f47cf07c9a4a43048123794e4a51904b P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825; no voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197
I20250831 19:54:59.101212 3162 raft_consensus.cc:2747] T f47cf07c9a4a43048123794e4a51904b P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250831 19:54:59.101596 3310 tablet_replica.cc:331] T d56dcc30166043c68c3f1c05e7f7bde0 P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:54:59.104482 3311 ts_tablet_manager.cc:1918] T d56dcc30166043c68c3f1c05e7f7bde0 P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250831 19:54:59.106791 1883 tablet_service.cc:1468] Processing CreateTablet for tablet 5fcb923d81a2495fa02dc76ddb9983b7 (DEFAULT_TABLE table=default.table_30272e2642084b1390e459c21c0bee62 [id=957ba0c5f36f4524a898d3126ed9ec26]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:59.106882 1609 tablet_service.cc:1468] Processing CreateTablet for tablet 5fcb923d81a2495fa02dc76ddb9983b7 (DEFAULT_TABLE table=default.table_30272e2642084b1390e459c21c0bee62 [id=957ba0c5f36f4524a898d3126ed9ec26]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:59.107113 1883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fcb923d81a2495fa02dc76ddb9983b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:59.107241 1609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fcb923d81a2495fa02dc76ddb9983b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:59.119504 3372 tablet_bootstrap.cc:492] T 5fcb923d81a2495fa02dc76ddb9983b7 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:59.121582 3372 tablet_bootstrap.cc:654] T 5fcb923d81a2495fa02dc76ddb9983b7 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:59.122299 3310 raft_consensus.cc:2241] T d56dcc30166043c68c3f1c05e7f7bde0 P 2441fafe1d62429386f4631ad423567d [term 1 LEADER]: Raft consensus shutting down.
I20250831 19:54:59.122653 3310 raft_consensus.cc:2270] T d56dcc30166043c68c3f1c05e7f7bde0 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:59.125715 2125 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_d3002519e6964bb484d995d871e766c9" } modify_external_catalogs: true
I20250831 19:54:59.126085 2125 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_d3002519e6964bb484d995d871e766c9" } modify_external_catalogs: true
I20250831 19:54:59.126825 3310 ts_tablet_manager.cc:1905] T d56dcc30166043c68c3f1c05e7f7bde0 P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:59.131012 2122 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_dbf76772503b48c3a9083efbcbbb62a3" } new_table_name: "default.Table_492565dabb704c25b9c4d1849bcb8eeb" modify_external_catalogs: true
I20250831 19:54:59.142148 3373 tablet_bootstrap.cc:492] T f47cf07c9a4a43048123794e4a51904b P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:59.142366 3373 ts_tablet_manager.cc:1397] T f47cf07c9a4a43048123794e4a51904b P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.084s user 0.005s sys 0.011s
I20250831 19:54:59.143172 3373 raft_consensus.cc:357] T f47cf07c9a4a43048123794e4a51904b P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:59.143440 3373 raft_consensus.cc:383] T f47cf07c9a4a43048123794e4a51904b P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:59.143536 3373 raft_consensus.cc:738] T f47cf07c9a4a43048123794e4a51904b P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:59.143842 3373 consensus_queue.cc:260] T f47cf07c9a4a43048123794e4a51904b P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:59.149592 3310 ts_tablet_manager.cc:1918] T d56dcc30166043c68c3f1c05e7f7bde0 P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250831 19:54:59.152796 3310 log.cc:1199] T d56dcc30166043c68c3f1c05e7f7bde0 P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/d56dcc30166043c68c3f1c05e7f7bde0
I20250831 19:54:59.152799 3372 tablet_bootstrap.cc:492] T 5fcb923d81a2495fa02dc76ddb9983b7 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:59.152936 3372 ts_tablet_manager.cc:1397] T 5fcb923d81a2495fa02dc76ddb9983b7 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.033s user 0.000s sys 0.006s
I20250831 19:54:59.153635 3372 raft_consensus.cc:357] T 5fcb923d81a2495fa02dc76ddb9983b7 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:59.153786 3372 raft_consensus.cc:383] T 5fcb923d81a2495fa02dc76ddb9983b7 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:59.153832 3372 raft_consensus.cc:738] T 5fcb923d81a2495fa02dc76ddb9983b7 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:59.154026 3372 consensus_queue.cc:260] T 5fcb923d81a2495fa02dc76ddb9983b7 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:59.155803 3372 ts_tablet_manager.cc:1428] T 5fcb923d81a2495fa02dc76ddb9983b7 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20250831 19:54:59.106540 1750 tablet_service.cc:1468] Processing CreateTablet for tablet 5fcb923d81a2495fa02dc76ddb9983b7 (DEFAULT_TABLE table=default.table_30272e2642084b1390e459c21c0bee62 [id=957ba0c5f36f4524a898d3126ed9ec26]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:59.156219 1750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fcb923d81a2495fa02dc76ddb9983b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:59.158200 3352 raft_consensus.cc:491] T 61101a699bb84b62af4e7a0cae243d4e P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:59.158303 3352 raft_consensus.cc:513] T 61101a699bb84b62af4e7a0cae243d4e P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:59.158380 3373 ts_tablet_manager.cc:1428] T f47cf07c9a4a43048123794e4a51904b P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.016s user 0.001s sys 0.001s
I20250831 19:54:59.158417 3310 ts_tablet_manager.cc:1939] T d56dcc30166043c68c3f1c05e7f7bde0 P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:54:59.158644 3373 tablet_bootstrap.cc:492] T 8afbd19c84f14fbb8f957c2f10d97a4c P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:59.158820 3352 leader_election.cc:290] T 61101a699bb84b62af4e7a0cae243d4e P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:59.161574 3373 tablet_bootstrap.cc:654] T 8afbd19c84f14fbb8f957c2f10d97a4c P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:59.161959 2119 catalog_manager.cc:2149] created HMS catalog entry for table [id=93c25513734040679fce59ac7b69ba38]
I20250831 19:54:59.136585 3375 tablet_bootstrap.cc:492] T 8afbd19c84f14fbb8f957c2f10d97a4c P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:59.162421 3375 ts_tablet_manager.cc:1397] T 8afbd19c84f14fbb8f957c2f10d97a4c P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.124s user 0.005s sys 0.000s
I20250831 19:54:59.163785 3375 raft_consensus.cc:357] T 8afbd19c84f14fbb8f957c2f10d97a4c P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:59.164036 3375 raft_consensus.cc:383] T 8afbd19c84f14fbb8f957c2f10d97a4c P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:59.164206 3375 raft_consensus.cc:738] T 8afbd19c84f14fbb8f957c2f10d97a4c P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:59.164548 3375 consensus_queue.cc:260] T 8afbd19c84f14fbb8f957c2f10d97a4c P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:59.165505 3375 ts_tablet_manager.cc:1428] T 8afbd19c84f14fbb8f957c2f10d97a4c P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20250831 19:54:59.165753 3375 tablet_bootstrap.cc:492] T 06c27385b0b8460c9ea4f1d96ecb2966 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:59.166474 2101 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet d56dcc30166043c68c3f1c05e7f7bde0 (table default.table_c7390b7344da4c3fbf7f2f502b096669 [id=1df66f6230794e939a25c0f2254d6e17]) successfully deleted
I20250831 19:54:59.167110 3375 tablet_bootstrap.cc:654] T 06c27385b0b8460c9ea4f1d96ecb2966 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:59.167850 3311 log.cc:1199] T d56dcc30166043c68c3f1c05e7f7bde0 P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/d56dcc30166043c68c3f1c05e7f7bde0
I20250831 19:54:59.168236 3311 ts_tablet_manager.cc:1939] T d56dcc30166043c68c3f1c05e7f7bde0 P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
I20250831 19:54:59.168426 1634 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "61101a699bb84b62af4e7a0cae243d4e" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:59.168618 1634 raft_consensus.cc:2466] T 61101a699bb84b62af4e7a0cae243d4e P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 0.
I20250831 19:54:59.173874 3311 tablet_replica.cc:331] T 2c03497e3cb4480d88d99dde5d6ea22b P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:54:59.174077 2105 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet d56dcc30166043c68c3f1c05e7f7bde0 (table default.table_c7390b7344da4c3fbf7f2f502b096669 [id=1df66f6230794e939a25c0f2254d6e17]) successfully deleted
I20250831 19:54:59.177975 2119 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:36958 (request call id 196) took 2511 ms. Trace:
I20250831 19:54:59.178095 2119 rpcz_store.cc:276] 0831 19:54:56.666431 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:58.542886 (+1876455us) service_pool.cc:225] Handling call
0831 19:54:58.727880 (+184994us) catalog_manager.cc:2076] Acquired catalog manager lock
0831 19:54:58.728453 (+ 573us) catalog_manager.cc:2122] Created new table and tablet info
0831 19:54:59.161914 (+433461us) catalog_manager.cc:2148] Created new table in HMS catalog
0831 19:54:59.177717 (+ 15803us) catalog_manager.cc:2182] Wrote table and tablets to system table
0831 19:54:59.177832 (+ 115us) catalog_manager.cc:2216] Inserted table and tablets into CatalogManager maps
0831 19:54:59.177935 (+ 103us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:59.162914 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:59.163028 (+ 114us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:59.163035 (+ 7us) write_op.cc:435] Acquired schema lock
0831 19:54:59.163037 (+ 2us) tablet.cc:660] Decoding operations
0831 19:54:59.163132 (+ 95us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:59.163143 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:59.163148 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:59.163231 (+ 83us) tablet.cc:699] Row locks acquired
0831 19:54:59.163233 (+ 2us) write_op.cc:260] PREPARE: finished
0831 19:54:59.163273 (+ 40us) write_op.cc:270] Start()
0831 19:54:59.163309 (+ 36us) write_op.cc:276] Timestamp: P: 1756670099163235 usec, L: 0
0831 19:54:59.163313 (+ 4us) op_driver.cc:348] REPLICATION: starting
0831 19:54:59.163517 (+ 204us) log.cc:844] Serialized 433 byte log entry
0831 19:54:59.172829 (+ 9312us) op_driver.cc:464] REPLICATION: finished
0831 19:54:59.172994 (+ 165us) write_op.cc:301] APPLY: starting
0831 19:54:59.173011 (+ 17us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:59.173067 (+ 56us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:59.173099 (+ 32us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:59.173213 (+ 114us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:59.173242 (+ 29us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0831 19:54:59.173249 (+ 7us) write_op.cc:312] APPLY: finished
0831 19:54:59.173316 (+ 67us) log.cc:844] Serialized 29 byte log entry
0831 19:54:59.173373 (+ 57us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:59.173403 (+ 30us) write_op.cc:454] Released schema lock
0831 19:54:59.173411 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0831 19:54:59.177332 (+ 3921us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:59.177340 (+ 8us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":326815,"Hive Metastore.run_cpu_time_us":241,"Hive Metastore.run_wall_time_us":106136,"child_traces":[["op",{"apply.queue_time_us":113,"apply.run_cpu_time_us":525,"apply.run_wall_time_us":4320,"num_ops":2,"prepare.queue_time_us":303,"prepare.run_cpu_time_us":708,"prepare.run_wall_time_us":709,"raft.queue_time_us":1111,"raft.run_cpu_time_us":479,"raft.run_wall_time_us":478,"replication_time_us":9487}]]}
I20250831 19:54:59.169885 1706 leader_election.cc:304] T 61101a699bb84b62af4e7a0cae243d4e P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:59.185976 2943 raft_consensus.cc:2802] T 61101a699bb84b62af4e7a0cae243d4e P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:59.186072 2943 raft_consensus.cc:491] T 61101a699bb84b62af4e7a0cae243d4e P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:59.186142 2943 raft_consensus.cc:3058] T 61101a699bb84b62af4e7a0cae243d4e P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:59.188570 2943 raft_consensus.cc:513] T 61101a699bb84b62af4e7a0cae243d4e P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:59.189487 1904 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "61101a699bb84b62af4e7a0cae243d4e" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:54:59.189641 1904 raft_consensus.cc:3058] T 61101a699bb84b62af4e7a0cae243d4e P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:59.191953 1904 raft_consensus.cc:2466] T 61101a699bb84b62af4e7a0cae243d4e P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:54:59.192276 2943 leader_election.cc:290] T 61101a699bb84b62af4e7a0cae243d4e P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Requested vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:59.192907 1705 leader_election.cc:304] T 61101a699bb84b62af4e7a0cae243d4e P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:59.193146 3295 raft_consensus.cc:2802] T 61101a699bb84b62af4e7a0cae243d4e P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:59.193246 3295 raft_consensus.cc:695] T 61101a699bb84b62af4e7a0cae243d4e P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: Becoming Leader. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Running, Role: LEADER
I20250831 19:54:59.193493 3295 consensus_queue.cc:237] T 61101a699bb84b62af4e7a0cae243d4e P de831f40fa1348a48a1f0260f4130197 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:59.209059 1634 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "61101a699bb84b62af4e7a0cae243d4e" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:54:59.209658 1634 raft_consensus.cc:3058] T 61101a699bb84b62af4e7a0cae243d4e P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:59.211493 1906 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "61101a699bb84b62af4e7a0cae243d4e" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:59.211650 1906 raft_consensus.cc:2374] T 61101a699bb84b62af4e7a0cae243d4e P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1. Re-sending same reply.
W20250831 19:54:59.213263 2126 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_1d29197c8463471d898f54b5dadaefc2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250831 19:54:59.213647 2119 catalog_manager.cc:5582] T a9d383f8caed44958fb3fa6ed1ca580e P 89aa85d59c53436ebdf3074b13d14825 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193). New cstate: current_term: 1 leader_uuid: "89aa85d59c53436ebdf3074b13d14825" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: HEALTHY } } }
W20250831 19:54:59.214905 2118 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_76aceaaac1fb4aaeb55445d641a113d1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250831 19:54:59.214530 2123 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_be7bbefda22d4660a8d257962bfe0979 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250831 19:54:59.214533 2120 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_dd23f581be78471f98008014d30c3398 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250831 19:54:59.227840 1634 raft_consensus.cc:2466] T 61101a699bb84b62af4e7a0cae243d4e P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:54:59.228905 3311 raft_consensus.cc:2241] T 2c03497e3cb4480d88d99dde5d6ea22b P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: Raft consensus shutting down.
I20250831 19:54:59.231758 2126 catalog_manager.cc:2149] created HMS catalog entry for table [id=8ef92f9201b34066b2b621ae3aa92ebe]
I20250831 19:54:59.241654 3311 raft_consensus.cc:2270] T 2c03497e3cb4480d88d99dde5d6ea22b P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:59.242525 3311 ts_tablet_manager.cc:1905] T 2c03497e3cb4480d88d99dde5d6ea22b P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:59.244377 1609 tablet_service.cc:1468] Processing CreateTablet for tablet 84177615877240688a2d4b3b88915525 (DEFAULT_TABLE table=default.table_75aa254646a24998b06bc2c45a479df2 [id=93c25513734040679fce59ac7b69ba38]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:59.244383 1883 tablet_service.cc:1468] Processing CreateTablet for tablet 84177615877240688a2d4b3b88915525 (DEFAULT_TABLE table=default.table_75aa254646a24998b06bc2c45a479df2 [id=93c25513734040679fce59ac7b69ba38]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:59.244812 1609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84177615877240688a2d4b3b88915525. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:59.244827 1883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84177615877240688a2d4b3b88915525. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:59.249699 2126 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:36958 (request call id 199) took 2513 ms. Trace:
I20250831 19:54:59.249830 2126 rpcz_store.cc:276] 0831 19:54:56.735702 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:58.598898 (+1863196us) service_pool.cc:225] Handling call
0831 19:54:59.213410 (+614512us) catalog_manager.cc:2076] Acquired catalog manager lock
0831 19:54:59.213893 (+ 483us) catalog_manager.cc:2122] Created new table and tablet info
0831 19:54:59.231700 (+ 17807us) catalog_manager.cc:2148] Created new table in HMS catalog
0831 19:54:59.249387 (+ 17687us) catalog_manager.cc:2182] Wrote table and tablets to system table
0831 19:54:59.249514 (+ 127us) catalog_manager.cc:2216] Inserted table and tablets into CatalogManager maps
0831 19:54:59.249636 (+ 122us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:59.233735 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:59.233858 (+ 123us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:59.233865 (+ 7us) write_op.cc:435] Acquired schema lock
0831 19:54:59.233868 (+ 3us) tablet.cc:660] Decoding operations
0831 19:54:59.234008 (+ 140us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:59.234020 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:59.234027 (+ 7us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:59.234113 (+ 86us) tablet.cc:699] Row locks acquired
0831 19:54:59.234116 (+ 3us) write_op.cc:260] PREPARE: finished
0831 19:54:59.234148 (+ 32us) write_op.cc:270] Start()
0831 19:54:59.234191 (+ 43us) write_op.cc:276] Timestamp: P: 1756670099234105 usec, L: 0
0831 19:54:59.234195 (+ 4us) op_driver.cc:348] REPLICATION: starting
0831 19:54:59.234346 (+ 151us) log.cc:844] Serialized 433 byte log entry
0831 19:54:59.248222 (+ 13876us) op_driver.cc:464] REPLICATION: finished
0831 19:54:59.248551 (+ 329us) write_op.cc:301] APPLY: starting
0831 19:54:59.248563 (+ 12us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:59.248595 (+ 32us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:59.248617 (+ 22us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:59.248725 (+ 108us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:59.248751 (+ 26us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0831 19:54:59.248756 (+ 5us) write_op.cc:312] APPLY: finished
0831 19:54:59.248811 (+ 55us) log.cc:844] Serialized 29 byte log entry
0831 19:54:59.248860 (+ 49us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:59.248873 (+ 13us) write_op.cc:454] Released schema lock
0831 19:54:59.248878 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0831 19:54:59.248932 (+ 54us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:59.248936 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":30,"Hive Metastore.run_cpu_time_us":232,"Hive Metastore.run_wall_time_us":17454,"child_traces":[["op",{"apply.queue_time_us":275,"apply.run_cpu_time_us":377,"apply.run_wall_time_us":376,"num_ops":2,"prepare.queue_time_us":1319,"prepare.run_cpu_time_us":682,"prepare.run_wall_time_us":682,"replication_time_us":14001}]]}
I20250831 19:54:59.251724 3372 tablet_bootstrap.cc:492] T 84177615877240688a2d4b3b88915525 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:59.253325 3372 tablet_bootstrap.cc:654] T 84177615877240688a2d4b3b88915525 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:59.255748 2121 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:36958 (request call id 191) took 2840 ms. Trace:
I20250831 19:54:59.255842 2121 rpcz_store.cc:276] 0831 19:54:56.415161 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:58.185791 (+1770630us) service_pool.cc:225] Handling call
0831 19:54:58.592775 (+406984us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:59.255227 (+662452us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:54:59.255463 (+ 236us) catalog_manager.cc:3683] Apply alter schema
0831 19:54:59.255693 (+ 230us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":1818,"Hive Metastore.run_cpu_time_us":737,"Hive Metastore.run_wall_time_us":145455}
W20250831 19:54:59.257268 2117 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_a9e5115b40204ad6afb299f06aa717a2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250831 19:54:59.273108 3372 tablet_bootstrap.cc:492] T 84177615877240688a2d4b3b88915525 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:59.273250 3372 ts_tablet_manager.cc:1397] T 84177615877240688a2d4b3b88915525 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.022s user 0.003s sys 0.000s
I20250831 19:54:59.273958 3372 raft_consensus.cc:357] T 84177615877240688a2d4b3b88915525 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:59.274138 3372 raft_consensus.cc:383] T 84177615877240688a2d4b3b88915525 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:59.274191 3372 raft_consensus.cc:738] T 84177615877240688a2d4b3b88915525 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:59.274365 3372 consensus_queue.cc:260] T 84177615877240688a2d4b3b88915525 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:59.276057 2118 catalog_manager.cc:2149] created HMS catalog entry for table [id=5646c567b288436588bca1dde5d6e213]
I20250831 19:54:59.264837 1750 tablet_service.cc:1468] Processing CreateTablet for tablet 84177615877240688a2d4b3b88915525 (DEFAULT_TABLE table=default.table_75aa254646a24998b06bc2c45a479df2 [id=93c25513734040679fce59ac7b69ba38]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:59.284380 3356 tablet.cc:1722] T f8578694650b4379a66d9ea3df34ca0c P de831f40fa1348a48a1f0260f4130197: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:59.275234 3375 tablet_bootstrap.cc:492] T 06c27385b0b8460c9ea4f1d96ecb2966 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:59.287856 3375 ts_tablet_manager.cc:1397] T 06c27385b0b8460c9ea4f1d96ecb2966 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.122s user 0.000s sys 0.008s
I20250831 19:54:59.288929 3375 raft_consensus.cc:357] T 06c27385b0b8460c9ea4f1d96ecb2966 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:59.291800 3394 tablet.cc:1722] T f8578694650b4379a66d9ea3df34ca0c P 89aa85d59c53436ebdf3074b13d14825: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:59.293627 3373 tablet_bootstrap.cc:492] T 8afbd19c84f14fbb8f957c2f10d97a4c P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:59.293788 3373 ts_tablet_manager.cc:1397] T 8afbd19c84f14fbb8f957c2f10d97a4c P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.135s user 0.001s sys 0.071s
I20250831 19:54:59.296828 3373 raft_consensus.cc:357] T 8afbd19c84f14fbb8f957c2f10d97a4c P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:59.296912 2126 catalog_manager.cc:5674] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237) does not have the latest schema for tablet 61101a699bb84b62af4e7a0cae243d4e (table default.table_207ac87518bc487184a89bb52cd204b3 [id=f48af5bc3eff4c819be4aeeff4128c2a]). Expected version 1 got 0
I20250831 19:54:59.297089 3373 raft_consensus.cc:383] T 8afbd19c84f14fbb8f957c2f10d97a4c P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:59.297242 3373 raft_consensus.cc:738] T 8afbd19c84f14fbb8f957c2f10d97a4c P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:59.297504 3373 consensus_queue.cc:260] T 8afbd19c84f14fbb8f957c2f10d97a4c P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:59.300299 2126 master_service.cc:948] ReplaceTablet: received request to replace tablet 3081636d94084a8aa3905f40edf34b0f from {username='slave'} at 127.0.0.1:36958
I20250831 19:54:59.303738 3373 ts_tablet_manager.cc:1428] T 8afbd19c84f14fbb8f957c2f10d97a4c P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.010s user 0.001s sys 0.000s
I20250831 19:54:59.304149 3373 tablet_bootstrap.cc:492] T 06c27385b0b8460c9ea4f1d96ecb2966 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:59.306077 3333 tablet.cc:1722] T f8578694650b4379a66d9ea3df34ca0c P 2441fafe1d62429386f4631ad423567d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:59.306793 3373 tablet_bootstrap.cc:654] T 06c27385b0b8460c9ea4f1d96ecb2966 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:59.310228 2119 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_13cea908832146dab4b8b794752b1a79" } modify_external_catalogs: true
I20250831 19:54:59.316766 2119 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_13cea908832146dab4b8b794752b1a79" } modify_external_catalogs: true
I20250831 19:54:59.317344 3372 ts_tablet_manager.cc:1428] T 84177615877240688a2d4b3b88915525 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.044s user 0.002s sys 0.000s
I20250831 19:54:59.323726 3373 tablet_bootstrap.cc:492] T 06c27385b0b8460c9ea4f1d96ecb2966 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:59.323891 3373 ts_tablet_manager.cc:1397] T 06c27385b0b8460c9ea4f1d96ecb2966 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.020s user 0.004s sys 0.003s
I20250831 19:54:59.324723 3373 raft_consensus.cc:357] T 06c27385b0b8460c9ea4f1d96ecb2966 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:59.325320 3373 raft_consensus.cc:383] T 06c27385b0b8460c9ea4f1d96ecb2966 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:59.325392 3373 raft_consensus.cc:738] T 06c27385b0b8460c9ea4f1d96ecb2966 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:59.325687 3373 consensus_queue.cc:260] T 06c27385b0b8460c9ea4f1d96ecb2966 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:59.326747 1952 heartbeater.cc:344] Connected to a master server at 127.1.1.254:34259
I20250831 19:54:59.328102 3355 raft_consensus.cc:491] T 5fcb923d81a2495fa02dc76ddb9983b7 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:59.328219 3355 raft_consensus.cc:513] T 5fcb923d81a2495fa02dc76ddb9983b7 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:59.328823 3355 leader_election.cc:290] T 5fcb923d81a2495fa02dc76ddb9983b7 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:59.329067 1906 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5fcb923d81a2495fa02dc76ddb9983b7" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
W20250831 19:54:59.329512 1568 leader_election.cc:343] T 5fcb923d81a2495fa02dc76ddb9983b7 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): Illegal state: must be running to vote when last-logged opid is not known
I20250831 19:54:59.331780 2042 master_runner.cc:186] Error getting master registration for 127.1.1.254:34259: OK, instance_id { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" instance_seqno: 1756670096866276 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20250831 19:54:59.332044 2042 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20250831 19:54:59.332342 3373 ts_tablet_manager.cc:1428] T 06c27385b0b8460c9ea4f1d96ecb2966 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.008s user 0.003s sys 0.000s
I20250831 19:54:59.336863 3162 raft_consensus.cc:491] T 06c27385b0b8460c9ea4f1d96ecb2966 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:59.337018 3162 raft_consensus.cc:513] T 06c27385b0b8460c9ea4f1d96ecb2966 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:59.337935 3162 leader_election.cc:290] T 06c27385b0b8460c9ea4f1d96ecb2966 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:59.338873 1906 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "06c27385b0b8460c9ea4f1d96ecb2966" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:59.339030 1906 raft_consensus.cc:2466] T 06c27385b0b8460c9ea4f1d96ecb2966 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 0.
I20250831 19:54:59.339424 1568 leader_election.cc:304] T 06c27385b0b8460c9ea4f1d96ecb2966 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:54:59.339712 3162 raft_consensus.cc:2802] T 06c27385b0b8460c9ea4f1d96ecb2966 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:59.339799 3162 raft_consensus.cc:491] T 06c27385b0b8460c9ea4f1d96ecb2966 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:59.339869 3162 raft_consensus.cc:3058] T 06c27385b0b8460c9ea4f1d96ecb2966 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:59.342453 3162 raft_consensus.cc:513] T 06c27385b0b8460c9ea4f1d96ecb2966 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:59.343652 3162 leader_election.cc:290] T 06c27385b0b8460c9ea4f1d96ecb2966 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Requested vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:59.343925 1906 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "06c27385b0b8460c9ea4f1d96ecb2966" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:54:59.344056 1906 raft_consensus.cc:3058] T 06c27385b0b8460c9ea4f1d96ecb2966 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:59.346460 1906 raft_consensus.cc:2466] T 06c27385b0b8460c9ea4f1d96ecb2966 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1.
I20250831 19:54:59.347005 3373 tablet_bootstrap.cc:492] T e47844d025bf42ecbfd2d3f34a31538e P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:59.347025 1568 leader_election.cc:304] T 06c27385b0b8460c9ea4f1d96ecb2966 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:54:59.347338 3162 raft_consensus.cc:2802] T 06c27385b0b8460c9ea4f1d96ecb2966 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:59.347602 3162 raft_consensus.cc:695] T 06c27385b0b8460c9ea4f1d96ecb2966 P 89aa85d59c53436ebdf3074b13d14825 [term 1 LEADER]: Becoming Leader. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Running, Role: LEADER
I20250831 19:54:59.347867 3162 consensus_queue.cc:237] T 06c27385b0b8460c9ea4f1d96ecb2966 P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:59.348489 3373 tablet_bootstrap.cc:654] T e47844d025bf42ecbfd2d3f34a31538e P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:59.348783 3081 raft_consensus.cc:491] T 84177615877240688a2d4b3b88915525 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:59.348907 3081 raft_consensus.cc:513] T 84177615877240688a2d4b3b88915525 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
W20250831 19:54:59.350560 1570 leader_election.cc:343] T 84177615877240688a2d4b3b88915525 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): Not found: Tablet not found: 84177615877240688a2d4b3b88915525
I20250831 19:54:59.349433 3081 leader_election.cc:290] T 84177615877240688a2d4b3b88915525 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:59.351255 1906 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "84177615877240688a2d4b3b88915525" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:59.351361 2118 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:36958 (request call id 201) took 2403 ms. Trace:
W20250831 19:54:59.351698 1568 leader_election.cc:343] T 84177615877240688a2d4b3b88915525 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): Illegal state: must be running to vote when last-logged opid is not known
I20250831 19:54:59.351780 1568 leader_election.cc:304] T 84177615877240688a2d4b3b88915525 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825; no voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197
I20250831 19:54:59.351451 2118 rpcz_store.cc:276] 0831 19:54:56.948370 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:58.713903 (+1765533us) service_pool.cc:225] Handling call
0831 19:54:58.719908 (+ 6005us) spinlock_profiling.cc:243] Waited 5.7 ms on lock 0x616000040c54. stack: 00007f1e3b0dc7d6 00007f1e3b0dc590 00007f1e3a0cf3ad 0000000000972d94 0000000000972d5d 00007f1e49ea714d 00007f1e49ea7243 00007f1e46b66941 00007f1e4e6f1a5d 00007f1e4e87ae93 00007f1e456b27a6 00007f1e456b24d5 00007f1e41e8a2ce 00007f1e41e891ae 00007f1e41e8f3e5 00007f1e41e8fd0f
0831 19:54:59.214994 (+495086us) catalog_manager.cc:2076] Acquired catalog manager lock
0831 19:54:59.215393 (+ 399us) catalog_manager.cc:2122] Created new table and tablet info
0831 19:54:59.276023 (+ 60630us) catalog_manager.cc:2148] Created new table in HMS catalog
0831 19:54:59.351103 (+ 75080us) catalog_manager.cc:2182] Wrote table and tablets to system table
0831 19:54:59.351215 (+ 112us) catalog_manager.cc:2216] Inserted table and tablets into CatalogManager maps
0831 19:54:59.351307 (+ 92us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:59.278274 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:59.278391 (+ 117us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:59.278397 (+ 6us) write_op.cc:435] Acquired schema lock
0831 19:54:59.278398 (+ 1us) tablet.cc:660] Decoding operations
0831 19:54:59.278481 (+ 83us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:59.278492 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:59.278496 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:59.278563 (+ 67us) tablet.cc:699] Row locks acquired
0831 19:54:59.278565 (+ 2us) write_op.cc:260] PREPARE: finished
0831 19:54:59.278601 (+ 36us) write_op.cc:270] Start()
0831 19:54:59.278765 (+ 164us) write_op.cc:276] Timestamp: P: 1756670099278552 usec, L: 0
0831 19:54:59.278769 (+ 4us) op_driver.cc:348] REPLICATION: starting
0831 19:54:59.307914 (+ 29145us) log.cc:844] Serialized 433 byte log entry
0831 19:54:59.308144 (+ 230us) spinlock_profiling.cc:243] Waited 28.9 ms on lock 0x616000040c54. stack: 00007f1e3b0dc7d6 00007f1e3b0dc590 00007f1e3a0cf3ad 0000000000972d94 0000000000972d5d 000000000097272a 00007f1e46b38d62 00007f1e47ee12d5 00007f1e47edfdf9 00007f1e47ee8220 00007f1e47ee802d 0000000000a774dc 00007f1e3b122b5f 00007f1e3b125e2b 00007f1e3b125ca8 0000000000a774dc
0831 19:54:59.350084 (+ 41940us) op_driver.cc:464] REPLICATION: finished
0831 19:54:59.350217 (+ 133us) write_op.cc:301] APPLY: starting
0831 19:54:59.350231 (+ 14us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:59.350264 (+ 33us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:59.350266 (+ 2us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:59.350388 (+ 122us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:59.350420 (+ 32us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0831 19:54:59.350426 (+ 6us) write_op.cc:312] APPLY: finished
0831 19:54:59.350497 (+ 71us) log.cc:844] Serialized 29 byte log entry
0831 19:54:59.350558 (+ 61us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:59.350574 (+ 16us) write_op.cc:454] Released schema lock
0831 19:54:59.350583 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0831 19:54:59.350651 (+ 68us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:59.350655 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":19081,"Hive Metastore.run_cpu_time_us":272,"Hive Metastore.run_wall_time_us":41201,"spinlock_wait_cycles":13108096,"child_traces":[["op",{"apply.queue_time_us":88,"apply.run_cpu_time_us":422,"apply.run_wall_time_us":422,"num_ops":2,"prepare.queue_time_us":1683,"prepare.run_cpu_time_us":1164,"prepare.run_wall_time_us":29935,"raft.queue_time_us":1139,"raft.run_cpu_time_us":264,"raft.run_wall_time_us":264,"replication_time_us":71287,"spinlock_wait_cycles":66580224}]]}
I20250831 19:54:59.352070 3081 raft_consensus.cc:2747] T 84177615877240688a2d4b3b88915525 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250831 19:54:59.354159 2123 catalog_manager.cc:2149] created HMS catalog entry for table [id=5579e4d41f7b456b8d92804eb3d03711]
I20250831 19:54:59.355962 1883 tablet_service.cc:1468] Processing CreateTablet for tablet a5e30fe82a41499caa5e79fa1560c1be (DEFAULT_TABLE table=default.table_1d29197c8463471d898f54b5dadaefc2 [id=8ef92f9201b34066b2b621ae3aa92ebe]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:59.356395 1883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5e30fe82a41499caa5e79fa1560c1be. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:59.356642 1609 tablet_service.cc:1468] Processing CreateTablet for tablet a5e30fe82a41499caa5e79fa1560c1be (DEFAULT_TABLE table=default.table_1d29197c8463471d898f54b5dadaefc2 [id=8ef92f9201b34066b2b621ae3aa92ebe]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:59.356978 1609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5e30fe82a41499caa5e79fa1560c1be. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:59.360533 2121 catalog_manager.cc:5582] T 61101a699bb84b62af4e7a0cae243d4e P de831f40fa1348a48a1f0260f4130197 reported cstate change: term changed from 0 to 1, leader changed from <none> to de831f40fa1348a48a1f0260f4130197 (127.1.1.194). New cstate: current_term: 1 leader_uuid: "de831f40fa1348a48a1f0260f4130197" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: UNKNOWN } } }
I20250831 19:54:59.360906 2121 catalog_manager.cc:5674] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475) does not have the latest schema for tablet 61101a699bb84b62af4e7a0cae243d4e (table default.table_207ac87518bc487184a89bb52cd204b3 [id=f48af5bc3eff4c819be4aeeff4128c2a]). Expected version 1 got 0
I20250831 19:54:59.366789 3372 tablet_bootstrap.cc:492] T a5e30fe82a41499caa5e79fa1560c1be P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:59.371611 3372 tablet_bootstrap.cc:654] T a5e30fe82a41499caa5e79fa1560c1be P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:59.380497 3373 tablet_bootstrap.cc:492] T e47844d025bf42ecbfd2d3f34a31538e P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:59.380717 3373 ts_tablet_manager.cc:1397] T e47844d025bf42ecbfd2d3f34a31538e P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.034s user 0.005s sys 0.004s
I20250831 19:54:59.381567 3373 raft_consensus.cc:357] T e47844d025bf42ecbfd2d3f34a31538e P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:59.381769 2123 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:36958 (request call id 202) took 2362 ms. Trace:
I20250831 19:54:59.381893 3373 raft_consensus.cc:383] T e47844d025bf42ecbfd2d3f34a31538e P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:59.382006 3373 raft_consensus.cc:738] T e47844d025bf42ecbfd2d3f34a31538e P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:59.381873 2123 rpcz_store.cc:276] 0831 19:54:57.018846 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:58.725972 (+1707126us) service_pool.cc:225] Handling call
0831 19:54:59.216119 (+490147us) catalog_manager.cc:2076] Acquired catalog manager lock
0831 19:54:59.216499 (+ 380us) catalog_manager.cc:2122] Created new table and tablet info
0831 19:54:59.354128 (+137629us) catalog_manager.cc:2148] Created new table in HMS catalog
0831 19:54:59.381518 (+ 27390us) catalog_manager.cc:2182] Wrote table and tablets to system table
0831 19:54:59.381628 (+ 110us) catalog_manager.cc:2216] Inserted table and tablets into CatalogManager maps
0831 19:54:59.381716 (+ 88us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:59.358109 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:59.358194 (+ 85us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:59.358199 (+ 5us) write_op.cc:435] Acquired schema lock
0831 19:54:59.358201 (+ 2us) tablet.cc:660] Decoding operations
0831 19:54:59.358283 (+ 82us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:59.358291 (+ 8us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:59.358294 (+ 3us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:59.358351 (+ 57us) tablet.cc:699] Row locks acquired
0831 19:54:59.358353 (+ 2us) write_op.cc:260] PREPARE: finished
0831 19:54:59.358379 (+ 26us) write_op.cc:270] Start()
0831 19:54:59.358403 (+ 24us) write_op.cc:276] Timestamp: P: 1756670099358326 usec, L: 0
0831 19:54:59.358406 (+ 3us) op_driver.cc:348] REPLICATION: starting
0831 19:54:59.363572 (+ 5166us) log.cc:844] Serialized 433 byte log entry
0831 19:54:59.364184 (+ 612us) spinlock_profiling.cc:243] Waited 5.02 ms on lock 0x616000040c54. stack: 00007f1e3b0dc7d6 00007f1e3b0dc590 00007f1e3a0cf3ad 0000000000972d94 0000000000972d5d 000000000097272a 00007f1e46b38d62 00007f1e47ee12d5 00007f1e47edfdf9 00007f1e47ee8220 00007f1e47ee802d 0000000000a774dc 00007f1e3b122b5f 00007f1e3b125e2b 00007f1e3b125ca8 0000000000a774dc
0831 19:54:59.378783 (+ 14599us) op_driver.cc:464] REPLICATION: finished
0831 19:54:59.379348 (+ 565us) write_op.cc:301] APPLY: starting
0831 19:54:59.379356 (+ 8us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:59.379387 (+ 31us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:59.379389 (+ 2us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:59.379464 (+ 75us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:59.379489 (+ 25us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0831 19:54:59.379496 (+ 7us) write_op.cc:312] APPLY: finished
0831 19:54:59.379547 (+ 51us) log.cc:844] Serialized 29 byte log entry
0831 19:54:59.379581 (+ 34us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:59.379591 (+ 10us) write_op.cc:454] Released schema lock
0831 19:54:59.379597 (+ 6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"Hive Metastore.queue_time_us":59240,"Hive Metastore.run_cpu_time_us":258,"Hive Metastore.run_wall_time_us":77887,"spinlock_wait_cycles":1664,"child_traces":[["op",{"apply.queue_time_us":531,"apply.run_cpu_time_us":299,"apply.run_wall_time_us":299,"num_ops":2,"prepare.queue_time_us":3381,"prepare.run_cpu_time_us":750,"prepare.run_wall_time_us":10102,"raft.queue_time_us":368,"raft.run_cpu_time_us":301,"raft.run_wall_time_us":414,"replication_time_us":20357,"spinlock_wait_cycles":11542400}]]}
I20250831 19:54:59.382361 3373 consensus_queue.cc:260] T e47844d025bf42ecbfd2d3f34a31538e P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:59.385270 2126 catalog_manager.cc:5869] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Sending DeleteTablet for 3 replicas of tablet 3081636d94084a8aa3905f40edf34b0f
I20250831 19:54:59.386054 2126 catalog_manager.cc:6652] ReplaceTablet: tablet 3081636d94084a8aa3905f40edf34b0f deleted and replaced by tablet bd2f43a6cd1d4782a420fe5e4e110ead
I20250831 19:54:59.386219 1609 tablet_service.cc:1515] Processing DeleteTablet for tablet 3081636d94084a8aa3905f40edf34b0f with delete_type TABLET_DATA_DELETED (replaced by tablet bd2f43a6cd1d4782a420fe5e4e110ead) from {username='slave'} at 127.0.0.1:51022
I20250831 19:54:59.386507 3312 tablet_replica.cc:331] T 3081636d94084a8aa3905f40edf34b0f P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:54:59.386677 3312 raft_consensus.cc:2241] T 3081636d94084a8aa3905f40edf34b0f P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:59.386833 3312 raft_consensus.cc:2270] T 3081636d94084a8aa3905f40edf34b0f P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:59.387753 3312 ts_tablet_manager.cc:1905] T 3081636d94084a8aa3905f40edf34b0f P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:59.390337 1883 tablet_service.cc:1515] Processing DeleteTablet for tablet 3081636d94084a8aa3905f40edf34b0f with delete_type TABLET_DATA_DELETED (replaced by tablet bd2f43a6cd1d4782a420fe5e4e110ead) from {username='slave'} at 127.0.0.1:45906
I20250831 19:54:59.390550 3310 tablet_replica.cc:331] T 3081636d94084a8aa3905f40edf34b0f P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:54:59.390717 3310 raft_consensus.cc:2241] T 3081636d94084a8aa3905f40edf34b0f P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:54:59.390861 3310 raft_consensus.cc:2270] T 3081636d94084a8aa3905f40edf34b0f P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:59.393875 3310 ts_tablet_manager.cc:1905] T 3081636d94084a8aa3905f40edf34b0f P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:59.397313 3312 ts_tablet_manager.cc:1918] T 3081636d94084a8aa3905f40edf34b0f P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:59.397411 3312 log.cc:1199] T 3081636d94084a8aa3905f40edf34b0f P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/3081636d94084a8aa3905f40edf34b0f
I20250831 19:54:59.397822 3312 ts_tablet_manager.cc:1939] T 3081636d94084a8aa3905f40edf34b0f P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
I20250831 19:54:59.398381 2104 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet 3081636d94084a8aa3905f40edf34b0f (table default.table_65ae80244c21495fad7b9e506a44ebcc [id=09c2744c9575474bba2df5503541accc]) successfully deleted
I20250831 19:54:59.407317 3310 ts_tablet_manager.cc:1918] T 3081636d94084a8aa3905f40edf34b0f P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:59.407478 3310 log.cc:1199] T 3081636d94084a8aa3905f40edf34b0f P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/3081636d94084a8aa3905f40edf34b0f
I20250831 19:54:59.408006 3310 ts_tablet_manager.cc:1939] T 3081636d94084a8aa3905f40edf34b0f P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:54:59.408897 2101 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet 3081636d94084a8aa3905f40edf34b0f (table default.table_65ae80244c21495fad7b9e506a44ebcc [id=09c2744c9575474bba2df5503541accc]) successfully deleted
I20250831 19:54:59.409202 3373 ts_tablet_manager.cc:1428] T e47844d025bf42ecbfd2d3f34a31538e P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.028s user 0.002s sys 0.000s
I20250831 19:54:59.416157 2126 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_55404df7d7524c7cb6139cc53ec92877" } modify_external_catalogs: true
I20250831 19:54:59.416461 2126 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_55404df7d7524c7cb6139cc53ec92877" } modify_external_catalogs: true
I20250831 19:54:59.426160 2118 catalog_manager.cc:6127] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: default.table_b63fcfe30c4b42e4aab0afa9159eff8b [id=690a54011d784c13992fd596584eadb8] alter complete (version 1)
I20250831 19:54:59.428017 3373 tablet_bootstrap.cc:492] T 3667c38e7b8c46ed8205e278c98c4b00 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:59.431442 2123 catalog_manager.cc:5674] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237) does not have the latest schema for tablet 06c27385b0b8460c9ea4f1d96ecb2966 (table default.table_4e12fc12cae640b99d4f3794151b6915 [id=ba4c5ecf4ae94ede9bfb83af2ee894ab]). Expected version 2 got 0
I20250831 19:54:59.436041 1609 tablet_service.cc:1468] Processing CreateTablet for tablet b54e648cf8e04022ad0bc099534424d1 (DEFAULT_TABLE table=default.table_76aceaaac1fb4aaeb55445d641a113d1 [id=5646c567b288436588bca1dde5d6e213]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:59.436581 1609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b54e648cf8e04022ad0bc099534424d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:59.437103 1883 tablet_service.cc:1468] Processing CreateTablet for tablet b54e648cf8e04022ad0bc099534424d1 (DEFAULT_TABLE table=default.table_76aceaaac1fb4aaeb55445d641a113d1 [id=5646c567b288436588bca1dde5d6e213]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:59.437520 1883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b54e648cf8e04022ad0bc099534424d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:59.293133 1750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84177615877240688a2d4b3b88915525. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:59.441817 1749 tablet_service.cc:1468] Processing CreateTablet for tablet b54e648cf8e04022ad0bc099534424d1 (DEFAULT_TABLE table=default.table_76aceaaac1fb4aaeb55445d641a113d1 [id=5646c567b288436588bca1dde5d6e213]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:59.442178 1749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b54e648cf8e04022ad0bc099534424d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:59.329281 1769 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5fcb923d81a2495fa02dc76ddb9983b7" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:59.338636 1768 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "06c27385b0b8460c9ea4f1d96ecb2966" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:59.343713 1772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "06c27385b0b8460c9ea4f1d96ecb2966" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197"
I20250831 19:54:59.360214 1748 tablet_service.cc:1468] Processing CreateTablet for tablet a5e30fe82a41499caa5e79fa1560c1be (DEFAULT_TABLE table=default.table_1d29197c8463471d898f54b5dadaefc2 [id=8ef92f9201b34066b2b621ae3aa92ebe]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:59.446130 1748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5e30fe82a41499caa5e79fa1560c1be. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:59.389561 1752 tablet_service.cc:1515] Processing DeleteTablet for tablet 3081636d94084a8aa3905f40edf34b0f with delete_type TABLET_DATA_DELETED (replaced by tablet bd2f43a6cd1d4782a420fe5e4e110ead) from {username='slave'} at 127.0.0.1:50674
I20250831 19:54:59.425669 3311 ts_tablet_manager.cc:1918] T 2c03497e3cb4480d88d99dde5d6ea22b P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:59.448506 3311 log.cc:1199] T 2c03497e3cb4480d88d99dde5d6ea22b P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/2c03497e3cb4480d88d99dde5d6ea22b
I20250831 19:54:59.448841 3311 ts_tablet_manager.cc:1939] T 2c03497e3cb4480d88d99dde5d6ea22b P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
I20250831 19:54:59.449211 3311 tablet_replica.cc:331] T 3081636d94084a8aa3905f40edf34b0f P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
W20250831 19:54:59.449991 1570 leader_election.cc:343] T 5fcb923d81a2495fa02dc76ddb9983b7 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): Illegal state: must be running to vote when last-logged opid is not known
I20250831 19:54:59.450101 1570 leader_election.cc:304] T 5fcb923d81a2495fa02dc76ddb9983b7 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825; no voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197
I20250831 19:54:59.450587 3081 raft_consensus.cc:2747] T 5fcb923d81a2495fa02dc76ddb9983b7 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250831 19:54:59.452602 2105 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet 2c03497e3cb4480d88d99dde5d6ea22b (table default.table_265519e91af542d1836f224e15cd5e60 [id=67d77a3f228b4f1da86b97cac2fc4aac]) successfully deleted
I20250831 19:54:59.453351 3375 raft_consensus.cc:383] T 06c27385b0b8460c9ea4f1d96ecb2966 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:59.453516 3375 raft_consensus.cc:738] T 06c27385b0b8460c9ea4f1d96ecb2966 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:59.453766 3375 consensus_queue.cc:260] T 06c27385b0b8460c9ea4f1d96ecb2966 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:59.454010 1768 raft_consensus.cc:2466] T 06c27385b0b8460c9ea4f1d96ecb2966 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 0.
I20250831 19:54:59.455819 3375 ts_tablet_manager.cc:1428] T 06c27385b0b8460c9ea4f1d96ecb2966 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.168s user 0.000s sys 0.001s
I20250831 19:54:59.456277 3375 tablet_bootstrap.cc:492] T f47cf07c9a4a43048123794e4a51904b P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:59.458654 3375 tablet_bootstrap.cc:654] T f47cf07c9a4a43048123794e4a51904b P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:59.460732 3373 tablet_bootstrap.cc:654] T 3667c38e7b8c46ed8205e278c98c4b00 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:59.462126 3311 raft_consensus.cc:2241] T 3081636d94084a8aa3905f40edf34b0f P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: Raft consensus shutting down.
I20250831 19:54:59.462563 3311 raft_consensus.cc:2270] T 3081636d94084a8aa3905f40edf34b0f P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:54:59.463531 3311 ts_tablet_manager.cc:1905] T 3081636d94084a8aa3905f40edf34b0f P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:54:59.470927 3373 tablet_bootstrap.cc:492] T 3667c38e7b8c46ed8205e278c98c4b00 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:59.471215 3373 ts_tablet_manager.cc:1397] T 3667c38e7b8c46ed8205e278c98c4b00 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.043s user 0.004s sys 0.000s
I20250831 19:54:59.472225 3373 raft_consensus.cc:357] T 3667c38e7b8c46ed8205e278c98c4b00 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:59.476763 3372 tablet_bootstrap.cc:492] T a5e30fe82a41499caa5e79fa1560c1be P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:59.476739 2118 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_0498f784ecd944168cd0cbd019307408" } modify_external_catalogs: true
I20250831 19:54:59.476886 3372 ts_tablet_manager.cc:1397] T a5e30fe82a41499caa5e79fa1560c1be P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.110s user 0.004s sys 0.000s
I20250831 19:54:59.476974 2118 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_0498f784ecd944168cd0cbd019307408" } modify_external_catalogs: true
I20250831 19:54:59.477219 3373 raft_consensus.cc:383] T 3667c38e7b8c46ed8205e278c98c4b00 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:59.477324 3373 raft_consensus.cc:738] T 3667c38e7b8c46ed8205e278c98c4b00 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:59.477887 3373 consensus_queue.cc:260] T 3667c38e7b8c46ed8205e278c98c4b00 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:59.479425 3372 raft_consensus.cc:357] T a5e30fe82a41499caa5e79fa1560c1be P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:59.479588 3372 raft_consensus.cc:383] T a5e30fe82a41499caa5e79fa1560c1be P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:59.479645 3372 raft_consensus.cc:738] T a5e30fe82a41499caa5e79fa1560c1be P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:59.479820 3372 consensus_queue.cc:260] T a5e30fe82a41499caa5e79fa1560c1be P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:59.479955 2121 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "default.Table_617124885d2e4d96b863e0e435bdf695" } new_table_name: "default.Table_dcdb51c187224f8c88da49b3ddd45493" modify_external_catalogs: true
I20250831 19:54:59.481554 3372 ts_tablet_manager.cc:1428] T a5e30fe82a41499caa5e79fa1560c1be P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.005s user 0.001s sys 0.002s
I20250831 19:54:59.481812 3372 tablet_bootstrap.cc:492] T b54e648cf8e04022ad0bc099534424d1 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:59.483348 3372 tablet_bootstrap.cc:654] T b54e648cf8e04022ad0bc099534424d1 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:59.483734 3162 raft_consensus.cc:491] T 8afbd19c84f14fbb8f957c2f10d97a4c P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:59.483886 3162 raft_consensus.cc:513] T 8afbd19c84f14fbb8f957c2f10d97a4c P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:59.485574 3162 leader_election.cc:290] T 8afbd19c84f14fbb8f957c2f10d97a4c P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:59.485934 1768 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8afbd19c84f14fbb8f957c2f10d97a4c" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:59.486138 1768 raft_consensus.cc:2466] T 8afbd19c84f14fbb8f957c2f10d97a4c P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 0.
I20250831 19:54:59.486505 1570 leader_election.cc:304] T 8afbd19c84f14fbb8f957c2f10d97a4c P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:59.486737 3162 raft_consensus.cc:2802] T 8afbd19c84f14fbb8f957c2f10d97a4c P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:59.486817 3162 raft_consensus.cc:491] T 8afbd19c84f14fbb8f957c2f10d97a4c P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:59.486873 3162 raft_consensus.cc:3058] T 8afbd19c84f14fbb8f957c2f10d97a4c P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:59.490103 3162 raft_consensus.cc:513] T 8afbd19c84f14fbb8f957c2f10d97a4c P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:59.491087 3162 leader_election.cc:290] T 8afbd19c84f14fbb8f957c2f10d97a4c P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Requested vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:59.491150 1768 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8afbd19c84f14fbb8f957c2f10d97a4c" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197"
I20250831 19:54:59.491303 1768 raft_consensus.cc:3058] T 8afbd19c84f14fbb8f957c2f10d97a4c P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:59.492381 1906 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8afbd19c84f14fbb8f957c2f10d97a4c" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:59.492580 1906 raft_consensus.cc:2466] T 8afbd19c84f14fbb8f957c2f10d97a4c P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 0.
I20250831 19:54:59.493103 1906 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8afbd19c84f14fbb8f957c2f10d97a4c" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:54:59.493266 1906 raft_consensus.cc:3058] T 8afbd19c84f14fbb8f957c2f10d97a4c P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:59.494401 1768 raft_consensus.cc:2466] T 8afbd19c84f14fbb8f957c2f10d97a4c P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1.
I20250831 19:54:59.494748 1570 leader_election.cc:304] T 8afbd19c84f14fbb8f957c2f10d97a4c P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:59.494990 3162 raft_consensus.cc:2802] T 8afbd19c84f14fbb8f957c2f10d97a4c P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:59.495185 3162 raft_consensus.cc:695] T 8afbd19c84f14fbb8f957c2f10d97a4c P 89aa85d59c53436ebdf3074b13d14825 [term 1 LEADER]: Becoming Leader. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Running, Role: LEADER
I20250831 19:54:59.495419 3162 consensus_queue.cc:237] T 8afbd19c84f14fbb8f957c2f10d97a4c P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:59.496485 1906 raft_consensus.cc:2466] T 8afbd19c84f14fbb8f957c2f10d97a4c P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1.
I20250831 19:54:59.500855 3373 ts_tablet_manager.cc:1428] T 3667c38e7b8c46ed8205e278c98c4b00 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.029s user 0.002s sys 0.000s
I20250831 19:54:59.504161 2123 catalog_manager.cc:5582] T 06c27385b0b8460c9ea4f1d96ecb2966 P 89aa85d59c53436ebdf3074b13d14825 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193). New cstate: current_term: 1 leader_uuid: "89aa85d59c53436ebdf3074b13d14825" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: HEALTHY } } }
I20250831 19:54:59.504688 2123 catalog_manager.cc:5674] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197) does not have the latest schema for tablet 06c27385b0b8460c9ea4f1d96ecb2966 (table default.table_4e12fc12cae640b99d4f3794151b6915 [id=ba4c5ecf4ae94ede9bfb83af2ee894ab]). Expected version 2 got 0
I20250831 19:54:59.507824 1748 tablet_service.cc:1468] Processing CreateTablet for tablet bddbec77b8444036b0c5e8d325faceaa (DEFAULT_TABLE table=default.table_be7bbefda22d4660a8d257962bfe0979 [id=5579e4d41f7b456b8d92804eb3d03711]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:59.516284 3373 tablet_bootstrap.cc:492] T 5fcb923d81a2495fa02dc76ddb9983b7 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:59.518437 3373 tablet_bootstrap.cc:654] T 5fcb923d81a2495fa02dc76ddb9983b7 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:59.521988 2123 catalog_manager.cc:5674] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237) does not have the latest schema for tablet e47844d025bf42ecbfd2d3f34a31538e (table default.table_c7390b7344da4c3fbf7f2f502b096669 [id=1df66f6230794e939a25c0f2254d6e17]). Expected version 2 got 0
I20250831 19:54:59.525035 3372 tablet_bootstrap.cc:492] T b54e648cf8e04022ad0bc099534424d1 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:59.525182 3372 ts_tablet_manager.cc:1397] T b54e648cf8e04022ad0bc099534424d1 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.043s user 0.003s sys 0.000s
I20250831 19:54:59.531765 3311 ts_tablet_manager.cc:1918] T 3081636d94084a8aa3905f40edf34b0f P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:54:59.534677 3311 log.cc:1199] T 3081636d94084a8aa3905f40edf34b0f P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/3081636d94084a8aa3905f40edf34b0f
I20250831 19:54:59.537142 2120 catalog_manager.cc:2149] created HMS catalog entry for table [id=fa5e29f502aa4eae9056a1e220d6e9bc]
I20250831 19:54:59.538061 3372 raft_consensus.cc:357] T b54e648cf8e04022ad0bc099534424d1 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:59.538228 3372 raft_consensus.cc:383] T b54e648cf8e04022ad0bc099534424d1 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:59.538280 3372 raft_consensus.cc:738] T b54e648cf8e04022ad0bc099534424d1 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:59.538470 3372 consensus_queue.cc:260] T b54e648cf8e04022ad0bc099534424d1 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:59.543006 1748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bddbec77b8444036b0c5e8d325faceaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:59.545564 2120 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:36958 (request call id 200) took 2740 ms. Trace:
I20250831 19:54:59.545717 2120 rpcz_store.cc:276] 0831 19:54:56.805139 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:58.657422 (+1852283us) service_pool.cc:225] Handling call
0831 19:54:59.216659 (+559237us) catalog_manager.cc:2076] Acquired catalog manager lock
0831 19:54:59.217061 (+ 402us) catalog_manager.cc:2122] Created new table and tablet info
0831 19:54:59.537075 (+320014us) catalog_manager.cc:2148] Created new table in HMS catalog
0831 19:54:59.545259 (+ 8184us) catalog_manager.cc:2182] Wrote table and tablets to system table
0831 19:54:59.545389 (+ 130us) catalog_manager.cc:2216] Inserted table and tablets into CatalogManager maps
0831 19:54:59.545517 (+ 128us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:54:59.537989 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:54:59.538124 (+ 135us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:54:59.538131 (+ 7us) write_op.cc:435] Acquired schema lock
0831 19:54:59.538135 (+ 4us) tablet.cc:660] Decoding operations
0831 19:54:59.538407 (+ 272us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:54:59.538421 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0831 19:54:59.538428 (+ 7us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:54:59.538552 (+ 124us) tablet.cc:699] Row locks acquired
0831 19:54:59.538556 (+ 4us) write_op.cc:260] PREPARE: finished
0831 19:54:59.538656 (+ 100us) write_op.cc:270] Start()
0831 19:54:59.538699 (+ 43us) write_op.cc:276] Timestamp: P: 1756670099538574 usec, L: 0
0831 19:54:59.538704 (+ 5us) op_driver.cc:348] REPLICATION: starting
0831 19:54:59.538934 (+ 230us) log.cc:844] Serialized 433 byte log entry
0831 19:54:59.544566 (+ 5632us) op_driver.cc:464] REPLICATION: finished
0831 19:54:59.544689 (+ 123us) write_op.cc:301] APPLY: starting
0831 19:54:59.544707 (+ 18us) tablet.cc:1365] starting BulkCheckPresence
0831 19:54:59.544754 (+ 47us) tablet.cc:1368] finished BulkCheckPresence
0831 19:54:59.544794 (+ 40us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:54:59.544932 (+ 138us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:54:59.544973 (+ 41us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0831 19:54:59.544983 (+ 10us) write_op.cc:312] APPLY: finished
0831 19:54:59.545065 (+ 82us) log.cc:844] Serialized 29 byte log entry
0831 19:54:59.545139 (+ 74us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:54:59.545161 (+ 22us) write_op.cc:454] Released schema lock
0831 19:54:59.545169 (+ 8us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"Hive Metastore.queue_time_us":136599,"Hive Metastore.run_cpu_time_us":299,"Hive Metastore.run_wall_time_us":183242,"spinlock_wait_cycles":2688,"child_traces":[["op",{"apply.queue_time_us":68,"num_ops":2,"prepare.queue_time_us":119,"prepare.run_cpu_time_us":863,"prepare.run_wall_time_us":1075,"raft.queue_time_us":1045,"raft.run_cpu_time_us":868,"raft.run_wall_time_us":6096,"replication_time_us":5827,"spinlock_wait_cycles":136448}]]}
I20250831 19:54:59.552382 2120 catalog_manager.cc:5674] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475) does not have the latest schema for tablet 06c27385b0b8460c9ea4f1d96ecb2966 (table default.table_4e12fc12cae640b99d4f3794151b6915 [id=ba4c5ecf4ae94ede9bfb83af2ee894ab]). Expected version 2 got 0
I20250831 19:54:59.553614 3323 raft_consensus.cc:491] T 3667c38e7b8c46ed8205e278c98c4b00 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:59.559125 2120 catalog_manager.cc:5582] T 8afbd19c84f14fbb8f957c2f10d97a4c P 89aa85d59c53436ebdf3074b13d14825 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193). New cstate: current_term: 1 leader_uuid: "89aa85d59c53436ebdf3074b13d14825" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: HEALTHY } } }
I20250831 19:54:59.560983 1886 tablet_service.cc:1468] Processing CreateTablet for tablet bd2f43a6cd1d4782a420fe5e4e110ead (DEFAULT_TABLE table=default.table_65ae80244c21495fad7b9e506a44ebcc [id=09c2744c9575474bba2df5503541accc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:59.561158 1748 tablet_service.cc:1468] Processing CreateTablet for tablet bd2f43a6cd1d4782a420fe5e4e110ead (DEFAULT_TABLE table=default.table_65ae80244c21495fad7b9e506a44ebcc [id=09c2744c9575474bba2df5503541accc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:59.561324 1886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd2f43a6cd1d4782a420fe5e4e110ead. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:59.561461 1748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd2f43a6cd1d4782a420fe5e4e110ead. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:59.561729 1609 tablet_service.cc:1468] Processing CreateTablet for tablet bddbec77b8444036b0c5e8d325faceaa (DEFAULT_TABLE table=default.table_be7bbefda22d4660a8d257962bfe0979 [id=5579e4d41f7b456b8d92804eb3d03711]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:59.562141 1609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bddbec77b8444036b0c5e8d325faceaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:59.571372 3372 ts_tablet_manager.cc:1428] T b54e648cf8e04022ad0bc099534424d1 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.046s user 0.002s sys 0.000s
I20250831 19:54:59.571308 1613 tablet_service.cc:1468] Processing CreateTablet for tablet bd2f43a6cd1d4782a420fe5e4e110ead (DEFAULT_TABLE table=default.table_65ae80244c21495fad7b9e506a44ebcc [id=09c2744c9575474bba2df5503541accc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:59.572885 3375 tablet_bootstrap.cc:492] T f47cf07c9a4a43048123794e4a51904b P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:59.573004 3375 ts_tablet_manager.cc:1397] T f47cf07c9a4a43048123794e4a51904b P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.117s user 0.002s sys 0.001s
I20250831 19:54:59.574342 3375 raft_consensus.cc:357] T f47cf07c9a4a43048123794e4a51904b P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:59.574489 3375 raft_consensus.cc:383] T f47cf07c9a4a43048123794e4a51904b P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:59.574600 3375 raft_consensus.cc:738] T f47cf07c9a4a43048123794e4a51904b P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:59.574837 3375 consensus_queue.cc:260] T f47cf07c9a4a43048123794e4a51904b P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:59.574962 1613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd2f43a6cd1d4782a420fe5e4e110ead. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:59.577014 3375 ts_tablet_manager.cc:1428] T f47cf07c9a4a43048123794e4a51904b P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20250831 19:54:59.577260 3375 tablet_bootstrap.cc:492] T e47844d025bf42ecbfd2d3f34a31538e P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:59.582980 3372 tablet_bootstrap.cc:492] T bddbec77b8444036b0c5e8d325faceaa P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:59.591092 3311 ts_tablet_manager.cc:1939] T 3081636d94084a8aa3905f40edf34b0f P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
I20250831 19:54:59.591179 3372 tablet_bootstrap.cc:654] T bddbec77b8444036b0c5e8d325faceaa P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:59.591809 2105 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet 3081636d94084a8aa3905f40edf34b0f (table default.table_65ae80244c21495fad7b9e506a44ebcc [id=09c2744c9575474bba2df5503541accc]) successfully deleted
I20250831 19:54:59.602453 1410 master_runner.cc:186] Error getting master registration for 127.1.1.254:34259: OK, instance_id { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" instance_seqno: 1756670096866276 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20250831 19:54:59.602660 1410 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20250831 19:54:59.603875 1748 tablet_service.cc:1468] Processing CreateTablet for tablet 1ea70a674686459d88265f5f5524fc10 (DEFAULT_TABLE table=default.table_dd23f581be78471f98008014d30c3398 [id=fa5e29f502aa4eae9056a1e220d6e9bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:59.604336 1748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ea70a674686459d88265f5f5524fc10. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:59.604782 3375 tablet_bootstrap.cc:654] T e47844d025bf42ecbfd2d3f34a31538e P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:59.608944 2123 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36958:
name: "default.Table_5b6b5bfafb524e0a9e93a06dbd4456c9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:59.611192 1609 tablet_service.cc:1468] Processing CreateTablet for tablet 1ea70a674686459d88265f5f5524fc10 (DEFAULT_TABLE table=default.table_dd23f581be78471f98008014d30c3398 [id=fa5e29f502aa4eae9056a1e220d6e9bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:59.611636 1609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ea70a674686459d88265f5f5524fc10. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:59.617187 1633 raft_consensus.cc:1273] T 61101a699bb84b62af4e7a0cae243d4e P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Refusing update from remote peer de831f40fa1348a48a1f0260f4130197: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250831 19:54:59.617377 3373 tablet_bootstrap.cc:492] T 5fcb923d81a2495fa02dc76ddb9983b7 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:59.617561 3373 ts_tablet_manager.cc:1397] T 5fcb923d81a2495fa02dc76ddb9983b7 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.101s user 0.004s sys 0.000s
I20250831 19:54:59.617861 3352 consensus_queue.cc:1035] T 61101a699bb84b62af4e7a0cae243d4e P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:59.622215 2120 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36958:
name: "default.Table_ca7adb92869942138e0f7dbe76fa583f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:54:59.622926 1884 tablet_service.cc:1468] Processing CreateTablet for tablet 1ea70a674686459d88265f5f5524fc10 (DEFAULT_TABLE table=default.table_dd23f581be78471f98008014d30c3398 [id=fa5e29f502aa4eae9056a1e220d6e9bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:59.623275 1884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ea70a674686459d88265f5f5524fc10. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:59.624743 1883 tablet_service.cc:1468] Processing CreateTablet for tablet bddbec77b8444036b0c5e8d325faceaa (DEFAULT_TABLE table=default.table_be7bbefda22d4660a8d257962bfe0979 [id=5579e4d41f7b456b8d92804eb3d03711]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:54:59.625094 1883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bddbec77b8444036b0c5e8d325faceaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:54:59.626259 1906 raft_consensus.cc:1273] T 61101a699bb84b62af4e7a0cae243d4e P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Refusing update from remote peer de831f40fa1348a48a1f0260f4130197: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250831 19:54:59.553818 3323 raft_consensus.cc:513] T 3667c38e7b8c46ed8205e278c98c4b00 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:59.630530 3352 consensus_queue.cc:1035] T 61101a699bb84b62af4e7a0cae243d4e P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:59.631913 3323 leader_election.cc:290] T 3667c38e7b8c46ed8205e278c98c4b00 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:59.632474 1634 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3667c38e7b8c46ed8205e278c98c4b00" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:59.632697 1634 raft_consensus.cc:2466] T 3667c38e7b8c46ed8205e278c98c4b00 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 0.
I20250831 19:54:59.633194 3162 raft_consensus.cc:491] T b54e648cf8e04022ad0bc099534424d1 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:59.633327 3162 raft_consensus.cc:513] T b54e648cf8e04022ad0bc099534424d1 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:59.633427 1841 leader_election.cc:304] T 3667c38e7b8c46ed8205e278c98c4b00 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:54:59.633958 1768 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3667c38e7b8c46ed8205e278c98c4b00" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:59.634222 3445 catalog_manager.cc:797] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20250831 19:54:59.634346 3162 leader_election.cc:290] T b54e648cf8e04022ad0bc099534424d1 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237)
I20250831 19:54:59.634606 1768 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b54e648cf8e04022ad0bc099534424d1" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
W20250831 19:54:59.634925 1842 leader_election.cc:343] T 3667c38e7b8c46ed8205e278c98c4b00 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): Illegal state: must be running to vote when last-logged opid is not known
I20250831 19:54:59.635320 3323 raft_consensus.cc:2802] T 3667c38e7b8c46ed8205e278c98c4b00 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:59.635380 3323 raft_consensus.cc:491] T 3667c38e7b8c46ed8205e278c98c4b00 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:59.635433 3323 raft_consensus.cc:3058] T 3667c38e7b8c46ed8205e278c98c4b00 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
W20250831 19:54:59.636181 1570 leader_election.cc:343] T b54e648cf8e04022ad0bc099534424d1 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): Illegal state: must be running to vote when last-logged opid is not known
I20250831 19:54:59.637656 1906 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b54e648cf8e04022ad0bc099534424d1" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
W20250831 19:54:59.639288 1568 leader_election.cc:343] T b54e648cf8e04022ad0bc099534424d1 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): Illegal state: must be running to vote when last-logged opid is not known
I20250831 19:54:59.639377 1568 leader_election.cc:304] T b54e648cf8e04022ad0bc099534424d1 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825; no voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197
I20250831 19:54:59.639808 3162 raft_consensus.cc:2747] T b54e648cf8e04022ad0bc099534424d1 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250831 19:54:59.639889 3323 raft_consensus.cc:513] T 3667c38e7b8c46ed8205e278c98c4b00 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:59.640424 3323 leader_election.cc:290] T 3667c38e7b8c46ed8205e278c98c4b00 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 election: Requested vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:59.640974 1634 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3667c38e7b8c46ed8205e278c98c4b00" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:54:59.641101 1634 raft_consensus.cc:3058] T 3667c38e7b8c46ed8205e278c98c4b00 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:59.641974 1768 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3667c38e7b8c46ed8205e278c98c4b00" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197"
W20250831 19:54:59.642397 1842 leader_election.cc:343] T 3667c38e7b8c46ed8205e278c98c4b00 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): Illegal state: must be running to vote when last-logged opid is not known
I20250831 19:54:59.644042 1634 raft_consensus.cc:2466] T 3667c38e7b8c46ed8205e278c98c4b00 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 1.
I20250831 19:54:59.644650 1841 leader_election.cc:304] T 3667c38e7b8c46ed8205e278c98c4b00 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters: de831f40fa1348a48a1f0260f4130197
I20250831 19:54:59.646445 3430 raft_consensus.cc:2802] T 3667c38e7b8c46ed8205e278c98c4b00 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:59.646574 3430 raft_consensus.cc:695] T 3667c38e7b8c46ed8205e278c98c4b00 P 2441fafe1d62429386f4631ad423567d [term 1 LEADER]: Becoming Leader. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Running, Role: LEADER
I20250831 19:54:59.646847 3430 consensus_queue.cc:237] T 3667c38e7b8c46ed8205e278c98c4b00 P 2441fafe1d62429386f4631ad423567d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:59.647902 3373 raft_consensus.cc:357] T 5fcb923d81a2495fa02dc76ddb9983b7 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:59.648056 3373 raft_consensus.cc:383] T 5fcb923d81a2495fa02dc76ddb9983b7 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:59.648109 3373 raft_consensus.cc:738] T 5fcb923d81a2495fa02dc76ddb9983b7 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:59.650349 3373 consensus_queue.cc:260] T 5fcb923d81a2495fa02dc76ddb9983b7 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:59.650827 3373 ts_tablet_manager.cc:1428] T 5fcb923d81a2495fa02dc76ddb9983b7 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.033s user 0.001s sys 0.000s
I20250831 19:54:59.651072 3373 tablet_bootstrap.cc:492] T 84177615877240688a2d4b3b88915525 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:59.659279 3372 tablet_bootstrap.cc:492] T bddbec77b8444036b0c5e8d325faceaa P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:59.659430 3372 ts_tablet_manager.cc:1397] T bddbec77b8444036b0c5e8d325faceaa P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.077s user 0.003s sys 0.001s
I20250831 19:54:59.660280 3372 raft_consensus.cc:357] T bddbec77b8444036b0c5e8d325faceaa P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:59.660444 3372 raft_consensus.cc:383] T bddbec77b8444036b0c5e8d325faceaa P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:59.660494 3372 raft_consensus.cc:738] T bddbec77b8444036b0c5e8d325faceaa P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:59.660689 3372 consensus_queue.cc:260] T bddbec77b8444036b0c5e8d325faceaa P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:59.661108 3372 ts_tablet_manager.cc:1428] T bddbec77b8444036b0c5e8d325faceaa P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20250831 19:54:59.661340 3372 tablet_bootstrap.cc:492] T bd2f43a6cd1d4782a420fe5e4e110ead P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:59.666499 3373 tablet_bootstrap.cc:654] T 84177615877240688a2d4b3b88915525 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:59.681222 3171 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "2441fafe1d62429386f4631ad423567d" instance_seqno: 1756670080785002) as {username='slave'} at 127.1.1.195:55195; Asking this server to re-register.
I20250831 19:54:59.684507 3356 tablet.cc:1722] T 61101a699bb84b62af4e7a0cae243d4e P de831f40fa1348a48a1f0260f4130197: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:59.687580 1952 heartbeater.cc:461] Registering TS with master...
I20250831 19:54:59.690251 3081 raft_consensus.cc:491] T a5e30fe82a41499caa5e79fa1560c1be P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:59.690404 3081 raft_consensus.cc:513] T a5e30fe82a41499caa5e79fa1560c1be P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:59.694705 3333 tablet.cc:1722] T 61101a699bb84b62af4e7a0cae243d4e P 2441fafe1d62429386f4631ad423567d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:59.706602 3171 ts_manager.cc:194] Registered new tserver with Master: 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237)
I20250831 19:54:59.717978 3081 leader_election.cc:290] T a5e30fe82a41499caa5e79fa1560c1be P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:59.719179 1769 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a5e30fe82a41499caa5e79fa1560c1be" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
W20250831 19:54:59.719772 1570 leader_election.cc:343] T a5e30fe82a41499caa5e79fa1560c1be P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): Illegal state: must be running to vote when last-logged opid is not known
I20250831 19:54:59.720490 1906 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a5e30fe82a41499caa5e79fa1560c1be" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
W20250831 19:54:59.720957 1568 leader_election.cc:343] T a5e30fe82a41499caa5e79fa1560c1be P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): Illegal state: must be running to vote when last-logged opid is not known
I20250831 19:54:59.721055 1568 leader_election.cc:304] T a5e30fe82a41499caa5e79fa1560c1be P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825; no voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197
I20250831 19:54:59.721410 3081 raft_consensus.cc:2747] T a5e30fe82a41499caa5e79fa1560c1be P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250831 19:54:59.722182 3375 tablet_bootstrap.cc:492] T e47844d025bf42ecbfd2d3f34a31538e P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:59.722347 3375 ts_tablet_manager.cc:1397] T e47844d025bf42ecbfd2d3f34a31538e P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.145s user 0.003s sys 0.029s
I20250831 19:54:59.723050 3375 raft_consensus.cc:357] T e47844d025bf42ecbfd2d3f34a31538e P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:59.723237 3375 raft_consensus.cc:383] T e47844d025bf42ecbfd2d3f34a31538e P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:59.723321 3375 raft_consensus.cc:738] T e47844d025bf42ecbfd2d3f34a31538e P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:59.723563 3375 consensus_queue.cc:260] T e47844d025bf42ecbfd2d3f34a31538e P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:59.728039 3375 ts_tablet_manager.cc:1428] T e47844d025bf42ecbfd2d3f34a31538e P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.006s user 0.000s sys 0.001s
I20250831 19:54:59.728353 3375 tablet_bootstrap.cc:492] T 3667c38e7b8c46ed8205e278c98c4b00 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:59.729466 3372 tablet_bootstrap.cc:654] T bd2f43a6cd1d4782a420fe5e4e110ead P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:59.729666 3375 tablet_bootstrap.cc:654] T 3667c38e7b8c46ed8205e278c98c4b00 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:59.742621 3375 tablet_bootstrap.cc:492] T 3667c38e7b8c46ed8205e278c98c4b00 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:59.742785 3375 ts_tablet_manager.cc:1397] T 3667c38e7b8c46ed8205e278c98c4b00 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.014s user 0.005s sys 0.005s
I20250831 19:54:59.743391 3375 raft_consensus.cc:357] T 3667c38e7b8c46ed8205e278c98c4b00 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:59.743577 3375 raft_consensus.cc:383] T 3667c38e7b8c46ed8205e278c98c4b00 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:59.743657 3375 raft_consensus.cc:738] T 3667c38e7b8c46ed8205e278c98c4b00 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:59.743872 3375 consensus_queue.cc:260] T 3667c38e7b8c46ed8205e278c98c4b00 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:59.744402 3375 ts_tablet_manager.cc:1428] T 3667c38e7b8c46ed8205e278c98c4b00 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20250831 19:54:59.744520 3171 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" instance_seqno: 1756670079933967) as {username='slave'} at 127.1.1.193:50887; Asking this server to re-register.
I20250831 19:54:59.744741 3375 tablet_bootstrap.cc:492] T 5fcb923d81a2495fa02dc76ddb9983b7 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:59.745986 3375 tablet_bootstrap.cc:654] T 5fcb923d81a2495fa02dc76ddb9983b7 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:59.746138 1680 heartbeater.cc:461] Registering TS with master...
I20250831 19:54:59.749059 3394 tablet.cc:1722] T 61101a699bb84b62af4e7a0cae243d4e P 89aa85d59c53436ebdf3074b13d14825: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:54:59.755388 3171 ts_manager.cc:194] Registered new tserver with Master: 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:59.755848 3375 tablet_bootstrap.cc:492] T 5fcb923d81a2495fa02dc76ddb9983b7 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:59.755970 3375 ts_tablet_manager.cc:1397] T 5fcb923d81a2495fa02dc76ddb9983b7 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.002s
I20250831 19:54:59.756620 3375 raft_consensus.cc:357] T 5fcb923d81a2495fa02dc76ddb9983b7 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:59.756819 3375 raft_consensus.cc:383] T 5fcb923d81a2495fa02dc76ddb9983b7 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:59.756917 3375 raft_consensus.cc:738] T 5fcb923d81a2495fa02dc76ddb9983b7 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:59.757164 3375 consensus_queue.cc:260] T 5fcb923d81a2495fa02dc76ddb9983b7 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:59.757855 3375 ts_tablet_manager.cc:1428] T 5fcb923d81a2495fa02dc76ddb9983b7 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250831 19:54:59.759653 3375 tablet_bootstrap.cc:492] T 84177615877240688a2d4b3b88915525 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:59.761008 3375 tablet_bootstrap.cc:654] T 84177615877240688a2d4b3b88915525 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:59.767231 3372 tablet_bootstrap.cc:492] T bd2f43a6cd1d4782a420fe5e4e110ead P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:59.767412 3372 ts_tablet_manager.cc:1397] T bd2f43a6cd1d4782a420fe5e4e110ead P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.106s user 0.000s sys 0.003s
I20250831 19:54:59.768285 3372 raft_consensus.cc:357] T bd2f43a6cd1d4782a420fe5e4e110ead P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:59.768471 3372 raft_consensus.cc:383] T bd2f43a6cd1d4782a420fe5e4e110ead P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:59.768545 3372 raft_consensus.cc:738] T bd2f43a6cd1d4782a420fe5e4e110ead P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:59.769292 3373 tablet_bootstrap.cc:492] T 84177615877240688a2d4b3b88915525 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:59.769471 3373 ts_tablet_manager.cc:1397] T 84177615877240688a2d4b3b88915525 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.118s user 0.003s sys 0.002s
I20250831 19:54:59.770351 1768 raft_consensus.cc:3058] T 06c27385b0b8460c9ea4f1d96ecb2966 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:59.770428 1906 raft_consensus.cc:1273] T 06c27385b0b8460c9ea4f1d96ecb2966 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Refusing update from remote peer 89aa85d59c53436ebdf3074b13d14825: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250831 19:54:59.771414 3373 raft_consensus.cc:357] T 84177615877240688a2d4b3b88915525 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:59.771540 3373 raft_consensus.cc:383] T 84177615877240688a2d4b3b88915525 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:59.771575 3373 raft_consensus.cc:738] T 84177615877240688a2d4b3b88915525 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:59.771764 3373 consensus_queue.cc:260] T 84177615877240688a2d4b3b88915525 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:59.772136 3373 ts_tablet_manager.cc:1428] T 84177615877240688a2d4b3b88915525 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20250831 19:54:59.774474 3373 tablet_bootstrap.cc:492] T a5e30fe82a41499caa5e79fa1560c1be P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:59.770946 3162 consensus_queue.cc:1035] T 06c27385b0b8460c9ea4f1d96ecb2966 P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:59.782335 1768 raft_consensus.cc:1273] T 06c27385b0b8460c9ea4f1d96ecb2966 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Refusing update from remote peer 89aa85d59c53436ebdf3074b13d14825: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250831 19:54:59.783032 3162 consensus_queue.cc:1035] T 06c27385b0b8460c9ea4f1d96ecb2966 P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:59.784077 3372 consensus_queue.cc:260] T bd2f43a6cd1d4782a420fe5e4e110ead P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:59.785642 3372 ts_tablet_manager.cc:1428] T bd2f43a6cd1d4782a420fe5e4e110ead P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.018s user 0.000s sys 0.001s
I20250831 19:54:59.786810 3373 tablet_bootstrap.cc:654] T a5e30fe82a41499caa5e79fa1560c1be P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:59.790747 3171 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "de831f40fa1348a48a1f0260f4130197" instance_seqno: 1756670080362800) as {username='slave'} at 127.1.1.194:54061; Asking this server to re-register.
I20250831 19:54:59.792311 1818 heartbeater.cc:461] Registering TS with master...
I20250831 19:54:59.794031 3394 tablet.cc:1722] T 06c27385b0b8460c9ea4f1d96ecb2966 P 89aa85d59c53436ebdf3074b13d14825: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250831 19:54:59.798836 3333 tablet.cc:1722] T 06c27385b0b8460c9ea4f1d96ecb2966 P 2441fafe1d62429386f4631ad423567d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250831 19:54:59.808251 3081 raft_consensus.cc:491] T e47844d025bf42ecbfd2d3f34a31538e P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:59.808393 3081 raft_consensus.cc:513] T e47844d025bf42ecbfd2d3f34a31538e P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:59.808977 3081 leader_election.cc:290] T e47844d025bf42ecbfd2d3f34a31538e P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:59.809468 1768 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e47844d025bf42ecbfd2d3f34a31538e" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:59.809491 1906 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e47844d025bf42ecbfd2d3f34a31538e" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:54:59.809688 1768 raft_consensus.cc:2466] T e47844d025bf42ecbfd2d3f34a31538e P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 0.
I20250831 19:54:59.809712 1906 raft_consensus.cc:2466] T e47844d025bf42ecbfd2d3f34a31538e P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 0.
I20250831 19:54:59.810079 1570 leader_election.cc:304] T e47844d025bf42ecbfd2d3f34a31538e P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:59.810473 3081 raft_consensus.cc:2802] T e47844d025bf42ecbfd2d3f34a31538e P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:59.810581 3081 raft_consensus.cc:491] T e47844d025bf42ecbfd2d3f34a31538e P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:59.810660 3081 raft_consensus.cc:3058] T e47844d025bf42ecbfd2d3f34a31538e P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:59.813469 3081 raft_consensus.cc:513] T e47844d025bf42ecbfd2d3f34a31538e P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:59.814796 3081 leader_election.cc:290] T e47844d025bf42ecbfd2d3f34a31538e P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Requested vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:59.816296 1772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e47844d025bf42ecbfd2d3f34a31538e" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197"
I20250831 19:54:59.816445 1772 raft_consensus.cc:3058] T e47844d025bf42ecbfd2d3f34a31538e P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:59.817546 3372 tablet_bootstrap.cc:492] T 1ea70a674686459d88265f5f5524fc10 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:54:59.818969 1772 raft_consensus.cc:2466] T e47844d025bf42ecbfd2d3f34a31538e P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1.
I20250831 19:54:59.819538 1570 leader_election.cc:304] T e47844d025bf42ecbfd2d3f34a31538e P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:59.820662 1906 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e47844d025bf42ecbfd2d3f34a31538e" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:54:59.820920 1906 raft_consensus.cc:3058] T e47844d025bf42ecbfd2d3f34a31538e P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:59.822466 3081 raft_consensus.cc:2802] T e47844d025bf42ecbfd2d3f34a31538e P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:59.822638 3081 raft_consensus.cc:695] T e47844d025bf42ecbfd2d3f34a31538e P 89aa85d59c53436ebdf3074b13d14825 [term 1 LEADER]: Becoming Leader. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Running, Role: LEADER
I20250831 19:54:59.822903 3081 consensus_queue.cc:237] T e47844d025bf42ecbfd2d3f34a31538e P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:59.826325 1906 raft_consensus.cc:2466] T e47844d025bf42ecbfd2d3f34a31538e P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1.
I20250831 19:54:59.832473 3170 ts_manager.cc:194] Registered new tserver with Master: de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:54:59.832841 3373 tablet_bootstrap.cc:492] T a5e30fe82a41499caa5e79fa1560c1be P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:59.832978 3373 ts_tablet_manager.cc:1397] T a5e30fe82a41499caa5e79fa1560c1be P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.059s user 0.002s sys 0.001s
I20250831 19:54:59.833756 3373 raft_consensus.cc:357] T a5e30fe82a41499caa5e79fa1560c1be P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:59.833942 3373 raft_consensus.cc:383] T a5e30fe82a41499caa5e79fa1560c1be P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:59.834009 3373 raft_consensus.cc:738] T a5e30fe82a41499caa5e79fa1560c1be P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:59.834229 3373 consensus_queue.cc:260] T a5e30fe82a41499caa5e79fa1560c1be P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:59.836515 3356 tablet.cc:1722] T 06c27385b0b8460c9ea4f1d96ecb2966 P de831f40fa1348a48a1f0260f4130197: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250831 19:54:59.838029 3373 ts_tablet_manager.cc:1428] T a5e30fe82a41499caa5e79fa1560c1be P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20250831 19:54:59.843987 3372 tablet_bootstrap.cc:654] T 1ea70a674686459d88265f5f5524fc10 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:59.844753 3430 raft_consensus.cc:491] T f47cf07c9a4a43048123794e4a51904b P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:59.844887 3430 raft_consensus.cc:513] T f47cf07c9a4a43048123794e4a51904b P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:59.845382 3430 leader_election.cc:290] T f47cf07c9a4a43048123794e4a51904b P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:59.846494 1768 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f47cf07c9a4a43048123794e4a51904b" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:54:59.846668 1768 raft_consensus.cc:2466] T f47cf07c9a4a43048123794e4a51904b P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 0.
I20250831 19:54:59.847050 1842 leader_election.cc:304] T f47cf07c9a4a43048123794e4a51904b P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:59.847386 3430 raft_consensus.cc:2802] T f47cf07c9a4a43048123794e4a51904b P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:54:59.847457 3430 raft_consensus.cc:491] T f47cf07c9a4a43048123794e4a51904b P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:54:59.847512 3430 raft_consensus.cc:3058] T f47cf07c9a4a43048123794e4a51904b P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:59.846298 1633 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f47cf07c9a4a43048123794e4a51904b" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:54:59.849905 1633 raft_consensus.cc:2466] T f47cf07c9a4a43048123794e4a51904b P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 0.
I20250831 19:54:59.850809 3430 raft_consensus.cc:513] T f47cf07c9a4a43048123794e4a51904b P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:59.851613 1768 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f47cf07c9a4a43048123794e4a51904b" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197"
I20250831 19:54:59.851766 1768 raft_consensus.cc:3058] T f47cf07c9a4a43048123794e4a51904b P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:59.854312 1768 raft_consensus.cc:2466] T f47cf07c9a4a43048123794e4a51904b P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 1.
I20250831 19:54:59.854651 1842 leader_election.cc:304] T f47cf07c9a4a43048123794e4a51904b P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:54:59.855116 3434 raft_consensus.cc:2802] T f47cf07c9a4a43048123794e4a51904b P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:54:59.855208 3434 raft_consensus.cc:695] T f47cf07c9a4a43048123794e4a51904b P 2441fafe1d62429386f4631ad423567d [term 1 LEADER]: Becoming Leader. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Running, Role: LEADER
I20250831 19:54:59.855401 3434 consensus_queue.cc:237] T f47cf07c9a4a43048123794e4a51904b P 2441fafe1d62429386f4631ad423567d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:59.857758 1633 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f47cf07c9a4a43048123794e4a51904b" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:54:59.857923 1633 raft_consensus.cc:3058] T f47cf07c9a4a43048123794e4a51904b P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:54:59.860368 1633 raft_consensus.cc:2466] T f47cf07c9a4a43048123794e4a51904b P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 1.
I20250831 19:54:59.862304 3430 leader_election.cc:290] T f47cf07c9a4a43048123794e4a51904b P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 election: Requested vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:54:59.863445 3373 tablet_bootstrap.cc:492] T b54e648cf8e04022ad0bc099534424d1 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:59.864113 3162 consensus_queue.cc:1035] T a9d383f8caed44958fb3fa6ed1ca580e P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:54:59.867295 3373 tablet_bootstrap.cc:654] T b54e648cf8e04022ad0bc099534424d1 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:59.880120 3372 tablet_bootstrap.cc:492] T 1ea70a674686459d88265f5f5524fc10 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:54:59.880296 3372 ts_tablet_manager.cc:1397] T 1ea70a674686459d88265f5f5524fc10 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.063s user 0.003s sys 0.011s
I20250831 19:54:59.881058 3372 raft_consensus.cc:357] T 1ea70a674686459d88265f5f5524fc10 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:59.881229 3372 raft_consensus.cc:383] T 1ea70a674686459d88265f5f5524fc10 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:59.881304 3372 raft_consensus.cc:738] T 1ea70a674686459d88265f5f5524fc10 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:54:59.881513 3372 consensus_queue.cc:260] T 1ea70a674686459d88265f5f5524fc10 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:59.887509 3375 tablet_bootstrap.cc:492] T 84177615877240688a2d4b3b88915525 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:59.887748 3375 ts_tablet_manager.cc:1397] T 84177615877240688a2d4b3b88915525 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.128s user 0.030s sys 0.058s
I20250831 19:54:59.888409 3375 raft_consensus.cc:357] T 84177615877240688a2d4b3b88915525 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:59.888669 3375 raft_consensus.cc:383] T 84177615877240688a2d4b3b88915525 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:59.888784 3375 raft_consensus.cc:738] T 84177615877240688a2d4b3b88915525 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:59.889045 3375 consensus_queue.cc:260] T 84177615877240688a2d4b3b88915525 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:59.891952 2125 catalog_manager.cc:2706] deleted HMS catalog entry for table default.table_d3002519e6964bb484d995d871e766c9 [id=1137b2754d104964bbe5bbaa4a0578b8]
I20250831 19:54:59.896209 3375 ts_tablet_manager.cc:1428] T 84177615877240688a2d4b3b88915525 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.008s user 0.000s sys 0.001s
I20250831 19:54:59.900182 3375 tablet_bootstrap.cc:492] T b54e648cf8e04022ad0bc099534424d1 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:59.901111 3375 tablet_bootstrap.cc:654] T b54e648cf8e04022ad0bc099534424d1 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:59.916504 3373 tablet_bootstrap.cc:492] T b54e648cf8e04022ad0bc099534424d1 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:59.916692 3373 ts_tablet_manager.cc:1397] T b54e648cf8e04022ad0bc099534424d1 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.053s user 0.004s sys 0.001s
I20250831 19:54:59.927220 3373 raft_consensus.cc:357] T b54e648cf8e04022ad0bc099534424d1 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:59.927467 3373 raft_consensus.cc:383] T b54e648cf8e04022ad0bc099534424d1 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:59.927579 3373 raft_consensus.cc:738] T b54e648cf8e04022ad0bc099534424d1 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:59.927882 3373 consensus_queue.cc:260] T b54e648cf8e04022ad0bc099534424d1 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:59.928458 3373 ts_tablet_manager.cc:1428] T b54e648cf8e04022ad0bc099534424d1 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.012s user 0.001s sys 0.000s
I20250831 19:54:59.928773 3373 tablet_bootstrap.cc:492] T 1ea70a674686459d88265f5f5524fc10 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:54:59.930588 3373 tablet_bootstrap.cc:654] T 1ea70a674686459d88265f5f5524fc10 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:59.935679 3372 ts_tablet_manager.cc:1428] T 1ea70a674686459d88265f5f5524fc10 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.055s user 0.006s sys 0.002s
I20250831 19:54:59.956631 3466 consensus_queue.cc:1035] T a9d383f8caed44958fb3fa6ed1ca580e P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250831 19:54:59.966997 1568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.1.195:43237, user_credentials={real_user=slave}} blocked reactor thread for 74846.1us
I20250831 19:54:59.978226 3465 raft_consensus.cc:491] T bddbec77b8444036b0c5e8d325faceaa P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:54:59.978427 3465 raft_consensus.cc:513] T bddbec77b8444036b0c5e8d325faceaa P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:59.979332 1768 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bddbec77b8444036b0c5e8d325faceaa" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
W20250831 19:54:59.979919 1570 leader_election.cc:343] T bddbec77b8444036b0c5e8d325faceaa P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): Illegal state: must be running to vote when last-logged opid is not known
I20250831 19:54:59.980255 3465 leader_election.cc:290] T bddbec77b8444036b0c5e8d325faceaa P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237)
I20250831 19:54:59.980748 1906 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bddbec77b8444036b0c5e8d325faceaa" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
W20250831 19:54:59.981192 1568 leader_election.cc:343] T bddbec77b8444036b0c5e8d325faceaa P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): Illegal state: must be running to vote when last-logged opid is not known
I20250831 19:54:59.981309 1568 leader_election.cc:304] T bddbec77b8444036b0c5e8d325faceaa P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825; no voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197
I20250831 19:54:59.981734 3465 raft_consensus.cc:2747] T bddbec77b8444036b0c5e8d325faceaa P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250831 19:54:59.984694 3375 tablet_bootstrap.cc:492] T b54e648cf8e04022ad0bc099534424d1 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:54:59.984818 3375 ts_tablet_manager.cc:1397] T b54e648cf8e04022ad0bc099534424d1 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.085s user 0.019s sys 0.025s
I20250831 19:54:59.985525 3375 raft_consensus.cc:357] T b54e648cf8e04022ad0bc099534424d1 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:59.985680 3375 raft_consensus.cc:383] T b54e648cf8e04022ad0bc099534424d1 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:59.985734 3375 raft_consensus.cc:738] T b54e648cf8e04022ad0bc099534424d1 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:54:59.985920 3375 consensus_queue.cc:260] T b54e648cf8e04022ad0bc099534424d1 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:59.986343 3375 ts_tablet_manager.cc:1428] T b54e648cf8e04022ad0bc099534424d1 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250831 19:54:59.986562 3373 tablet_bootstrap.cc:492] T 1ea70a674686459d88265f5f5524fc10 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:54:59.986629 3375 tablet_bootstrap.cc:492] T a5e30fe82a41499caa5e79fa1560c1be P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:54:59.986707 3373 ts_tablet_manager.cc:1397] T 1ea70a674686459d88265f5f5524fc10 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.058s user 0.011s sys 0.001s
I20250831 19:54:59.987322 3373 raft_consensus.cc:357] T 1ea70a674686459d88265f5f5524fc10 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:59.987483 3373 raft_consensus.cc:383] T 1ea70a674686459d88265f5f5524fc10 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:54:59.987545 3373 raft_consensus.cc:738] T 1ea70a674686459d88265f5f5524fc10 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:54:59.987816 3373 consensus_queue.cc:260] T 1ea70a674686459d88265f5f5524fc10 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:54:59.988190 3375 tablet_bootstrap.cc:654] T a5e30fe82a41499caa5e79fa1560c1be P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:54:59.997939 3373 ts_tablet_manager.cc:1428] T 1ea70a674686459d88265f5f5524fc10 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.011s user 0.000s sys 0.001s
I20250831 19:55:00.006850 3373 tablet_bootstrap.cc:492] T bd2f43a6cd1d4782a420fe5e4e110ead P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:55:00.008499 3373 tablet_bootstrap.cc:654] T bd2f43a6cd1d4782a420fe5e4e110ead P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:55:00.010529 3375 tablet_bootstrap.cc:492] T a5e30fe82a41499caa5e79fa1560c1be P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:55:00.010681 3375 ts_tablet_manager.cc:1397] T a5e30fe82a41499caa5e79fa1560c1be P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.024s user 0.003s sys 0.006s
I20250831 19:55:00.011253 3375 raft_consensus.cc:357] T a5e30fe82a41499caa5e79fa1560c1be P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:55:00.011417 3375 raft_consensus.cc:383] T a5e30fe82a41499caa5e79fa1560c1be P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:55:00.011488 3375 raft_consensus.cc:738] T a5e30fe82a41499caa5e79fa1560c1be P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:55:00.011682 3375 consensus_queue.cc:260] T a5e30fe82a41499caa5e79fa1560c1be P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:55:00.012421 3375 ts_tablet_manager.cc:1428] T a5e30fe82a41499caa5e79fa1560c1be P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20250831 19:55:00.012706 3375 tablet_bootstrap.cc:492] T bddbec77b8444036b0c5e8d325faceaa P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:55:00.014546 3375 tablet_bootstrap.cc:654] T bddbec77b8444036b0c5e8d325faceaa P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:55:00.023629 3375 tablet_bootstrap.cc:492] T bddbec77b8444036b0c5e8d325faceaa P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:55:00.023770 3375 ts_tablet_manager.cc:1397] T bddbec77b8444036b0c5e8d325faceaa P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.001s
I20250831 19:55:00.024317 3375 raft_consensus.cc:357] T bddbec77b8444036b0c5e8d325faceaa P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:55:00.024477 3375 raft_consensus.cc:383] T bddbec77b8444036b0c5e8d325faceaa P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:55:00.024557 3375 raft_consensus.cc:738] T bddbec77b8444036b0c5e8d325faceaa P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:55:00.024746 3375 consensus_queue.cc:260] T bddbec77b8444036b0c5e8d325faceaa P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:55:00.034574 3375 ts_tablet_manager.cc:1428] T bddbec77b8444036b0c5e8d325faceaa P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.011s user 0.000s sys 0.001s
I20250831 19:55:00.034891 3375 tablet_bootstrap.cc:492] T bd2f43a6cd1d4782a420fe5e4e110ead P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:55:00.041110 2943 raft_consensus.cc:491] T a5e30fe82a41499caa5e79fa1560c1be P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:55:00.041242 2943 raft_consensus.cc:513] T a5e30fe82a41499caa5e79fa1560c1be P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:55:00.041776 2943 leader_election.cc:290] T a5e30fe82a41499caa5e79fa1560c1be P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:55:00.042637 1906 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a5e30fe82a41499caa5e79fa1560c1be" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:55:00.042804 1906 raft_consensus.cc:2466] T a5e30fe82a41499caa5e79fa1560c1be P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 0.
I20250831 19:55:00.043125 1633 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a5e30fe82a41499caa5e79fa1560c1be" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:55:00.043296 1633 raft_consensus.cc:2466] T a5e30fe82a41499caa5e79fa1560c1be P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 0.
I20250831 19:55:00.043711 1705 leader_election.cc:304] T a5e30fe82a41499caa5e79fa1560c1be P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:55:00.044360 2943 raft_consensus.cc:2802] T a5e30fe82a41499caa5e79fa1560c1be P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:55:00.044428 2943 raft_consensus.cc:491] T a5e30fe82a41499caa5e79fa1560c1be P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:55:00.044484 2943 raft_consensus.cc:3058] T a5e30fe82a41499caa5e79fa1560c1be P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:55:00.046856 2943 raft_consensus.cc:513] T a5e30fe82a41499caa5e79fa1560c1be P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:55:00.047849 1906 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a5e30fe82a41499caa5e79fa1560c1be" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:55:00.048003 1906 raft_consensus.cc:3058] T a5e30fe82a41499caa5e79fa1560c1be P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:55:00.048645 3373 tablet_bootstrap.cc:492] T bd2f43a6cd1d4782a420fe5e4e110ead P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:55:00.048862 3373 ts_tablet_manager.cc:1397] T bd2f43a6cd1d4782a420fe5e4e110ead P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.042s user 0.017s sys 0.021s
I20250831 19:55:00.049752 3373 raft_consensus.cc:357] T bd2f43a6cd1d4782a420fe5e4e110ead P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:55:00.049958 3373 raft_consensus.cc:383] T bd2f43a6cd1d4782a420fe5e4e110ead P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:55:00.050053 3373 raft_consensus.cc:738] T bd2f43a6cd1d4782a420fe5e4e110ead P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:55:00.050340 1906 raft_consensus.cc:2466] T a5e30fe82a41499caa5e79fa1560c1be P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:55:00.050293 3373 consensus_queue.cc:260] T bd2f43a6cd1d4782a420fe5e4e110ead P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:55:00.050750 1705 leader_election.cc:304] T a5e30fe82a41499caa5e79fa1560c1be P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:55:00.050966 3352 raft_consensus.cc:2802] T a5e30fe82a41499caa5e79fa1560c1be P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:55:00.051049 3352 raft_consensus.cc:695] T a5e30fe82a41499caa5e79fa1560c1be P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: Becoming Leader. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Running, Role: LEADER
I20250831 19:55:00.051231 3352 consensus_queue.cc:237] T a5e30fe82a41499caa5e79fa1560c1be P de831f40fa1348a48a1f0260f4130197 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:55:00.052634 1633 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a5e30fe82a41499caa5e79fa1560c1be" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:55:00.052781 1633 raft_consensus.cc:3058] T a5e30fe82a41499caa5e79fa1560c1be P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:55:00.055176 1633 raft_consensus.cc:2466] T a5e30fe82a41499caa5e79fa1560c1be P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:55:00.055787 2943 leader_election.cc:290] T a5e30fe82a41499caa5e79fa1560c1be P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Requested vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:55:00.057922 3373 ts_tablet_manager.cc:1428] T bd2f43a6cd1d4782a420fe5e4e110ead P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.009s user 0.001s sys 0.000s
I20250831 19:55:00.058910 3434 raft_consensus.cc:491] T 5fcb923d81a2495fa02dc76ddb9983b7 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:55:00.059026 3434 raft_consensus.cc:513] T 5fcb923d81a2495fa02dc76ddb9983b7 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:55:00.059525 3434 leader_election.cc:290] T 5fcb923d81a2495fa02dc76ddb9983b7 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:55:00.060088 1633 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5fcb923d81a2495fa02dc76ddb9983b7" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:55:00.060276 1633 raft_consensus.cc:2466] T 5fcb923d81a2495fa02dc76ddb9983b7 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 0.
I20250831 19:55:00.060599 1841 leader_election.cc:304] T 5fcb923d81a2495fa02dc76ddb9983b7 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:55:00.060909 3434 raft_consensus.cc:2802] T 5fcb923d81a2495fa02dc76ddb9983b7 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:55:00.060973 3434 raft_consensus.cc:491] T 5fcb923d81a2495fa02dc76ddb9983b7 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:55:00.061026 3434 raft_consensus.cc:3058] T 5fcb923d81a2495fa02dc76ddb9983b7 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:55:00.061009 1772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5fcb923d81a2495fa02dc76ddb9983b7" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:55:00.061147 1772 raft_consensus.cc:2466] T 5fcb923d81a2495fa02dc76ddb9983b7 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 0.
I20250831 19:55:00.063364 3434 raft_consensus.cc:513] T 5fcb923d81a2495fa02dc76ddb9983b7 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:55:00.064234 3434 leader_election.cc:290] T 5fcb923d81a2495fa02dc76ddb9983b7 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 election: Requested vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:55:00.064474 1633 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5fcb923d81a2495fa02dc76ddb9983b7" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:55:00.064641 1633 raft_consensus.cc:3058] T 5fcb923d81a2495fa02dc76ddb9983b7 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:55:00.064723 1772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5fcb923d81a2495fa02dc76ddb9983b7" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197"
I20250831 19:55:00.064859 1772 raft_consensus.cc:3058] T 5fcb923d81a2495fa02dc76ddb9983b7 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:55:00.066871 1633 raft_consensus.cc:2466] T 5fcb923d81a2495fa02dc76ddb9983b7 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 1.
I20250831 19:55:00.067174 1772 raft_consensus.cc:2466] T 5fcb923d81a2495fa02dc76ddb9983b7 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 1.
I20250831 19:55:00.067215 1841 leader_election.cc:304] T 5fcb923d81a2495fa02dc76ddb9983b7 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:55:00.067499 3434 raft_consensus.cc:2802] T 5fcb923d81a2495fa02dc76ddb9983b7 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:55:00.067687 3434 raft_consensus.cc:695] T 5fcb923d81a2495fa02dc76ddb9983b7 P 2441fafe1d62429386f4631ad423567d [term 1 LEADER]: Becoming Leader. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Running, Role: LEADER
I20250831 19:55:00.067934 3434 consensus_queue.cc:237] T 5fcb923d81a2495fa02dc76ddb9983b7 P 2441fafe1d62429386f4631ad423567d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:55:00.069687 3373 tablet_bootstrap.cc:492] T bddbec77b8444036b0c5e8d325faceaa P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:55:00.071137 3373 tablet_bootstrap.cc:654] T bddbec77b8444036b0c5e8d325faceaa P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:55:00.073688 2124 catalog_manager.cc:3460] renamed table default.table_1dc7d3d86ed047bd8c86e21d7b38f477 [id=30b1e9d6cb5e486fbed42ac06053ebc3] in HMS: new name default.table_2f8e5422042942d6a683316fbd7ac45d
I20250831 19:55:00.079850 3465 raft_consensus.cc:491] T bd2f43a6cd1d4782a420fe5e4e110ead P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:55:00.079970 3465 raft_consensus.cc:513] T bd2f43a6cd1d4782a420fe5e4e110ead P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:55:00.080490 3465 leader_election.cc:290] T bd2f43a6cd1d4782a420fe5e4e110ead P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:55:00.081386 1906 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bd2f43a6cd1d4782a420fe5e4e110ead" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:55:00.081378 1772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bd2f43a6cd1d4782a420fe5e4e110ead" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:55:00.081620 1906 raft_consensus.cc:2466] T bd2f43a6cd1d4782a420fe5e4e110ead P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 0.
W20250831 19:55:00.081828 1570 leader_election.cc:343] T bd2f43a6cd1d4782a420fe5e4e110ead P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): Illegal state: must be running to vote when last-logged opid is not known
I20250831 19:55:00.081972 1568 leader_election.cc:304] T bd2f43a6cd1d4782a420fe5e4e110ead P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters: de831f40fa1348a48a1f0260f4130197
I20250831 19:55:00.082031 3375 tablet_bootstrap.cc:654] T bd2f43a6cd1d4782a420fe5e4e110ead P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:55:00.082409 3465 raft_consensus.cc:2802] T bd2f43a6cd1d4782a420fe5e4e110ead P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:55:00.082486 3465 raft_consensus.cc:491] T bd2f43a6cd1d4782a420fe5e4e110ead P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:55:00.082543 3465 raft_consensus.cc:3058] T bd2f43a6cd1d4782a420fe5e4e110ead P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:55:00.084895 3465 raft_consensus.cc:513] T bd2f43a6cd1d4782a420fe5e4e110ead P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:55:00.086184 1772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bd2f43a6cd1d4782a420fe5e4e110ead" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197"
I20250831 19:55:00.086256 1904 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bd2f43a6cd1d4782a420fe5e4e110ead" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:55:00.086371 1904 raft_consensus.cc:3058] T bd2f43a6cd1d4782a420fe5e4e110ead P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:55:00.088639 1904 raft_consensus.cc:2466] T bd2f43a6cd1d4782a420fe5e4e110ead P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1.
W20250831 19:55:00.089126 1570 leader_election.cc:343] T bd2f43a6cd1d4782a420fe5e4e110ead P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): Illegal state: must be running to vote when last-logged opid is not known
I20250831 19:55:00.089372 1568 leader_election.cc:304] T bd2f43a6cd1d4782a420fe5e4e110ead P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters: de831f40fa1348a48a1f0260f4130197
I20250831 19:55:00.089620 3466 raft_consensus.cc:2802] T bd2f43a6cd1d4782a420fe5e4e110ead P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:55:00.089722 3466 raft_consensus.cc:695] T bd2f43a6cd1d4782a420fe5e4e110ead P 89aa85d59c53436ebdf3074b13d14825 [term 1 LEADER]: Becoming Leader. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Running, Role: LEADER
I20250831 19:55:00.089919 3466 consensus_queue.cc:237] T bd2f43a6cd1d4782a420fe5e4e110ead P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:55:00.091112 3465 leader_election.cc:290] T bd2f43a6cd1d4782a420fe5e4e110ead P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Requested vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:55:00.100215 3373 tablet_bootstrap.cc:492] T bddbec77b8444036b0c5e8d325faceaa P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:55:00.100353 3373 ts_tablet_manager.cc:1397] T bddbec77b8444036b0c5e8d325faceaa P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.031s user 0.006s sys 0.004s
I20250831 19:55:00.102111 3375 tablet_bootstrap.cc:492] T bd2f43a6cd1d4782a420fe5e4e110ead P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:55:00.102239 3375 ts_tablet_manager.cc:1397] T bd2f43a6cd1d4782a420fe5e4e110ead P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.067s user 0.003s sys 0.002s
I20250831 19:55:00.102957 3375 raft_consensus.cc:357] T bd2f43a6cd1d4782a420fe5e4e110ead P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:55:00.103117 3375 raft_consensus.cc:383] T bd2f43a6cd1d4782a420fe5e4e110ead P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:55:00.103171 3375 raft_consensus.cc:738] T bd2f43a6cd1d4782a420fe5e4e110ead P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:55:00.103379 3375 consensus_queue.cc:260] T bd2f43a6cd1d4782a420fe5e4e110ead P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:55:00.103860 3375 ts_tablet_manager.cc:1428] T bd2f43a6cd1d4782a420fe5e4e110ead P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250831 19:55:00.104157 3375 tablet_bootstrap.cc:492] T 1ea70a674686459d88265f5f5524fc10 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:55:00.105605 3375 tablet_bootstrap.cc:654] T 1ea70a674686459d88265f5f5524fc10 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:55:00.105695 3373 raft_consensus.cc:357] T bddbec77b8444036b0c5e8d325faceaa P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:55:00.105847 3373 raft_consensus.cc:383] T bddbec77b8444036b0c5e8d325faceaa P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:55:00.105901 3373 raft_consensus.cc:738] T bddbec77b8444036b0c5e8d325faceaa P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:55:00.106069 3373 consensus_queue.cc:260] T bddbec77b8444036b0c5e8d325faceaa P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:55:00.106503 3373 ts_tablet_manager.cc:1428] T bddbec77b8444036b0c5e8d325faceaa P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20250831 19:55:00.114223 3465 raft_consensus.cc:491] T 1ea70a674686459d88265f5f5524fc10 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:55:00.114362 3465 raft_consensus.cc:513] T 1ea70a674686459d88265f5f5524fc10 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:55:00.114903 3465 leader_election.cc:290] T 1ea70a674686459d88265f5f5524fc10 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237)
I20250831 19:55:00.115746 1906 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1ea70a674686459d88265f5f5524fc10" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:55:00.115890 1906 raft_consensus.cc:2466] T 1ea70a674686459d88265f5f5524fc10 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 0.
I20250831 19:55:00.116581 1568 leader_election.cc:304] T 1ea70a674686459d88265f5f5524fc10 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:55:00.116887 3464 raft_consensus.cc:2802] T 1ea70a674686459d88265f5f5524fc10 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:55:00.116943 3464 raft_consensus.cc:491] T 1ea70a674686459d88265f5f5524fc10 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:55:00.116991 3464 raft_consensus.cc:3058] T 1ea70a674686459d88265f5f5524fc10 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:55:00.117808 1772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1ea70a674686459d88265f5f5524fc10" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
W20250831 19:55:00.118202 1570 leader_election.cc:343] T 1ea70a674686459d88265f5f5524fc10 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): Illegal state: must be running to vote when last-logged opid is not known
I20250831 19:55:00.119323 3464 raft_consensus.cc:513] T 1ea70a674686459d88265f5f5524fc10 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:55:00.119779 3464 leader_election.cc:290] T 1ea70a674686459d88265f5f5524fc10 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Requested vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237)
I20250831 19:55:00.120685 1904 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1ea70a674686459d88265f5f5524fc10" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:55:00.120812 1904 raft_consensus.cc:3058] T 1ea70a674686459d88265f5f5524fc10 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:55:00.122282 1772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1ea70a674686459d88265f5f5524fc10" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197"
I20250831 19:55:00.123457 1904 raft_consensus.cc:2466] T 1ea70a674686459d88265f5f5524fc10 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1.
W20250831 19:55:00.123876 1570 leader_election.cc:343] T 1ea70a674686459d88265f5f5524fc10 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): Illegal state: must be running to vote when last-logged opid is not known
I20250831 19:55:00.124195 1568 leader_election.cc:304] T 1ea70a674686459d88265f5f5524fc10 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters: de831f40fa1348a48a1f0260f4130197
I20250831 19:55:00.124545 3465 raft_consensus.cc:2802] T 1ea70a674686459d88265f5f5524fc10 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:55:00.124640 3465 raft_consensus.cc:695] T 1ea70a674686459d88265f5f5524fc10 P 89aa85d59c53436ebdf3074b13d14825 [term 1 LEADER]: Becoming Leader. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Running, Role: LEADER
I20250831 19:55:00.124850 3465 consensus_queue.cc:237] T 1ea70a674686459d88265f5f5524fc10 P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:55:00.140259 3479 raft_consensus.cc:491] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a4d46bc3ef5a4fbb8c9e4349c86c54a5)
I20250831 19:55:00.140502 3479 raft_consensus.cc:513] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } }
I20250831 19:55:00.143002 2136 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" candidate_term: 4 candidate_status { last_received { term: 3 index: 511 } } ignore_live_leader: false dest_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" is_pre_election: true
I20250831 19:55:00.144778 3480 raft_consensus.cc:491] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a4d46bc3ef5a4fbb8c9e4349c86c54a5)
I20250831 19:55:00.144953 3480 raft_consensus.cc:513] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } }
I20250831 19:55:00.146133 3215 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ac75f6e7a0634a89beb9670950e95220" candidate_term: 4 candidate_status { last_received { term: 3 index: 511 } } ignore_live_leader: false dest_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" is_pre_election: true
I20250831 19:55:00.146454 3215 raft_consensus.cc:2466] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac75f6e7a0634a89beb9670950e95220 in term 3.
I20250831 19:55:00.147012 3479 leader_election.cc:290] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a4d46bc3ef5a4fbb8c9e4349c86c54a5 (127.1.1.253:45581), ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943)
I20250831 19:55:00.148259 1430 leader_election.cc:304] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c830f6055d64a3b8a9f78b405ad8aa3, ac75f6e7a0634a89beb9670950e95220; no voters:
I20250831 19:55:00.148459 2136 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ac75f6e7a0634a89beb9670950e95220" candidate_term: 4 candidate_status { last_received { term: 3 index: 511 } } ignore_live_leader: false dest_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" is_pre_election: true
I20250831 19:55:00.148093 3480 leader_election.cc:290] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259), a4d46bc3ef5a4fbb8c9e4349c86c54a5 (127.1.1.253:45581)
I20250831 19:55:00.150034 3483 raft_consensus.cc:2802] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20250831 19:55:00.150117 3483 raft_consensus.cc:491] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a4d46bc3ef5a4fbb8c9e4349c86c54a5)
I20250831 19:55:00.150252 3483 raft_consensus.cc:3058] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220 [term 3 FOLLOWER]: Advancing to term 4
I20250831 19:55:00.152100 3483 raft_consensus.cc:513] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } }
I20250831 19:55:00.152890 3215 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ac75f6e7a0634a89beb9670950e95220" candidate_term: 4 candidate_status { last_received { term: 3 index: 511 } } ignore_live_leader: false dest_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3"
I20250831 19:55:00.152894 2136 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ac75f6e7a0634a89beb9670950e95220" candidate_term: 4 candidate_status { last_received { term: 3 index: 511 } } ignore_live_leader: false dest_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5"
I20250831 19:55:00.153082 3215 raft_consensus.cc:3058] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [term 3 FOLLOWER]: Advancing to term 4
I20250831 19:55:00.153419 3483 leader_election.cc:290] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220 [CANDIDATE]: Term 4 election: Requested vote from peers 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259), a4d46bc3ef5a4fbb8c9e4349c86c54a5 (127.1.1.253:45581)
I20250831 19:55:00.154345 3375 tablet_bootstrap.cc:492] T 1ea70a674686459d88265f5f5524fc10 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:55:00.154464 3375 ts_tablet_manager.cc:1397] T 1ea70a674686459d88265f5f5524fc10 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.050s user 0.000s sys 0.009s
I20250831 19:55:00.155164 3375 raft_consensus.cc:357] T 1ea70a674686459d88265f5f5524fc10 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:55:00.155309 3375 raft_consensus.cc:383] T 1ea70a674686459d88265f5f5524fc10 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:55:00.155354 3375 raft_consensus.cc:738] T 1ea70a674686459d88265f5f5524fc10 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:55:00.155558 3375 consensus_queue.cc:260] T 1ea70a674686459d88265f5f5524fc10 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:55:00.156011 3375 ts_tablet_manager.cc:1428] T 1ea70a674686459d88265f5f5524fc10 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250831 19:55:00.157286 3215 raft_consensus.cc:2466] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac75f6e7a0634a89beb9670950e95220 in term 4.
I20250831 19:55:00.157984 1430 leader_election.cc:304] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c830f6055d64a3b8a9f78b405ad8aa3, ac75f6e7a0634a89beb9670950e95220; no voters: a4d46bc3ef5a4fbb8c9e4349c86c54a5
I20250831 19:55:00.158440 3483 raft_consensus.cc:2802] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220 [term 4 FOLLOWER]: Leader election won for term 4
I20250831 19:55:00.158635 3483 raft_consensus.cc:695] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220 [term 4 LEADER]: Becoming Leader. State: Replica: ac75f6e7a0634a89beb9670950e95220, State: Running, Role: LEADER
I20250831 19:55:00.158982 3483 consensus_queue.cc:237] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 511, Committed index: 511, Last appended: 3.511, Last appended by leader: 511, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } }
I20250831 19:55:00.164229 3483 sys_catalog.cc:455] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ac75f6e7a0634a89beb9670950e95220. Latest consensus state: current_term: 4 leader_uuid: "ac75f6e7a0634a89beb9670950e95220" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } } }
I20250831 19:55:00.164426 3483 sys_catalog.cc:458] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220 [sys.catalog]: This master's current role is: LEADER
I20250831 19:55:00.164942 3484 catalog_manager.cc:1477] Loading table and tablet metadata into memory...
W20250831 19:55:00.166932 2101 catalog_manager.cc:4726] Async tablet task AlterTable RPC for tablet e47844d025bf42ecbfd2d3f34a31538e (table default.table_c7390b7344da4c3fbf7f2f502b096669 [id=1df66f6230794e939a25c0f2254d6e17], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet e47844d025bf42ecbfd2d3f34a31538e consensus state has no leader
I20250831 19:55:00.172055 3484 catalog_manager.cc:671] Loaded metadata for table default.table_0498f784ecd944168cd0cbd019307408 [id=003066b121574814b254d138ec66c64c]
I20250831 19:55:00.172611 3484 catalog_manager.cc:671] Loaded metadata for table default.table_1d644a2c8bd54f89964228704cd693e6 [id=028e873d141c4006aca7d45be88d9ae3]
I20250831 19:55:00.173295 3484 catalog_manager.cc:671] Loaded metadata for table default.table_3f81774719a24ce68cce90f20487fa97 [id=08d05283df4c4408954c3793beaa4adb]
I20250831 19:55:00.173749 3484 catalog_manager.cc:671] Loaded metadata for table default.table_13fd718b01d445dbb3955c7804421b1e [id=096152b885a04bfd9cced171fb8a12af]
I20250831 19:55:00.174135 3484 catalog_manager.cc:671] Loaded metadata for table default.table_65ae80244c21495fad7b9e506a44ebcc [id=09c2744c9575474bba2df5503541accc]
I20250831 19:55:00.174520 3484 catalog_manager.cc:671] Loaded metadata for table default.table_fec0d0e06479419886c036a37df0cfdf [id=0e44d9b8a8044f2685d97f13e0b15ef3]
I20250831 19:55:00.175329 3484 catalog_manager.cc:671] Loaded metadata for table default.table_617124885d2e4d96b863e0e435bdf695 [id=0fc929ad819b48a9af984f8c301bad2b]
I20250831 19:55:00.175740 3484 catalog_manager.cc:671] Loaded metadata for table default.table_9e316239c779453a9a3a3b8b84d62adc [id=10598630389746d2886e5687fe074fd7]
I20250831 19:55:00.176335 3484 catalog_manager.cc:671] Loaded metadata for table default.table_d3002519e6964bb484d995d871e766c9 [id=1137b2754d104964bbe5bbaa4a0578b8]
I20250831 19:55:00.176885 3484 catalog_manager.cc:671] Loaded metadata for table default.table_a03aade65d4449ec87fdbd94f7edd5ca [id=124c069ee3d5449cb64e8a816f67a365]
I20250831 19:55:00.177246 3484 catalog_manager.cc:671] Loaded metadata for table default.table_dbeae8f9a2c34da78b7e284664c00cd1 [id=1aaaa30dc3cd4d8497bc2a18ab02ec3d]
I20250831 19:55:00.177632 3484 catalog_manager.cc:671] Loaded metadata for table default.table_dbf76772503b48c3a9083efbcbbb62a3 [id=1c606e303bbe40afaf2ec496b8680b4c]
I20250831 19:55:00.178015 3484 catalog_manager.cc:671] Loaded metadata for table default.table_c7390b7344da4c3fbf7f2f502b096669 [id=1df66f6230794e939a25c0f2254d6e17]
I20250831 19:55:00.179520 3484 catalog_manager.cc:671] Loaded metadata for table default.table_bced9a3b747a4c33b6fc5b05b2a4dd89 [id=2b57fa1ef98f4029bc75e981255c74da]
I20250831 19:55:00.179929 3484 catalog_manager.cc:671] Loaded metadata for table default.table_55404df7d7524c7cb6139cc53ec92877 [id=2cd4af6b415c4e3a92a3732fa145aa42]
I20250831 19:55:00.180012 3215 raft_consensus.cc:1238] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [term 4 FOLLOWER]: Rejecting Update request from peer a4d46bc3ef5a4fbb8c9e4349c86c54a5 for earlier term 3. Current term is 4. Ops: []
I20250831 19:55:00.180541 3484 catalog_manager.cc:671] Loaded metadata for table default.table_1dc7d3d86ed047bd8c86e21d7b38f477 [id=30b1e9d6cb5e486fbed42ac06053ebc3]
I20250831 19:55:00.180944 3484 catalog_manager.cc:671] Loaded metadata for table default.table_4021d3dbb7f04e50997c9cc51c7e3888 [id=321a68b57ebf4e3a80670c3c862403f1]
I20250831 19:55:00.181485 3484 catalog_manager.cc:671] Loaded metadata for table default.table_dbd9b94e2d224171acd87195ab912666 [id=3671adc17a134657a7e9b07c97bea371]
I20250831 19:55:00.182210 3484 catalog_manager.cc:671] Loaded metadata for table default.table_969c1fd9ed5340858aa7434d10785589 [id=416489b351d443ebb067fa9b8625e63e]
I20250831 19:55:00.183637 3484 catalog_manager.cc:671] Loaded metadata for table default.table_0409d51b133145c5b7e7d4d407a471b2 [id=4cfc2f0bed1f4f5c80524f8cf8d69f3e]
I20250831 19:55:00.184458 3484 catalog_manager.cc:671] Loaded metadata for table default.table_be7bbefda22d4660a8d257962bfe0979 [id=5579e4d41f7b456b8d92804eb3d03711]
I20250831 19:55:00.184983 3484 catalog_manager.cc:671] Loaded metadata for table default.table_76aceaaac1fb4aaeb55445d641a113d1 [id=5646c567b288436588bca1dde5d6e213]
I20250831 19:55:00.186187 3484 catalog_manager.cc:671] Loaded metadata for table default.table_f6d2041746f14f4a84962c26b1df1118 [id=59220fba0aa647bca189db2218f3e28f]
I20250831 19:55:00.186929 3484 catalog_manager.cc:671] Loaded metadata for table default.table_20d403c55682499a9ba3267b85aecde7 [id=5b8cc2293fc545e7bedbf645db8dd2ce]
I20250831 19:55:00.187408 3484 catalog_manager.cc:671] Loaded metadata for table default.table_9e76b4c3909b459c812cb7fbddc11988 [id=5cc9b389dd1f4a0289aaecd18be10263]
I20250831 19:55:00.187978 3484 catalog_manager.cc:671] Loaded metadata for table default.table_af003c3f30c04853bc025b34d543d0e0 [id=5ce6c4d5dcd34d73af61fd2c4bf28799]
I20250831 19:55:00.188650 3484 catalog_manager.cc:671] Loaded metadata for table default.table_13cea908832146dab4b8b794752b1a79 [id=61032a0c11594321b1e4cb5ba3394c18]
I20250831 19:55:00.188596 3485 consensus_queue.cc:1046] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 }, Status: INVALID_TERM, Last received: 3.511, Next index: 512, Last known committed idx: 511, Time since last communication: 0.001s
I20250831 19:55:00.189313 3484 catalog_manager.cc:671] Loaded metadata for table default.table_b63fcfe30c4b42e4aab0afa9159eff8b [id=690a54011d784c13992fd596584eadb8]
I20250831 19:55:00.189867 3486 raft_consensus.cc:3053] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 3 LEADER]: Stepping down as leader of term 3
I20250831 19:55:00.189977 3486 raft_consensus.cc:738] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a4d46bc3ef5a4fbb8c9e4349c86c54a5, State: Running, Role: LEADER
I20250831 19:55:00.190340 3486 consensus_queue.cc:260] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 511, Committed index: 511, Last appended: 3.511, Last appended by leader: 511, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } }
I20250831 19:55:00.190864 3486 raft_consensus.cc:3058] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 3 FOLLOWER]: Advancing to term 4
I20250831 19:55:00.194370 3484 catalog_manager.cc:671] Loaded metadata for table default.table_6c90d2f731914735837fa73efe73971b [id=69ff45f06b4641a987204b04e7586cb7]
I20250831 19:55:00.195173 3484 catalog_manager.cc:671] Loaded metadata for table default.table_5546b3f364ce47768a100eec7bcf06af [id=7c4a0345486747339c3e158a950bc5aa]
I20250831 19:55:00.195552 3484 catalog_manager.cc:671] Loaded metadata for table default.table_4c0155db27d445829ea2e453cd3ad0f3 [id=7d31bd8f26c94d15b09cf05778a2f253]
I20250831 19:55:00.195964 3484 catalog_manager.cc:671] Loaded metadata for table default.table_0bd3ac197d96497390258988a7c498f4 [id=7d4c018fcf534133bcf67cf6c12e3607]
I20250831 19:55:00.196635 3484 catalog_manager.cc:671] Loaded metadata for table default.table_9ef01b3dfa2640dbbd4b622e06a1da94 [id=7e12dc19746647d790e1d0c465317f0d]
I20250831 19:55:00.197640 3484 catalog_manager.cc:671] Loaded metadata for table default.table_1d29197c8463471d898f54b5dadaefc2 [id=8ef92f9201b34066b2b621ae3aa92ebe]
I20250831 19:55:00.198030 3484 catalog_manager.cc:671] Loaded metadata for table default.table_930d37393d93428bb6c9407bbd479a71 [id=921f83cf8ea14fd68e86ce2b90aac92c]
I20250831 19:55:00.198340 3484 catalog_manager.cc:671] Loaded metadata for table default.table_75aa254646a24998b06bc2c45a479df2 [id=93c25513734040679fce59ac7b69ba38]
I20250831 19:55:00.198637 3484 catalog_manager.cc:671] Loaded metadata for table default.table_30272e2642084b1390e459c21c0bee62 [id=957ba0c5f36f4524a898d3126ed9ec26]
I20250831 19:55:00.199291 3484 catalog_manager.cc:671] Loaded metadata for table default.table_ac609d4af0b748438a68966d468a56c6 [id=9b01227041494090854149aefbbc4a88]
I20250831 19:55:00.199618 3484 catalog_manager.cc:671] Loaded metadata for table default.table_06c3d3b006e64e1b8e20c6d64625ea64 [id=a0fbaa8ae6b54d03abdd641e2e0eb746]
I20250831 19:55:00.200126 3484 catalog_manager.cc:671] Loaded metadata for table default.table_1dd756d1d1c14b878105f242f44b087e [id=aabaa79336954b3ab0450dcff3afa7bf]
I20250831 19:55:00.200433 3484 catalog_manager.cc:671] Loaded metadata for table default.table_5bc22ff7931245ad82121fb433351a08 [id=acf00823fd974ac6bcbff016c1296aa5]
I20250831 19:55:00.201181 3484 catalog_manager.cc:671] Loaded metadata for table default.table_b4399bb161024e3eb0b69c23e3f9af47 [id=b3f794b4f5384662a4cdff8f76f56a66]
I20250831 19:55:00.201586 3484 catalog_manager.cc:671] Loaded metadata for table default.table_4e12fc12cae640b99d4f3794151b6915 [id=ba4c5ecf4ae94ede9bfb83af2ee894ab]
I20250831 19:55:00.202867 3484 catalog_manager.cc:671] Loaded metadata for table default.table_ba7cea85816c4b98a116ec6b7a569c98 [id=c8f8d410198f4e0ba51900271218aebe]
I20250831 19:55:00.203711 3484 catalog_manager.cc:671] Loaded metadata for table default.table_4dba59fc46824095bd698aa0ccc13224 [id=d340aa6d78a5421f9e03785004d551c7]
I20250831 19:55:00.204125 3484 catalog_manager.cc:671] Loaded metadata for table default.table_160ddd96ddce4f1788f276ea8535d70b [id=d39100e5184f4a9ca1932e0d3cd0b243]
I20250831 19:55:00.204516 3484 catalog_manager.cc:671] Loaded metadata for table default.table_c3cffc1117c341b0b3a7d4f82c01763a [id=da5a81d8cada4041bd31e0bb6369d108]
I20250831 19:55:00.205404 3484 catalog_manager.cc:671] Loaded metadata for table default.table_e28995f706a34a2cb421352cb92a7349 [id=dc8984dc66cb4a01813cb742320a34cc]
I20250831 19:55:00.206718 3484 catalog_manager.cc:671] Loaded metadata for table default.table_207ac87518bc487184a89bb52cd204b3 [id=f48af5bc3eff4c819be4aeeff4128c2a]
I20250831 19:55:00.207098 3484 catalog_manager.cc:671] Loaded metadata for table default.table_08b74e57795c4dd8a7f91f01e1b5ba4a [id=f63d391a9c824314bf6789cc7bbb5ffb]
I20250831 19:55:00.207449 3484 catalog_manager.cc:671] Loaded metadata for table default.table_c48f1c99f3174cb8acca698339447ed9 [id=f707909e6af44750a5fc5e3b15af0b24]
I20250831 19:55:00.207818 3484 catalog_manager.cc:671] Loaded metadata for table default.table_dd23f581be78471f98008014d30c3398 [id=fa5e29f502aa4eae9056a1e220d6e9bc]
I20250831 19:55:00.208204 3484 catalog_manager.cc:671] Loaded metadata for table default.table_ea8910dd3df74137a9832974c833f71e [id=fd551e0ec667492c86ff0aaed181366b]
I20250831 19:55:00.208758 3484 catalog_manager.cc:671] Loaded metadata for table default.table_afb8eb0248714122aa74efa2d6fcfce4 [id=fe54e4791a0d4e3c9a36e1968988ea0d]
I20250831 19:55:00.215989 3484 tablet_loader.cc:96] loaded metadata for tablet 06c27385b0b8460c9ea4f1d96ecb2966 (table default.table_4e12fc12cae640b99d4f3794151b6915 [id=ba4c5ecf4ae94ede9bfb83af2ee894ab])
I20250831 19:55:00.217983 3484 tablet_loader.cc:96] loaded metadata for tablet 1ea70a674686459d88265f5f5524fc10 (table default.table_dd23f581be78471f98008014d30c3398 [id=fa5e29f502aa4eae9056a1e220d6e9bc])
I20250831 19:55:00.218654 3484 tablet_loader.cc:96] loaded metadata for tablet 27a32ae2ed1a4b94b1a2e6a9aa9d0d8c (table default.table_5546b3f364ce47768a100eec7bcf06af [id=7c4a0345486747339c3e158a950bc5aa])
I20250831 19:55:00.219152 3484 tablet_loader.cc:96] loaded metadata for tablet 2a0c12b9233244809b96121e034c029e (table default.table_af003c3f30c04853bc025b34d543d0e0 [id=5ce6c4d5dcd34d73af61fd2c4bf28799])
I20250831 19:55:00.219542 3484 tablet_loader.cc:96] loaded metadata for tablet 2a20faaf76fe4806b47e5ac80ccf5915 (table default.table_55404df7d7524c7cb6139cc53ec92877 [id=2cd4af6b415c4e3a92a3732fa145aa42])
I20250831 19:55:00.220992 3484 tablet_loader.cc:96] loaded metadata for tablet 3667c38e7b8c46ed8205e278c98c4b00 (table default.table_fec0d0e06479419886c036a37df0cfdf [id=0e44d9b8a8044f2685d97f13e0b15ef3])
I20250831 19:55:00.221704 3484 tablet_loader.cc:96] loaded metadata for tablet 48c3872dbaee495fb80d1415b5631eaf (table default.table_08b74e57795c4dd8a7f91f01e1b5ba4a [id=f63d391a9c824314bf6789cc7bbb5ffb])
I20250831 19:55:00.222232 3484 tablet_loader.cc:96] loaded metadata for tablet 4be6edd110374d2bb941e26defc7302f (table default.table_617124885d2e4d96b863e0e435bdf695 [id=0fc929ad819b48a9af984f8c301bad2b])
I20250831 19:55:00.223683 3484 tablet_loader.cc:96] loaded metadata for tablet 5a080bbabe8840c3ba954bdc0626dc39 (table default.table_dbf76772503b48c3a9083efbcbbb62a3 [id=1c606e303bbe40afaf2ec496b8680b4c])
I20250831 19:55:00.225023 3484 tablet_loader.cc:96] loaded metadata for tablet 5fcb923d81a2495fa02dc76ddb9983b7 (table default.table_30272e2642084b1390e459c21c0bee62 [id=957ba0c5f36f4524a898d3126ed9ec26])
I20250831 19:55:00.225921 3484 tablet_loader.cc:96] loaded metadata for tablet 61101a699bb84b62af4e7a0cae243d4e (table default.table_207ac87518bc487184a89bb52cd204b3 [id=f48af5bc3eff4c819be4aeeff4128c2a])
I20250831 19:55:00.226701 3484 tablet_loader.cc:96] loaded metadata for tablet 6952ee3fe766450993142c673d9509e8 (table default.table_f6d2041746f14f4a84962c26b1df1118 [id=59220fba0aa647bca189db2218f3e28f])
I20250831 19:55:00.227092 2122 catalog_manager.cc:3460] renamed table default.table_dbf76772503b48c3a9083efbcbbb62a3 [id=1c606e303bbe40afaf2ec496b8680b4c] in HMS: new name default.table_492565dabb704c25b9c4d1849bcb8eeb
I20250831 19:55:00.227618 3484 tablet_loader.cc:96] loaded metadata for tablet 701cef9d6fd04a99986b871760397f1e (table default.table_0498f784ecd944168cd0cbd019307408 [id=003066b121574814b254d138ec66c64c])
I20250831 19:55:00.229368 3484 tablet_loader.cc:96] loaded metadata for tablet 7a217324e97b43e5a7ec540e3b9f70a5 (table default.table_1dd756d1d1c14b878105f242f44b087e [id=aabaa79336954b3ab0450dcff3afa7bf])
I20250831 19:55:00.229723 3484 tablet_loader.cc:96] loaded metadata for tablet 7afc8e9259a548fe946265ea513fde2f (table default.table_bced9a3b747a4c33b6fc5b05b2a4dd89 [id=2b57fa1ef98f4029bc75e981255c74da])
I20250831 19:55:00.231693 3484 tablet_loader.cc:96] loaded metadata for tablet 84177615877240688a2d4b3b88915525 (table default.table_75aa254646a24998b06bc2c45a479df2 [id=93c25513734040679fce59ac7b69ba38])
I20250831 19:55:00.232255 3484 tablet_loader.cc:96] loaded metadata for tablet 876f49b43408443da6a867c03df891b9 (table default.table_6c90d2f731914735837fa73efe73971b [id=69ff45f06b4641a987204b04e7586cb7])
I20250831 19:55:00.232649 3484 tablet_loader.cc:96] loaded metadata for tablet 8afbd19c84f14fbb8f957c2f10d97a4c (table default.table_c48f1c99f3174cb8acca698339447ed9 [id=f707909e6af44750a5fc5e3b15af0b24])
I20250831 19:55:00.233042 3484 tablet_loader.cc:96] loaded metadata for tablet 8ebf42e07edf40f9b95b0304a912b9b8 (table default.table_3f81774719a24ce68cce90f20487fa97 [id=08d05283df4c4408954c3793beaa4adb])
I20250831 19:55:00.233475 3484 tablet_loader.cc:96] loaded metadata for tablet 8fb7abc5581e4a16a55f844acd5fd2e9 (table default.table_dbd9b94e2d224171acd87195ab912666 [id=3671adc17a134657a7e9b07c97bea371])
I20250831 19:55:00.234280 3484 tablet_loader.cc:96] loaded metadata for tablet 93bfd2c663634436a61211a406c9f92f (table default.table_969c1fd9ed5340858aa7434d10785589 [id=416489b351d443ebb067fa9b8625e63e])
I20250831 19:55:00.234664 3484 tablet_loader.cc:96] loaded metadata for tablet 9525ea0cb58146d6851936d749447c3f (table default.table_b4399bb161024e3eb0b69c23e3f9af47 [id=b3f794b4f5384662a4cdff8f76f56a66])
I20250831 19:55:00.235950 3484 tablet_loader.cc:96] loaded metadata for tablet 9dd77008323943ceaf515422255c8a23 (table default.table_9ef01b3dfa2640dbbd4b622e06a1da94 [id=7e12dc19746647d790e1d0c465317f0d])
I20250831 19:55:00.236564 3484 tablet_loader.cc:96] loaded metadata for tablet 9fc4297f4d704acda823360fe6d406cf (table default.table_9e316239c779453a9a3a3b8b84d62adc [id=10598630389746d2886e5687fe074fd7])
I20250831 19:55:00.237147 3484 tablet_loader.cc:96] loaded metadata for tablet a4e2586021c046dd8c5acd838bb5e83f (table default.table_a03aade65d4449ec87fdbd94f7edd5ca [id=124c069ee3d5449cb64e8a816f67a365])
I20250831 19:55:00.238052 3484 tablet_loader.cc:96] loaded metadata for tablet a5e30fe82a41499caa5e79fa1560c1be (table default.table_1d29197c8463471d898f54b5dadaefc2 [id=8ef92f9201b34066b2b621ae3aa92ebe])
I20250831 19:55:00.238421 3484 tablet_loader.cc:96] loaded metadata for tablet a6a3938379c64baba6f5f2c1a2f7087a (table default.table_06c3d3b006e64e1b8e20c6d64625ea64 [id=a0fbaa8ae6b54d03abdd641e2e0eb746])
I20250831 19:55:00.239230 3484 tablet_loader.cc:96] loaded metadata for tablet a9d383f8caed44958fb3fa6ed1ca580e (table default.table_dbeae8f9a2c34da78b7e284664c00cd1 [id=1aaaa30dc3cd4d8497bc2a18ab02ec3d])
I20250831 19:55:00.239593 3484 tablet_loader.cc:96] loaded metadata for tablet b0d177e2e2f745b8969b65ab318321a1 (table default.table_1dc7d3d86ed047bd8c86e21d7b38f477 [id=30b1e9d6cb5e486fbed42ac06053ebc3])
I20250831 19:55:00.240456 3484 tablet_loader.cc:96] loaded metadata for tablet b54e648cf8e04022ad0bc099534424d1 (table default.table_76aceaaac1fb4aaeb55445d641a113d1 [id=5646c567b288436588bca1dde5d6e213])
I20250831 19:55:00.241468 3484 tablet_loader.cc:96] loaded metadata for tablet b7576e353a1c46b5af830f437afcb207 (table default.table_160ddd96ddce4f1788f276ea8535d70b [id=d39100e5184f4a9ca1932e0d3cd0b243])
I20250831 19:55:00.242545 3484 tablet_loader.cc:96] loaded metadata for tablet bd12184dd70f451fbd9a2025d2c00758 (table default.table_ba7cea85816c4b98a116ec6b7a569c98 [id=c8f8d410198f4e0ba51900271218aebe])
I20250831 19:55:00.242938 3484 tablet_loader.cc:96] loaded metadata for tablet bd2f43a6cd1d4782a420fe5e4e110ead (table default.table_65ae80244c21495fad7b9e506a44ebcc [id=09c2744c9575474bba2df5503541accc])
I20250831 19:55:00.243317 3484 tablet_loader.cc:96] loaded metadata for tablet bddbec77b8444036b0c5e8d325faceaa (table default.table_be7bbefda22d4660a8d257962bfe0979 [id=5579e4d41f7b456b8d92804eb3d03711])
I20250831 19:55:00.243850 3484 tablet_loader.cc:96] loaded metadata for tablet bec4c2ee742e4e6ab5f98fb3a1c36aca (table default.table_13cea908832146dab4b8b794752b1a79 [id=61032a0c11594321b1e4cb5ba3394c18])
I20250831 19:55:00.244426 3484 tablet_loader.cc:96] loaded metadata for tablet c1ccea09b6c34c52a9212a5a481c80f7 (table default.table_0409d51b133145c5b7e7d4d407a471b2 [id=4cfc2f0bed1f4f5c80524f8cf8d69f3e])
I20250831 19:55:00.244835 3484 tablet_loader.cc:96] loaded metadata for tablet c307e8673f164f509e0c5ebcfcc2a033 (table default.table_ac609d4af0b748438a68966d468a56c6 [id=9b01227041494090854149aefbbc4a88])
I20250831 19:55:00.245199 3484 tablet_loader.cc:96] loaded metadata for tablet c47f69c5eeda4044b5c0f796375c013b (table default.table_5bc22ff7931245ad82121fb433351a08 [id=acf00823fd974ac6bcbff016c1296aa5])
I20250831 19:55:00.245600 3484 tablet_loader.cc:96] loaded metadata for tablet c515598ee89b4f1a8839c28c7e7bc0c9 (table default.table_20d403c55682499a9ba3267b85aecde7 [id=5b8cc2293fc545e7bedbf645db8dd2ce])
I20250831 19:55:00.246379 3484 tablet_loader.cc:96] loaded metadata for tablet c6db2a319cbf4359846c5f930ce8f0de (table default.table_0bd3ac197d96497390258988a7c498f4 [id=7d4c018fcf534133bcf67cf6c12e3607])
I20250831 19:55:00.246999 3484 tablet_loader.cc:96] loaded metadata for tablet cb21c47c27ea4f34801e93bd647e41b5 (table default.table_ea8910dd3df74137a9832974c833f71e [id=fd551e0ec667492c86ff0aaed181366b])
I20250831 19:55:00.248214 3484 tablet_loader.cc:96] loaded metadata for tablet d1f811715ac64ca591a84b52be6e2621 (table default.table_c3cffc1117c341b0b3a7d4f82c01763a [id=da5a81d8cada4041bd31e0bb6369d108])
I20250831 19:55:00.248996 3484 tablet_loader.cc:96] loaded metadata for tablet d7551c6a0ebd493dba75b1f766c4db0f (table default.table_4021d3dbb7f04e50997c9cc51c7e3888 [id=321a68b57ebf4e3a80670c3c862403f1])
I20250831 19:55:00.249379 3484 tablet_loader.cc:96] loaded metadata for tablet dc6c1d165b5a484ab98ac55cd2330139 (table default.table_930d37393d93428bb6c9407bbd479a71 [id=921f83cf8ea14fd68e86ce2b90aac92c])
I20250831 19:55:00.249991 3484 tablet_loader.cc:96] loaded metadata for tablet e47844d025bf42ecbfd2d3f34a31538e (table default.table_c7390b7344da4c3fbf7f2f502b096669 [id=1df66f6230794e939a25c0f2254d6e17])
I20250831 19:55:00.250353 3484 tablet_loader.cc:96] loaded metadata for tablet e6438652703c45d691f528a4322767b9 (table default.table_d3002519e6964bb484d995d871e766c9 [id=1137b2754d104964bbe5bbaa4a0578b8])
I20250831 19:55:00.251121 3484 tablet_loader.cc:96] loaded metadata for tablet eb97839972ba4bda89287c30da49bb40 (table default.table_13fd718b01d445dbb3955c7804421b1e [id=096152b885a04bfd9cced171fb8a12af])
I20250831 19:55:00.251767 3484 tablet_loader.cc:96] loaded metadata for tablet eed712e77ad740ae95050fe589f3a61a (table default.table_9e76b4c3909b459c812cb7fbddc11988 [id=5cc9b389dd1f4a0289aaecd18be10263])
I20250831 19:55:00.253706 3484 tablet_loader.cc:96] loaded metadata for tablet f3ea6c8b0bf64d8b86dc96dc1abe0934 (table default.table_e28995f706a34a2cb421352cb92a7349 [id=dc8984dc66cb4a01813cb742320a34cc])
I20250831 19:55:00.254197 3484 tablet_loader.cc:96] loaded metadata for tablet f42849cccf8a45ed95794eac0e3922e7 (table default.table_afb8eb0248714122aa74efa2d6fcfce4 [id=fe54e4791a0d4e3c9a36e1968988ea0d])
I20250831 19:55:00.254556 3484 tablet_loader.cc:96] loaded metadata for tablet f47cf07c9a4a43048123794e4a51904b (table default.table_4c0155db27d445829ea2e453cd3ad0f3 [id=7d31bd8f26c94d15b09cf05778a2f253])
I20250831 19:55:00.255108 3484 tablet_loader.cc:96] loaded metadata for tablet f7a7fad8a2ca4da297070dd3b49bc2d8 (table default.table_4dba59fc46824095bd698aa0ccc13224 [id=d340aa6d78a5421f9e03785004d551c7])
I20250831 19:55:00.255445 3484 tablet_loader.cc:96] loaded metadata for tablet f8578694650b4379a66d9ea3df34ca0c (table default.table_b63fcfe30c4b42e4aab0afa9159eff8b [id=690a54011d784c13992fd596584eadb8])
I20250831 19:55:00.256356 3484 tablet_loader.cc:96] loaded metadata for tablet fae02e9ed1434c7c82f6c5faa3a1acec (table default.table_1d644a2c8bd54f89964228704cd693e6 [id=028e873d141c4006aca7d45be88d9ae3])
I20250831 19:55:00.257347 3484 catalog_manager.cc:1486] Initializing Kudu cluster ID...
I20250831 19:55:00.258128 2117 catalog_manager.cc:2149] created HMS catalog entry for table [id=e1533afc63584001bcf2474d09532525]
W20250831 19:55:00.259008 2117 catalog_manager.cc:2177] Illegal state: an error occurred while writing to the sys-catalog: replica a4d46bc3ef5a4fbb8c9e4349c86c54a5 is not leader of this config: current role FOLLOWER
I20250831 19:55:00.259285 1453 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" candidate_term: 4 candidate_status { last_received { term: 3 index: 511 } } ignore_live_leader: false dest_uuid: "ac75f6e7a0634a89beb9670950e95220" is_pre_election: true
I20250831 19:55:00.259878 3113 leader_election.cc:304] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c830f6055d64a3b8a9f78b405ad8aa3; no voters: a4d46bc3ef5a4fbb8c9e4349c86c54a5, ac75f6e7a0634a89beb9670950e95220
W20250831 19:55:00.260321 2186 hms_notification_log_listener.cc:143] Hive Metastore notification log listener poll failed: Service unavailable: lost leadership while handling Hive Metastore notification log events
I20250831 19:55:00.260630 3479 raft_consensus.cc:2747] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20250831 19:55:00.260802 2119 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:36958 (request call id 208) took 1870 ms. Trace:
I20250831 19:55:00.260908 2119 rpcz_store.cc:276] 0831 19:54:58.389865 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:59.264092 (+874227us) service_pool.cc:225] Handling call
0831 19:54:59.310145 (+ 46053us) spinlock_profiling.cc:243] Waited 38.2 ms on lock 0x616000040c54. stack: 00007f1e3b0dc7d6 00007f1e3b0dc590 00007f1e3a0cf3ad 0000000000972d94 0000000000972d5d 00007f1e49ea714d 00007f1e49ea7243 00007f1e46b66941 00007f1e4e6f1a5d 00007f1e4e87be86 00007f1e456b4466 00007f1e456b4195 00007f1e41e8a2ce 00007f1e41e891ae 00007f1e41e8f3e5 00007f1e41e8fd0f
0831 19:55:00.260751 (+950606us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":87866240}
W20250831 19:55:00.261394 2120 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_ca7adb92869942138e0f7dbe76fa583f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250831 19:55:00.264890 3484 catalog_manager.cc:1261] Loaded cluster ID: 003a9cb4df1f460dbfc9d2f57d96ced1
I20250831 19:55:00.264977 3484 catalog_manager.cc:1497] Initializing Kudu internal certificate authority...
W20250831 19:55:00.266196 2123 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_5b6b5bfafb524e0a9e93a06dbd4456c9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250831 19:55:00.266927 2125 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:36958 (request call id 206) took 1877 ms. Trace:
W20250831 19:55:00.268790 1958 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.1.1.253:45581)
I20250831 19:55:00.273392 3484 catalog_manager.cc:1506] Loading token signing keys...
I20250831 19:55:00.277192 2122 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:36958 (request call id 207) took 1887 ms. Trace:
I20250831 19:55:00.277274 2122 rpcz_store.cc:276] 0831 19:54:58.389767 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:59.130840 (+741073us) service_pool.cc:225] Handling call
0831 19:54:59.257096 (+126256us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:55:00.267167 (+1010071us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:55:00.276928 (+ 9761us) catalog_manager.cc:3683] Apply alter schema
0831 19:55:00.277097 (+ 169us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":816252,"Hive Metastore.run_cpu_time_us":712,"Hive Metastore.run_wall_time_us":153299}
I20250831 19:55:00.276671 2125 rpcz_store.cc:276] 0831 19:54:58.389642 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:59.125536 (+735894us) service_pool.cc:225] Handling call
0831 19:54:59.256910 (+131374us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:55:00.266896 (+1009986us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":280001,"Hive Metastore.run_cpu_time_us":177,"Hive Metastore.run_wall_time_us":354700}
I20250831 19:55:00.278141 2124 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:36958 (request call id 204) took 2485 ms. Trace:
I20250831 19:55:00.278239 2124 rpcz_store.cc:276] 0831 19:54:57.790683 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:58.748526 (+957843us) service_pool.cc:225] Handling call
0831 19:54:59.256922 (+508396us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:55:00.267069 (+1010147us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:55:00.276146 (+ 9077us) catalog_manager.cc:3683] Apply alter schema
0831 19:55:00.276371 (+ 225us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":634738,"Hive Metastore.run_cpu_time_us":755,"Hive Metastore.run_wall_time_us":181585}
I20250831 19:55:00.278731 2124 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:36958 (request call id 215) took 1472 ms. Trace:
I20250831 19:55:00.278823 2124 rpcz_store.cc:276] 0831 19:54:58.806119 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:55:00.278440 (+1472321us) service_pool.cc:225] Handling call
0831 19:55:00.278705 (+ 265us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250831 19:55:00.279011 2124 master_service.cc:948] ReplaceTablet: received request to replace tablet 2c03497e3cb4480d88d99dde5d6ea22b from {username='slave'} at 127.0.0.1:36958
I20250831 19:55:00.279277 2124 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:36958 (request call id 216) took 1450 ms. Trace:
I20250831 19:55:00.279341 2124 rpcz_store.cc:276] 0831 19:54:58.829044 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:55:00.278941 (+1449897us) service_pool.cc:225] Handling call
0831 19:55:00.279239 (+ 298us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250831 19:55:00.279536 2124 master_service.cc:948] ReplaceTablet: received request to replace tablet 8fb7abc5581e4a16a55f844acd5fd2e9 from {username='slave'} at 127.0.0.1:36958
I20250831 19:55:00.279775 2124 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:36958 (request call id 217) took 1374 ms. Trace:
I20250831 19:55:00.279860 2124 rpcz_store.cc:276] 0831 19:54:58.905212 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:55:00.279483 (+1374271us) service_pool.cc:225] Handling call
0831 19:55:00.279747 (+ 264us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250831 19:55:00.279942 3484 catalog_manager.cc:5966] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220: Loaded TSK: 0
I20250831 19:55:00.280018 2124 master_service.cc:948] ReplaceTablet: received request to replace tablet f3ea6c8b0bf64d8b86dc96dc1abe0934 from {username='slave'} at 127.0.0.1:36958
I20250831 19:55:00.280248 2124 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:36958 (request call id 218) took 1371 ms. Trace:
I20250831 19:55:00.280316 2124 rpcz_store.cc:276] 0831 19:54:58.908583 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:55:00.279978 (+1371395us) service_pool.cc:225] Handling call
0831 19:55:00.280205 (+ 227us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250831 19:55:00.280423 3484 catalog_manager.cc:1516] Initializing in-progress tserver states...
I20250831 19:55:00.280678 2124 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:36958 (request call id 219) took 1352 ms. Trace:
I20250831 19:55:00.280759 2124 rpcz_store.cc:276] 0831 19:54:58.927795 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:55:00.280436 (+1352641us) service_pool.cc:225] Handling call
0831 19:55:00.280623 (+ 187us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250831 19:55:00.280947 2124 master_service.cc:948] ReplaceTablet: received request to replace tablet 4be6edd110374d2bb941e26defc7302f from {username='slave'} at 127.0.0.1:36958
I20250831 19:55:00.281190 2124 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:36958 (request call id 220) took 1305 ms. Trace:
I20250831 19:55:00.281275 2124 rpcz_store.cc:276] 0831 19:54:58.975483 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:55:00.280879 (+1305396us) service_pool.cc:225] Handling call
0831 19:55:00.281164 (+ 285us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20250831 19:55:00.284641 1958 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.1.1.253:45581)
W20250831 19:55:00.284927 1958 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.1.1.253:45581)
I20250831 19:55:00.286674 2122 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:36958 (request call id 222) took 1001 ms. Trace:
I20250831 19:55:00.286758 2122 rpcz_store.cc:276] 0831 19:54:59.285575 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:55:00.286380 (+1000805us) service_pool.cc:225] Handling call
0831 19:55:00.286620 (+ 240us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250831 19:55:00.288127 3484 catalog_manager.cc:1529] Loading latest processed Hive Metastore notification log event ID...
I20250831 19:55:00.288450 2122 master_service.cc:948] ReplaceTablet: received request to replace tablet 701cef9d6fd04a99986b871760397f1e from {username='slave'} at 127.0.0.1:36958
I20250831 19:55:00.289688 3434 raft_consensus.cc:491] T 84177615877240688a2d4b3b88915525 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:55:00.289815 3434 raft_consensus.cc:513] T 84177615877240688a2d4b3b88915525 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:55:00.290391 3434 leader_election.cc:290] T 84177615877240688a2d4b3b88915525 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:55:00.291010 1772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "84177615877240688a2d4b3b88915525" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:55:00.291111 1633 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "84177615877240688a2d4b3b88915525" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:55:00.291194 1772 raft_consensus.cc:2466] T 84177615877240688a2d4b3b88915525 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 0.
I20250831 19:55:00.291293 1633 raft_consensus.cc:2466] T 84177615877240688a2d4b3b88915525 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 0.
I20250831 19:55:00.291621 1842 leader_election.cc:304] T 84177615877240688a2d4b3b88915525 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:55:00.292042 3434 raft_consensus.cc:2802] T 84177615877240688a2d4b3b88915525 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:55:00.292115 3434 raft_consensus.cc:491] T 84177615877240688a2d4b3b88915525 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:55:00.292163 3434 raft_consensus.cc:3058] T 84177615877240688a2d4b3b88915525 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:55:00.294245 3484 catalog_manager.cc:5804] Last processed Hive Metastore notification event ID: 173
I20250831 19:55:00.294517 3434 raft_consensus.cc:513] T 84177615877240688a2d4b3b88915525 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:55:00.295027 3434 leader_election.cc:290] T 84177615877240688a2d4b3b88915525 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 election: Requested vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:55:00.295344 1772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "84177615877240688a2d4b3b88915525" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197"
I20250831 19:55:00.295409 1633 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "84177615877240688a2d4b3b88915525" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:55:00.295490 1772 raft_consensus.cc:3058] T 84177615877240688a2d4b3b88915525 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:55:00.295552 1633 raft_consensus.cc:3058] T 84177615877240688a2d4b3b88915525 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:55:00.297892 1772 raft_consensus.cc:2466] T 84177615877240688a2d4b3b88915525 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 1.
I20250831 19:55:00.298112 1633 raft_consensus.cc:2466] T 84177615877240688a2d4b3b88915525 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 1.
W20250831 19:55:00.298365 1958 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.1.1.253:45581)
I20250831 19:55:00.298405 1842 leader_election.cc:304] T 84177615877240688a2d4b3b88915525 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:55:00.300192 2124 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:36958 (request call id 221) took 1151 ms. Trace:
I20250831 19:55:00.300349 2124 rpcz_store.cc:276] 0831 19:54:59.148542 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:55:00.281389 (+1132847us) service_pool.cc:225] Handling call
0831 19:55:00.300156 (+ 18767us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250831 19:55:00.300688 3434 raft_consensus.cc:2802] T 84177615877240688a2d4b3b88915525 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:55:00.300861 3434 raft_consensus.cc:695] T 84177615877240688a2d4b3b88915525 P 2441fafe1d62429386f4631ad423567d [term 1 LEADER]: Becoming Leader. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Running, Role: LEADER
I20250831 19:55:00.301378 3434 consensus_queue.cc:237] T 84177615877240688a2d4b3b88915525 P 2441fafe1d62429386f4631ad423567d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:55:00.304236 2122 rpcz_store.cc:275] Call kudu.master.MasterService.GetMasterRegistration from 127.0.0.1:36974 (request call id 0) took 10760 ms. Trace:
I20250831 19:55:00.304649 2122 rpcz_store.cc:276] 0831 19:54:49.543559 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:55:00.289338 (+10745779us) service_pool.cc:225] Handling call
0831 19:55:00.304201 (+ 14863us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20250831 19:55:00.305109 2101 connection.cc:441] server connection from 127.0.0.1:36974 torn down before Call kudu.master.MasterService.GetMasterRegistration from 127.0.0.1:36974 (request call id 0) could send its response
I20250831 19:55:00.316419 2117 catalog_manager.cc:2159] deleted orphaned HMS catalog entry for table [id=e1533afc63584001bcf2474d09532525]
I20250831 19:55:00.316840 2117 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:36958 (request call id 205) took 2396 ms. Trace:
I20250831 19:55:00.316941 2117 rpcz_store.cc:276] 0831 19:54:57.920572 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:58.797993 (+877421us) service_pool.cc:225] Handling call
0831 19:54:59.257414 (+459421us) catalog_manager.cc:2076] Acquired catalog manager lock
0831 19:54:59.258027 (+ 613us) catalog_manager.cc:2122] Created new table and tablet info
0831 19:55:00.258099 (+1000072us) catalog_manager.cc:2148] Created new table in HMS catalog
0831 19:55:00.258842 (+ 743us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:55:00.258845 (+ 3us) write_op.cc:454] Released schema lock
0831 19:55:00.259095 (+ 250us) catalog_manager.cc:2156] Rolling back HMS table creation
0831 19:55:00.316783 (+ 57688us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:55:00.258755 (+ 0us) op_driver.cc:389] HandleFailure(Illegal state: replica a4d46bc3ef5a4fbb8c9e4349c86c54a5 is not leader of this config: current role FOLLOWER)
0831 19:55:00.258770 (+ 15us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:55:00.258777 (+ 7us) write_op.cc:454] Released schema lock
0831 19:55:00.258782 (+ 5us) write_op.cc:335] FINISH: Op aborted
Metrics: {"Hive Metastore.queue_time_us":969615,"Hive Metastore.run_cpu_time_us":412,"Hive Metastore.run_wall_time_us":87260,"child_traces":[["op",{}]]}
I20250831 19:55:00.320163 1434 catalog_manager.cc:5582] T 84177615877240688a2d4b3b88915525 P 2441fafe1d62429386f4631ad423567d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2441fafe1d62429386f4631ad423567d (127.1.1.195). New cstate: current_term: 1 leader_uuid: "2441fafe1d62429386f4631ad423567d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: UNKNOWN } } }
I20250831 19:55:00.337405 2136 raft_consensus.cc:1273] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 4 FOLLOWER]: Refusing update from remote peer ac75f6e7a0634a89beb9670950e95220: Log matching property violated. Preceding OpId in replica: term: 3 index: 511. Preceding OpId from leader: term: 4 index: 513. (index mismatch)
I20250831 19:55:00.338161 3215 raft_consensus.cc:1273] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [term 4 FOLLOWER]: Refusing update from remote peer ac75f6e7a0634a89beb9670950e95220: Log matching property violated. Preceding OpId in replica: term: 3 index: 511. Preceding OpId from leader: term: 4 index: 513. (index mismatch)
I20250831 19:55:00.339587 3483 consensus_queue.cc:1035] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 512, Last known committed idx: 511, Time since last communication: 0.000s
I20250831 19:55:00.339671 1439 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51254:
table { table_name: "default.Table_13cea908832146dab4b8b794752b1a79" } modify_external_catalogs: true
I20250831 19:55:00.339867 1439 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51254:
table { table_name: "default.Table_13cea908832146dab4b8b794752b1a79" } modify_external_catalogs: true
I20250831 19:55:00.340126 1438 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51254:
table { table_name: "default.Table_0409d51b133145c5b7e7d4d407a471b2" } new_table_name: "default.Table_615fc2c3b7bb4650bee9ad184ed4e886" modify_external_catalogs: true
I20250831 19:55:00.340382 1443 master_service.cc:948] ReplaceTablet: received request to replace tablet 2c03497e3cb4480d88d99dde5d6ea22b from {username='slave'} at 127.0.0.1:51254
I20250831 19:55:00.341063 1443 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51254:
name: "default.Table_8df2121e4bed46549eeca09cee50f14b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:55:00.341377 1441 master_service.cc:948] ReplaceTablet: received request to replace tablet 8fb7abc5581e4a16a55f844acd5fd2e9 from {username='slave'} at 127.0.0.1:51254
I20250831 19:55:00.341554 1440 master_service.cc:948] ReplaceTablet: received request to replace tablet f3ea6c8b0bf64d8b86dc96dc1abe0934 from {username='slave'} at 127.0.0.1:51254
I20250831 19:55:00.341902 1436 master_service.cc:948] ReplaceTablet: received request to replace tablet 4be6edd110374d2bb941e26defc7302f from {username='slave'} at 127.0.0.1:51254
I20250831 19:55:00.344465 3483 consensus_queue.cc:1035] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 512, Last known committed idx: 511, Time since last communication: 0.000s
I20250831 19:55:00.346006 1435 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51254:
table { table_name: "default.Table_c48f1c99f3174cb8acca698339447ed9" } modify_external_catalogs: true
I20250831 19:55:00.346179 1437 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51254:
name: "default.Table_c0b1a771fbef4422a91422a51e5dc1f6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:55:00.346184 1435 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51254:
table { table_name: "default.Table_c48f1c99f3174cb8acca698339447ed9" } modify_external_catalogs: true
I20250831 19:55:00.346915 1442 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51254:
name: "default.Table_87e693c7c4a14344a2fe8a792457842d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:55:00.347875 3479 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ac75f6e7a0634a89beb9670950e95220. Latest consensus state: current_term: 4 leader_uuid: "ac75f6e7a0634a89beb9670950e95220" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } } }
I20250831 19:55:00.348088 3479 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [sys.catalog]: This master's current role is: FOLLOWER
I20250831 19:55:00.352399 3479 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 4 leader_uuid: "ac75f6e7a0634a89beb9670950e95220" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } } }
I20250831 19:55:00.352559 3479 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [sys.catalog]: This master's current role is: FOLLOWER
I20250831 19:55:00.353605 3348 mvcc.cc:204] Tried to move back new op lower bound from 7195320730972561408 to 7195320730264121344. Current Snapshot: MvccSnapshot[applied={T|T < 7195320730972561408 or (T in {7195320730972561408})}]
I20250831 19:55:00.358572 2120 catalog_manager.cc:2149] created HMS catalog entry for table [id=ee1df8f0a3e64e2684bb9cfde377d9f6]
W20250831 19:55:00.359535 2120 catalog_manager.cc:2177] Illegal state: an error occurred while writing to the sys-catalog: replica a4d46bc3ef5a4fbb8c9e4349c86c54a5 is not leader of this config: current role FOLLOWER
I20250831 19:55:00.366423 1499 catalog_manager.cc:2747] Deleting table default.table_d3002519e6964bb484d995d871e766c9 [id=1137b2754d104964bbe5bbaa4a0578b8] in response to Hive Metastore notification log event 177
I20250831 19:55:00.370487 1434 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51254:
table { table_name: "default.Table_76aceaaac1fb4aaeb55445d641a113d1" } new_table_name: "default.Table_4898d53becde4f898538edc03de0d520" modify_external_catalogs: true
I20250831 19:55:00.373237 3486 sys_catalog.cc:455] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ac75f6e7a0634a89beb9670950e95220. Latest consensus state: current_term: 4 leader_uuid: "ac75f6e7a0634a89beb9670950e95220" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } } }
I20250831 19:55:00.373446 3486 sys_catalog.cc:458] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [sys.catalog]: This master's current role is: FOLLOWER
I20250831 19:55:00.374908 3483 sys_catalog.cc:455] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 4 leader_uuid: "ac75f6e7a0634a89beb9670950e95220" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } } }
I20250831 19:55:00.375809 3483 sys_catalog.cc:458] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220 [sys.catalog]: This master's current role is: LEADER
I20250831 19:55:00.383301 3486 sys_catalog.cc:455] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 4 leader_uuid: "ac75f6e7a0634a89beb9670950e95220" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } } }
I20250831 19:55:00.383489 3486 sys_catalog.cc:458] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [sys.catalog]: This master's current role is: FOLLOWER
I20250831 19:55:00.384912 1441 catalog_manager.cc:5869] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220: Sending DeleteTablet for 3 replicas of tablet 8fb7abc5581e4a16a55f844acd5fd2e9
I20250831 19:55:00.385486 1441 catalog_manager.cc:6652] ReplaceTablet: tablet 8fb7abc5581e4a16a55f844acd5fd2e9 deleted and replaced by tablet 2c57c6e3bf0c4ffaa30abb7e800a3bea
I20250831 19:55:00.385901 3434 raft_consensus.cc:491] T b54e648cf8e04022ad0bc099534424d1 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:55:00.385932 1748 tablet_service.cc:1515] Processing DeleteTablet for tablet 8fb7abc5581e4a16a55f844acd5fd2e9 with delete_type TABLET_DATA_DELETED (replaced by tablet 2c57c6e3bf0c4ffaa30abb7e800a3bea) from {username='slave'} at 127.0.0.1:50662
I20250831 19:55:00.385936 1609 tablet_service.cc:1515] Processing DeleteTablet for tablet 8fb7abc5581e4a16a55f844acd5fd2e9 with delete_type TABLET_DATA_DELETED (replaced by tablet 2c57c6e3bf0c4ffaa30abb7e800a3bea) from {username='slave'} at 127.0.0.1:51018
I20250831 19:55:00.386022 3434 raft_consensus.cc:513] T b54e648cf8e04022ad0bc099534424d1 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:55:00.386557 3434 leader_election.cc:290] T b54e648cf8e04022ad0bc099534424d1 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:55:00.387334 1883 tablet_service.cc:1515] Processing DeleteTablet for tablet 8fb7abc5581e4a16a55f844acd5fd2e9 with delete_type TABLET_DATA_DELETED (replaced by tablet 2c57c6e3bf0c4ffaa30abb7e800a3bea) from {username='slave'} at 127.0.0.1:45900
I20250831 19:55:00.387831 1633 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b54e648cf8e04022ad0bc099534424d1" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:55:00.387825 1772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b54e648cf8e04022ad0bc099534424d1" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:55:00.387993 1633 raft_consensus.cc:2466] T b54e648cf8e04022ad0bc099534424d1 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 0.
I20250831 19:55:00.388046 1772 raft_consensus.cc:2466] T b54e648cf8e04022ad0bc099534424d1 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 0.
I20250831 19:55:00.388485 1842 leader_election.cc:304] T b54e648cf8e04022ad0bc099534424d1 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:55:00.388994 3434 raft_consensus.cc:2802] T b54e648cf8e04022ad0bc099534424d1 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:55:00.389061 3434 raft_consensus.cc:491] T b54e648cf8e04022ad0bc099534424d1 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:55:00.389112 3434 raft_consensus.cc:3058] T b54e648cf8e04022ad0bc099534424d1 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:55:00.390659 3498 tablet_replica.cc:331] T 8fb7abc5581e4a16a55f844acd5fd2e9 P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:55:00.390841 3498 raft_consensus.cc:2241] T 8fb7abc5581e4a16a55f844acd5fd2e9 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:55:00.390975 3498 raft_consensus.cc:2270] T 8fb7abc5581e4a16a55f844acd5fd2e9 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:55:00.391451 3498 ts_tablet_manager.cc:1905] T 8fb7abc5581e4a16a55f844acd5fd2e9 P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:55:00.391443 3434 raft_consensus.cc:513] T b54e648cf8e04022ad0bc099534424d1 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:55:00.392161 1440 catalog_manager.cc:5869] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220: Sending DeleteTablet for 3 replicas of tablet f3ea6c8b0bf64d8b86dc96dc1abe0934
I20250831 19:55:00.392611 1440 catalog_manager.cc:6652] ReplaceTablet: tablet f3ea6c8b0bf64d8b86dc96dc1abe0934 deleted and replaced by tablet 9c19b3ec9e844963a8392f0a2a97e25e
I20250831 19:55:00.392948 1609 tablet_service.cc:1515] Processing DeleteTablet for tablet f3ea6c8b0bf64d8b86dc96dc1abe0934 with delete_type TABLET_DATA_DELETED (replaced by tablet 9c19b3ec9e844963a8392f0a2a97e25e) from {username='slave'} at 127.0.0.1:51018
I20250831 19:55:00.393098 1436 catalog_manager.cc:5869] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220: Sending DeleteTablet for 3 replicas of tablet 4be6edd110374d2bb941e26defc7302f
I20250831 19:55:00.393241 1750 tablet_service.cc:1515] Processing DeleteTablet for tablet f3ea6c8b0bf64d8b86dc96dc1abe0934 with delete_type TABLET_DATA_DELETED (replaced by tablet 9c19b3ec9e844963a8392f0a2a97e25e) from {username='slave'} at 127.0.0.1:50662
I20250831 19:55:00.393487 1436 catalog_manager.cc:6652] ReplaceTablet: tablet 4be6edd110374d2bb941e26defc7302f deleted and replaced by tablet 644cb7245dcf4097a35de65c2767041a
I20250831 19:55:00.393682 1436 master_service.cc:948] ReplaceTablet: received request to replace tablet 701cef9d6fd04a99986b871760397f1e from {username='slave'} at 127.0.0.1:51254
I20250831 19:55:00.394095 1609 tablet_service.cc:1515] Processing DeleteTablet for tablet 4be6edd110374d2bb941e26defc7302f with delete_type TABLET_DATA_DELETED (replaced by tablet 644cb7245dcf4097a35de65c2767041a) from {username='slave'} at 127.0.0.1:51018
I20250831 19:55:00.394480 1750 tablet_service.cc:1515] Processing DeleteTablet for tablet 4be6edd110374d2bb941e26defc7302f with delete_type TABLET_DATA_DELETED (replaced by tablet 644cb7245dcf4097a35de65c2767041a) from {username='slave'} at 127.0.0.1:50662
I20250831 19:55:00.394608 1886 tablet_service.cc:1515] Processing DeleteTablet for tablet f3ea6c8b0bf64d8b86dc96dc1abe0934 with delete_type TABLET_DATA_DELETED (replaced by tablet 9c19b3ec9e844963a8392f0a2a97e25e) from {username='slave'} at 127.0.0.1:45900
I20250831 19:55:00.394793 1884 tablet_service.cc:1515] Processing DeleteTablet for tablet 4be6edd110374d2bb941e26defc7302f with delete_type TABLET_DATA_DELETED (replaced by tablet 644cb7245dcf4097a35de65c2767041a) from {username='slave'} at 127.0.0.1:45900
I20250831 19:55:00.395397 1772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b54e648cf8e04022ad0bc099534424d1" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197"
I20250831 19:55:00.395579 1772 raft_consensus.cc:3058] T b54e648cf8e04022ad0bc099534424d1 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:55:00.396111 1633 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b54e648cf8e04022ad0bc099534424d1" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:55:00.396235 1633 raft_consensus.cc:3058] T b54e648cf8e04022ad0bc099534424d1 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:55:00.397714 3497 tablet_replica.cc:331] T 8fb7abc5581e4a16a55f844acd5fd2e9 P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:55:00.397917 3497 raft_consensus.cc:2241] T 8fb7abc5581e4a16a55f844acd5fd2e9 P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: Raft consensus shutting down.
I20250831 19:55:00.398162 3497 raft_consensus.cc:2270] T 8fb7abc5581e4a16a55f844acd5fd2e9 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:55:00.398499 1633 raft_consensus.cc:2466] T b54e648cf8e04022ad0bc099534424d1 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 1.
I20250831 19:55:00.398633 3497 ts_tablet_manager.cc:1905] T 8fb7abc5581e4a16a55f844acd5fd2e9 P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:55:00.398665 1772 raft_consensus.cc:2466] T b54e648cf8e04022ad0bc099534424d1 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 1.
I20250831 19:55:00.398923 1841 leader_election.cc:304] T b54e648cf8e04022ad0bc099534424d1 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:55:00.399160 3430 raft_consensus.cc:2802] T b54e648cf8e04022ad0bc099534424d1 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:55:00.400736 3480 sys_catalog.cc:455] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 4 leader_uuid: "ac75f6e7a0634a89beb9670950e95220" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } } }
I20250831 19:55:00.400955 3480 sys_catalog.cc:458] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220 [sys.catalog]: This master's current role is: LEADER
I20250831 19:55:00.401743 1440 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51254:
name: "default.Table_42c6b8d164fd442bb4d9d239110099aa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:55:00.402042 1499 catalog_manager.cc:5869] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220: Sending DeleteTablet for 3 replicas of tablet e6438652703c45d691f528a4322767b9
I20250831 19:55:00.402400 1441 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51254:
name: "default.Table_e3c1c1682df94256ae59468b2f23f6e9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:55:00.403157 3434 leader_election.cc:290] T b54e648cf8e04022ad0bc099534424d1 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 election: Requested vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:55:00.403966 1951 heartbeater.cc:499] Master 127.1.1.252:35943 was elected leader, sending a full tablet report...
I20250831 19:55:00.409492 2943 raft_consensus.cc:491] T bddbec77b8444036b0c5e8d325faceaa P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:55:00.409608 2943 raft_consensus.cc:513] T bddbec77b8444036b0c5e8d325faceaa P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:55:00.410122 2943 leader_election.cc:290] T bddbec77b8444036b0c5e8d325faceaa P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:55:00.410888 1904 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bddbec77b8444036b0c5e8d325faceaa" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:55:00.411032 1904 raft_consensus.cc:2466] T bddbec77b8444036b0c5e8d325faceaa P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 0.
I20250831 19:55:00.412086 1748 tablet_service.cc:1515] Processing DeleteTablet for tablet e6438652703c45d691f528a4322767b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:55:00 UTC) from {username='slave'} at 127.0.0.1:50662
I20250831 19:55:00.412611 3499 tablet_replica.cc:331] T 8fb7abc5581e4a16a55f844acd5fd2e9 P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:55:00.412791 3499 raft_consensus.cc:2241] T 8fb7abc5581e4a16a55f844acd5fd2e9 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:55:00.412778 1705 leader_election.cc:304] T bddbec77b8444036b0c5e8d325faceaa P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:55:00.412935 3499 raft_consensus.cc:2270] T 8fb7abc5581e4a16a55f844acd5fd2e9 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:55:00.413478 3499 ts_tablet_manager.cc:1905] T 8fb7abc5581e4a16a55f844acd5fd2e9 P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:55:00.413599 3352 raft_consensus.cc:2802] T bddbec77b8444036b0c5e8d325faceaa P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:55:00.413678 3352 raft_consensus.cc:491] T bddbec77b8444036b0c5e8d325faceaa P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:55:00.413741 3352 raft_consensus.cc:3058] T bddbec77b8444036b0c5e8d325faceaa P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:55:00.415956 3352 raft_consensus.cc:513] T bddbec77b8444036b0c5e8d325faceaa P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:55:00.416424 3352 leader_election.cc:290] T bddbec77b8444036b0c5e8d325faceaa P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Requested vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:55:00.417587 1904 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bddbec77b8444036b0c5e8d325faceaa" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:55:00.417750 1904 raft_consensus.cc:3058] T bddbec77b8444036b0c5e8d325faceaa P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:55:00.420174 1904 raft_consensus.cc:2466] T bddbec77b8444036b0c5e8d325faceaa P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:55:00.421180 1613 tablet_service.cc:1468] Processing CreateTablet for tablet 2c57c6e3bf0c4ffaa30abb7e800a3bea (DEFAULT_TABLE table=default.table_dbd9b94e2d224171acd87195ab912666 [id=3671adc17a134657a7e9b07c97bea371]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:55:00.421267 1614 tablet_service.cc:1468] Processing CreateTablet for tablet 644cb7245dcf4097a35de65c2767041a (DEFAULT_TABLE table=default.table_617124885d2e4d96b863e0e435bdf695 [id=0fc929ad819b48a9af984f8c301bad2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:55:00.421334 1610 tablet_service.cc:1468] Processing CreateTablet for tablet 9c19b3ec9e844963a8392f0a2a97e25e (DEFAULT_TABLE table=default.table_e28995f706a34a2cb421352cb92a7349 [id=dc8984dc66cb4a01813cb742320a34cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:55:00.421562 1613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c57c6e3bf0c4ffaa30abb7e800a3bea. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:55:00.422128 3465 consensus_queue.cc:1035] T 8afbd19c84f14fbb8f957c2f10d97a4c P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:55:00.422266 1750 tablet_service.cc:1468] Processing CreateTablet for tablet 644cb7245dcf4097a35de65c2767041a (DEFAULT_TABLE table=default.table_617124885d2e4d96b863e0e435bdf695 [id=0fc929ad819b48a9af984f8c301bad2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:55:00.422605 1750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 644cb7245dcf4097a35de65c2767041a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:55:00.425642 1749 tablet_service.cc:1468] Processing CreateTablet for tablet 9c19b3ec9e844963a8392f0a2a97e25e (DEFAULT_TABLE table=default.table_e28995f706a34a2cb421352cb92a7349 [id=dc8984dc66cb4a01813cb742320a34cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:55:00.425910 1749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c19b3ec9e844963a8392f0a2a97e25e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:55:00.428922 3498 ts_tablet_manager.cc:1918] T 8fb7abc5581e4a16a55f844acd5fd2e9 P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:55:00.429018 3498 log.cc:1199] T 8fb7abc5581e4a16a55f844acd5fd2e9 P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/8fb7abc5581e4a16a55f844acd5fd2e9
I20250831 19:55:00.429387 3498 ts_tablet_manager.cc:1939] T 8fb7abc5581e4a16a55f844acd5fd2e9 P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
I20250831 19:55:00.429797 3430 raft_consensus.cc:695] T b54e648cf8e04022ad0bc099534424d1 P 2441fafe1d62429386f4631ad423567d [term 1 LEADER]: Becoming Leader. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Running, Role: LEADER
I20250831 19:55:00.429997 3430 consensus_queue.cc:237] T b54e648cf8e04022ad0bc099534424d1 P 2441fafe1d62429386f4631ad423567d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:55:00.430122 1748 tablet_service.cc:1468] Processing CreateTablet for tablet 2c57c6e3bf0c4ffaa30abb7e800a3bea (DEFAULT_TABLE table=default.table_dbd9b94e2d224171acd87195ab912666 [id=3671adc17a134657a7e9b07c97bea371]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:55:00.430385 1748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c57c6e3bf0c4ffaa30abb7e800a3bea. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:55:00.434120 1436 catalog_manager.cc:5869] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220: Sending DeleteTablet for 3 replicas of tablet 701cef9d6fd04a99986b871760397f1e
I20250831 19:55:00.434547 1436 catalog_manager.cc:6652] ReplaceTablet: tablet 701cef9d6fd04a99986b871760397f1e deleted and replaced by tablet 8aeda031e62e46ddbda679ce6b01df00
I20250831 19:55:00.434866 1614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 644cb7245dcf4097a35de65c2767041a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:55:00.435457 1612 tablet_service.cc:1515] Processing DeleteTablet for tablet 701cef9d6fd04a99986b871760397f1e with delete_type TABLET_DATA_DELETED (replaced by tablet 8aeda031e62e46ddbda679ce6b01df00) from {username='slave'} at 127.0.0.1:51018
I20250831 19:55:00.436606 3497 ts_tablet_manager.cc:1918] T 8fb7abc5581e4a16a55f844acd5fd2e9 P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:55:00.436702 3497 log.cc:1199] T 8fb7abc5581e4a16a55f844acd5fd2e9 P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/8fb7abc5581e4a16a55f844acd5fd2e9
I20250831 19:55:00.437044 3497 ts_tablet_manager.cc:1939] T 8fb7abc5581e4a16a55f844acd5fd2e9 P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
I20250831 19:55:00.437705 1610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c19b3ec9e844963a8392f0a2a97e25e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:55:00.439641 3497 tablet_replica.cc:331] T f3ea6c8b0bf64d8b86dc96dc1abe0934 P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:55:00.439857 3497 raft_consensus.cc:2241] T f3ea6c8b0bf64d8b86dc96dc1abe0934 P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: Raft consensus shutting down.
I20250831 19:55:00.440135 3497 raft_consensus.cc:2270] T f3ea6c8b0bf64d8b86dc96dc1abe0934 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:55:00.440625 3497 ts_tablet_manager.cc:1905] T f3ea6c8b0bf64d8b86dc96dc1abe0934 P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:55:00.442138 3499 ts_tablet_manager.cc:1918] T 8fb7abc5581e4a16a55f844acd5fd2e9 P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:55:00.442266 3499 log.cc:1199] T 8fb7abc5581e4a16a55f844acd5fd2e9 P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/8fb7abc5581e4a16a55f844acd5fd2e9
I20250831 19:55:00.443094 1752 tablet_service.cc:1515] Processing DeleteTablet for tablet 701cef9d6fd04a99986b871760397f1e with delete_type TABLET_DATA_DELETED (replaced by tablet 8aeda031e62e46ddbda679ce6b01df00) from {username='slave'} at 127.0.0.1:50662
I20250831 19:55:00.443651 3499 ts_tablet_manager.cc:1939] T 8fb7abc5581e4a16a55f844acd5fd2e9 P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:55:00.443740 1705 leader_election.cc:304] T bddbec77b8444036b0c5e8d325faceaa P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:55:00.443977 2943 raft_consensus.cc:2802] T bddbec77b8444036b0c5e8d325faceaa P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:55:00.444069 2943 raft_consensus.cc:695] T bddbec77b8444036b0c5e8d325faceaa P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: Becoming Leader. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Running, Role: LEADER
I20250831 19:55:00.444257 2943 consensus_queue.cc:237] T bddbec77b8444036b0c5e8d325faceaa P de831f40fa1348a48a1f0260f4130197 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:55:00.446301 1634 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bddbec77b8444036b0c5e8d325faceaa" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:55:00.446453 1634 raft_consensus.cc:3058] T bddbec77b8444036b0c5e8d325faceaa P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:55:00.446933 3499 tablet_replica.cc:331] T f3ea6c8b0bf64d8b86dc96dc1abe0934 P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:55:00.447151 3499 raft_consensus.cc:2241] T f3ea6c8b0bf64d8b86dc96dc1abe0934 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:55:00.447316 3499 raft_consensus.cc:2270] T f3ea6c8b0bf64d8b86dc96dc1abe0934 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:55:00.447801 3499 ts_tablet_manager.cc:1905] T f3ea6c8b0bf64d8b86dc96dc1abe0934 P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:55:00.447942 1633 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bddbec77b8444036b0c5e8d325faceaa" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:55:00.448678 1634 raft_consensus.cc:2466] T bddbec77b8444036b0c5e8d325faceaa P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:55:00.449687 1436 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51254:
name: "default.Table_f205daa920134307a850938482f79a93"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:55:00.453467 1430 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet 8fb7abc5581e4a16a55f844acd5fd2e9 (table default.table_dbd9b94e2d224171acd87195ab912666 [id=3671adc17a134657a7e9b07c97bea371]) successfully deleted
I20250831 19:55:00.455323 1884 tablet_service.cc:1468] Processing CreateTablet for tablet 2c57c6e3bf0c4ffaa30abb7e800a3bea (DEFAULT_TABLE table=default.table_dbd9b94e2d224171acd87195ab912666 [id=3671adc17a134657a7e9b07c97bea371]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:55:00.455407 1428 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet 8fb7abc5581e4a16a55f844acd5fd2e9 (table default.table_dbd9b94e2d224171acd87195ab912666 [id=3671adc17a134657a7e9b07c97bea371]) successfully deleted
I20250831 19:55:00.455627 1883 tablet_service.cc:1515] Processing DeleteTablet for tablet e6438652703c45d691f528a4322767b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:55:00 UTC) from {username='slave'} at 127.0.0.1:45900
I20250831 19:55:00.455844 1886 tablet_service.cc:1468] Processing CreateTablet for tablet 644cb7245dcf4097a35de65c2767041a (DEFAULT_TABLE table=default.table_617124885d2e4d96b863e0e435bdf695 [id=0fc929ad819b48a9af984f8c301bad2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:55:00.456000 1885 tablet_service.cc:1468] Processing CreateTablet for tablet 9c19b3ec9e844963a8392f0a2a97e25e (DEFAULT_TABLE table=default.table_e28995f706a34a2cb421352cb92a7349 [id=dc8984dc66cb4a01813cb742320a34cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:55:00.456174 3497 ts_tablet_manager.cc:1918] T f3ea6c8b0bf64d8b86dc96dc1abe0934 P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:55:00.456230 1882 tablet_service.cc:1515] Processing DeleteTablet for tablet 701cef9d6fd04a99986b871760397f1e with delete_type TABLET_DATA_DELETED (replaced by tablet 8aeda031e62e46ddbda679ce6b01df00) from {username='slave'} at 127.0.0.1:45900
I20250831 19:55:00.456267 3497 log.cc:1199] T f3ea6c8b0bf64d8b86dc96dc1abe0934 P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/f3ea6c8b0bf64d8b86dc96dc1abe0934
I20250831 19:55:00.455638 1884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c57c6e3bf0c4ffaa30abb7e800a3bea. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:55:00.456597 1885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c19b3ec9e844963a8392f0a2a97e25e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:55:00.456624 3497 ts_tablet_manager.cc:1939] T f3ea6c8b0bf64d8b86dc96dc1abe0934 P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
I20250831 19:55:00.456838 1886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 644cb7245dcf4097a35de65c2767041a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:55:00.457171 1430 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet f3ea6c8b0bf64d8b86dc96dc1abe0934 (table default.table_e28995f706a34a2cb421352cb92a7349 [id=dc8984dc66cb4a01813cb742320a34cc]) successfully deleted
I20250831 19:55:00.460875 3497 tablet_replica.cc:331] T 4be6edd110374d2bb941e26defc7302f P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:55:00.461054 3497 raft_consensus.cc:2241] T 4be6edd110374d2bb941e26defc7302f P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:55:00.461205 3497 raft_consensus.cc:2270] T 4be6edd110374d2bb941e26defc7302f P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:55:00.461575 3373 tablet_bootstrap.cc:492] T 644cb7245dcf4097a35de65c2767041a P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:55:00.461752 3497 ts_tablet_manager.cc:1905] T 4be6edd110374d2bb941e26defc7302f P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:55:00.462849 3373 tablet_bootstrap.cc:654] T 644cb7245dcf4097a35de65c2767041a P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:55:00.469775 3498 tablet_replica.cc:331] T f3ea6c8b0bf64d8b86dc96dc1abe0934 P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:55:00.469902 3499 ts_tablet_manager.cc:1918] T f3ea6c8b0bf64d8b86dc96dc1abe0934 P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:55:00.469988 3498 raft_consensus.cc:2241] T f3ea6c8b0bf64d8b86dc96dc1abe0934 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:55:00.470024 3499 log.cc:1199] T f3ea6c8b0bf64d8b86dc96dc1abe0934 P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/f3ea6c8b0bf64d8b86dc96dc1abe0934
I20250831 19:55:00.470142 3498 raft_consensus.cc:2270] T f3ea6c8b0bf64d8b86dc96dc1abe0934 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:55:00.470423 3499 ts_tablet_manager.cc:1939] T f3ea6c8b0bf64d8b86dc96dc1abe0934 P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:55:00.470647 3498 ts_tablet_manager.cc:1905] T f3ea6c8b0bf64d8b86dc96dc1abe0934 P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:55:00.471375 3499 tablet_replica.cc:331] T 4be6edd110374d2bb941e26defc7302f P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:55:00.471616 3499 raft_consensus.cc:2241] T 4be6edd110374d2bb941e26defc7302f P 2441fafe1d62429386f4631ad423567d [term 1 LEADER]: Raft consensus shutting down.
I20250831 19:55:00.471939 3499 raft_consensus.cc:2270] T 4be6edd110374d2bb941e26defc7302f P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:55:00.472446 3499 ts_tablet_manager.cc:1905] T 4be6edd110374d2bb941e26defc7302f P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:55:00.473824 1609 tablet_service.cc:1515] Processing DeleteTablet for tablet e6438652703c45d691f528a4322767b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:55:00 UTC) from {username='slave'} at 127.0.0.1:51018
I20250831 19:55:00.473932 1428 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet f3ea6c8b0bf64d8b86dc96dc1abe0934 (table default.table_e28995f706a34a2cb421352cb92a7349 [id=dc8984dc66cb4a01813cb742320a34cc]) successfully deleted
I20250831 19:55:00.476327 1752 tablet_service.cc:1468] Processing CreateTablet for tablet 8aeda031e62e46ddbda679ce6b01df00 (DEFAULT_TABLE table=default.table_0498f784ecd944168cd0cbd019307408 [id=003066b121574814b254d138ec66c64c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:55:00.476482 1429 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet 8fb7abc5581e4a16a55f844acd5fd2e9 (table default.table_dbd9b94e2d224171acd87195ab912666 [id=3671adc17a134657a7e9b07c97bea371]) successfully deleted
I20250831 19:55:00.476672 1752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8aeda031e62e46ddbda679ce6b01df00. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:55:00.477371 1609 tablet_service.cc:1468] Processing CreateTablet for tablet 8aeda031e62e46ddbda679ce6b01df00 (DEFAULT_TABLE table=default.table_0498f784ecd944168cd0cbd019307408 [id=003066b121574814b254d138ec66c64c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:55:00.477708 1609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8aeda031e62e46ddbda679ce6b01df00. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:55:00.479424 3498 ts_tablet_manager.cc:1918] T f3ea6c8b0bf64d8b86dc96dc1abe0934 P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:55:00.479513 3498 log.cc:1199] T f3ea6c8b0bf64d8b86dc96dc1abe0934 P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/f3ea6c8b0bf64d8b86dc96dc1abe0934
I20250831 19:55:00.479851 3498 ts_tablet_manager.cc:1939] T f3ea6c8b0bf64d8b86dc96dc1abe0934 P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
I20250831 19:55:00.480703 1429 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet f3ea6c8b0bf64d8b86dc96dc1abe0934 (table default.table_e28995f706a34a2cb421352cb92a7349 [id=dc8984dc66cb4a01813cb742320a34cc]) successfully deleted
I20250831 19:55:00.481083 3498 tablet_replica.cc:331] T 4be6edd110374d2bb941e26defc7302f P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:55:00.481252 3498 raft_consensus.cc:2241] T 4be6edd110374d2bb941e26defc7302f P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:55:00.481395 3498 raft_consensus.cc:2270] T 4be6edd110374d2bb941e26defc7302f P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:55:00.481925 3498 ts_tablet_manager.cc:1905] T 4be6edd110374d2bb941e26defc7302f P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:55:00.483639 3375 tablet_bootstrap.cc:492] T 8aeda031e62e46ddbda679ce6b01df00 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:55:00.485285 3375 tablet_bootstrap.cc:654] T 8aeda031e62e46ddbda679ce6b01df00 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:55:00.486912 2126 catalog_manager.cc:2706] deleted HMS catalog entry for table default.table_55404df7d7524c7cb6139cc53ec92877 [id=2cd4af6b415c4e3a92a3732fa145aa42]
I20250831 19:55:00.487354 2126 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:36958 (request call id 210) took 1831 ms. Trace:
I20250831 19:55:00.487469 2126 rpcz_store.cc:276] 0831 19:54:58.656249 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:59.386316 (+730067us) service_pool.cc:225] Handling call
0831 19:54:59.416094 (+ 29778us) spinlock_profiling.cc:243] Waited 27.9 ms on lock 0x616000040c54. stack: 00007f1e3b0dc7d6 00007f1e3b0dc590 00007f1e3a0cf3ad 0000000000972d94 0000000000972d5d 00007f1e49ea714d 00007f1e49ea7243 00007f1e46b66941 00007f1e4e6f1a5d 00007f1e4e87be86 00007f1e456b4466 00007f1e456b4195 00007f1e41e8a2ce 00007f1e41e891ae 00007f1e41e8f3e5 00007f1e41e8fd0f
0831 19:55:00.265482 (+849388us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:55:00.487306 (+221824us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":92864,"Hive Metastore.run_cpu_time_us":166,"Hive Metastore.run_wall_time_us":128271,"spinlock_wait_cycles":64245504}
I20250831 19:55:00.490010 3498 ts_tablet_manager.cc:1918] T 4be6edd110374d2bb941e26defc7302f P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20250831 19:55:00.490190 3498 log.cc:1199] T 4be6edd110374d2bb941e26defc7302f P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/4be6edd110374d2bb941e26defc7302f
I20250831 19:55:00.490598 3498 ts_tablet_manager.cc:1939] T 4be6edd110374d2bb941e26defc7302f P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
I20250831 19:55:00.492061 3497 ts_tablet_manager.cc:1918] T 4be6edd110374d2bb941e26defc7302f P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20250831 19:55:00.493060 1886 tablet_service.cc:1468] Processing CreateTablet for tablet 8aeda031e62e46ddbda679ce6b01df00 (DEFAULT_TABLE table=default.table_0498f784ecd944168cd0cbd019307408 [id=003066b121574814b254d138ec66c64c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:55:00.493471 1886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8aeda031e62e46ddbda679ce6b01df00. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:55:00.495644 3497 log.cc:1199] T 4be6edd110374d2bb941e26defc7302f P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/4be6edd110374d2bb941e26defc7302f
I20250831 19:55:00.495982 3497 ts_tablet_manager.cc:1939] T 4be6edd110374d2bb941e26defc7302f P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
I20250831 19:55:00.496838 3497 tablet_replica.cc:331] T e6438652703c45d691f528a4322767b9 P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:55:00.497000 3497 raft_consensus.cc:2241] T e6438652703c45d691f528a4322767b9 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:55:00.497212 3497 raft_consensus.cc:2270] T e6438652703c45d691f528a4322767b9 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:55:00.497242 1430 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet 4be6edd110374d2bb941e26defc7302f (table default.table_617124885d2e4d96b863e0e435bdf695 [id=0fc929ad819b48a9af984f8c301bad2b]) successfully deleted
I20250831 19:55:00.498086 3497 ts_tablet_manager.cc:1905] T e6438652703c45d691f528a4322767b9 P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:55:00.499963 1499 catalog_manager.cc:2747] Deleting table default.table_a9e5115b40204ad6afb299f06aa717a2 [id=e1533afc63584001bcf2474d09532525] in response to Hive Metastore notification log event 181
W20250831 19:55:00.500290 1499 hms_notification_log_listener.cc:330] Failed to handle Hive Metastore notification: 181 DROP_TABLE default.table_a9e5115b40204ad6afb299f06aa717a2: Not found: the table does not exist: table_id: "e1533afc63584001bcf2474d09532525" table_name: "default.table_a9e5115b40204ad6afb299f06aa717a2"
I20250831 19:55:00.501930 3498 tablet_replica.cc:331] T 701cef9d6fd04a99986b871760397f1e P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:55:00.502014 1429 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet 4be6edd110374d2bb941e26defc7302f (table default.table_617124885d2e4d96b863e0e435bdf695 [id=0fc929ad819b48a9af984f8c301bad2b]) successfully deleted
I20250831 19:55:00.502135 3498 raft_consensus.cc:2241] T 701cef9d6fd04a99986b871760397f1e P 89aa85d59c53436ebdf3074b13d14825 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250831 19:55:00.502310 3498 raft_consensus.cc:2270] T 701cef9d6fd04a99986b871760397f1e P 89aa85d59c53436ebdf3074b13d14825 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250831 19:55:00.502868 3498 ts_tablet_manager.cc:1905] T 701cef9d6fd04a99986b871760397f1e P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:55:00.510937 3497 ts_tablet_manager.cc:1918] T e6438652703c45d691f528a4322767b9 P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250831 19:55:00.513680 3373 tablet_bootstrap.cc:492] T 644cb7245dcf4097a35de65c2767041a P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:55:00.513839 3373 ts_tablet_manager.cc:1397] T 644cb7245dcf4097a35de65c2767041a P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.052s user 0.005s sys 0.000s
I20250831 19:55:00.514676 3373 raft_consensus.cc:357] T 644cb7245dcf4097a35de65c2767041a P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:55:00.514873 3373 raft_consensus.cc:383] T 644cb7245dcf4097a35de65c2767041a P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:55:00.514935 3373 raft_consensus.cc:738] T 644cb7245dcf4097a35de65c2767041a P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:55:00.515185 3373 consensus_queue.cc:260] T 644cb7245dcf4097a35de65c2767041a P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:55:00.515877 3373 ts_tablet_manager.cc:1428] T 644cb7245dcf4097a35de65c2767041a P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250831 19:55:00.516160 3373 tablet_bootstrap.cc:492] T 2c57c6e3bf0c4ffaa30abb7e800a3bea P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:55:00.511267 3352 raft_consensus.cc:491] T bd2f43a6cd1d4782a420fe5e4e110ead P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:55:00.522544 3352 raft_consensus.cc:513] T bd2f43a6cd1d4782a420fe5e4e110ead P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:55:00.523176 3352 leader_election.cc:290] T bd2f43a6cd1d4782a420fe5e4e110ead P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:55:00.523892 1904 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bd2f43a6cd1d4782a420fe5e4e110ead" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:55:00.524003 1631 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bd2f43a6cd1d4782a420fe5e4e110ead" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:55:00.524088 1904 raft_consensus.cc:2391] T bd2f43a6cd1d4782a420fe5e4e110ead P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate de831f40fa1348a48a1f0260f4130197 in current term 1: Already voted for candidate 89aa85d59c53436ebdf3074b13d14825 in this term.
I20250831 19:55:00.524629 1706 leader_election.cc:304] T bd2f43a6cd1d4782a420fe5e4e110ead P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: de831f40fa1348a48a1f0260f4130197; no voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825
I20250831 19:55:00.524956 3352 raft_consensus.cc:3058] T bd2f43a6cd1d4782a420fe5e4e110ead P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:55:00.527257 3355 consensus_queue.cc:1035] T 8afbd19c84f14fbb8f957c2f10d97a4c P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:55:00.528484 3352 raft_consensus.cc:2747] T bd2f43a6cd1d4782a420fe5e4e110ead P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250831 19:55:00.522526 3497 log.cc:1199] T e6438652703c45d691f528a4322767b9 P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/e6438652703c45d691f528a4322767b9
I20250831 19:55:00.529049 3497 ts_tablet_manager.cc:1939] T e6438652703c45d691f528a4322767b9 P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
I20250831 19:55:00.529587 3497 tablet_replica.cc:331] T 701cef9d6fd04a99986b871760397f1e P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:55:00.529574 1430 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet e6438652703c45d691f528a4322767b9 (table default.table_d3002519e6964bb484d995d871e766c9 [id=1137b2754d104964bbe5bbaa4a0578b8]) successfully deleted
I20250831 19:55:00.529819 3497 raft_consensus.cc:2241] T 701cef9d6fd04a99986b871760397f1e P de831f40fa1348a48a1f0260f4130197 [term 2 LEADER]: Raft consensus shutting down.
I20250831 19:55:00.530172 3497 raft_consensus.cc:2270] T 701cef9d6fd04a99986b871760397f1e P de831f40fa1348a48a1f0260f4130197 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250831 19:55:00.531348 3497 ts_tablet_manager.cc:1905] T 701cef9d6fd04a99986b871760397f1e P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:55:00.537362 3497 ts_tablet_manager.cc:1918] T 701cef9d6fd04a99986b871760397f1e P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.1
I20250831 19:55:00.537560 3497 log.cc:1199] T 701cef9d6fd04a99986b871760397f1e P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/701cef9d6fd04a99986b871760397f1e
I20250831 19:55:00.538084 3497 ts_tablet_manager.cc:1939] T 701cef9d6fd04a99986b871760397f1e P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
I20250831 19:55:00.538714 1430 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet 701cef9d6fd04a99986b871760397f1e (table default.table_0498f784ecd944168cd0cbd019307408 [id=003066b121574814b254d138ec66c64c]) successfully deleted
I20250831 19:55:00.542544 3375 tablet_bootstrap.cc:492] T 8aeda031e62e46ddbda679ce6b01df00 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:55:00.543023 3375 ts_tablet_manager.cc:1397] T 8aeda031e62e46ddbda679ce6b01df00 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.059s user 0.003s sys 0.009s
I20250831 19:55:00.543946 3375 raft_consensus.cc:357] T 8aeda031e62e46ddbda679ce6b01df00 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:55:00.550329 3373 tablet_bootstrap.cc:654] T 2c57c6e3bf0c4ffaa30abb7e800a3bea P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:55:00.552893 3499 ts_tablet_manager.cc:1918] T 4be6edd110374d2bb941e26defc7302f P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20250831 19:55:00.553018 3499 log.cc:1199] T 4be6edd110374d2bb941e26defc7302f P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/4be6edd110374d2bb941e26defc7302f
I20250831 19:55:00.553675 3375 raft_consensus.cc:383] T 8aeda031e62e46ddbda679ce6b01df00 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:55:00.553750 3375 raft_consensus.cc:738] T 8aeda031e62e46ddbda679ce6b01df00 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:55:00.554169 3375 consensus_queue.cc:260] T 8aeda031e62e46ddbda679ce6b01df00 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:55:00.554852 3375 ts_tablet_manager.cc:1428] T 8aeda031e62e46ddbda679ce6b01df00 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.012s user 0.000s sys 0.001s
I20250831 19:55:00.557260 3375 tablet_bootstrap.cc:492] T 644cb7245dcf4097a35de65c2767041a P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:55:00.559422 3498 ts_tablet_manager.cc:1918] T 701cef9d6fd04a99986b871760397f1e P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.1
I20250831 19:55:00.564164 3375 tablet_bootstrap.cc:654] T 644cb7245dcf4097a35de65c2767041a P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:55:00.564685 2118 catalog_manager.cc:2706] deleted HMS catalog entry for table default.table_0498f784ecd944168cd0cbd019307408 [id=003066b121574814b254d138ec66c64c]
I20250831 19:55:00.565268 2118 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:36958 (request call id 211) took 1908 ms. Trace:
I20250831 19:55:00.565387 2118 rpcz_store.cc:276] 0831 19:54:58.656376 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:59.426749 (+770373us) service_pool.cc:225] Handling call
0831 19:54:59.476684 (+ 49935us) spinlock_profiling.cc:243] Waited 49.7 ms on lock 0x616000040c54. stack: 00007f1e3b0dc7d6 00007f1e3b0dc590 00007f1e3a0cf3ad 0000000000972d94 0000000000972d5d 00007f1e49ea714d 00007f1e49ea7243 00007f1e46b66941 00007f1e4e6f1a5d 00007f1e4e87be86 00007f1e456b4466 00007f1e456b4195 00007f1e41e8a2ce 00007f1e41e891ae 00007f1e41e8f3e5 00007f1e41e8fd0f
0831 19:55:00.265634 (+788950us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:55:00.565210 (+299576us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":221048,"Hive Metastore.run_cpu_time_us":183,"Hive Metastore.run_wall_time_us":77653,"spinlock_wait_cycles":114295040}
I20250831 19:55:00.570186 3498 log.cc:1199] T 701cef9d6fd04a99986b871760397f1e P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/701cef9d6fd04a99986b871760397f1e
I20250831 19:55:00.570549 3498 ts_tablet_manager.cc:1939] T 701cef9d6fd04a99986b871760397f1e P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
I20250831 19:55:00.563601 3509 tablet_bootstrap.cc:492] T 2c57c6e3bf0c4ffaa30abb7e800a3bea P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:55:00.571516 1429 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet 701cef9d6fd04a99986b871760397f1e (table default.table_0498f784ecd944168cd0cbd019307408 [id=003066b121574814b254d138ec66c64c]) successfully deleted
I20250831 19:55:00.575333 3498 tablet_replica.cc:331] T e6438652703c45d691f528a4322767b9 P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:55:00.575515 3498 raft_consensus.cc:2241] T e6438652703c45d691f528a4322767b9 P 89aa85d59c53436ebdf3074b13d14825 [term 1 LEADER]: Raft consensus shutting down.
I20250831 19:55:00.575754 3498 raft_consensus.cc:2270] T e6438652703c45d691f528a4322767b9 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:55:00.576180 1768 raft_consensus.cc:3058] T 3667c38e7b8c46ed8205e278c98c4b00 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:55:00.580773 3375 tablet_bootstrap.cc:492] T 644cb7245dcf4097a35de65c2767041a P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:55:00.581297 3498 ts_tablet_manager.cc:1905] T e6438652703c45d691f528a4322767b9 P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:55:00.581753 3375 ts_tablet_manager.cc:1397] T 644cb7245dcf4097a35de65c2767041a P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.025s user 0.002s sys 0.003s
I20250831 19:55:00.584543 3430 consensus_queue.cc:1035] T 3667c38e7b8c46ed8205e278c98c4b00 P 2441fafe1d62429386f4631ad423567d [LEADER]: Connected to new peer: Peer: permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:55:00.586346 3373 tablet_bootstrap.cc:492] T 2c57c6e3bf0c4ffaa30abb7e800a3bea P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:55:00.587240 3373 ts_tablet_manager.cc:1397] T 2c57c6e3bf0c4ffaa30abb7e800a3bea P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.071s user 0.003s sys 0.002s
I20250831 19:55:00.589748 3373 raft_consensus.cc:357] T 2c57c6e3bf0c4ffaa30abb7e800a3bea P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:55:00.590008 3373 raft_consensus.cc:383] T 2c57c6e3bf0c4ffaa30abb7e800a3bea P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:55:00.590200 3373 raft_consensus.cc:738] T 2c57c6e3bf0c4ffaa30abb7e800a3bea P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:55:00.553400 3499 ts_tablet_manager.cc:1939] T 4be6edd110374d2bb941e26defc7302f P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:55:00.613303 3434 consensus_queue.cc:1035] T 3667c38e7b8c46ed8205e278c98c4b00 P 2441fafe1d62429386f4631ad423567d [LEADER]: Connected to new peer: Peer: permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:55:00.614343 3499 tablet_replica.cc:331] T e6438652703c45d691f528a4322767b9 P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:55:00.614542 3499 raft_consensus.cc:2241] T e6438652703c45d691f528a4322767b9 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:55:00.614691 3499 raft_consensus.cc:2270] T e6438652703c45d691f528a4322767b9 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:55:00.615186 3499 ts_tablet_manager.cc:1905] T e6438652703c45d691f528a4322767b9 P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:55:00.616092 1428 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet 4be6edd110374d2bb941e26defc7302f (table default.table_617124885d2e4d96b863e0e435bdf695 [id=0fc929ad819b48a9af984f8c301bad2b]) successfully deleted
I20250831 19:55:00.616340 3375 raft_consensus.cc:357] T 644cb7245dcf4097a35de65c2767041a P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:55:00.616495 3375 raft_consensus.cc:383] T 644cb7245dcf4097a35de65c2767041a P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:55:00.616540 3375 raft_consensus.cc:738] T 644cb7245dcf4097a35de65c2767041a P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:55:00.616705 3375 consensus_queue.cc:260] T 644cb7245dcf4097a35de65c2767041a P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:55:00.617172 3375 ts_tablet_manager.cc:1428] T 644cb7245dcf4097a35de65c2767041a P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.032s user 0.000s sys 0.000s
I20250831 19:55:00.617408 3375 tablet_bootstrap.cc:492] T 9c19b3ec9e844963a8392f0a2a97e25e P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:55:00.617498 3295 raft_consensus.cc:491] T 1ea70a674686459d88265f5f5524fc10 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:55:00.617585 3295 raft_consensus.cc:513] T 1ea70a674686459d88265f5f5524fc10 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:55:00.618117 3295 leader_election.cc:290] T 1ea70a674686459d88265f5f5524fc10 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:55:00.618639 1632 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1ea70a674686459d88265f5f5524fc10" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:55:00.630893 3375 tablet_bootstrap.cc:654] T 9c19b3ec9e844963a8392f0a2a97e25e P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:55:00.636662 3498 ts_tablet_manager.cc:1918] T e6438652703c45d691f528a4322767b9 P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250831 19:55:00.639922 3375 tablet_bootstrap.cc:492] T 9c19b3ec9e844963a8392f0a2a97e25e P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:55:00.645673 3375 ts_tablet_manager.cc:1397] T 9c19b3ec9e844963a8392f0a2a97e25e P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.028s user 0.002s sys 0.001s
I20250831 19:55:00.646795 3375 raft_consensus.cc:357] T 9c19b3ec9e844963a8392f0a2a97e25e P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:55:00.647504 3498 log.cc:1199] T e6438652703c45d691f528a4322767b9 P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/e6438652703c45d691f528a4322767b9
I20250831 19:55:00.648900 3498 ts_tablet_manager.cc:1939] T e6438652703c45d691f528a4322767b9 P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
I20250831 19:55:00.650704 1906 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1ea70a674686459d88265f5f5524fc10" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:55:00.651458 1906 raft_consensus.cc:2391] T 1ea70a674686459d88265f5f5524fc10 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate de831f40fa1348a48a1f0260f4130197 in current term 1: Already voted for candidate 89aa85d59c53436ebdf3074b13d14825 in this term.
I20250831 19:55:00.652172 1705 leader_election.cc:304] T 1ea70a674686459d88265f5f5524fc10 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: de831f40fa1348a48a1f0260f4130197; no voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825
I20250831 19:55:00.652709 2943 raft_consensus.cc:3058] T 1ea70a674686459d88265f5f5524fc10 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:55:00.655799 2943 raft_consensus.cc:2747] T 1ea70a674686459d88265f5f5524fc10 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250831 19:55:00.656056 3375 raft_consensus.cc:383] T 9c19b3ec9e844963a8392f0a2a97e25e P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:55:00.656322 3375 raft_consensus.cc:738] T 9c19b3ec9e844963a8392f0a2a97e25e P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:55:00.657040 3373 consensus_queue.cc:260] T 2c57c6e3bf0c4ffaa30abb7e800a3bea P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:55:00.657420 1429 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet e6438652703c45d691f528a4322767b9 (table default.table_d3002519e6964bb484d995d871e766c9 [id=1137b2754d104964bbe5bbaa4a0578b8]) successfully deleted
I20250831 19:55:00.657534 3375 consensus_queue.cc:260] T 9c19b3ec9e844963a8392f0a2a97e25e P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:55:00.657754 3373 ts_tablet_manager.cc:1428] T 2c57c6e3bf0c4ffaa30abb7e800a3bea P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.070s user 0.002s sys 0.000s
I20250831 19:55:00.657994 3375 ts_tablet_manager.cc:1428] T 9c19b3ec9e844963a8392f0a2a97e25e P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.012s user 0.001s sys 0.000s
I20250831 19:55:00.658241 3375 tablet_bootstrap.cc:492] T 2c57c6e3bf0c4ffaa30abb7e800a3bea P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:55:00.668435 3499 ts_tablet_manager.cc:1918] T e6438652703c45d691f528a4322767b9 P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250831 19:55:00.668543 3499 log.cc:1199] T e6438652703c45d691f528a4322767b9 P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/e6438652703c45d691f528a4322767b9
I20250831 19:55:00.668864 3499 ts_tablet_manager.cc:1939] T e6438652703c45d691f528a4322767b9 P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:55:00.671355 3375 tablet_bootstrap.cc:654] T 2c57c6e3bf0c4ffaa30abb7e800a3bea P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:55:00.674433 3499 tablet_replica.cc:331] T 701cef9d6fd04a99986b871760397f1e P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:55:00.674609 3499 raft_consensus.cc:2241] T 701cef9d6fd04a99986b871760397f1e P 2441fafe1d62429386f4631ad423567d [term 2 FOLLOWER]: Raft consensus shutting down.
I20250831 19:55:00.674612 1428 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet e6438652703c45d691f528a4322767b9 (table default.table_d3002519e6964bb484d995d871e766c9 [id=1137b2754d104964bbe5bbaa4a0578b8]) successfully deleted
I20250831 19:55:00.674757 3499 raft_consensus.cc:2270] T 701cef9d6fd04a99986b871760397f1e P 2441fafe1d62429386f4631ad423567d [term 2 FOLLOWER]: Raft consensus is shut down!
I20250831 19:55:00.675217 3499 ts_tablet_manager.cc:1905] T 701cef9d6fd04a99986b871760397f1e P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:55:00.675967 3529 tablet.cc:1722] T 5a080bbabe8840c3ba954bdc0626dc39 P 89aa85d59c53436ebdf3074b13d14825: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:55:00.679206 1439 catalog_manager.cc:2706] deleted HMS catalog entry for table default.table_13cea908832146dab4b8b794752b1a79 [id=61032a0c11594321b1e4cb5ba3394c18]
I20250831 19:55:00.680843 3525 tablet.cc:1722] T 5a080bbabe8840c3ba954bdc0626dc39 P 2441fafe1d62429386f4631ad423567d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:55:00.681845 3373 tablet_bootstrap.cc:492] T 9c19b3ec9e844963a8392f0a2a97e25e P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:55:00.691025 3532 tablet.cc:1722] T 5a080bbabe8840c3ba954bdc0626dc39 P de831f40fa1348a48a1f0260f4130197: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:55:00.684145 3373 tablet_bootstrap.cc:654] T 9c19b3ec9e844963a8392f0a2a97e25e P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:55:00.692898 3445 catalog_manager.cc:1261] Loaded cluster ID: 003a9cb4df1f460dbfc9d2f57d96ced1
I20250831 19:55:00.693017 3445 catalog_manager.cc:1554] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3: loading cluster ID for follower catalog manager: success
I20250831 19:55:00.697175 3509 tablet_bootstrap.cc:654] T 2c57c6e3bf0c4ffaa30abb7e800a3bea P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:55:00.697674 3531 tablet.cc:1722] T b0d177e2e2f745b8969b65ab318321a1 P 2441fafe1d62429386f4631ad423567d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:55:00.697230 3530 tablet.cc:1722] T b0d177e2e2f745b8969b65ab318321a1 P de831f40fa1348a48a1f0260f4130197: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:55:00.698818 3534 tablet.cc:1722] T b0d177e2e2f745b8969b65ab318321a1 P 89aa85d59c53436ebdf3074b13d14825: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250831 19:55:00.701485 3499 ts_tablet_manager.cc:1918] T 701cef9d6fd04a99986b871760397f1e P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.1
I20250831 19:55:00.701592 3499 log.cc:1199] T 701cef9d6fd04a99986b871760397f1e P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/701cef9d6fd04a99986b871760397f1e
I20250831 19:55:00.701926 3499 ts_tablet_manager.cc:1939] T 701cef9d6fd04a99986b871760397f1e P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:55:00.714955 3445 catalog_manager.cc:1576] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3: acquiring CA information for follower catalog manager: success
I20250831 19:55:00.730829 1499 catalog_manager.cc:2747] Deleting table default.table_55404df7d7524c7cb6139cc53ec92877 [id=2cd4af6b415c4e3a92a3732fa145aa42] in response to Hive Metastore notification log event 183
I20250831 19:55:00.732900 1428 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet 701cef9d6fd04a99986b871760397f1e (table default.table_0498f784ecd944168cd0cbd019307408 [id=003066b121574814b254d138ec66c64c]) successfully deleted
I20250831 19:55:00.734324 3373 tablet_bootstrap.cc:492] T 9c19b3ec9e844963a8392f0a2a97e25e P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:55:00.735958 3373 ts_tablet_manager.cc:1397] T 9c19b3ec9e844963a8392f0a2a97e25e P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.054s user 0.005s sys 0.000s
I20250831 19:55:00.736601 3373 raft_consensus.cc:357] T 9c19b3ec9e844963a8392f0a2a97e25e P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:55:00.737656 3509 tablet_bootstrap.cc:492] T 2c57c6e3bf0c4ffaa30abb7e800a3bea P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:55:00.737826 3509 ts_tablet_manager.cc:1397] T 2c57c6e3bf0c4ffaa30abb7e800a3bea P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.174s user 0.006s sys 0.000s
I20250831 19:55:00.738196 1499 catalog_manager.cc:5869] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220: Sending DeleteTablet for 3 replicas of tablet 2a20faaf76fe4806b47e5ac80ccf5915
I20250831 19:55:00.739320 1499 catalog_manager.cc:2747] Deleting table default.table_0498f784ecd944168cd0cbd019307408 [id=003066b121574814b254d138ec66c64c] in response to Hive Metastore notification log event 184
I20250831 19:55:00.739389 3509 raft_consensus.cc:357] T 2c57c6e3bf0c4ffaa30abb7e800a3bea P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:55:00.739537 3509 raft_consensus.cc:383] T 2c57c6e3bf0c4ffaa30abb7e800a3bea P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:55:00.739575 3509 raft_consensus.cc:738] T 2c57c6e3bf0c4ffaa30abb7e800a3bea P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:55:00.739754 3509 consensus_queue.cc:260] T 2c57c6e3bf0c4ffaa30abb7e800a3bea P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:55:00.740223 3509 ts_tablet_manager.cc:1428] T 2c57c6e3bf0c4ffaa30abb7e800a3bea P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250831 19:55:00.738905 1886 tablet_service.cc:1515] Processing DeleteTablet for tablet 2a20faaf76fe4806b47e5ac80ccf5915 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:55:00 UTC) from {username='slave'} at 127.0.0.1:45900
I20250831 19:55:00.740518 1748 tablet_service.cc:1515] Processing DeleteTablet for tablet 2a20faaf76fe4806b47e5ac80ccf5915 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:55:00 UTC) from {username='slave'} at 127.0.0.1:50662
I20250831 19:55:00.740729 3497 tablet_replica.cc:331] T 2a20faaf76fe4806b47e5ac80ccf5915 P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:55:00.740906 3497 raft_consensus.cc:2241] T 2a20faaf76fe4806b47e5ac80ccf5915 P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: Raft consensus shutting down.
I20250831 19:55:00.740918 3499 tablet_replica.cc:331] T 2a20faaf76fe4806b47e5ac80ccf5915 P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:55:00.741072 3499 raft_consensus.cc:2241] T 2a20faaf76fe4806b47e5ac80ccf5915 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:55:00.741140 3497 raft_consensus.cc:2270] T 2a20faaf76fe4806b47e5ac80ccf5915 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:55:00.741233 3499 raft_consensus.cc:2270] T 2a20faaf76fe4806b47e5ac80ccf5915 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:55:00.741725 3499 ts_tablet_manager.cc:1905] T 2a20faaf76fe4806b47e5ac80ccf5915 P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:55:00.741922 3497 ts_tablet_manager.cc:1905] T 2a20faaf76fe4806b47e5ac80ccf5915 P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:55:00.742534 3373 raft_consensus.cc:383] T 9c19b3ec9e844963a8392f0a2a97e25e P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:55:00.742674 3373 raft_consensus.cc:738] T 9c19b3ec9e844963a8392f0a2a97e25e P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:55:00.742849 1613 tablet_service.cc:1515] Processing DeleteTablet for tablet 2a20faaf76fe4806b47e5ac80ccf5915 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:55:00 UTC) from {username='slave'} at 127.0.0.1:51018
I20250831 19:55:00.743043 3498 tablet_replica.cc:331] T 2a20faaf76fe4806b47e5ac80ccf5915 P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:55:00.743178 3498 raft_consensus.cc:2241] T 2a20faaf76fe4806b47e5ac80ccf5915 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:55:00.743300 3498 raft_consensus.cc:2270] T 2a20faaf76fe4806b47e5ac80ccf5915 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:55:00.743734 3498 ts_tablet_manager.cc:1905] T 2a20faaf76fe4806b47e5ac80ccf5915 P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:55:00.745762 1499 catalog_manager.cc:5869] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220: Sending DeleteTablet for 3 replicas of tablet 8aeda031e62e46ddbda679ce6b01df00
I20250831 19:55:00.746872 1499 catalog_manager.cc:2747] Deleting table default.table_13cea908832146dab4b8b794752b1a79 [id=61032a0c11594321b1e4cb5ba3394c18] in response to Hive Metastore notification log event 185
I20250831 19:55:00.748780 1613 tablet_service.cc:1515] Processing DeleteTablet for tablet 8aeda031e62e46ddbda679ce6b01df00 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:55:00 UTC) from {username='slave'} at 127.0.0.1:51018
I20250831 19:55:00.749483 3498 ts_tablet_manager.cc:1918] T 2a20faaf76fe4806b47e5ac80ccf5915 P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20250831 19:55:00.749656 3498 log.cc:1199] T 2a20faaf76fe4806b47e5ac80ccf5915 P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/2a20faaf76fe4806b47e5ac80ccf5915
I20250831 19:55:00.749640 1748 tablet_service.cc:1515] Processing DeleteTablet for tablet 8aeda031e62e46ddbda679ce6b01df00 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:55:00 UTC) from {username='slave'} at 127.0.0.1:50662
I20250831 19:55:00.750085 3498 ts_tablet_manager.cc:1939] T 2a20faaf76fe4806b47e5ac80ccf5915 P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
I20250831 19:55:00.748498 1886 tablet_service.cc:1515] Processing DeleteTablet for tablet 8aeda031e62e46ddbda679ce6b01df00 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:55:00 UTC) from {username='slave'} at 127.0.0.1:45900
I20250831 19:55:00.751060 1429 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet 2a20faaf76fe4806b47e5ac80ccf5915 (table default.table_55404df7d7524c7cb6139cc53ec92877 [id=2cd4af6b415c4e3a92a3732fa145aa42]) successfully deleted
I20250831 19:55:00.751341 3373 consensus_queue.cc:260] T 9c19b3ec9e844963a8392f0a2a97e25e P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
W20250831 19:55:00.751900 1429 catalog_manager.cc:4908] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): delete failed for tablet 8aeda031e62e46ddbda679ce6b01df00 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8aeda031e62e46ddbda679ce6b01df00 already in progress: creating tablet
I20250831 19:55:00.752602 3355 consensus_queue.cc:1035] T e47844d025bf42ecbfd2d3f34a31538e P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:55:00.753271 3445 catalog_manager.cc:1604] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20250831 19:55:00.756309 1499 catalog_manager.cc:5869] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220: Sending DeleteTablet for 3 replicas of tablet bec4c2ee742e4e6ab5f98fb3a1c36aca
I20250831 19:55:00.756979 1613 tablet_service.cc:1515] Processing DeleteTablet for tablet bec4c2ee742e4e6ab5f98fb3a1c36aca with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:55:00 UTC) from {username='slave'} at 127.0.0.1:51018
I20250831 19:55:00.757388 1886 tablet_service.cc:1515] Processing DeleteTablet for tablet bec4c2ee742e4e6ab5f98fb3a1c36aca with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:55:00 UTC) from {username='slave'} at 127.0.0.1:45900
I20250831 19:55:00.757421 3497 ts_tablet_manager.cc:1918] T 2a20faaf76fe4806b47e5ac80ccf5915 P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20250831 19:55:00.757561 3497 log.cc:1199] T 2a20faaf76fe4806b47e5ac80ccf5915 P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/2a20faaf76fe4806b47e5ac80ccf5915
W20250831 19:55:00.757530 1443 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_8df2121e4bed46549eeca09cee50f14b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250831 19:55:00.757738 3498 tablet_replica.cc:331] T bec4c2ee742e4e6ab5f98fb3a1c36aca P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:55:00.757956 3497 ts_tablet_manager.cc:1939] T 2a20faaf76fe4806b47e5ac80ccf5915 P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
I20250831 19:55:00.758000 3498 raft_consensus.cc:2241] T bec4c2ee742e4e6ab5f98fb3a1c36aca P 89aa85d59c53436ebdf3074b13d14825 [term 1 LEADER]: Raft consensus shutting down.
I20250831 19:55:00.758375 3498 raft_consensus.cc:2270] T bec4c2ee742e4e6ab5f98fb3a1c36aca P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus is shut down!
W20250831 19:55:00.758745 1437 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_c0b1a771fbef4422a91422a51e5dc1f6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250831 19:55:00.758919 3497 tablet_replica.cc:331] T 8aeda031e62e46ddbda679ce6b01df00 P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:55:00.759089 3498 ts_tablet_manager.cc:1905] T bec4c2ee742e4e6ab5f98fb3a1c36aca P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:55:00.759155 3497 raft_consensus.cc:2241] T 8aeda031e62e46ddbda679ce6b01df00 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250831 19:55:00.759474 3497 raft_consensus.cc:2270] T 8aeda031e62e46ddbda679ce6b01df00 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Raft consensus is shut down!
W20250831 19:55:00.759819 1442 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_87e693c7c4a14344a2fe8a792457842d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250831 19:55:00.760183 3497 ts_tablet_manager.cc:1905] T 8aeda031e62e46ddbda679ce6b01df00 P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:55:00.760871 3375 tablet_bootstrap.cc:492] T 2c57c6e3bf0c4ffaa30abb7e800a3bea P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
W20250831 19:55:00.760867 1440 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_42c6b8d164fd442bb4d9d239110099aa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250831 19:55:00.760983 3375 ts_tablet_manager.cc:1397] T 2c57c6e3bf0c4ffaa30abb7e800a3bea P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.103s user 0.015s sys 0.004s
W20250831 19:55:00.761735 1441 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_e3c1c1682df94256ae59468b2f23f6e9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250831 19:55:00.761806 3375 raft_consensus.cc:357] T 2c57c6e3bf0c4ffaa30abb7e800a3bea P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:55:00.761970 3375 raft_consensus.cc:383] T 2c57c6e3bf0c4ffaa30abb7e800a3bea P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:55:00.762017 3375 raft_consensus.cc:738] T 2c57c6e3bf0c4ffaa30abb7e800a3bea P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:55:00.762207 3375 consensus_queue.cc:260] T 2c57c6e3bf0c4ffaa30abb7e800a3bea P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:55:00.762686 3375 ts_tablet_manager.cc:1428] T 2c57c6e3bf0c4ffaa30abb7e800a3bea P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
W20250831 19:55:00.763207 1436 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_f205daa920134307a850938482f79a93 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250831 19:55:00.764350 1430 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet 2a20faaf76fe4806b47e5ac80ccf5915 (table default.table_55404df7d7524c7cb6139cc53ec92877 [id=2cd4af6b415c4e3a92a3732fa145aa42]) successfully deleted
I20250831 19:55:00.764900 1748 tablet_service.cc:1515] Processing DeleteTablet for tablet bec4c2ee742e4e6ab5f98fb3a1c36aca with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:55:00 UTC) from {username='slave'} at 127.0.0.1:50662
I20250831 19:55:00.765054 3509 tablet_bootstrap.cc:492] T 644cb7245dcf4097a35de65c2767041a P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:55:00.766350 3509 tablet_bootstrap.cc:654] T 644cb7245dcf4097a35de65c2767041a P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:55:00.770475 3373 ts_tablet_manager.cc:1428] T 9c19b3ec9e844963a8392f0a2a97e25e P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.034s user 0.001s sys 0.000s
I20250831 19:55:00.770812 3373 tablet_bootstrap.cc:492] T 8aeda031e62e46ddbda679ce6b01df00 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:55:00.772780 3497 ts_tablet_manager.cc:1918] T 8aeda031e62e46ddbda679ce6b01df00 P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250831 19:55:00.777943 3355 consensus_queue.cc:1035] T e47844d025bf42ecbfd2d3f34a31538e P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:55:00.787381 3498 ts_tablet_manager.cc:1918] T bec4c2ee742e4e6ab5f98fb3a1c36aca P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:55:00.787484 3498 log.cc:1199] T bec4c2ee742e4e6ab5f98fb3a1c36aca P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/bec4c2ee742e4e6ab5f98fb3a1c36aca
I20250831 19:55:00.787855 3498 ts_tablet_manager.cc:1939] T bec4c2ee742e4e6ab5f98fb3a1c36aca P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
I20250831 19:55:00.788940 1429 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet bec4c2ee742e4e6ab5f98fb3a1c36aca (table default.table_13cea908832146dab4b8b794752b1a79 [id=61032a0c11594321b1e4cb5ba3394c18]) successfully deleted
I20250831 19:55:00.789548 3499 ts_tablet_manager.cc:1918] T 2a20faaf76fe4806b47e5ac80ccf5915 P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20250831 19:55:00.789685 3499 log.cc:1199] T 2a20faaf76fe4806b47e5ac80ccf5915 P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/2a20faaf76fe4806b47e5ac80ccf5915
I20250831 19:55:00.790066 3499 ts_tablet_manager.cc:1939] T 2a20faaf76fe4806b47e5ac80ccf5915 P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:55:00.791049 1428 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet 2a20faaf76fe4806b47e5ac80ccf5915 (table default.table_55404df7d7524c7cb6139cc53ec92877 [id=2cd4af6b415c4e3a92a3732fa145aa42]) successfully deleted
I20250831 19:55:00.791106 3499 tablet_replica.cc:331] T bec4c2ee742e4e6ab5f98fb3a1c36aca P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
W20250831 19:55:00.791309 1428 catalog_manager.cc:4908] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): delete failed for tablet 8aeda031e62e46ddbda679ce6b01df00 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8aeda031e62e46ddbda679ce6b01df00 already in progress: creating tablet
I20250831 19:55:00.791328 3499 raft_consensus.cc:2241] T bec4c2ee742e4e6ab5f98fb3a1c36aca P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:55:00.791487 3499 raft_consensus.cc:2270] T bec4c2ee742e4e6ab5f98fb3a1c36aca P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:55:00.792075 3499 ts_tablet_manager.cc:1905] T bec4c2ee742e4e6ab5f98fb3a1c36aca P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:55:00.795109 3373 tablet_bootstrap.cc:654] T 8aeda031e62e46ddbda679ce6b01df00 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:55:00.796053 3509 tablet_bootstrap.cc:492] T 644cb7245dcf4097a35de65c2767041a P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:55:00.796197 3509 ts_tablet_manager.cc:1397] T 644cb7245dcf4097a35de65c2767041a P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.031s user 0.003s sys 0.000s
I20250831 19:55:00.796990 3509 raft_consensus.cc:357] T 644cb7245dcf4097a35de65c2767041a P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:55:00.797179 3509 raft_consensus.cc:383] T 644cb7245dcf4097a35de65c2767041a P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:55:00.797232 3509 raft_consensus.cc:738] T 644cb7245dcf4097a35de65c2767041a P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:55:00.797452 3509 consensus_queue.cc:260] T 644cb7245dcf4097a35de65c2767041a P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:55:00.798009 3509 ts_tablet_manager.cc:1428] T 644cb7245dcf4097a35de65c2767041a P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20250831 19:55:00.798353 3509 tablet_bootstrap.cc:492] T 8aeda031e62e46ddbda679ce6b01df00 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:55:00.800164 3509 tablet_bootstrap.cc:654] T 8aeda031e62e46ddbda679ce6b01df00 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:55:00.803996 3499 ts_tablet_manager.cc:1918] T bec4c2ee742e4e6ab5f98fb3a1c36aca P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:55:00.808108 3499 log.cc:1199] T bec4c2ee742e4e6ab5f98fb3a1c36aca P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/bec4c2ee742e4e6ab5f98fb3a1c36aca
I20250831 19:55:00.808478 3499 ts_tablet_manager.cc:1939] T bec4c2ee742e4e6ab5f98fb3a1c36aca P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:55:00.809986 1428 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet bec4c2ee742e4e6ab5f98fb3a1c36aca (table default.table_13cea908832146dab4b8b794752b1a79 [id=61032a0c11594321b1e4cb5ba3394c18]) successfully deleted
I20250831 19:55:00.820719 3430 consensus_queue.cc:1035] T f47cf07c9a4a43048123794e4a51904b P 2441fafe1d62429386f4631ad423567d [LEADER]: Connected to new peer: Peer: permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:55:00.828442 3501 consensus_queue.cc:1035] T f47cf07c9a4a43048123794e4a51904b P 2441fafe1d62429386f4631ad423567d [LEADER]: Connected to new peer: Peer: permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:55:00.854645 3497 log.cc:1199] T 8aeda031e62e46ddbda679ce6b01df00 P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/8aeda031e62e46ddbda679ce6b01df00
I20250831 19:55:00.857682 3497 ts_tablet_manager.cc:1939] T 8aeda031e62e46ddbda679ce6b01df00 P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
I20250831 19:55:00.858387 3509 tablet_bootstrap.cc:492] T 8aeda031e62e46ddbda679ce6b01df00 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:55:00.858575 3509 ts_tablet_manager.cc:1397] T 8aeda031e62e46ddbda679ce6b01df00 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.060s user 0.000s sys 0.006s
I20250831 19:55:00.859292 3509 raft_consensus.cc:357] T 8aeda031e62e46ddbda679ce6b01df00 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:55:00.859490 3509 raft_consensus.cc:383] T 8aeda031e62e46ddbda679ce6b01df00 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:55:00.859578 3509 raft_consensus.cc:738] T 8aeda031e62e46ddbda679ce6b01df00 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:55:00.859807 3509 consensus_queue.cc:260] T 8aeda031e62e46ddbda679ce6b01df00 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:55:00.866008 3509 ts_tablet_manager.cc:1428] T 8aeda031e62e46ddbda679ce6b01df00 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20250831 19:55:00.876411 3509 tablet_bootstrap.cc:492] T 9c19b3ec9e844963a8392f0a2a97e25e P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:55:00.880159 2121 catalog_manager.cc:3460] renamed table default.table_617124885d2e4d96b863e0e435bdf695 [id=0fc929ad819b48a9af984f8c301bad2b] in HMS: new name default.table_dcdb51c187224f8c88da49b3ddd45493
I20250831 19:55:00.880564 2943 consensus_queue.cc:1035] T a5e30fe82a41499caa5e79fa1560c1be P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:55:00.881287 2121 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:36958 (request call id 212) took 2224 ms. Trace:
I20250831 19:55:00.881383 2121 rpcz_store.cc:276] 0831 19:54:58.656507 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:59.427665 (+771158us) service_pool.cc:225] Handling call
0831 19:54:59.479893 (+ 52228us) spinlock_profiling.cc:243] Waited 51.9 ms on lock 0x616000040c54. stack: 00007f1e3b0dc7d6 00007f1e3b0dc590 00007f1e3a0cf3ad 0000000000972d94 0000000000972d5d 00007f1e49ea714d 00007f1e49ea7243 00007f1e46b66941 00007f1e4e6f1a5d 00007f1e4e87d126 00007f1e456b6126 00007f1e456b5e55 00007f1e41e8a2ce 00007f1e41e891ae 00007f1e41e8f3e5 00007f1e41e8fd0f
0831 19:55:00.265765 (+785872us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:55:00.880577 (+614812us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:55:00.880966 (+ 389us) catalog_manager.cc:3683] Apply alter schema
0831 19:55:00.881230 (+ 264us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":298585,"Hive Metastore.run_cpu_time_us":739,"Hive Metastore.run_wall_time_us":315411,"spinlock_wait_cycles":119324928}
I20250831 19:55:00.888471 3509 tablet_bootstrap.cc:654] T 9c19b3ec9e844963a8392f0a2a97e25e P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:55:00.889709 3497 tablet_replica.cc:331] T bec4c2ee742e4e6ab5f98fb3a1c36aca P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:55:00.889935 3497 raft_consensus.cc:2241] T bec4c2ee742e4e6ab5f98fb3a1c36aca P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:55:00.890116 3497 raft_consensus.cc:2270] T bec4c2ee742e4e6ab5f98fb3a1c36aca P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:55:00.890138 3373 tablet_bootstrap.cc:492] T 8aeda031e62e46ddbda679ce6b01df00 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:55:00.890254 3373 ts_tablet_manager.cc:1397] T 8aeda031e62e46ddbda679ce6b01df00 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.120s user 0.017s sys 0.029s
I20250831 19:55:00.890918 3373 raft_consensus.cc:357] T 8aeda031e62e46ddbda679ce6b01df00 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:55:00.892599 1430 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet 8aeda031e62e46ddbda679ce6b01df00 (table default.table_0498f784ecd944168cd0cbd019307408 [id=003066b121574814b254d138ec66c64c]) successfully deleted
I20250831 19:55:00.893580 3497 ts_tablet_manager.cc:1905] T bec4c2ee742e4e6ab5f98fb3a1c36aca P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:55:00.894493 3295 consensus_queue.cc:1035] T a5e30fe82a41499caa5e79fa1560c1be P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:55:00.895484 3355 consensus_queue.cc:1035] T bd2f43a6cd1d4782a420fe5e4e110ead P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:55:00.904201 3373 raft_consensus.cc:383] T 8aeda031e62e46ddbda679ce6b01df00 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:55:00.904497 3373 raft_consensus.cc:738] T 8aeda031e62e46ddbda679ce6b01df00 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:55:00.904843 3373 consensus_queue.cc:260] T 8aeda031e62e46ddbda679ce6b01df00 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:55:00.906067 3373 ts_tablet_manager.cc:1428] T 8aeda031e62e46ddbda679ce6b01df00 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.016s user 0.001s sys 0.000s
I20250831 19:55:00.918921 3465 consensus_queue.cc:1035] T bd2f43a6cd1d4782a420fe5e4e110ead P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:55:00.924012 3501 consensus_queue.cc:1035] T 5fcb923d81a2495fa02dc76ddb9983b7 P 2441fafe1d62429386f4631ad423567d [LEADER]: Connected to new peer: Peer: permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:55:00.942104 3509 tablet_bootstrap.cc:492] T 9c19b3ec9e844963a8392f0a2a97e25e P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:55:00.943158 3509 ts_tablet_manager.cc:1397] T 9c19b3ec9e844963a8392f0a2a97e25e P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.067s user 0.005s sys 0.000s
I20250831 19:55:00.943881 3509 raft_consensus.cc:357] T 9c19b3ec9e844963a8392f0a2a97e25e P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:55:00.946753 3509 raft_consensus.cc:383] T 9c19b3ec9e844963a8392f0a2a97e25e P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:55:00.946871 3509 raft_consensus.cc:738] T 9c19b3ec9e844963a8392f0a2a97e25e P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:55:00.949146 3497 ts_tablet_manager.cc:1918] T bec4c2ee742e4e6ab5f98fb3a1c36aca P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:55:00.949280 3497 log.cc:1199] T bec4c2ee742e4e6ab5f98fb3a1c36aca P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/bec4c2ee742e4e6ab5f98fb3a1c36aca
I20250831 19:55:00.947094 3509 consensus_queue.cc:260] T 9c19b3ec9e844963a8392f0a2a97e25e P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:55:00.954346 3509 ts_tablet_manager.cc:1428] T 9c19b3ec9e844963a8392f0a2a97e25e P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.011s user 0.001s sys 0.000s
I20250831 19:55:00.955526 1438 catalog_manager.cc:3460] renamed table default.table_0409d51b133145c5b7e7d4d407a471b2 [id=4cfc2f0bed1f4f5c80524f8cf8d69f3e] in HMS: new name default.table_615fc2c3b7bb4650bee9ad184ed4e886
I20250831 19:55:00.959736 3497 ts_tablet_manager.cc:1939] T bec4c2ee742e4e6ab5f98fb3a1c36aca P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
I20250831 19:55:00.961161 1430 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet bec4c2ee742e4e6ab5f98fb3a1c36aca (table default.table_13cea908832146dab4b8b794752b1a79 [id=61032a0c11594321b1e4cb5ba3394c18]) successfully deleted
I20250831 19:55:00.979400 2123 catalog_manager.cc:2149] created HMS catalog entry for table [id=53e85e8b37dd4a1eb36c7af9465f7304]
W20250831 19:55:00.980131 2123 catalog_manager.cc:2177] Illegal state: an error occurred while writing to the sys-catalog: replica a4d46bc3ef5a4fbb8c9e4349c86c54a5 is not leader of this config: current role FOLLOWER
I20250831 19:55:00.981346 3430 consensus_queue.cc:1035] T 5fcb923d81a2495fa02dc76ddb9983b7 P 2441fafe1d62429386f4631ad423567d [LEADER]: Connected to new peer: Peer: permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:55:00.981979 1443 catalog_manager.cc:2149] created HMS catalog entry for table [id=86819fd5cdeb4d1bafa01e65ce6300e1]
I20250831 19:55:00.989812 3430 raft_consensus.cc:491] T 644cb7245dcf4097a35de65c2767041a P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:55:00.989944 3430 raft_consensus.cc:513] T 644cb7245dcf4097a35de65c2767041a P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:55:00.990460 3430 leader_election.cc:290] T 644cb7245dcf4097a35de65c2767041a P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:55:00.991003 1634 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "644cb7245dcf4097a35de65c2767041a" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:55:00.991207 1634 raft_consensus.cc:2466] T 644cb7245dcf4097a35de65c2767041a P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 0.
I20250831 19:55:00.991581 1841 leader_election.cc:304] T 644cb7245dcf4097a35de65c2767041a P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:55:00.991945 3430 raft_consensus.cc:2802] T 644cb7245dcf4097a35de65c2767041a P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:55:00.992012 3430 raft_consensus.cc:491] T 644cb7245dcf4097a35de65c2767041a P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:55:00.992063 3430 raft_consensus.cc:3058] T 644cb7245dcf4097a35de65c2767041a P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:55:00.994952 3430 raft_consensus.cc:513] T 644cb7245dcf4097a35de65c2767041a P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:55:00.997053 1771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "644cb7245dcf4097a35de65c2767041a" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:55:00.997242 1771 raft_consensus.cc:2466] T 644cb7245dcf4097a35de65c2767041a P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 0.
I20250831 19:55:00.997601 1634 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "644cb7245dcf4097a35de65c2767041a" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:55:00.997745 1634 raft_consensus.cc:3058] T 644cb7245dcf4097a35de65c2767041a P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:55:00.999920 1634 raft_consensus.cc:2466] T 644cb7245dcf4097a35de65c2767041a P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 1.
I20250831 19:55:01.000236 1841 leader_election.cc:304] T 644cb7245dcf4097a35de65c2767041a P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:55:01.000451 3434 raft_consensus.cc:2802] T 644cb7245dcf4097a35de65c2767041a P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:55:01.000533 3434 raft_consensus.cc:695] T 644cb7245dcf4097a35de65c2767041a P 2441fafe1d62429386f4631ad423567d [term 1 LEADER]: Becoming Leader. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Running, Role: LEADER
I20250831 19:55:01.000727 3434 consensus_queue.cc:237] T 644cb7245dcf4097a35de65c2767041a P 2441fafe1d62429386f4631ad423567d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:55:01.007756 1886 tablet_service.cc:1468] Processing CreateTablet for tablet 26637de652434209aafd5fc15d68146d (DEFAULT_TABLE table=default.table_8df2121e4bed46549eeca09cee50f14b [id=86819fd5cdeb4d1bafa01e65ce6300e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:55:01.008126 1886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26637de652434209aafd5fc15d68146d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:55:01.012599 1443 catalog_manager.cc:5582] T f47cf07c9a4a43048123794e4a51904b P 2441fafe1d62429386f4631ad423567d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2441fafe1d62429386f4631ad423567d (127.1.1.195). New cstate: current_term: 1 leader_uuid: "2441fafe1d62429386f4631ad423567d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: UNKNOWN } } }
I20250831 19:55:01.013759 1748 tablet_service.cc:1468] Processing CreateTablet for tablet 26637de652434209aafd5fc15d68146d (DEFAULT_TABLE table=default.table_8df2121e4bed46549eeca09cee50f14b [id=86819fd5cdeb4d1bafa01e65ce6300e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:55:01.014134 1748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26637de652434209aafd5fc15d68146d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:55:01.014367 1613 tablet_service.cc:1468] Processing CreateTablet for tablet 26637de652434209aafd5fc15d68146d (DEFAULT_TABLE table=default.table_8df2121e4bed46549eeca09cee50f14b [id=86819fd5cdeb4d1bafa01e65ce6300e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:55:01.014721 1613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26637de652434209aafd5fc15d68146d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:55:01.018805 1437 catalog_manager.cc:2149] created HMS catalog entry for table [id=a2e1d51e394b45bdbb816beebada66e9]
I20250831 19:55:01.019922 3501 raft_consensus.cc:491] T 8aeda031e62e46ddbda679ce6b01df00 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:55:01.020018 3501 raft_consensus.cc:513] T 8aeda031e62e46ddbda679ce6b01df00 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:55:01.020937 3501 leader_election.cc:290] T 8aeda031e62e46ddbda679ce6b01df00 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
W20250831 19:55:01.021768 1842 leader_election.cc:343] T 8aeda031e62e46ddbda679ce6b01df00 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): Not found: Tablet not found: 8aeda031e62e46ddbda679ce6b01df00
I20250831 19:55:01.024662 3509 tablet_bootstrap.cc:492] T 26637de652434209aafd5fc15d68146d P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:55:01.024703 1634 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8aeda031e62e46ddbda679ce6b01df00" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:55:01.024856 1634 raft_consensus.cc:2466] T 8aeda031e62e46ddbda679ce6b01df00 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 0.
I20250831 19:55:01.025177 1841 leader_election.cc:304] T 8aeda031e62e46ddbda679ce6b01df00 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters: de831f40fa1348a48a1f0260f4130197
I20250831 19:55:01.025516 3501 raft_consensus.cc:2802] T 8aeda031e62e46ddbda679ce6b01df00 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:55:01.025578 3501 raft_consensus.cc:491] T 8aeda031e62e46ddbda679ce6b01df00 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:55:01.025645 3501 raft_consensus.cc:3058] T 8aeda031e62e46ddbda679ce6b01df00 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:55:01.026156 3509 tablet_bootstrap.cc:654] T 26637de652434209aafd5fc15d68146d P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:55:01.028014 3501 raft_consensus.cc:513] T 8aeda031e62e46ddbda679ce6b01df00 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
W20250831 19:55:01.029492 1842 leader_election.cc:343] T 8aeda031e62e46ddbda679ce6b01df00 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): Not found: Tablet not found: 8aeda031e62e46ddbda679ce6b01df00
I20250831 19:55:01.029636 3501 leader_election.cc:290] T 8aeda031e62e46ddbda679ce6b01df00 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 election: Requested vote from peers 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:55:01.034368 1634 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8aeda031e62e46ddbda679ce6b01df00" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:55:01.034518 1634 raft_consensus.cc:3058] T 8aeda031e62e46ddbda679ce6b01df00 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:55:01.036763 1634 raft_consensus.cc:2466] T 8aeda031e62e46ddbda679ce6b01df00 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 1.
I20250831 19:55:01.037076 1841 leader_election.cc:304] T 8aeda031e62e46ddbda679ce6b01df00 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters: de831f40fa1348a48a1f0260f4130197
I20250831 19:55:01.041126 3434 raft_consensus.cc:2802] T 8aeda031e62e46ddbda679ce6b01df00 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:55:01.041266 3434 raft_consensus.cc:695] T 8aeda031e62e46ddbda679ce6b01df00 P 2441fafe1d62429386f4631ad423567d [term 1 LEADER]: Becoming Leader. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Running, Role: LEADER
I20250831 19:55:01.041536 3434 consensus_queue.cc:237] T 8aeda031e62e46ddbda679ce6b01df00 P 2441fafe1d62429386f4631ad423567d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:55:01.049167 3375 tablet_bootstrap.cc:492] T 26637de652434209aafd5fc15d68146d P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:55:01.050959 3375 tablet_bootstrap.cc:654] T 26637de652434209aafd5fc15d68146d P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:55:01.057798 1443 catalog_manager.cc:5582] T b54e648cf8e04022ad0bc099534424d1 P 2441fafe1d62429386f4631ad423567d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2441fafe1d62429386f4631ad423567d (127.1.1.195). New cstate: current_term: 1 leader_uuid: "2441fafe1d62429386f4631ad423567d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: UNKNOWN } } }
I20250831 19:55:01.058888 1443 catalog_manager.cc:5582] T 5fcb923d81a2495fa02dc76ddb9983b7 P 2441fafe1d62429386f4631ad423567d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2441fafe1d62429386f4631ad423567d (127.1.1.195). New cstate: current_term: 1 leader_uuid: "2441fafe1d62429386f4631ad423567d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: UNKNOWN } } }
I20250831 19:55:01.059703 1443 catalog_manager.cc:5582] T 3667c38e7b8c46ed8205e278c98c4b00 P 2441fafe1d62429386f4631ad423567d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2441fafe1d62429386f4631ad423567d (127.1.1.195). New cstate: current_term: 1 leader_uuid: "2441fafe1d62429386f4631ad423567d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: UNKNOWN } } }
I20250831 19:55:01.061529 1443 catalog_manager.cc:5674] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237) does not have the latest schema for tablet e47844d025bf42ecbfd2d3f34a31538e (table default.table_c7390b7344da4c3fbf7f2f502b096669 [id=1df66f6230794e939a25c0f2254d6e17]). Expected version 2 got 0
I20250831 19:55:01.062325 3375 tablet_bootstrap.cc:492] T 26637de652434209aafd5fc15d68146d P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:55:01.062508 3375 ts_tablet_manager.cc:1397] T 26637de652434209aafd5fc15d68146d P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.013s user 0.010s sys 0.000s
I20250831 19:55:01.062932 1443 catalog_manager.cc:5674] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237) does not have the latest schema for tablet 5a080bbabe8840c3ba954bdc0626dc39 (table default.table_492565dabb704c25b9c4d1849bcb8eeb [id=1c606e303bbe40afaf2ec496b8680b4c]). Expected version 1 got 0
I20250831 19:55:01.063369 3375 raft_consensus.cc:357] T 26637de652434209aafd5fc15d68146d P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:55:01.063580 3375 raft_consensus.cc:383] T 26637de652434209aafd5fc15d68146d P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:55:01.063668 3375 raft_consensus.cc:738] T 26637de652434209aafd5fc15d68146d P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:55:01.063906 3375 consensus_queue.cc:260] T 26637de652434209aafd5fc15d68146d P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:55:01.064404 1443 catalog_manager.cc:5674] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237) does not have the latest schema for tablet b0d177e2e2f745b8969b65ab318321a1 (table default.table_2f8e5422042942d6a683316fbd7ac45d [id=30b1e9d6cb5e486fbed42ac06053ebc3]). Expected version 1 got 0
I20250831 19:55:01.065671 3430 leader_election.cc:290] T 644cb7245dcf4097a35de65c2767041a P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 election: Requested vote from peers 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:55:01.067101 1771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "644cb7245dcf4097a35de65c2767041a" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197"
I20250831 19:55:01.067250 1771 raft_consensus.cc:3058] T 644cb7245dcf4097a35de65c2767041a P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:55:01.068887 3373 tablet_bootstrap.cc:492] T 26637de652434209aafd5fc15d68146d P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:55:01.069914 1771 raft_consensus.cc:2466] T 644cb7245dcf4097a35de65c2767041a P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 1.
I20250831 19:55:01.070230 3373 tablet_bootstrap.cc:654] T 26637de652434209aafd5fc15d68146d P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:55:01.072376 3375 ts_tablet_manager.cc:1428] T 26637de652434209aafd5fc15d68146d P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.010s user 0.001s sys 0.000s
I20250831 19:55:01.092183 1679 heartbeater.cc:499] Master 127.1.1.252:35943 was elected leader, sending a full tablet report...
I20250831 19:55:01.093082 3509 tablet_bootstrap.cc:492] T 26637de652434209aafd5fc15d68146d P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:55:01.093217 3509 ts_tablet_manager.cc:1397] T 26637de652434209aafd5fc15d68146d P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.069s user 0.007s sys 0.009s
I20250831 19:55:01.099041 3373 tablet_bootstrap.cc:492] T 26637de652434209aafd5fc15d68146d P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:55:01.099172 3373 ts_tablet_manager.cc:1397] T 26637de652434209aafd5fc15d68146d P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.030s user 0.003s sys 0.005s
I20250831 19:55:01.099814 3373 raft_consensus.cc:357] T 26637de652434209aafd5fc15d68146d P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:55:01.099975 3373 raft_consensus.cc:383] T 26637de652434209aafd5fc15d68146d P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:55:01.100029 3373 raft_consensus.cc:738] T 26637de652434209aafd5fc15d68146d P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:55:01.100260 3373 consensus_queue.cc:260] T 26637de652434209aafd5fc15d68146d P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:55:01.102805 1613 tablet_service.cc:1468] Processing CreateTablet for tablet f0f12cd5b1354e73990c0cced8e29fd8 (DEFAULT_TABLE table=default.table_c0b1a771fbef4422a91422a51e5dc1f6 [id=a2e1d51e394b45bdbb816beebada66e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:55:01.103190 1613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0f12cd5b1354e73990c0cced8e29fd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:55:01.104028 3509 raft_consensus.cc:357] T 26637de652434209aafd5fc15d68146d P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:55:01.104202 3509 raft_consensus.cc:383] T 26637de652434209aafd5fc15d68146d P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:55:01.104249 3509 raft_consensus.cc:738] T 26637de652434209aafd5fc15d68146d P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:55:01.104400 3509 consensus_queue.cc:260] T 26637de652434209aafd5fc15d68146d P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:55:01.106841 1748 tablet_service.cc:1468] Processing CreateTablet for tablet f0f12cd5b1354e73990c0cced8e29fd8 (DEFAULT_TABLE table=default.table_c0b1a771fbef4422a91422a51e5dc1f6 [id=a2e1d51e394b45bdbb816beebada66e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:55:01.107236 1748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0f12cd5b1354e73990c0cced8e29fd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:55:01.108975 1886 tablet_service.cc:1468] Processing CreateTablet for tablet f0f12cd5b1354e73990c0cced8e29fd8 (DEFAULT_TABLE table=default.table_c0b1a771fbef4422a91422a51e5dc1f6 [id=a2e1d51e394b45bdbb816beebada66e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:55:01.109330 1886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0f12cd5b1354e73990c0cced8e29fd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:55:01.112823 3375 tablet_bootstrap.cc:492] T f0f12cd5b1354e73990c0cced8e29fd8 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:55:01.114200 3375 tablet_bootstrap.cc:654] T f0f12cd5b1354e73990c0cced8e29fd8 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:55:01.114178 1437 catalog_manager.cc:5582] T bddbec77b8444036b0c5e8d325faceaa P de831f40fa1348a48a1f0260f4130197 reported cstate change: term changed from 0 to 1, leader changed from <none> to de831f40fa1348a48a1f0260f4130197 (127.1.1.194). New cstate: current_term: 1 leader_uuid: "de831f40fa1348a48a1f0260f4130197" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: UNKNOWN } } }
I20250831 19:55:01.114969 1437 catalog_manager.cc:5674] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475) does not have the latest schema for tablet 644cb7245dcf4097a35de65c2767041a (table default.table_617124885d2e4d96b863e0e435bdf695 [id=0fc929ad819b48a9af984f8c301bad2b]). Expected version 2 got 0
I20250831 19:55:01.115296 1437 catalog_manager.cc:5582] T a5e30fe82a41499caa5e79fa1560c1be P de831f40fa1348a48a1f0260f4130197 reported cstate change: term changed from 0 to 1, leader changed from <none> to de831f40fa1348a48a1f0260f4130197 (127.1.1.194). New cstate: current_term: 1 leader_uuid: "de831f40fa1348a48a1f0260f4130197" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: UNKNOWN } } }
I20250831 19:55:01.117895 3509 ts_tablet_manager.cc:1428] T 26637de652434209aafd5fc15d68146d P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.025s user 0.000s sys 0.002s
I20250831 19:55:01.118623 3373 ts_tablet_manager.cc:1428] T 26637de652434209aafd5fc15d68146d P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.019s user 0.001s sys 0.001s
I20250831 19:55:01.120273 3509 tablet_bootstrap.cc:492] T f0f12cd5b1354e73990c0cced8e29fd8 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:55:01.129034 3373 tablet_bootstrap.cc:492] T f0f12cd5b1354e73990c0cced8e29fd8 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:55:01.130527 3373 tablet_bootstrap.cc:654] T f0f12cd5b1354e73990c0cced8e29fd8 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:55:01.133713 3509 tablet_bootstrap.cc:654] T f0f12cd5b1354e73990c0cced8e29fd8 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:55:01.136288 3295 raft_consensus.cc:491] T 26637de652434209aafd5fc15d68146d P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:55:01.136416 3295 raft_consensus.cc:513] T 26637de652434209aafd5fc15d68146d P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:55:01.137101 3295 leader_election.cc:290] T 26637de652434209aafd5fc15d68146d P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:55:01.137760 1904 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "26637de652434209aafd5fc15d68146d" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:55:01.137949 1904 raft_consensus.cc:2466] T 26637de652434209aafd5fc15d68146d P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 0.
I20250831 19:55:01.138464 1705 leader_election.cc:304] T 26637de652434209aafd5fc15d68146d P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:55:01.138758 3295 raft_consensus.cc:2802] T 26637de652434209aafd5fc15d68146d P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:55:01.138830 3295 raft_consensus.cc:491] T 26637de652434209aafd5fc15d68146d P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:55:01.138899 3295 raft_consensus.cc:3058] T 26637de652434209aafd5fc15d68146d P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:55:01.141237 3295 raft_consensus.cc:513] T 26637de652434209aafd5fc15d68146d P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:55:01.141556 3375 tablet_bootstrap.cc:492] T f0f12cd5b1354e73990c0cced8e29fd8 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:55:01.141683 3375 ts_tablet_manager.cc:1397] T f0f12cd5b1354e73990c0cced8e29fd8 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.029s user 0.001s sys 0.008s
I20250831 19:55:01.142045 1631 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "26637de652434209aafd5fc15d68146d" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:55:01.142227 1631 raft_consensus.cc:2466] T 26637de652434209aafd5fc15d68146d P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 0.
I20250831 19:55:01.142514 1904 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "26637de652434209aafd5fc15d68146d" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:55:01.142657 1904 raft_consensus.cc:3058] T 26637de652434209aafd5fc15d68146d P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:55:01.142586 3375 raft_consensus.cc:357] T f0f12cd5b1354e73990c0cced8e29fd8 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:55:01.142724 3375 raft_consensus.cc:383] T f0f12cd5b1354e73990c0cced8e29fd8 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:55:01.142771 3375 raft_consensus.cc:738] T f0f12cd5b1354e73990c0cced8e29fd8 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:55:01.145032 1904 raft_consensus.cc:2466] T 26637de652434209aafd5fc15d68146d P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:55:01.145597 1705 leader_election.cc:304] T 26637de652434209aafd5fc15d68146d P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:55:01.145866 3352 raft_consensus.cc:2802] T 26637de652434209aafd5fc15d68146d P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:55:01.145977 3352 raft_consensus.cc:695] T 26637de652434209aafd5fc15d68146d P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: Becoming Leader. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Running, Role: LEADER
I20250831 19:55:01.146616 3352 consensus_queue.cc:237] T 26637de652434209aafd5fc15d68146d P de831f40fa1348a48a1f0260f4130197 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
W20250831 19:55:01.146641 1437 catalog_manager.cc:5774] Failed to send AlterTable RPC for tablet 644cb7245dcf4097a35de65c2767041a (table default.table_617124885d2e4d96b863e0e435bdf695 [id=0fc929ad819b48a9af984f8c301bad2b], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet 644cb7245dcf4097a35de65c2767041a consensus state has no leader
I20250831 19:55:01.147312 1748 tablet_service.cc:1515] Processing DeleteTablet for tablet 8aeda031e62e46ddbda679ce6b01df00 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:55:00 UTC) from {username='slave'} at 127.0.0.1:50662
I20250831 19:55:01.147768 3295 leader_election.cc:290] T 26637de652434209aafd5fc15d68146d P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Requested vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
W20250831 19:55:01.148034 1430 catalog_manager.cc:4895] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): delete failed for tablet 8aeda031e62e46ddbda679ce6b01df00 because the tablet was not found. No further retry: Not found: Tablet not found: 8aeda031e62e46ddbda679ce6b01df00
I20250831 19:55:01.148171 1631 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "26637de652434209aafd5fc15d68146d" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:55:01.148418 1631 raft_consensus.cc:3058] T 26637de652434209aafd5fc15d68146d P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:55:01.148612 3373 tablet_bootstrap.cc:492] T f0f12cd5b1354e73990c0cced8e29fd8 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:55:01.148738 3373 ts_tablet_manager.cc:1397] T f0f12cd5b1354e73990c0cced8e29fd8 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.020s user 0.004s sys 0.000s
I20250831 19:55:01.149350 3373 raft_consensus.cc:357] T f0f12cd5b1354e73990c0cced8e29fd8 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:55:01.149510 3373 raft_consensus.cc:383] T f0f12cd5b1354e73990c0cced8e29fd8 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:55:01.149565 3373 raft_consensus.cc:738] T f0f12cd5b1354e73990c0cced8e29fd8 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:55:01.149752 3373 consensus_queue.cc:260] T f0f12cd5b1354e73990c0cced8e29fd8 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:55:01.150153 3373 ts_tablet_manager.cc:1428] T f0f12cd5b1354e73990c0cced8e29fd8 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250831 19:55:01.151532 1631 raft_consensus.cc:2466] T 26637de652434209aafd5fc15d68146d P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:55:01.152724 3509 tablet_bootstrap.cc:492] T f0f12cd5b1354e73990c0cced8e29fd8 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:55:01.153081 3509 ts_tablet_manager.cc:1397] T f0f12cd5b1354e73990c0cced8e29fd8 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.033s user 0.001s sys 0.003s
I20250831 19:55:01.153731 3509 raft_consensus.cc:357] T f0f12cd5b1354e73990c0cced8e29fd8 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:55:01.163080 1817 heartbeater.cc:499] Master 127.1.1.252:35943 was elected leader, sending a full tablet report...
I20250831 19:55:01.169663 1886 tablet_service.cc:1515] Processing DeleteTablet for tablet 8fb7abc5581e4a16a55f844acd5fd2e9 with delete_type TABLET_DATA_DELETED (replaced by tablet 2c57c6e3bf0c4ffaa30abb7e800a3bea) from {username='slave'} at 127.0.0.1:45900
I20250831 19:55:01.170730 3434 consensus_queue.cc:1035] T 84177615877240688a2d4b3b88915525 P 2441fafe1d62429386f4631ad423567d [LEADER]: Connected to new peer: Peer: permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250831 19:55:01.171023 1428 catalog_manager.cc:4895] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): delete failed for tablet 8fb7abc5581e4a16a55f844acd5fd2e9 because the tablet was not found. No further retry: Not found: Tablet not found: 8fb7abc5581e4a16a55f844acd5fd2e9
I20250831 19:55:01.145599 3375 consensus_queue.cc:260] T f0f12cd5b1354e73990c0cced8e29fd8 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:55:01.174073 1886 tablet_service.cc:1515] Processing DeleteTablet for tablet 4be6edd110374d2bb941e26defc7302f with delete_type TABLET_DATA_DELETED (replaced by tablet 644cb7245dcf4097a35de65c2767041a) from {username='slave'} at 127.0.0.1:45900
I20250831 19:55:01.174381 1885 tablet_service.cc:1515] Processing DeleteTablet for tablet e6438652703c45d691f528a4322767b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:55:00 UTC) from {username='slave'} at 127.0.0.1:45900
W20250831 19:55:01.177066 1428 catalog_manager.cc:4895] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): delete failed for tablet e6438652703c45d691f528a4322767b9 because the tablet was not found. No further retry: Not found: Tablet not found: e6438652703c45d691f528a4322767b9
W20250831 19:55:01.177302 1443 catalog_manager.cc:5774] Failed to send AlterTable RPC for tablet e47844d025bf42ecbfd2d3f34a31538e (table default.table_c7390b7344da4c3fbf7f2f502b096669 [id=1df66f6230794e939a25c0f2254d6e17], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet e47844d025bf42ecbfd2d3f34a31538e consensus state has no leader
I20250831 19:55:01.177734 1884 tablet_service.cc:1515] Processing DeleteTablet for tablet 701cef9d6fd04a99986b871760397f1e with delete_type TABLET_DATA_DELETED (replaced by tablet 8aeda031e62e46ddbda679ce6b01df00) from {username='slave'} at 127.0.0.1:45900
I20250831 19:55:01.177896 1885 tablet_service.cc:1515] Processing DeleteTablet for tablet 2a20faaf76fe4806b47e5ac80ccf5915 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:55:00 UTC) from {username='slave'} at 127.0.0.1:45900
W20250831 19:55:01.178526 1428 catalog_manager.cc:4895] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): delete failed for tablet 701cef9d6fd04a99986b871760397f1e because the tablet was not found. No further retry: Not found: Tablet not found: 701cef9d6fd04a99986b871760397f1e
W20250831 19:55:01.178721 1428 catalog_manager.cc:4895] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): delete failed for tablet 2a20faaf76fe4806b47e5ac80ccf5915 because the tablet was not found. No further retry: Not found: Tablet not found: 2a20faaf76fe4806b47e5ac80ccf5915
I20250831 19:55:01.178717 1885 tablet_service.cc:1515] Processing DeleteTablet for tablet bec4c2ee742e4e6ab5f98fb3a1c36aca with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:55:00 UTC) from {username='slave'} at 127.0.0.1:45900
W20250831 19:55:01.179226 1428 catalog_manager.cc:4895] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): delete failed for tablet bec4c2ee742e4e6ab5f98fb3a1c36aca because the tablet was not found. No further retry: Not found: Tablet not found: bec4c2ee742e4e6ab5f98fb3a1c36aca
W20250831 19:55:01.179665 1428 catalog_manager.cc:4895] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): delete failed for tablet 4be6edd110374d2bb941e26defc7302f because the tablet was not found. No further retry: Not found: Tablet not found: 4be6edd110374d2bb941e26defc7302f
I20250831 19:55:01.180400 1886 tablet_service.cc:1515] Processing DeleteTablet for tablet f3ea6c8b0bf64d8b86dc96dc1abe0934 with delete_type TABLET_DATA_DELETED (replaced by tablet 9c19b3ec9e844963a8392f0a2a97e25e) from {username='slave'} at 127.0.0.1:45900
W20250831 19:55:01.180891 1428 catalog_manager.cc:4895] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): delete failed for tablet f3ea6c8b0bf64d8b86dc96dc1abe0934 because the tablet was not found. No further retry: Not found: Tablet not found: f3ea6c8b0bf64d8b86dc96dc1abe0934
I20250831 19:55:01.181864 3375 ts_tablet_manager.cc:1428] T f0f12cd5b1354e73990c0cced8e29fd8 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.040s user 0.001s sys 0.001s
I20250831 19:55:01.171110 3355 raft_consensus.cc:491] T 2c57c6e3bf0c4ffaa30abb7e800a3bea P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:55:01.182070 3509 raft_consensus.cc:383] T f0f12cd5b1354e73990c0cced8e29fd8 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:55:01.182142 3509 raft_consensus.cc:738] T f0f12cd5b1354e73990c0cced8e29fd8 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:55:01.182114 3355 raft_consensus.cc:513] T 2c57c6e3bf0c4ffaa30abb7e800a3bea P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:55:01.182654 3355 leader_election.cc:290] T 2c57c6e3bf0c4ffaa30abb7e800a3bea P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237)
I20250831 19:55:01.183243 1769 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2c57c6e3bf0c4ffaa30abb7e800a3bea" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:55:01.183390 1769 raft_consensus.cc:2466] T 2c57c6e3bf0c4ffaa30abb7e800a3bea P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 0.
I20250831 19:55:01.183969 1570 leader_election.cc:304] T 2c57c6e3bf0c4ffaa30abb7e800a3bea P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:55:01.184500 1904 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2c57c6e3bf0c4ffaa30abb7e800a3bea" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:55:01.184655 1904 raft_consensus.cc:2466] T 2c57c6e3bf0c4ffaa30abb7e800a3bea P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 0.
I20250831 19:55:01.185178 3355 raft_consensus.cc:2802] T 2c57c6e3bf0c4ffaa30abb7e800a3bea P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:55:01.185248 3355 raft_consensus.cc:491] T 2c57c6e3bf0c4ffaa30abb7e800a3bea P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:55:01.185297 3355 raft_consensus.cc:3058] T 2c57c6e3bf0c4ffaa30abb7e800a3bea P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:55:01.185212 3509 consensus_queue.cc:260] T f0f12cd5b1354e73990c0cced8e29fd8 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:55:01.185725 3509 ts_tablet_manager.cc:1428] T f0f12cd5b1354e73990c0cced8e29fd8 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.033s user 0.001s sys 0.000s
W20250831 19:55:01.187685 1430 catalog_manager.cc:4726] Async tablet task AlterTable RPC for tablet 644cb7245dcf4097a35de65c2767041a (table default.table_617124885d2e4d96b863e0e435bdf695 [id=0fc929ad819b48a9af984f8c301bad2b], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 644cb7245dcf4097a35de65c2767041a consensus state has no leader
I20250831 19:55:01.187637 3355 raft_consensus.cc:513] T 2c57c6e3bf0c4ffaa30abb7e800a3bea P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:55:01.189756 1769 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2c57c6e3bf0c4ffaa30abb7e800a3bea" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197"
I20250831 19:55:01.189898 1769 raft_consensus.cc:3058] T 2c57c6e3bf0c4ffaa30abb7e800a3bea P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:55:01.192116 1769 raft_consensus.cc:2466] T 2c57c6e3bf0c4ffaa30abb7e800a3bea P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1.
I20250831 19:55:01.192523 1570 leader_election.cc:304] T 2c57c6e3bf0c4ffaa30abb7e800a3bea P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:55:01.192649 1435 catalog_manager.cc:2706] deleted HMS catalog entry for table default.table_c48f1c99f3174cb8acca698339447ed9 [id=f707909e6af44750a5fc5e3b15af0b24]
I20250831 19:55:01.192798 3464 raft_consensus.cc:2802] T 2c57c6e3bf0c4ffaa30abb7e800a3bea P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:55:01.192898 3464 raft_consensus.cc:695] T 2c57c6e3bf0c4ffaa30abb7e800a3bea P 89aa85d59c53436ebdf3074b13d14825 [term 1 LEADER]: Becoming Leader. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Running, Role: LEADER
I20250831 19:55:01.193090 3464 consensus_queue.cc:237] T 2c57c6e3bf0c4ffaa30abb7e800a3bea P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:55:01.195523 1904 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2c57c6e3bf0c4ffaa30abb7e800a3bea" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:55:01.195657 1904 raft_consensus.cc:3058] T 2c57c6e3bf0c4ffaa30abb7e800a3bea P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:55:01.195827 2120 catalog_manager.cc:2159] deleted orphaned HMS catalog entry for table [id=ee1df8f0a3e64e2684bb9cfde377d9f6]
I20250831 19:55:01.196154 2120 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:36958 (request call id 214) took 2395 ms. Trace:
I20250831 19:55:01.196231 2120 rpcz_store.cc:276] 0831 19:54:58.800386 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:59.622013 (+821627us) service_pool.cc:225] Handling call
0831 19:55:00.261512 (+639499us) catalog_manager.cc:2076] Acquired catalog manager lock
0831 19:55:00.261983 (+ 471us) catalog_manager.cc:2122] Created new table and tablet info
0831 19:55:00.358517 (+ 96534us) catalog_manager.cc:2148] Created new table in HMS catalog
0831 19:55:00.359367 (+ 850us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:55:00.359372 (+ 5us) write_op.cc:454] Released schema lock
0831 19:55:00.359631 (+ 259us) catalog_manager.cc:2156] Rolling back HMS table creation
0831 19:55:01.196093 (+836462us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:55:00.359287 (+ 0us) op_driver.cc:389] HandleFailure(Illegal state: replica a4d46bc3ef5a4fbb8c9e4349c86c54a5 is not leader of this config: current role FOLLOWER)
0831 19:55:00.359301 (+ 14us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:55:00.359308 (+ 7us) write_op.cc:454] Released schema lock
0831 19:55:00.359314 (+ 6us) write_op.cc:335] FINISH: Op aborted
Metrics: {"Hive Metastore.queue_time_us":673532,"Hive Metastore.run_cpu_time_us":440,"Hive Metastore.run_wall_time_us":258692,"child_traces":[["op",{}]]}
I20250831 19:55:01.197289 1437 catalog_manager.cc:5582] T bd2f43a6cd1d4782a420fe5e4e110ead P 89aa85d59c53436ebdf3074b13d14825 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193). New cstate: current_term: 1 leader_uuid: "89aa85d59c53436ebdf3074b13d14825" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: HEALTHY } } }
I20250831 19:55:01.197969 1904 raft_consensus.cc:2466] T 2c57c6e3bf0c4ffaa30abb7e800a3bea P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1.
I20250831 19:55:01.197923 1437 catalog_manager.cc:5582] T 1ea70a674686459d88265f5f5524fc10 P 89aa85d59c53436ebdf3074b13d14825 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193). New cstate: current_term: 1 leader_uuid: "89aa85d59c53436ebdf3074b13d14825" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: HEALTHY } } }
I20250831 19:55:01.198390 3355 leader_election.cc:290] T 2c57c6e3bf0c4ffaa30abb7e800a3bea P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Requested vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237)
I20250831 19:55:01.198608 1437 catalog_manager.cc:5582] T e47844d025bf42ecbfd2d3f34a31538e P 89aa85d59c53436ebdf3074b13d14825 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193). New cstate: current_term: 1 leader_uuid: "89aa85d59c53436ebdf3074b13d14825" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: HEALTHY } } }
I20250831 19:55:01.198932 1437 catalog_manager.cc:5674] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197) does not have the latest schema for tablet e47844d025bf42ecbfd2d3f34a31538e (table default.table_c7390b7344da4c3fbf7f2f502b096669 [id=1df66f6230794e939a25c0f2254d6e17]). Expected version 2 got 0
I20250831 19:55:01.199460 1437 catalog_manager.cc:5674] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197) does not have the latest schema for tablet 644cb7245dcf4097a35de65c2767041a (table default.table_617124885d2e4d96b863e0e435bdf695 [id=0fc929ad819b48a9af984f8c301bad2b]). Expected version 2 got 0
I20250831 19:55:01.206053 3352 consensus_queue.cc:1035] T bddbec77b8444036b0c5e8d325faceaa P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:55:01.216367 3534 tablet.cc:1722] T e47844d025bf42ecbfd2d3f34a31538e P 89aa85d59c53436ebdf3074b13d14825: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250831 19:55:01.217516 1443 catalog_manager.cc:5582] T 26637de652434209aafd5fc15d68146d P de831f40fa1348a48a1f0260f4130197 reported cstate change: term changed from 0 to 1, leader changed from <none> to de831f40fa1348a48a1f0260f4130197 (127.1.1.194). New cstate: current_term: 1 leader_uuid: "de831f40fa1348a48a1f0260f4130197" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: HEALTHY } } }
I20250831 19:55:01.221020 3530 tablet.cc:1722] T e47844d025bf42ecbfd2d3f34a31538e P de831f40fa1348a48a1f0260f4130197: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20250831 19:55:01.225167 2101 catalog_manager.cc:4726] Async tablet task AlterTable RPC for tablet e47844d025bf42ecbfd2d3f34a31538e (table default.table_c7390b7344da4c3fbf7f2f502b096669 [id=1df66f6230794e939a25c0f2254d6e17], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet e47844d025bf42ecbfd2d3f34a31538e consensus state has no leader
I20250831 19:55:01.225919 3434 consensus_queue.cc:1035] T b54e648cf8e04022ad0bc099534424d1 P 2441fafe1d62429386f4631ad423567d [LEADER]: Connected to new peer: Peer: permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:55:01.231070 2943 consensus_queue.cc:1035] T bddbec77b8444036b0c5e8d325faceaa P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:55:01.247375 1443 catalog_manager.cc:5674] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475) does not have the latest schema for tablet e47844d025bf42ecbfd2d3f34a31538e (table default.table_c7390b7344da4c3fbf7f2f502b096669 [id=1df66f6230794e939a25c0f2254d6e17]). Expected version 2 got 0
I20250831 19:55:01.247970 1443 catalog_manager.cc:5674] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475) does not have the latest schema for tablet 644cb7245dcf4097a35de65c2767041a (table default.table_617124885d2e4d96b863e0e435bdf695 [id=0fc929ad819b48a9af984f8c301bad2b]). Expected version 2 got 0
I20250831 19:55:01.255676 1437 catalog_manager.cc:6127] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220: default.table_492565dabb704c25b9c4d1849bcb8eeb [id=1c606e303bbe40afaf2ec496b8680b4c] alter complete (version 1)
I20250831 19:55:01.257951 3434 consensus_queue.cc:1035] T 84177615877240688a2d4b3b88915525 P 2441fafe1d62429386f4631ad423567d [LEADER]: Connected to new peer: Peer: permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:55:01.263522 3566 tablet.cc:1722] T e47844d025bf42ecbfd2d3f34a31538e P 2441fafe1d62429386f4631ad423567d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250831 19:55:01.271816 1437 catalog_manager.cc:6127] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220: default.table_2f8e5422042942d6a683316fbd7ac45d [id=30b1e9d6cb5e486fbed42ac06053ebc3] alter complete (version 1)
I20250831 19:55:01.272732 1613 tablet_service.cc:1515] Processing DeleteTablet for tablet 8aeda031e62e46ddbda679ce6b01df00 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:55:00 UTC) from {username='slave'} at 127.0.0.1:51018
I20250831 19:55:01.272982 3498 tablet_replica.cc:331] T 8aeda031e62e46ddbda679ce6b01df00 P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:55:01.273159 3498 raft_consensus.cc:2241] T 8aeda031e62e46ddbda679ce6b01df00 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:55:01.273279 3498 raft_consensus.cc:2270] T 8aeda031e62e46ddbda679ce6b01df00 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:55:01.274345 3498 ts_tablet_manager.cc:1905] T 8aeda031e62e46ddbda679ce6b01df00 P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:55:01.279876 3498 ts_tablet_manager.cc:1918] T 8aeda031e62e46ddbda679ce6b01df00 P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250831 19:55:01.280045 3498 log.cc:1199] T 8aeda031e62e46ddbda679ce6b01df00 P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/8aeda031e62e46ddbda679ce6b01df00
I20250831 19:55:01.280404 3498 ts_tablet_manager.cc:1939] T 8aeda031e62e46ddbda679ce6b01df00 P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
I20250831 19:55:01.281541 1429 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet 8aeda031e62e46ddbda679ce6b01df00 (table default.table_0498f784ecd944168cd0cbd019307408 [id=003066b121574814b254d138ec66c64c]) successfully deleted
I20250831 19:55:01.285714 3501 consensus_queue.cc:1035] T b54e648cf8e04022ad0bc099534424d1 P 2441fafe1d62429386f4631ad423567d [LEADER]: Connected to new peer: Peer: permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:55:01.290810 1442 catalog_manager.cc:2149] created HMS catalog entry for table [id=7ad45cd85b694203b15bae99967c8b19]
I20250831 19:55:01.324975 1437 catalog_manager.cc:5582] T 644cb7245dcf4097a35de65c2767041a P 2441fafe1d62429386f4631ad423567d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2441fafe1d62429386f4631ad423567d (127.1.1.195). New cstate: current_term: 1 leader_uuid: "2441fafe1d62429386f4631ad423567d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: HEALTHY } } }
I20250831 19:55:01.325374 1437 catalog_manager.cc:5674] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237) does not have the latest schema for tablet 644cb7245dcf4097a35de65c2767041a (table default.table_617124885d2e4d96b863e0e435bdf695 [id=0fc929ad819b48a9af984f8c301bad2b]). Expected version 2 got 0
I20250831 19:55:01.325716 1437 catalog_manager.cc:5674] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237) does not have the latest schema for tablet e47844d025bf42ecbfd2d3f34a31538e (table default.table_c7390b7344da4c3fbf7f2f502b096669 [id=1df66f6230794e939a25c0f2254d6e17]). Expected version 2 got 0
I20250831 19:55:01.330754 1443 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51254:
name: "default.Table_e3b5fcc868e34263984dd116c032f2ac"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:55:01.339264 2123 catalog_manager.cc:2159] deleted orphaned HMS catalog entry for table [id=53e85e8b37dd4a1eb36c7af9465f7304]
I20250831 19:55:01.339541 2123 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:36958 (request call id 213) took 2677 ms. Trace:
I20250831 19:55:01.339641 2123 rpcz_store.cc:276] 0831 19:54:58.661730 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:54:59.608754 (+947024us) service_pool.cc:225] Handling call
0831 19:55:00.266306 (+657552us) catalog_manager.cc:2076] Acquired catalog manager lock
0831 19:55:00.266733 (+ 427us) catalog_manager.cc:2122] Created new table and tablet info
0831 19:55:00.979348 (+712615us) catalog_manager.cc:2148] Created new table in HMS catalog
0831 19:55:00.980029 (+ 681us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:55:00.980032 (+ 3us) write_op.cc:454] Released schema lock
0831 19:55:00.980211 (+ 179us) catalog_manager.cc:2156] Rolling back HMS table creation
0831 19:55:01.339511 (+359300us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:55:00.979959 (+ 0us) op_driver.cc:389] HandleFailure(Illegal state: replica a4d46bc3ef5a4fbb8c9e4349c86c54a5 is not leader of this config: current role FOLLOWER)
0831 19:55:00.979970 (+ 11us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:55:00.979977 (+ 7us) write_op.cc:454] Released schema lock
0831 19:55:00.979981 (+ 4us) write_op.cc:335] FINISH: Op aborted
Metrics: {"Hive Metastore.queue_time_us":828499,"Hive Metastore.run_cpu_time_us":397,"Hive Metastore.run_wall_time_us":242516,"child_traces":[["op",{}]]}
W20250831 19:55:01.340426 1958 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.1.1.252:35943)
I20250831 19:55:01.341637 3355 consensus_queue.cc:1035] T 1ea70a674686459d88265f5f5524fc10 P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:55:01.349258 1771 raft_consensus.cc:1273] T 644cb7245dcf4097a35de65c2767041a P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Refusing update from remote peer 2441fafe1d62429386f4631ad423567d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250831 19:55:01.349478 1634 raft_consensus.cc:1273] T 644cb7245dcf4097a35de65c2767041a P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Refusing update from remote peer 2441fafe1d62429386f4631ad423567d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250831 19:55:01.350093 3430 consensus_queue.cc:1035] T 644cb7245dcf4097a35de65c2767041a P 2441fafe1d62429386f4631ad423567d [LEADER]: Connected to new peer: Peer: permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:55:01.350464 3430 consensus_queue.cc:1035] T 644cb7245dcf4097a35de65c2767041a P 2441fafe1d62429386f4631ad423567d [LEADER]: Connected to new peer: Peer: permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:55:01.352777 3355 raft_consensus.cc:491] T 9c19b3ec9e844963a8392f0a2a97e25e P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:55:01.352896 3355 raft_consensus.cc:513] T 9c19b3ec9e844963a8392f0a2a97e25e P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:55:01.353524 3355 leader_election.cc:290] T 9c19b3ec9e844963a8392f0a2a97e25e P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237)
I20250831 19:55:01.353680 3355 consensus_queue.cc:1035] T 1ea70a674686459d88265f5f5524fc10 P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:55:01.355156 1906 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9c19b3ec9e844963a8392f0a2a97e25e" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:55:01.355307 1906 raft_consensus.cc:2466] T 9c19b3ec9e844963a8392f0a2a97e25e P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 0.
I20250831 19:55:01.355468 1769 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9c19b3ec9e844963a8392f0a2a97e25e" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:55:01.355610 1769 raft_consensus.cc:2466] T 9c19b3ec9e844963a8392f0a2a97e25e P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 0.
I20250831 19:55:01.355691 1568 leader_election.cc:304] T 9c19b3ec9e844963a8392f0a2a97e25e P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:55:01.355929 3464 raft_consensus.cc:2802] T 9c19b3ec9e844963a8392f0a2a97e25e P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:55:01.355988 3464 raft_consensus.cc:491] T 9c19b3ec9e844963a8392f0a2a97e25e P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:55:01.356040 3464 raft_consensus.cc:3058] T 9c19b3ec9e844963a8392f0a2a97e25e P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:55:01.358144 1748 tablet_service.cc:1468] Processing CreateTablet for tablet 8aa9b1c1435545d7a212b2e97e7a2931 (DEFAULT_TABLE table=default.table_87e693c7c4a14344a2fe8a792457842d [id=7ad45cd85b694203b15bae99967c8b19]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:55:01.358479 1748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8aa9b1c1435545d7a212b2e97e7a2931. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:55:01.358562 3464 raft_consensus.cc:513] T 9c19b3ec9e844963a8392f0a2a97e25e P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:55:01.359330 3464 leader_election.cc:290] T 9c19b3ec9e844963a8392f0a2a97e25e P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Requested vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237)
I20250831 19:55:01.360091 1886 tablet_service.cc:1468] Processing CreateTablet for tablet 8aa9b1c1435545d7a212b2e97e7a2931 (DEFAULT_TABLE table=default.table_87e693c7c4a14344a2fe8a792457842d [id=7ad45cd85b694203b15bae99967c8b19]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:55:01.360404 1886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8aa9b1c1435545d7a212b2e97e7a2931. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:55:01.357344 1442 catalog_manager.cc:5582] T 2c57c6e3bf0c4ffaa30abb7e800a3bea P 89aa85d59c53436ebdf3074b13d14825 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193). New cstate: current_term: 1 leader_uuid: "89aa85d59c53436ebdf3074b13d14825" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } }
I20250831 19:55:01.359470 1613 tablet_service.cc:1468] Processing CreateTablet for tablet 8aa9b1c1435545d7a212b2e97e7a2931 (DEFAULT_TABLE table=default.table_87e693c7c4a14344a2fe8a792457842d [id=7ad45cd85b694203b15bae99967c8b19]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:55:01.365631 1613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8aa9b1c1435545d7a212b2e97e7a2931. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:55:01.373539 1902 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9c19b3ec9e844963a8392f0a2a97e25e" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:55:01.373734 1902 raft_consensus.cc:3058] T 9c19b3ec9e844963a8392f0a2a97e25e P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:55:01.374969 1769 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9c19b3ec9e844963a8392f0a2a97e25e" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197"
I20250831 19:55:01.375123 1769 raft_consensus.cc:3058] T 9c19b3ec9e844963a8392f0a2a97e25e P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:55:01.375712 1442 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51254:
name: "default.Table_a9e5115b40204ad6afb299f06aa717a2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:55:01.376152 1902 raft_consensus.cc:2466] T 9c19b3ec9e844963a8392f0a2a97e25e P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1.
I20250831 19:55:01.377223 1769 raft_consensus.cc:2466] T 9c19b3ec9e844963a8392f0a2a97e25e P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1.
I20250831 19:55:01.378258 1568 leader_election.cc:304] T 9c19b3ec9e844963a8392f0a2a97e25e P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:55:01.378427 3375 tablet_bootstrap.cc:492] T 8aa9b1c1435545d7a212b2e97e7a2931 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:55:01.378518 3466 raft_consensus.cc:2802] T 9c19b3ec9e844963a8392f0a2a97e25e P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:55:01.378618 3466 raft_consensus.cc:695] T 9c19b3ec9e844963a8392f0a2a97e25e P 89aa85d59c53436ebdf3074b13d14825 [term 1 LEADER]: Becoming Leader. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Running, Role: LEADER
I20250831 19:55:01.378767 3466 consensus_queue.cc:237] T 9c19b3ec9e844963a8392f0a2a97e25e P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:55:01.379840 3375 tablet_bootstrap.cc:654] T 8aa9b1c1435545d7a212b2e97e7a2931 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:55:01.381495 1885 tablet_service.cc:1515] Processing DeleteTablet for tablet 8aeda031e62e46ddbda679ce6b01df00 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-31 19:55:00 UTC) from {username='slave'} at 127.0.0.1:45900
I20250831 19:55:01.381742 3499 tablet_replica.cc:331] T 8aeda031e62e46ddbda679ce6b01df00 P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:55:01.381906 3499 raft_consensus.cc:2241] T 8aeda031e62e46ddbda679ce6b01df00 P 2441fafe1d62429386f4631ad423567d [term 1 LEADER]: Raft consensus shutting down.
I20250831 19:55:01.382097 3499 pending_rounds.cc:70] T 8aeda031e62e46ddbda679ce6b01df00 P 2441fafe1d62429386f4631ad423567d: Trying to abort 1 pending ops.
I20250831 19:55:01.382139 3499 pending_rounds.cc:77] T 8aeda031e62e46ddbda679ce6b01df00 P 2441fafe1d62429386f4631ad423567d: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7195320733868638208 op_type: NO_OP noop_request { }
I20250831 19:55:01.382207 3499 raft_consensus.cc:2887] T 8aeda031e62e46ddbda679ce6b01df00 P 2441fafe1d62429386f4631ad423567d [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250831 19:55:01.382270 3499 raft_consensus.cc:2270] T 8aeda031e62e46ddbda679ce6b01df00 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:55:01.383121 3499 ts_tablet_manager.cc:1905] T 8aeda031e62e46ddbda679ce6b01df00 P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:55:01.384953 3375 tablet_bootstrap.cc:492] T 8aa9b1c1435545d7a212b2e97e7a2931 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:55:01.385078 3375 ts_tablet_manager.cc:1397] T 8aa9b1c1435545d7a212b2e97e7a2931 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.001s
I20250831 19:55:01.385763 3375 raft_consensus.cc:357] T 8aa9b1c1435545d7a212b2e97e7a2931 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:55:01.385910 3375 raft_consensus.cc:383] T 8aa9b1c1435545d7a212b2e97e7a2931 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:55:01.385986 3375 raft_consensus.cc:738] T 8aa9b1c1435545d7a212b2e97e7a2931 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:55:01.386164 3375 consensus_queue.cc:260] T 8aa9b1c1435545d7a212b2e97e7a2931 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:55:01.386621 3375 ts_tablet_manager.cc:1428] T 8aa9b1c1435545d7a212b2e97e7a2931 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250831 19:55:01.387424 3499 ts_tablet_manager.cc:1918] T 8aeda031e62e46ddbda679ce6b01df00 P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:55:01.387694 3499 log.cc:1199] T 8aeda031e62e46ddbda679ce6b01df00 P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/8aeda031e62e46ddbda679ce6b01df00
I20250831 19:55:01.388075 3499 ts_tablet_manager.cc:1939] T 8aeda031e62e46ddbda679ce6b01df00 P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:55:01.389425 1428 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet 8aeda031e62e46ddbda679ce6b01df00 (table default.table_0498f784ecd944168cd0cbd019307408 [id=003066b121574814b254d138ec66c64c]) successfully deleted
I20250831 19:55:01.391609 3509 tablet_bootstrap.cc:492] T 8aa9b1c1435545d7a212b2e97e7a2931 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:55:01.392374 1437 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51254:
table { table_name: "default.Table_9ef01b3dfa2640dbbd4b622e06a1da94" } new_table_name: "default.Table_4c80ce33565e497686cb53f6a100c6e0" modify_external_catalogs: true
I20250831 19:55:01.393576 3509 tablet_bootstrap.cc:654] T 8aa9b1c1435545d7a212b2e97e7a2931 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:55:01.395085 3373 tablet_bootstrap.cc:492] T 8aa9b1c1435545d7a212b2e97e7a2931 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:55:01.397266 3373 tablet_bootstrap.cc:654] T 8aa9b1c1435545d7a212b2e97e7a2931 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:55:01.426007 3566 tablet.cc:1722] T 644cb7245dcf4097a35de65c2767041a P 2441fafe1d62429386f4631ad423567d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250831 19:55:01.428333 2943 raft_consensus.cc:491] T 8aa9b1c1435545d7a212b2e97e7a2931 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:55:01.428468 2943 raft_consensus.cc:513] T 8aa9b1c1435545d7a212b2e97e7a2931 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:55:01.428982 2943 leader_election.cc:290] T 8aa9b1c1435545d7a212b2e97e7a2931 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197), 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237)
I20250831 19:55:01.429520 1902 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8aa9b1c1435545d7a212b2e97e7a2931" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:55:01.430272 1631 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8aa9b1c1435545d7a212b2e97e7a2931" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
W20250831 19:55:01.430811 1705 leader_election.cc:343] T 8aa9b1c1435545d7a212b2e97e7a2931 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): Illegal state: must be running to vote when last-logged opid is not known
W20250831 19:55:01.431586 1706 leader_election.cc:343] T 8aa9b1c1435545d7a212b2e97e7a2931 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): Illegal state: must be running to vote when last-logged opid is not known
I20250831 19:55:01.431702 1706 leader_election.cc:304] T 8aa9b1c1435545d7a212b2e97e7a2931 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: de831f40fa1348a48a1f0260f4130197; no voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825
I20250831 19:55:01.432319 2943 raft_consensus.cc:2747] T 8aa9b1c1435545d7a212b2e97e7a2931 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250831 19:55:01.432647 3373 tablet_bootstrap.cc:492] T 8aa9b1c1435545d7a212b2e97e7a2931 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:55:01.432897 3373 ts_tablet_manager.cc:1397] T 8aa9b1c1435545d7a212b2e97e7a2931 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.038s user 0.004s sys 0.007s
I20250831 19:55:01.433835 3373 raft_consensus.cc:357] T 8aa9b1c1435545d7a212b2e97e7a2931 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:55:01.434089 3373 raft_consensus.cc:383] T 8aa9b1c1435545d7a212b2e97e7a2931 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:55:01.434177 3373 raft_consensus.cc:738] T 8aa9b1c1435545d7a212b2e97e7a2931 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:55:01.434425 3373 consensus_queue.cc:260] T 8aa9b1c1435545d7a212b2e97e7a2931 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:55:01.435112 3373 ts_tablet_manager.cc:1428] T 8aa9b1c1435545d7a212b2e97e7a2931 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250831 19:55:01.439002 3509 tablet_bootstrap.cc:492] T 8aa9b1c1435545d7a212b2e97e7a2931 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:55:01.439169 3509 ts_tablet_manager.cc:1397] T 8aa9b1c1435545d7a212b2e97e7a2931 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.048s user 0.009s sys 0.020s
I20250831 19:55:01.439889 3509 raft_consensus.cc:357] T 8aa9b1c1435545d7a212b2e97e7a2931 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:55:01.440084 3509 raft_consensus.cc:383] T 8aa9b1c1435545d7a212b2e97e7a2931 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:55:01.440160 3509 raft_consensus.cc:738] T 8aa9b1c1435545d7a212b2e97e7a2931 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:55:01.440352 3509 consensus_queue.cc:260] T 8aa9b1c1435545d7a212b2e97e7a2931 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:55:01.440459 3534 tablet.cc:1722] T 644cb7245dcf4097a35de65c2767041a P 89aa85d59c53436ebdf3074b13d14825: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250831 19:55:01.440897 3509 ts_tablet_manager.cc:1428] T 8aa9b1c1435545d7a212b2e97e7a2931 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250831 19:55:01.444348 3517 mvcc.cc:204] Tried to move back new op lower bound from 7195320735121723392 to 7195320733700669440. Current Snapshot: MvccSnapshot[applied={T|T < 7195320735121723392}]
I20250831 19:55:01.444782 3530 tablet.cc:1722] T 644cb7245dcf4097a35de65c2767041a P de831f40fa1348a48a1f0260f4130197: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250831 19:55:01.476853 1434 catalog_manager.cc:3460] renamed table default.table_76aceaaac1fb4aaeb55445d641a113d1 [id=5646c567b288436588bca1dde5d6e213] in HMS: new name default.table_4898d53becde4f898538edc03de0d520
I20250831 19:55:01.490756 1440 catalog_manager.cc:2149] created HMS catalog entry for table [id=e5568b781ed34d098b2b97bf896dd3b0]
I20250831 19:55:01.494408 3355 raft_consensus.cc:491] T 8aa9b1c1435545d7a212b2e97e7a2931 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:55:01.494554 3355 raft_consensus.cc:513] T 8aa9b1c1435545d7a212b2e97e7a2931 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:55:01.495142 3355 leader_election.cc:290] T 8aa9b1c1435545d7a212b2e97e7a2931 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237)
I20250831 19:55:01.495713 1768 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8aa9b1c1435545d7a212b2e97e7a2931" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:55:01.495905 1768 raft_consensus.cc:2466] T 8aa9b1c1435545d7a212b2e97e7a2931 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 0.
I20250831 19:55:01.496230 1902 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8aa9b1c1435545d7a212b2e97e7a2931" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:55:01.496309 1570 leader_election.cc:304] T 8aa9b1c1435545d7a212b2e97e7a2931 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:55:01.496439 1902 raft_consensus.cc:2466] T 8aa9b1c1435545d7a212b2e97e7a2931 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 0.
I20250831 19:55:01.496546 3355 raft_consensus.cc:2802] T 8aa9b1c1435545d7a212b2e97e7a2931 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:55:01.496646 3355 raft_consensus.cc:491] T 8aa9b1c1435545d7a212b2e97e7a2931 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:55:01.496697 3355 raft_consensus.cc:3058] T 8aa9b1c1435545d7a212b2e97e7a2931 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:55:01.498963 3355 raft_consensus.cc:513] T 8aa9b1c1435545d7a212b2e97e7a2931 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:55:01.499826 1440 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51254 (request call id 96) took 1160 ms. Trace:
I20250831 19:55:01.499938 1440 rpcz_store.cc:276] 0831 19:55:00.339053 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:55:00.392744 (+ 53691us) service_pool.cc:225] Handling call
0831 19:55:00.401682 (+ 8938us) spinlock_profiling.cc:243] Waited 8.69 ms on lock 0x616000040f54. stack: 00007f80ca7a17d6 00007f80ca7a1590 00007f80c97943ad 0000000000972d94 0000000000972d5d 00007f80d956c14d 00007f80d956c243 00007f80d622b941 00007f80dddb6a5d 00007f80ddf3fe93 00007f80d4d777a6 00007f80d4d774d5 00007f80d154f2ce 00007f80d154e1ae 00007f80d15543e5 00007f80d1554d0f
0831 19:55:00.760951 (+359269us) catalog_manager.cc:2076] Acquired catalog manager lock
0831 19:55:00.761379 (+ 428us) catalog_manager.cc:2122] Created new table and tablet info
0831 19:55:01.490725 (+729346us) catalog_manager.cc:2148] Created new table in HMS catalog
0831 19:55:01.499566 (+ 8841us) catalog_manager.cc:2182] Wrote table and tablets to system table
0831 19:55:01.499669 (+ 103us) catalog_manager.cc:2216] Inserted table and tablets into CatalogManager maps
0831 19:55:01.499767 (+ 98us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:55:01.491461 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:55:01.491575 (+ 114us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:55:01.491582 (+ 7us) write_op.cc:435] Acquired schema lock
0831 19:55:01.491584 (+ 2us) tablet.cc:660] Decoding operations
0831 19:55:01.491672 (+ 88us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:55:01.491686 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0831 19:55:01.491691 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:55:01.491763 (+ 72us) tablet.cc:699] Row locks acquired
0831 19:55:01.491765 (+ 2us) write_op.cc:260] PREPARE: finished
0831 19:55:01.491796 (+ 31us) write_op.cc:270] Start()
0831 19:55:01.491826 (+ 30us) write_op.cc:276] Timestamp: P: 1756670101491773 usec, L: 0
0831 19:55:01.491829 (+ 3us) op_driver.cc:348] REPLICATION: starting
0831 19:55:01.492008 (+ 179us) log.cc:844] Serialized 433 byte log entry
0831 19:55:01.498606 (+ 6598us) op_driver.cc:464] REPLICATION: finished
0831 19:55:01.498696 (+ 90us) write_op.cc:301] APPLY: starting
0831 19:55:01.498713 (+ 17us) tablet.cc:1365] starting BulkCheckPresence
0831 19:55:01.498758 (+ 45us) tablet.cc:1368] finished BulkCheckPresence
0831 19:55:01.498790 (+ 32us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:55:01.498906 (+ 116us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:55:01.498939 (+ 33us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0831 19:55:01.498945 (+ 6us) write_op.cc:312] APPLY: finished
0831 19:55:01.499017 (+ 72us) log.cc:844] Serialized 29 byte log entry
0831 19:55:01.499085 (+ 68us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:55:01.499103 (+ 18us) write_op.cc:454] Released schema lock
0831 19:55:01.499109 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0831 19:55:01.499169 (+ 60us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:55:01.499172 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":715156,"Hive Metastore.run_cpu_time_us":270,"Hive Metastore.run_wall_time_us":13845,"mutex_wait_us":2678,"spinlock_wait_cycles":19976448,"child_traces":[["op",{"apply.queue_time_us":47,"apply.run_cpu_time_us":467,"apply.run_wall_time_us":467,"num_ops":2,"prepare.queue_time_us":92,"prepare.run_cpu_time_us":656,"prepare.run_wall_time_us":656,"raft.queue_time_us":587,"raft.run_cpu_time_us":526,"raft.run_wall_time_us":525,"replication_time_us":6750,"spinlock_wait_cycles":29952}]]}
I20250831 19:55:01.501561 1771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8aa9b1c1435545d7a212b2e97e7a2931" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197"
I20250831 19:55:01.501730 1771 raft_consensus.cc:3058] T 8aa9b1c1435545d7a212b2e97e7a2931 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:55:01.504478 1771 raft_consensus.cc:2466] T 8aa9b1c1435545d7a212b2e97e7a2931 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1.
I20250831 19:55:01.506824 1570 leader_election.cc:304] T 8aa9b1c1435545d7a212b2e97e7a2931 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:55:01.507058 3466 raft_consensus.cc:2802] T 8aa9b1c1435545d7a212b2e97e7a2931 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:55:01.507157 3466 raft_consensus.cc:695] T 8aa9b1c1435545d7a212b2e97e7a2931 P 89aa85d59c53436ebdf3074b13d14825 [term 1 LEADER]: Becoming Leader. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Running, Role: LEADER
I20250831 19:55:01.507354 3466 consensus_queue.cc:237] T 8aa9b1c1435545d7a212b2e97e7a2931 P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:55:01.509145 3355 leader_election.cc:290] T 8aa9b1c1435545d7a212b2e97e7a2931 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Requested vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237)
I20250831 19:55:01.512380 1441 catalog_manager.cc:2149] created HMS catalog entry for table [id=1c615ebd2b914a3f9ce6dc130e8c8d25]
I20250831 19:55:01.515038 1440 catalog_manager.cc:5674] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475) does not have the latest schema for tablet 644cb7245dcf4097a35de65c2767041a (table default.table_617124885d2e4d96b863e0e435bdf695 [id=0fc929ad819b48a9af984f8c301bad2b]). Expected version 2 got 0
I20250831 19:55:01.518359 1440 catalog_manager.cc:5674] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197) does not have the latest schema for tablet 644cb7245dcf4097a35de65c2767041a (table default.table_617124885d2e4d96b863e0e435bdf695 [id=0fc929ad819b48a9af984f8c301bad2b]). Expected version 2 got 0
I20250831 19:55:01.520727 1902 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8aa9b1c1435545d7a212b2e97e7a2931" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:55:01.520913 1902 raft_consensus.cc:3058] T 8aa9b1c1435545d7a212b2e97e7a2931 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:55:01.523933 1902 raft_consensus.cc:2466] T 8aa9b1c1435545d7a212b2e97e7a2931 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1.
I20250831 19:55:01.533499 1613 tablet_service.cc:1468] Processing CreateTablet for tablet 29203140e57a4cacb70e3a6115272738 (DEFAULT_TABLE table=default.table_42c6b8d164fd442bb4d9d239110099aa [id=e5568b781ed34d098b2b97bf896dd3b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:55:01.533934 1613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29203140e57a4cacb70e3a6115272738. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:55:01.534008 1748 tablet_service.cc:1468] Processing CreateTablet for tablet 29203140e57a4cacb70e3a6115272738 (DEFAULT_TABLE table=default.table_42c6b8d164fd442bb4d9d239110099aa [id=e5568b781ed34d098b2b97bf896dd3b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:55:01.534363 1748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29203140e57a4cacb70e3a6115272738. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:55:01.539698 3509 tablet_bootstrap.cc:492] T 29203140e57a4cacb70e3a6115272738 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:55:01.541716 3509 tablet_bootstrap.cc:654] T 29203140e57a4cacb70e3a6115272738 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:55:01.546396 1440 catalog_manager.cc:5582] T 9c19b3ec9e844963a8392f0a2a97e25e P 89aa85d59c53436ebdf3074b13d14825 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193). New cstate: current_term: 1 leader_uuid: "89aa85d59c53436ebdf3074b13d14825" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } }
I20250831 19:55:01.547509 1886 tablet_service.cc:1468] Processing CreateTablet for tablet 29203140e57a4cacb70e3a6115272738 (DEFAULT_TABLE table=default.table_42c6b8d164fd442bb4d9d239110099aa [id=e5568b781ed34d098b2b97bf896dd3b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:55:01.547924 1886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29203140e57a4cacb70e3a6115272738. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:55:01.554196 3373 tablet_bootstrap.cc:492] T 29203140e57a4cacb70e3a6115272738 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:55:01.555737 3373 tablet_bootstrap.cc:654] T 29203140e57a4cacb70e3a6115272738 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:55:01.559574 3375 tablet_bootstrap.cc:492] T 29203140e57a4cacb70e3a6115272738 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:55:01.549038 1441 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51254 (request call id 95) took 1210 ms. Trace:
I20250831 19:55:01.560945 3375 tablet_bootstrap.cc:654] T 29203140e57a4cacb70e3a6115272738 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:55:01.560353 1441 rpcz_store.cc:276] 0831 19:55:00.338999 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:55:00.385676 (+ 46677us) service_pool.cc:225] Handling call
0831 19:55:00.402249 (+ 16573us) spinlock_profiling.cc:243] Waited 16.3 ms on lock 0x616000040f54. stack: 00007f80ca7a17d6 00007f80ca7a1590 00007f80c97943ad 0000000000972d94 0000000000972d5d 00007f80d956c14d 00007f80d956c243 00007f80d622b941 00007f80dddb6a5d 00007f80ddf3fe93 00007f80d4d777a6 00007f80d4d774d5 00007f80d154f2ce 00007f80d154e1ae 00007f80d15543e5 00007f80d1554d0f
0831 19:55:00.761835 (+359586us) catalog_manager.cc:2076] Acquired catalog manager lock
0831 19:55:00.762844 (+ 1009us) catalog_manager.cc:2122] Created new table and tablet info
0831 19:55:01.512340 (+749496us) catalog_manager.cc:2148] Created new table in HMS catalog
0831 19:55:01.548754 (+ 36414us) catalog_manager.cc:2182] Wrote table and tablets to system table
0831 19:55:01.548892 (+ 138us) catalog_manager.cc:2216] Inserted table and tablets into CatalogManager maps
0831 19:55:01.548993 (+ 101us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:55:01.526107 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:55:01.526306 (+ 199us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:55:01.526314 (+ 8us) write_op.cc:435] Acquired schema lock
0831 19:55:01.526318 (+ 4us) tablet.cc:660] Decoding operations
0831 19:55:01.526411 (+ 93us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:55:01.526421 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0831 19:55:01.526426 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:55:01.526497 (+ 71us) tablet.cc:699] Row locks acquired
0831 19:55:01.526500 (+ 3us) write_op.cc:260] PREPARE: finished
0831 19:55:01.526531 (+ 31us) write_op.cc:270] Start()
0831 19:55:01.526560 (+ 29us) write_op.cc:276] Timestamp: P: 1756670101526505 usec, L: 0
0831 19:55:01.526564 (+ 4us) op_driver.cc:348] REPLICATION: starting
0831 19:55:01.526744 (+ 180us) log.cc:844] Serialized 433 byte log entry
0831 19:55:01.548008 (+ 21264us) op_driver.cc:464] REPLICATION: finished
0831 19:55:01.548125 (+ 117us) write_op.cc:301] APPLY: starting
0831 19:55:01.548144 (+ 19us) tablet.cc:1365] starting BulkCheckPresence
0831 19:55:01.548189 (+ 45us) tablet.cc:1368] finished BulkCheckPresence
0831 19:55:01.548213 (+ 24us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:55:01.548338 (+ 125us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:55:01.548375 (+ 37us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0831 19:55:01.548382 (+ 7us) write_op.cc:312] APPLY: finished
0831 19:55:01.548469 (+ 87us) log.cc:844] Serialized 29 byte log entry
0831 19:55:01.548548 (+ 79us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:55:01.548569 (+ 21us) write_op.cc:454] Released schema lock
0831 19:55:01.548576 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0831 19:55:01.548656 (+ 80us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:55:01.548659 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":727585,"Hive Metastore.run_cpu_time_us":229,"Hive Metastore.run_wall_time_us":21146,"mutex_wait_us":1578,"spinlock_wait_cycles":37586816,"child_traces":[["op",{"apply.queue_time_us":63,"apply.run_cpu_time_us":523,"apply.run_wall_time_us":522,"num_ops":2,"prepare.queue_time_us":13179,"prepare.run_cpu_time_us":732,"prepare.run_wall_time_us":732,"raft.queue_time_us":88,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":195,"replication_time_us":21412}]]}
I20250831 19:55:01.566017 1441 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51254:
table { table_name: "default.Table_6c90d2f731914735837fa73efe73971b" } modify_external_catalogs: true
I20250831 19:55:01.566268 1441 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51254:
table { table_name: "default.Table_6c90d2f731914735837fa73efe73971b" } modify_external_catalogs: true
I20250831 19:55:01.566744 1440 catalog_manager.cc:5582] T 8aa9b1c1435545d7a212b2e97e7a2931 P 89aa85d59c53436ebdf3074b13d14825 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193). New cstate: current_term: 1 leader_uuid: "89aa85d59c53436ebdf3074b13d14825" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } health_report { overall_health: UNKNOWN } } }
I20250831 19:55:01.571327 3375 tablet_bootstrap.cc:492] T 29203140e57a4cacb70e3a6115272738 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:55:01.571528 3375 ts_tablet_manager.cc:1397] T 29203140e57a4cacb70e3a6115272738 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.012s user 0.005s sys 0.002s
I20250831 19:55:01.571957 1436 catalog_manager.cc:2149] created HMS catalog entry for table [id=7a926135e65e459cb72f8766db79f2cf]
I20250831 19:55:01.572358 3375 raft_consensus.cc:357] T 29203140e57a4cacb70e3a6115272738 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:55:01.572526 3375 raft_consensus.cc:383] T 29203140e57a4cacb70e3a6115272738 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:55:01.572571 3375 raft_consensus.cc:738] T 29203140e57a4cacb70e3a6115272738 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:55:01.572794 3375 consensus_queue.cc:260] T 29203140e57a4cacb70e3a6115272738 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:55:01.573288 3375 ts_tablet_manager.cc:1428] T 29203140e57a4cacb70e3a6115272738 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250831 19:55:01.575328 3373 tablet_bootstrap.cc:492] T 29203140e57a4cacb70e3a6115272738 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:55:01.575502 3373 ts_tablet_manager.cc:1397] T 29203140e57a4cacb70e3a6115272738 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.021s user 0.001s sys 0.007s
I20250831 19:55:01.576136 3373 raft_consensus.cc:357] T 29203140e57a4cacb70e3a6115272738 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:55:01.576315 3373 raft_consensus.cc:383] T 29203140e57a4cacb70e3a6115272738 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:55:01.576357 3373 raft_consensus.cc:738] T 29203140e57a4cacb70e3a6115272738 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:55:01.576506 3373 consensus_queue.cc:260] T 29203140e57a4cacb70e3a6115272738 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:55:01.580309 3373 ts_tablet_manager.cc:1428] T 29203140e57a4cacb70e3a6115272738 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20250831 19:55:01.590415 3509 tablet_bootstrap.cc:492] T 29203140e57a4cacb70e3a6115272738 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:55:01.590561 3509 ts_tablet_manager.cc:1397] T 29203140e57a4cacb70e3a6115272738 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.051s user 0.010s sys 0.002s
I20250831 19:55:01.591298 3509 raft_consensus.cc:357] T 29203140e57a4cacb70e3a6115272738 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:55:01.591476 3509 raft_consensus.cc:383] T 29203140e57a4cacb70e3a6115272738 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:55:01.591548 3509 raft_consensus.cc:738] T 29203140e57a4cacb70e3a6115272738 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:55:01.591735 3509 consensus_queue.cc:260] T 29203140e57a4cacb70e3a6115272738 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:55:01.592191 3509 ts_tablet_manager.cc:1428] T 29203140e57a4cacb70e3a6115272738 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20250831 19:55:01.592396 1439 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:51254 (request call id 84) took 1254 ms. Trace:
I20250831 19:55:01.592528 1439 rpcz_store.cc:276] 0831 19:55:00.338158 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:55:00.339512 (+ 1354us) service_pool.cc:225] Handling call
0831 19:55:00.511786 (+172274us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0831 19:55:01.592355 (+1080569us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":34,"Hive Metastore.run_cpu_time_us":192,"Hive Metastore.run_wall_time_us":166979}
I20250831 19:55:01.606447 1436 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51254 (request call id 98) took 1267 ms. Trace:
I20250831 19:55:01.606571 1436 rpcz_store.cc:276] 0831 19:55:00.339224 (+ 0us) service_pool.cc:168] Inserting onto call queue
0831 19:55:00.434701 (+ 95477us) service_pool.cc:225] Handling call
0831 19:55:00.449616 (+ 14915us) spinlock_profiling.cc:243] Waited 14.6 ms on lock 0x616000040f54. stack: 00007f80ca7a17d6 00007f80ca7a1590 00007f80c97943ad 0000000000972d94 0000000000972d5d 00007f80d956c14d 00007f80d956c243 00007f80d622b941 00007f80dddb6a5d 00007f80ddf3fe93 00007f80d4d777a6 00007f80d4d774d5 00007f80d154f2ce 00007f80d154e1ae 00007f80d15543e5 00007f80d1554d0f
0831 19:55:00.763295 (+313679us) catalog_manager.cc:2076] Acquired catalog manager lock
0831 19:55:00.763730 (+ 435us) catalog_manager.cc:2122] Created new table and tablet info
0831 19:55:01.571933 (+808203us) catalog_manager.cc:2148] Created new table in HMS catalog
0831 19:55:01.606187 (+ 34254us) catalog_manager.cc:2182] Wrote table and tablets to system table
0831 19:55:01.606301 (+ 114us) catalog_manager.cc:2216] Inserted table and tablets into CatalogManager maps
0831 19:55:01.606393 (+ 92us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0831 19:55:01.584438 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0831 19:55:01.584567 (+ 129us) write_op.cc:432] Acquiring schema lock in shared mode
0831 19:55:01.584573 (+ 6us) write_op.cc:435] Acquired schema lock
0831 19:55:01.584576 (+ 3us) tablet.cc:660] Decoding operations
0831 19:55:01.584677 (+ 101us) write_op.cc:620] Acquiring the partition lock for write op
0831 19:55:01.584692 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0831 19:55:01.584699 (+ 7us) tablet.cc:683] Acquiring locks for 2 operations
0831 19:55:01.584772 (+ 73us) tablet.cc:699] Row locks acquired
0831 19:55:01.584775 (+ 3us) write_op.cc:260] PREPARE: finished
0831 19:55:01.584802 (+ 27us) write_op.cc:270] Start()
0831 19:55:01.584829 (+ 27us) write_op.cc:276] Timestamp: P: 1756670101584771 usec, L: 0
0831 19:55:01.584834 (+ 5us) op_driver.cc:348] REPLICATION: starting
0831 19:55:01.585001 (+ 167us) log.cc:844] Serialized 433 byte log entry
0831 19:55:01.605582 (+ 20581us) op_driver.cc:464] REPLICATION: finished
0831 19:55:01.605693 (+ 111us) write_op.cc:301] APPLY: starting
0831 19:55:01.605710 (+ 17us) tablet.cc:1365] starting BulkCheckPresence
0831 19:55:01.605753 (+ 43us) tablet.cc:1368] finished BulkCheckPresence
0831 19:55:01.605777 (+ 24us) tablet.cc:1370] starting ApplyRowOperation cycle
0831 19:55:01.605895 (+ 118us) tablet.cc:1381] finished ApplyRowOperation cycle
0831 19:55:01.605927 (+ 32us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0831 19:55:01.605934 (+ 7us) write_op.cc:312] APPLY: finished
0831 19:55:01.606007 (+ 73us) log.cc:844] Serialized 29 byte log entry
0831 19:55:01.606075 (+ 68us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:55:01.606095 (+ 20us) write_op.cc:454] Released schema lock
0831 19:55:01.606101 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0831 19:55:01.606177 (+ 76us) write_op.cc:489] Releasing partition, row and schema locks
0831 19:55:01.606181 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":747899,"Hive Metastore.run_cpu_time_us":242,"Hive Metastore.run_wall_time_us":60061,"mutex_wait_us":750,"spinlock_wait_cycles":33544576,"child_traces":[["op",{"apply.queue_time_us":66,"apply.run_cpu_time_us":473,"apply.run_wall_time_us":473,"num_ops":2,"prepare.queue_time_us":11979,"prepare.run_cpu_time_us":637,"prepare.run_wall_time_us":637,"replication_time_us":20718}]]}
F20250831 19:55:01.614987 1499 hms_notification_log_listener.cc:287] non-monotonous event IDs from HMS: current 191, previous 191; dumping first 7 out of 13 received events: NotificationEvent(eventId=186, eventTime=1756670100, eventType=ALTER_TABLE, dbName=default, tableName=table_dcdb51c187224f8c88da49b3ddd45493, message={"server":"","servicePrincipal":"","db":"default","table":"table_617124885d2e4d96b863e0e435bdf695","tableType":"MANAGED_TABLE","tableObjBeforeJson":"{\"1\":{\"str\":\"table_617124885d2e4d96b863e0e435bdf695\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1756670086},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/warehouse/table_617124885d2e4d96b863e0e435bdf695\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_617124885d2e4d96b863e0e435bdf695\",\"kudu.table_id\":\"0fc929ad819b48a9af984f8c301bad2b\",\"transient_lastDdlTime\":\"1756670086\",\"comment\":\"\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.master_addresses\":\"127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943\",\"kudu.cluster_id\":\"003a9cb4df1f460dbfc9d2f57d96ced1\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","tableObjAfterJson":"{\"1\":{\"str\":\"table_dcdb51c187224f8c88da49b3ddd45493\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1756670086},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/warehouse/table_dcdb51c187224f8c88da49b3ddd45493\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_dcdb51c187224f8c88da49b3ddd45493\",\"kudu.table_id\":\"0fc929ad819b48a9af984f8c301bad2b\",\"transient_lastDdlTime\":\"1756670086\",\"comment\":\"\",\"kudu.master_addresses\":\"127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"003a9cb4df1f460dbfc9d2f57d96ced1\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","isTruncateOp":"false","timestamp":1756670100}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=187, eventTime=1756670100, eventType=ALTER_TABLE, dbName=default, tableName=table_615fc2c3b7bb4650bee9ad184ed4e886, message={"server":"","servicePrincipal":"","db":"default","table":"table_0409d51b133145c5b7e7d4d407a471b2","tableType":"MANAGED_TABLE","tableObjBeforeJson":"{\"1\":{\"str\":\"table_0409d51b133145c5b7e7d4d407a471b2\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1756670093},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/warehouse/table_0409d51b133145c5b7e7d4d407a471b2\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_0409d51b133145c5b7e7d4d407a471b2\",\"kudu.table_id\":\"4cfc2f0bed1f4f5c80524f8cf8d69f3e\",\"transient_lastDdlTime\":\"1756670093\",\"comment\":\"\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.master_addresses\":\"127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943\",\"kudu.cluster_id\":\"003a9cb4df1f460dbfc9d2f57d96ced1\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","tableObjAfterJson":"{\"1\":{\"str\":\"table_615fc2c3b7bb4650bee9ad184ed4e886\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1756670093},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/warehouse/table_615fc2c3b7bb4650bee9ad184ed4e886\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_615fc2c3b7bb4650bee9ad184ed4e886\",\"kudu.table_id\":\"4cfc2f0bed1f4f5c80524f8cf8d69f3e\",\"transient_lastDdlTime\":\"1756670093\",\"comment\":\"\",\"kudu.master_addresses\":\"127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"003a9cb4df1f460dbfc9d2f57d96ced1\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","isTruncateOp":"false","timestamp":1756670100}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=188, eventTime=1756670100, eventType=CREATE_TABLE, dbName=default, tableName=table_5b6b5bfafb524e0a9e93a06dbd4456c9, message={"server":"","servicePrincipal":"","db":"default","table":"table_5b6b5bfafb524e0a9e93a06dbd4456c9","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_5b6b5bfafb524e0a9e93a06dbd4456c9\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1756670100},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/warehouse/table_5b6b5bfafb524e0a9e93a06dbd4456c9\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_5b6b5bfafb524e0a9e93a06dbd4456c9\",\"kudu.table_id\":\"53e85e8b37dd4a1eb36c7af9465f7304\",\"transient_lastDdlTime\":\"1756670100\",\"comment\":\"\",\"kudu.master_addresses\":\"127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"003a9cb4df1f460dbfc9d2f57d96ced1\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1756670100,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=189, eventTime=1756670100, eventType=CREATE_TABLE, dbName=default, tableName=table_8df2121e4bed46549eeca09cee50f14b, message={"server":"","servicePrincipal":"","db":"default","table":"table_8df2121e4bed46549eeca09cee50f14b","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_8df2121e4bed46549eeca09cee50f14b\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1756670100},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/warehouse/table_8df2121e4bed46549eeca09cee50f14b\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_8df2121e4bed46549eeca09cee50f14b\",\"kudu.table_id\":\"86819fd5cdeb4d1bafa01e65ce6300e1\",\"transient_lastDdlTime\":\"1756670100\",\"comment\":\"\",\"kudu.master_addresses\":\"127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"003a9cb4df1f460dbfc9d2f57d96ced1\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1756670100,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=190, eventTime=1756670100, eventType=CREATE_TABLE, dbName=default, tableName=table_c0b1a771fbef4422a91422a51e5dc1f6, message={"server":"","servicePrincipal":"","db":"default","table":"table_c0b1a771fbef4422a91422a51e5dc1f6","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_c0b1a771fbef4422a91422a51e5dc1f6\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1756670100},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/warehouse/table_c0b1a771fbef4422a91422a51e5dc1f6\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_c0b1a771fbef4422a91422a51e5dc1f6\",\"kudu.table_id\":\"a2e1d51e394b45bdbb816beebada66e9\",\"transient_lastDdlTime\":\"1756670100\",\"comment\":\"\",\"kudu.master_addresses\":\"127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"003a9cb4df1f460dbfc9d2f57d96ced1\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1756670100,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=191, eventTime=1756670101, eventType=DROP_TABLE, dbName=default, tableName=table_ca7adb92869942138e0f7dbe76fa583f, message={"server":"","servicePrincipal":"","db":"default","table":"table_ca7adb92869942138e0f7dbe76fa583f","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_ca7adb92869942138e0f7dbe76fa583f\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1756670100},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/warehouse/table_ca7adb92869942138e0f7dbe76fa583f\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_ca7adb92869942138e0f7dbe76fa583f\",\"kudu.table_id\":\"ee1df8f0a3e64e2684bb9cfde377d9f6\",\"transient_lastDdlTime\":\"1756670100\",\"comment\":\"\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.master_addresses\":\"127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943\",\"kudu.cluster_id\":\"003a9cb4df1f460dbfc9d2f57d96ced1\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1756670101}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=191, eventTime=1756670101, eventType=DROP_TABLE, dbName=default, tableName=table_c48f1c99f3174cb8acca698339447ed9, message={"server":"","servicePrincipal":"","db":"default","table":"table_c48f1c99f3174cb8acca698339447ed9","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_c48f1c99f3174cb8acca698339447ed9\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1756670094},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/warehouse/table_c48f1c99f3174cb8acca698339447ed9\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_c48f1c99f3174cb8acca698339447ed9\",\"kudu.table_id\":\"f707909e6af44750a5fc5e3b15af0b24\",\"transient_lastDdlTime\":\"1756670094\",\"comment\":\"\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.master_addresses\":\"127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943\",\"kudu.cluster_id\":\"003a9cb4df1f460dbfc9d2f57d96ced1\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1756670101}, messageFormat=json-0.2, catName=hive);
*** Check failure stack trace: ***
@ 0x7f80c7a69dcd google::LogMessage::Fail() at ??:0
@ 0x7f80c7a6db93 google::LogMessage::SendToLog() at ??:0
@ 0x7f80c7a697cc google::LogMessage::Flush() at ??:0
@ 0x7f80c7a69a11 google::LogMessage::~LogMessage() at ??:0
I20250831 19:55:01.624397 1439 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51254:
table { table_name: "default.Table_5546b3f364ce47768a100eec7bcf06af" } new_table_name: "default.Table_189482ae066d4f3788e6dc385456891c" modify_external_catalogs: true
I20250831 19:55:01.625303 1436 master_service.cc:948] ReplaceTablet: received request to replace tablet 3667c38e7b8c46ed8205e278c98c4b00 from {username='slave'} at 127.0.0.1:51254
I20250831 19:55:01.626809 1613 tablet_service.cc:1468] Processing CreateTablet for tablet 2f11ba75567f46709e48075f6b60ce5a (DEFAULT_TABLE table=default.table_e3c1c1682df94256ae59468b2f23f6e9 [id=1c615ebd2b914a3f9ce6dc130e8c8d25]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:55:01.627216 1613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f11ba75567f46709e48075f6b60ce5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:55:01.627386 1748 tablet_service.cc:1468] Processing CreateTablet for tablet 2f11ba75567f46709e48075f6b60ce5a (DEFAULT_TABLE table=default.table_e3c1c1682df94256ae59468b2f23f6e9 [id=1c615ebd2b914a3f9ce6dc130e8c8d25]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:55:01.627748 1748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f11ba75567f46709e48075f6b60ce5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:55:01.627846 1886 tablet_service.cc:1468] Processing CreateTablet for tablet 2f11ba75567f46709e48075f6b60ce5a (DEFAULT_TABLE table=default.table_e3c1c1682df94256ae59468b2f23f6e9 [id=1c615ebd2b914a3f9ce6dc130e8c8d25]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:55:01.628203 1886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f11ba75567f46709e48075f6b60ce5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:55:01.633358 3509 tablet_bootstrap.cc:492] T 2f11ba75567f46709e48075f6b60ce5a P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:55:01.634735 3509 tablet_bootstrap.cc:654] T 2f11ba75567f46709e48075f6b60ce5a P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
I20250831 19:55:01.636042 3373 tablet_bootstrap.cc:492] T 2f11ba75567f46709e48075f6b60ce5a P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:55:01.637300 3373 tablet_bootstrap.cc:654] T 2f11ba75567f46709e48075f6b60ce5a P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:55:01.640363 1436 catalog_manager.cc:5869] T 00000000000000000000000000000000 P ac75f6e7a0634a89beb9670950e95220: Sending DeleteTablet for 3 replicas of tablet 3667c38e7b8c46ed8205e278c98c4b00
I20250831 19:55:01.640398 3375 tablet_bootstrap.cc:492] T 2f11ba75567f46709e48075f6b60ce5a P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:55:01.640952 1436 catalog_manager.cc:6652] ReplaceTablet: tablet 3667c38e7b8c46ed8205e278c98c4b00 deleted and replaced by tablet be23b28b74554b03a10a278c55b1d382
I20250831 19:55:01.641209 1748 tablet_service.cc:1515] Processing DeleteTablet for tablet 3667c38e7b8c46ed8205e278c98c4b00 with delete_type TABLET_DATA_DELETED (replaced by tablet be23b28b74554b03a10a278c55b1d382) from {username='slave'} at 127.0.0.1:50662
I20250831 19:55:01.641639 3375 tablet_bootstrap.cc:654] T 2f11ba75567f46709e48075f6b60ce5a P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:55:01.642385 3497 tablet_replica.cc:331] T 3667c38e7b8c46ed8205e278c98c4b00 P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:55:01.642589 3497 raft_consensus.cc:2241] T 3667c38e7b8c46ed8205e278c98c4b00 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:55:01.642729 3497 raft_consensus.cc:2270] T 3667c38e7b8c46ed8205e278c98c4b00 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:55:01.643232 3497 ts_tablet_manager.cc:1905] T 3667c38e7b8c46ed8205e278c98c4b00 P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:55:01.644373 1885 tablet_service.cc:1515] Processing DeleteTablet for tablet 3667c38e7b8c46ed8205e278c98c4b00 with delete_type TABLET_DATA_DELETED (replaced by tablet be23b28b74554b03a10a278c55b1d382) from {username='slave'} at 127.0.0.1:45900
I20250831 19:55:01.644593 3499 tablet_replica.cc:331] T 3667c38e7b8c46ed8205e278c98c4b00 P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:55:01.644757 3499 raft_consensus.cc:2241] T 3667c38e7b8c46ed8205e278c98c4b00 P 2441fafe1d62429386f4631ad423567d [term 1 LEADER]: Raft consensus shutting down.
I20250831 19:55:01.645023 3499 raft_consensus.cc:2270] T 3667c38e7b8c46ed8205e278c98c4b00 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:55:01.645443 1613 tablet_service.cc:1515] Processing DeleteTablet for tablet 3667c38e7b8c46ed8205e278c98c4b00 with delete_type TABLET_DATA_DELETED (replaced by tablet be23b28b74554b03a10a278c55b1d382) from {username='slave'} at 127.0.0.1:51018
I20250831 19:55:01.645551 3499 ts_tablet_manager.cc:1905] T 3667c38e7b8c46ed8205e278c98c4b00 P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:55:01.645684 3498 tablet_replica.cc:331] T 3667c38e7b8c46ed8205e278c98c4b00 P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:55:01.645834 3498 raft_consensus.cc:2241] T 3667c38e7b8c46ed8205e278c98c4b00 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:55:01.645993 3498 raft_consensus.cc:2270] T 3667c38e7b8c46ed8205e278c98c4b00 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:55:01.646754 3498 ts_tablet_manager.cc:1905] T 3667c38e7b8c46ed8205e278c98c4b00 P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:55:01.651778 3499 ts_tablet_manager.cc:1918] T 3667c38e7b8c46ed8205e278c98c4b00 P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:55:01.651866 3499 log.cc:1199] T 3667c38e7b8c46ed8205e278c98c4b00 P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/3667c38e7b8c46ed8205e278c98c4b00
I20250831 19:55:01.652153 3499 ts_tablet_manager.cc:1939] T 3667c38e7b8c46ed8205e278c98c4b00 P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:55:01.652667 3498 ts_tablet_manager.cc:1918] T 3667c38e7b8c46ed8205e278c98c4b00 P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:55:01.652752 3498 log.cc:1199] T 3667c38e7b8c46ed8205e278c98c4b00 P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/3667c38e7b8c46ed8205e278c98c4b00
I20250831 19:55:01.653020 1428 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet 3667c38e7b8c46ed8205e278c98c4b00 (table default.table_fec0d0e06479419886c036a37df0cfdf [id=0e44d9b8a8044f2685d97f13e0b15ef3]) successfully deleted
I20250831 19:55:01.653379 3498 ts_tablet_manager.cc:1939] T 3667c38e7b8c46ed8205e278c98c4b00 P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
I20250831 19:55:01.654325 1429 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet 3667c38e7b8c46ed8205e278c98c4b00 (table default.table_fec0d0e06479419886c036a37df0cfdf [id=0e44d9b8a8044f2685d97f13e0b15ef3]) successfully deleted
I20250831 19:55:01.655047 3497 ts_tablet_manager.cc:1918] T 3667c38e7b8c46ed8205e278c98c4b00 P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:55:01.655133 3497 log.cc:1199] T 3667c38e7b8c46ed8205e278c98c4b00 P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/3667c38e7b8c46ed8205e278c98c4b00
I20250831 19:55:01.655433 3497 ts_tablet_manager.cc:1939] T 3667c38e7b8c46ed8205e278c98c4b00 P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
@ 0x7f80dde9e794 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
I20250831 19:55:01.660596 1430 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet 3667c38e7b8c46ed8205e278c98c4b00 (table default.table_fec0d0e06479419886c036a37df0cfdf [id=0e44d9b8a8044f2685d97f13e0b15ef3]) successfully deleted
I20250831 19:55:01.662232 3509 tablet_bootstrap.cc:492] T 2f11ba75567f46709e48075f6b60ce5a P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:55:01.662361 3509 ts_tablet_manager.cc:1397] T 2f11ba75567f46709e48075f6b60ce5a P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.029s user 0.005s sys 0.005s
I20250831 19:55:01.662302 1748 tablet_service.cc:1468] Processing CreateTablet for tablet e030c417e8c64c72a509258b74f72ff2 (DEFAULT_TABLE table=default.table_f205daa920134307a850938482f79a93 [id=7a926135e65e459cb72f8766db79f2cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:55:01.662722 1748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e030c417e8c64c72a509258b74f72ff2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:55:01.664280 3509 raft_consensus.cc:357] T 2f11ba75567f46709e48075f6b60ce5a P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:55:01.664462 3509 raft_consensus.cc:383] T 2f11ba75567f46709e48075f6b60ce5a P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:55:01.664515 3509 raft_consensus.cc:738] T 2f11ba75567f46709e48075f6b60ce5a P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:55:01.664789 3509 consensus_queue.cc:260] T 2f11ba75567f46709e48075f6b60ce5a P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:55:01.665396 3509 ts_tablet_manager.cc:1428] T 2f11ba75567f46709e48075f6b60ce5a P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20250831 19:55:01.668023 1613 tablet_service.cc:1468] Processing CreateTablet for tablet e030c417e8c64c72a509258b74f72ff2 (DEFAULT_TABLE table=default.table_f205daa920134307a850938482f79a93 [id=7a926135e65e459cb72f8766db79f2cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:55:01.668380 1613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e030c417e8c64c72a509258b74f72ff2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:55:01.673810 3509 tablet_bootstrap.cc:492] T e030c417e8c64c72a509258b74f72ff2 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:55:01.673878 1886 tablet_service.cc:1468] Processing CreateTablet for tablet e030c417e8c64c72a509258b74f72ff2 (DEFAULT_TABLE table=default.table_f205daa920134307a850938482f79a93 [id=7a926135e65e459cb72f8766db79f2cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:55:01.674191 1886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e030c417e8c64c72a509258b74f72ff2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:55:01.676873 3375 tablet_bootstrap.cc:492] T 2f11ba75567f46709e48075f6b60ce5a P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:55:01.676987 3375 ts_tablet_manager.cc:1397] T 2f11ba75567f46709e48075f6b60ce5a P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.037s user 0.002s sys 0.009s
I20250831 19:55:01.677609 3375 raft_consensus.cc:357] T 2f11ba75567f46709e48075f6b60ce5a P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:55:01.677781 3375 raft_consensus.cc:383] T 2f11ba75567f46709e48075f6b60ce5a P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:55:01.677829 3375 raft_consensus.cc:738] T 2f11ba75567f46709e48075f6b60ce5a P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:55:01.678020 3375 consensus_queue.cc:260] T 2f11ba75567f46709e48075f6b60ce5a P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:55:01.679391 3375 ts_tablet_manager.cc:1428] T 2f11ba75567f46709e48075f6b60ce5a P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20250831 19:55:01.679641 3375 tablet_bootstrap.cc:492] T e030c417e8c64c72a509258b74f72ff2 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:55:01.680946 3375 tablet_bootstrap.cc:654] T e030c417e8c64c72a509258b74f72ff2 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:55:01.681459 3509 tablet_bootstrap.cc:654] T e030c417e8c64c72a509258b74f72ff2 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
@ 0x7f80dde9d041 kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
I20250831 19:55:01.682111 3373 tablet_bootstrap.cc:492] T 2f11ba75567f46709e48075f6b60ce5a P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:55:01.682224 3373 ts_tablet_manager.cc:1397] T 2f11ba75567f46709e48075f6b60ce5a P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.046s user 0.007s sys 0.004s
I20250831 19:55:01.682891 3373 raft_consensus.cc:357] T 2f11ba75567f46709e48075f6b60ce5a P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:55:01.683218 3373 raft_consensus.cc:383] T 2f11ba75567f46709e48075f6b60ce5a P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:55:01.683280 3373 raft_consensus.cc:738] T 2f11ba75567f46709e48075f6b60ce5a P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:55:01.683604 1885 tablet_service.cc:1468] Processing CreateTablet for tablet be23b28b74554b03a10a278c55b1d382 (DEFAULT_TABLE table=default.table_fec0d0e06479419886c036a37df0cfdf [id=0e44d9b8a8044f2685d97f13e0b15ef3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:55:01.683941 1885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be23b28b74554b03a10a278c55b1d382. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:55:01.685811 1613 tablet_service.cc:1468] Processing CreateTablet for tablet be23b28b74554b03a10a278c55b1d382 (DEFAULT_TABLE table=default.table_fec0d0e06479419886c036a37df0cfdf [id=0e44d9b8a8044f2685d97f13e0b15ef3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:55:01.686110 1613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be23b28b74554b03a10a278c55b1d382. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:55:01.689810 3373 consensus_queue.cc:260] T 2f11ba75567f46709e48075f6b60ce5a P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:55:01.690302 3373 ts_tablet_manager.cc:1428] T 2f11ba75567f46709e48075f6b60ce5a P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20250831 19:55:01.690546 3373 tablet_bootstrap.cc:492] T be23b28b74554b03a10a278c55b1d382 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:55:01.691748 3373 tablet_bootstrap.cc:654] T be23b28b74554b03a10a278c55b1d382 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:55:01.695214 3509 tablet_bootstrap.cc:492] T e030c417e8c64c72a509258b74f72ff2 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:55:01.695348 3509 ts_tablet_manager.cc:1397] T e030c417e8c64c72a509258b74f72ff2 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.022s user 0.002s sys 0.003s
I20250831 19:55:01.696218 3509 raft_consensus.cc:357] T e030c417e8c64c72a509258b74f72ff2 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:55:01.696395 3509 raft_consensus.cc:383] T e030c417e8c64c72a509258b74f72ff2 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:55:01.696446 3509 raft_consensus.cc:738] T e030c417e8c64c72a509258b74f72ff2 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:55:01.696667 3509 consensus_queue.cc:260] T e030c417e8c64c72a509258b74f72ff2 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:55:01.700330 3509 ts_tablet_manager.cc:1428] T e030c417e8c64c72a509258b74f72ff2 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20250831 19:55:01.700619 3509 tablet_bootstrap.cc:492] T be23b28b74554b03a10a278c55b1d382 P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
@ 0x7f80ddea4cbc kudu::master::HmsNotificationLogListenerTask::Init()::$_0::operator()() at ??:0
I20250831 19:55:01.702488 3553 raft_consensus.cc:491] T 29203140e57a4cacb70e3a6115272738 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:55:01.702643 3553 raft_consensus.cc:513] T 29203140e57a4cacb70e3a6115272738 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:55:01.703331 3553 leader_election.cc:290] T 29203140e57a4cacb70e3a6115272738 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:55:01.703747 1771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "29203140e57a4cacb70e3a6115272738" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:55:01.703781 1634 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "29203140e57a4cacb70e3a6115272738" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:55:01.703922 1634 raft_consensus.cc:2466] T 29203140e57a4cacb70e3a6115272738 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 0.
I20250831 19:55:01.703919 1771 raft_consensus.cc:2466] T 29203140e57a4cacb70e3a6115272738 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 0.
I20250831 19:55:01.704257 1842 leader_election.cc:304] T 29203140e57a4cacb70e3a6115272738 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:55:01.704860 3553 raft_consensus.cc:2802] T 29203140e57a4cacb70e3a6115272738 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:55:01.704926 3553 raft_consensus.cc:491] T 29203140e57a4cacb70e3a6115272738 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:55:01.704990 3553 raft_consensus.cc:3058] T 29203140e57a4cacb70e3a6115272738 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:55:01.706018 3509 tablet_bootstrap.cc:654] T be23b28b74554b03a10a278c55b1d382 P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
@ 0x7f80ddea4b39 std::_Function_handler<>::_M_invoke() at ??:0
I20250831 19:55:01.707940 3375 tablet_bootstrap.cc:492] T e030c417e8c64c72a509258b74f72ff2 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:55:01.708070 3375 ts_tablet_manager.cc:1397] T e030c417e8c64c72a509258b74f72ff2 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.028s user 0.000s sys 0.009s
@ 0xa774dd std::function<>::operator()() at ??:?
I20250831 19:55:01.708858 3375 raft_consensus.cc:357] T e030c417e8c64c72a509258b74f72ff2 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:55:01.709031 3375 raft_consensus.cc:383] T e030c417e8c64c72a509258b74f72ff2 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:55:01.709098 3375 raft_consensus.cc:738] T e030c417e8c64c72a509258b74f72ff2 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:55:01.709390 1031 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-taskfwTdIj/build/asan/bin/kudu pid 2955
I20250831 19:55:01.709357 3375 consensus_queue.cc:260] T e030c417e8c64c72a509258b74f72ff2 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:55:01.709977 3375 ts_tablet_manager.cc:1428] T e030c417e8c64c72a509258b74f72ff2 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250831 19:55:01.716559 3509 tablet_bootstrap.cc:492] T be23b28b74554b03a10a278c55b1d382 P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
I20250831 19:55:01.716691 3509 ts_tablet_manager.cc:1397] T be23b28b74554b03a10a278c55b1d382 P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.016s user 0.005s sys 0.000s
I20250831 19:55:01.717487 3509 raft_consensus.cc:357] T be23b28b74554b03a10a278c55b1d382 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:55:01.717633 3509 raft_consensus.cc:383] T be23b28b74554b03a10a278c55b1d382 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:55:01.717682 3509 raft_consensus.cc:738] T be23b28b74554b03a10a278c55b1d382 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:55:01.717911 3509 consensus_queue.cc:260] T be23b28b74554b03a10a278c55b1d382 P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:55:01.718065 3373 tablet_bootstrap.cc:492] T be23b28b74554b03a10a278c55b1d382 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:55:01.718189 3373 ts_tablet_manager.cc:1397] T be23b28b74554b03a10a278c55b1d382 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.028s user 0.006s sys 0.012s
I20250831 19:55:01.718536 3509 ts_tablet_manager.cc:1428] T be23b28b74554b03a10a278c55b1d382 P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250831 19:55:01.718772 3373 raft_consensus.cc:357] T be23b28b74554b03a10a278c55b1d382 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:55:01.718940 3373 raft_consensus.cc:383] T be23b28b74554b03a10a278c55b1d382 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:55:01.718989 3373 raft_consensus.cc:738] T be23b28b74554b03a10a278c55b1d382 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:55:01.719162 3373 consensus_queue.cc:260] T be23b28b74554b03a10a278c55b1d382 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:55:01.721937 3373 ts_tablet_manager.cc:1428] T be23b28b74554b03a10a278c55b1d382 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
@ 0x7f80ca7c6cc9 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f80cdbe86db start_thread at ??:0
I20250831 19:55:01.727452 3553 raft_consensus.cc:513] T 29203140e57a4cacb70e3a6115272738 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:55:01.727885 3553 leader_election.cc:290] T 29203140e57a4cacb70e3a6115272738 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 election: Requested vote from peers 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:55:01.728304 1771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "29203140e57a4cacb70e3a6115272738" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197"
I20250831 19:55:01.728457 1771 raft_consensus.cc:3058] T 29203140e57a4cacb70e3a6115272738 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:55:01.728430 1634 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "29203140e57a4cacb70e3a6115272738" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:55:01.728579 1634 raft_consensus.cc:3058] T 29203140e57a4cacb70e3a6115272738 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:55:01.730873 1634 raft_consensus.cc:2466] T 29203140e57a4cacb70e3a6115272738 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 1.
I20250831 19:55:01.731353 1841 leader_election.cc:304] T 29203140e57a4cacb70e3a6115272738 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
@ 0x7f80c691a71f clone at ??:0
I20250831 19:55:01.731977 3553 raft_consensus.cc:2802] T 29203140e57a4cacb70e3a6115272738 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:55:01.732195 3553 raft_consensus.cc:695] T 29203140e57a4cacb70e3a6115272738 P 2441fafe1d62429386f4631ad423567d [term 1 LEADER]: Becoming Leader. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Running, Role: LEADER
I20250831 19:55:01.732203 1771 raft_consensus.cc:2466] T 29203140e57a4cacb70e3a6115272738 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 1.
I20250831 19:55:01.732381 3553 consensus_queue.cc:237] T 29203140e57a4cacb70e3a6115272738 P 2441fafe1d62429386f4631ad423567d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:55:01.732414 1748 tablet_service.cc:1468] Processing CreateTablet for tablet be23b28b74554b03a10a278c55b1d382 (DEFAULT_TABLE table=default.table_fec0d0e06479419886c036a37df0cfdf [id=0e44d9b8a8044f2685d97f13e0b15ef3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:55:01.733055 1748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be23b28b74554b03a10a278c55b1d382. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:55:01.743628 3375 tablet_bootstrap.cc:492] T be23b28b74554b03a10a278c55b1d382 P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:55:01.744930 3375 tablet_bootstrap.cc:654] T be23b28b74554b03a10a278c55b1d382 P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:55:01.757666 3375 tablet_bootstrap.cc:492] T be23b28b74554b03a10a278c55b1d382 P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:55:01.757799 3375 ts_tablet_manager.cc:1397] T be23b28b74554b03a10a278c55b1d382 P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.014s user 0.000s sys 0.003s
I20250831 19:55:01.758234 3373 tablet_bootstrap.cc:492] T e030c417e8c64c72a509258b74f72ff2 P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:55:01.758622 3375 raft_consensus.cc:357] T be23b28b74554b03a10a278c55b1d382 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:55:01.758832 3375 raft_consensus.cc:383] T be23b28b74554b03a10a278c55b1d382 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:55:01.758905 3375 raft_consensus.cc:738] T be23b28b74554b03a10a278c55b1d382 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:55:01.759107 3375 consensus_queue.cc:260] T be23b28b74554b03a10a278c55b1d382 P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:55:01.759490 3373 tablet_bootstrap.cc:654] T e030c417e8c64c72a509258b74f72ff2 P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:55:01.765592 3375 ts_tablet_manager.cc:1428] T be23b28b74554b03a10a278c55b1d382 P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20250831 19:55:01.775163 3373 tablet_bootstrap.cc:492] T e030c417e8c64c72a509258b74f72ff2 P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:55:01.775281 3373 ts_tablet_manager.cc:1397] T e030c417e8c64c72a509258b74f72ff2 P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.017s user 0.009s sys 0.005s
I20250831 19:55:01.776068 3373 raft_consensus.cc:357] T e030c417e8c64c72a509258b74f72ff2 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:55:01.776214 3373 raft_consensus.cc:383] T e030c417e8c64c72a509258b74f72ff2 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:55:01.776261 3373 raft_consensus.cc:738] T e030c417e8c64c72a509258b74f72ff2 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:55:01.776475 3373 consensus_queue.cc:260] T e030c417e8c64c72a509258b74f72ff2 P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:55:01.776968 3373 ts_tablet_manager.cc:1428] T e030c417e8c64c72a509258b74f72ff2 P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250831 19:55:01.786476 3270 generic_service.cc:196] Checking for leaks (request via RPC)
I20250831 19:55:01.858566 3603 raft_consensus.cc:491] T 2f11ba75567f46709e48075f6b60ce5a P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:55:01.858726 3603 raft_consensus.cc:513] T 2f11ba75567f46709e48075f6b60ce5a P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:55:01.859316 3603 leader_election.cc:290] T 2f11ba75567f46709e48075f6b60ce5a P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197), 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237)
I20250831 19:55:01.859728 1634 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2f11ba75567f46709e48075f6b60ce5a" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:55:01.859921 1634 raft_consensus.cc:2466] T 2f11ba75567f46709e48075f6b60ce5a P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 0.
I20250831 19:55:01.860000 1902 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2f11ba75567f46709e48075f6b60ce5a" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:55:01.860184 1902 raft_consensus.cc:2466] T 2f11ba75567f46709e48075f6b60ce5a P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 0.
I20250831 19:55:01.860281 1706 leader_election.cc:304] T 2f11ba75567f46709e48075f6b60ce5a P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:55:01.860724 3603 raft_consensus.cc:2802] T 2f11ba75567f46709e48075f6b60ce5a P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:55:01.860913 3603 raft_consensus.cc:491] T 2f11ba75567f46709e48075f6b60ce5a P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:55:01.861035 3603 raft_consensus.cc:3058] T 2f11ba75567f46709e48075f6b60ce5a P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:55:01.864084 3603 raft_consensus.cc:513] T 2f11ba75567f46709e48075f6b60ce5a P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:55:01.864918 1634 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2f11ba75567f46709e48075f6b60ce5a" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:55:01.864946 1902 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2f11ba75567f46709e48075f6b60ce5a" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:55:01.865060 1634 raft_consensus.cc:3058] T 2f11ba75567f46709e48075f6b60ce5a P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:55:01.865097 1902 raft_consensus.cc:3058] T 2f11ba75567f46709e48075f6b60ce5a P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:55:01.867269 1634 raft_consensus.cc:2466] T 2f11ba75567f46709e48075f6b60ce5a P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:55:01.867630 1902 raft_consensus.cc:2466] T 2f11ba75567f46709e48075f6b60ce5a P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:55:01.867751 1706 leader_election.cc:304] T 2f11ba75567f46709e48075f6b60ce5a P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:55:01.867973 3295 raft_consensus.cc:2802] T 2f11ba75567f46709e48075f6b60ce5a P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:55:01.868083 3295 raft_consensus.cc:695] T 2f11ba75567f46709e48075f6b60ce5a P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: Becoming Leader. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Running, Role: LEADER
I20250831 19:55:01.868160 3603 leader_election.cc:290] T 2f11ba75567f46709e48075f6b60ce5a P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Requested vote from peers 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197), 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237)
I20250831 19:55:01.868300 3295 consensus_queue.cc:237] T 2f11ba75567f46709e48075f6b60ce5a P de831f40fa1348a48a1f0260f4130197 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:55:01.925767 1031 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskfwTdIj/build/asan/bin/kudu with pid 2955
I20250831 19:55:01.932861 3464 raft_consensus.cc:491] T f0f12cd5b1354e73990c0cced8e29fd8 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:55:01.933063 3464 raft_consensus.cc:513] T f0f12cd5b1354e73990c0cced8e29fd8 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:55:01.933918 3464 leader_election.cc:290] T f0f12cd5b1354e73990c0cced8e29fd8 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237)
I20250831 19:55:01.934695 1902 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f0f12cd5b1354e73990c0cced8e29fd8" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:55:01.934881 1902 raft_consensus.cc:2466] T f0f12cd5b1354e73990c0cced8e29fd8 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 0.
I20250831 19:55:01.934875 1771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f0f12cd5b1354e73990c0cced8e29fd8" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:55:01.935091 1771 raft_consensus.cc:2466] T f0f12cd5b1354e73990c0cced8e29fd8 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 0.
I20250831 19:55:01.935639 1568 leader_election.cc:304] T f0f12cd5b1354e73990c0cced8e29fd8 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:55:01.935962 3464 raft_consensus.cc:2802] T f0f12cd5b1354e73990c0cced8e29fd8 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:55:01.936041 3464 raft_consensus.cc:491] T f0f12cd5b1354e73990c0cced8e29fd8 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:55:01.936103 3464 raft_consensus.cc:3058] T f0f12cd5b1354e73990c0cced8e29fd8 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:55:01.939733 3464 raft_consensus.cc:513] T f0f12cd5b1354e73990c0cced8e29fd8 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:55:01.940984 1771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f0f12cd5b1354e73990c0cced8e29fd8" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197"
I20250831 19:55:01.941171 1771 raft_consensus.cc:3058] T f0f12cd5b1354e73990c0cced8e29fd8 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:55:01.945791 1771 raft_consensus.cc:2466] T f0f12cd5b1354e73990c0cced8e29fd8 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1.
I20250831 19:55:01.946286 1570 leader_election.cc:304] T f0f12cd5b1354e73990c0cced8e29fd8 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:55:01.946647 3355 raft_consensus.cc:2802] T f0f12cd5b1354e73990c0cced8e29fd8 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:55:01.952634 3464 leader_election.cc:290] T f0f12cd5b1354e73990c0cced8e29fd8 P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Requested vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237)
I20250831 19:55:01.953258 1902 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f0f12cd5b1354e73990c0cced8e29fd8" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:55:01.953466 1902 raft_consensus.cc:3058] T f0f12cd5b1354e73990c0cced8e29fd8 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:55:01.954113 3355 raft_consensus.cc:695] T f0f12cd5b1354e73990c0cced8e29fd8 P 89aa85d59c53436ebdf3074b13d14825 [term 1 LEADER]: Becoming Leader. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Running, Role: LEADER
I20250831 19:55:01.954512 3355 consensus_queue.cc:237] T f0f12cd5b1354e73990c0cced8e29fd8 P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:55:01.955972 1902 raft_consensus.cc:2466] T f0f12cd5b1354e73990c0cced8e29fd8 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1.
W20250831 19:55:01.967957 3611 negotiation.cc:337] Failed RPC negotiation. Trace:
0831 19:55:01.953813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.1.254:34259 (local address 127.1.1.194:53615)
0831 19:55:01.967024 (+ 13211us) negotiation.cc:107] Waiting for socket to connect
0831 19:55:01.967106 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":13099,"threads_started":1}
W20250831 19:55:01.988147 1841 connection.cc:537] server connection from 127.0.0.1:45900 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20250831 19:55:01.988277 1958 connection.cc:537] client connection to 127.1.1.252:35943 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20250831 19:55:01.988649 1958 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.1.1.252:35943)
W20250831 19:55:01.988973 1958 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.1.1.252:35943)
W20250831 19:55:01.989069 1707 connection.cc:537] server connection from 127.0.0.1:50662 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20250831 19:55:01.989717 1958 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.1.1.252:35943)
I20250831 19:55:02.142932 3295 raft_consensus.cc:491] T e030c417e8c64c72a509258b74f72ff2 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:55:02.143110 3295 raft_consensus.cc:513] T e030c417e8c64c72a509258b74f72ff2 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:55:02.143683 3295 leader_election.cc:290] T e030c417e8c64c72a509258b74f72ff2 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197), 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237)
I20250831 19:55:02.144057 1902 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e030c417e8c64c72a509258b74f72ff2" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:55:02.144062 1634 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e030c417e8c64c72a509258b74f72ff2" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:55:02.144225 1634 raft_consensus.cc:2466] T e030c417e8c64c72a509258b74f72ff2 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 0.
I20250831 19:55:02.144244 1902 raft_consensus.cc:2466] T e030c417e8c64c72a509258b74f72ff2 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 0.
I20250831 19:55:02.144569 1706 leader_election.cc:304] T e030c417e8c64c72a509258b74f72ff2 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:55:02.144809 3295 raft_consensus.cc:2802] T e030c417e8c64c72a509258b74f72ff2 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:55:02.144896 3295 raft_consensus.cc:491] T e030c417e8c64c72a509258b74f72ff2 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:55:02.144980 3295 raft_consensus.cc:3058] T e030c417e8c64c72a509258b74f72ff2 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:55:02.146660 3295 raft_consensus.cc:513] T e030c417e8c64c72a509258b74f72ff2 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:55:02.147123 3295 leader_election.cc:290] T e030c417e8c64c72a509258b74f72ff2 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Requested vote from peers 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197), 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237)
I20250831 19:55:02.147467 1634 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e030c417e8c64c72a509258b74f72ff2" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:55:02.147531 1902 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e030c417e8c64c72a509258b74f72ff2" candidate_uuid: "de831f40fa1348a48a1f0260f4130197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:55:02.147635 1634 raft_consensus.cc:3058] T e030c417e8c64c72a509258b74f72ff2 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:55:02.147717 1902 raft_consensus.cc:3058] T e030c417e8c64c72a509258b74f72ff2 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:55:02.149211 1634 raft_consensus.cc:2466] T e030c417e8c64c72a509258b74f72ff2 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:55:02.149652 1706 leader_election.cc:304] T e030c417e8c64c72a509258b74f72ff2 P de831f40fa1348a48a1f0260f4130197 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89aa85d59c53436ebdf3074b13d14825, de831f40fa1348a48a1f0260f4130197; no voters:
I20250831 19:55:02.149849 3295 raft_consensus.cc:2802] T e030c417e8c64c72a509258b74f72ff2 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:55:02.150453 3295 raft_consensus.cc:695] T e030c417e8c64c72a509258b74f72ff2 P de831f40fa1348a48a1f0260f4130197 [term 1 LEADER]: Becoming Leader. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Running, Role: LEADER
I20250831 19:55:02.150758 3295 consensus_queue.cc:237] T e030c417e8c64c72a509258b74f72ff2 P de831f40fa1348a48a1f0260f4130197 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } }
I20250831 19:55:02.151396 1902 raft_consensus.cc:2466] T e030c417e8c64c72a509258b74f72ff2 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de831f40fa1348a48a1f0260f4130197 in term 1.
I20250831 19:55:02.158042 3295 consensus_queue.cc:1035] T 26637de652434209aafd5fc15d68146d P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:55:02.164510 3603 consensus_queue.cc:1035] T 26637de652434209aafd5fc15d68146d P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:55:02.168673 3355 consensus_queue.cc:1035] T 2c57c6e3bf0c4ffaa30abb7e800a3bea P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:55:02.176328 3610 consensus_queue.cc:1035] T 2c57c6e3bf0c4ffaa30abb7e800a3bea P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:55:02.187536 3628 raft_consensus.cc:491] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ac75f6e7a0634a89beb9670950e95220)
I20250831 19:55:02.187726 3628 raft_consensus.cc:513] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } }
I20250831 19:55:02.197152 3628 leader_election.cc:290] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259), ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943)
W20250831 19:55:02.199354 2100 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111) [suppressed 9 similar messages]
W20250831 19:55:02.203435 2105 leader_election.cc:336] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259): Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111)
W20250831 19:55:02.203675 2100 leader_election.cc:336] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943): Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
I20250831 19:55:02.203814 2100 leader_election.cc:304] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4d46bc3ef5a4fbb8c9e4349c86c54a5; no voters: 6c830f6055d64a3b8a9f78b405ad8aa3, ac75f6e7a0634a89beb9670950e95220
I20250831 19:55:02.204097 3628 raft_consensus.cc:2747] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20250831 19:55:02.213492 3553 raft_consensus.cc:491] T be23b28b74554b03a10a278c55b1d382 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:55:02.213644 3553 raft_consensus.cc:513] T be23b28b74554b03a10a278c55b1d382 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:55:02.214148 3553 leader_election.cc:290] T be23b28b74554b03a10a278c55b1d382 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:55:02.214524 1771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "be23b28b74554b03a10a278c55b1d382" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:55:02.214566 1634 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "be23b28b74554b03a10a278c55b1d382" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825" is_pre_election: true
I20250831 19:55:02.214722 1634 raft_consensus.cc:2466] T be23b28b74554b03a10a278c55b1d382 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 0.
I20250831 19:55:02.214738 1771 raft_consensus.cc:2466] T be23b28b74554b03a10a278c55b1d382 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 0.
I20250831 19:55:02.215068 1841 leader_election.cc:304] T be23b28b74554b03a10a278c55b1d382 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:55:02.215315 3553 raft_consensus.cc:2802] T be23b28b74554b03a10a278c55b1d382 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:55:02.215397 3553 raft_consensus.cc:491] T be23b28b74554b03a10a278c55b1d382 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:55:02.215466 3553 raft_consensus.cc:3058] T be23b28b74554b03a10a278c55b1d382 P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:55:02.216742 3355 consensus_queue.cc:1035] T 9c19b3ec9e844963a8392f0a2a97e25e P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:55:02.218287 3553 raft_consensus.cc:513] T be23b28b74554b03a10a278c55b1d382 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:55:02.219457 3553 leader_election.cc:290] T be23b28b74554b03a10a278c55b1d382 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 election: Requested vote from peers de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475), 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:55:02.219642 1634 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "be23b28b74554b03a10a278c55b1d382" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89aa85d59c53436ebdf3074b13d14825"
I20250831 19:55:02.219851 1634 raft_consensus.cc:3058] T be23b28b74554b03a10a278c55b1d382 P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:55:02.224547 1634 raft_consensus.cc:2466] T be23b28b74554b03a10a278c55b1d382 P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 1.
I20250831 19:55:02.225054 1841 leader_election.cc:304] T be23b28b74554b03a10a278c55b1d382 P 2441fafe1d62429386f4631ad423567d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:55:02.225358 3553 raft_consensus.cc:2802] T be23b28b74554b03a10a278c55b1d382 P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:55:02.225788 1768 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "be23b28b74554b03a10a278c55b1d382" candidate_uuid: "2441fafe1d62429386f4631ad423567d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197"
I20250831 19:55:02.225973 1768 raft_consensus.cc:3058] T be23b28b74554b03a10a278c55b1d382 P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:55:02.226096 3553 raft_consensus.cc:695] T be23b28b74554b03a10a278c55b1d382 P 2441fafe1d62429386f4631ad423567d [term 1 LEADER]: Becoming Leader. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Running, Role: LEADER
I20250831 19:55:02.226339 3553 consensus_queue.cc:237] T be23b28b74554b03a10a278c55b1d382 P 2441fafe1d62429386f4631ad423567d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } }
I20250831 19:55:02.228904 1768 raft_consensus.cc:2466] T be23b28b74554b03a10a278c55b1d382 P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441fafe1d62429386f4631ad423567d in term 1.
I20250831 19:55:02.239691 3355 consensus_queue.cc:1035] T 9c19b3ec9e844963a8392f0a2a97e25e P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:55:02.576210 3466 consensus_queue.cc:1035] T 8aa9b1c1435545d7a212b2e97e7a2931 P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:55:02.582146 3355 consensus_queue.cc:1035] T 8aa9b1c1435545d7a212b2e97e7a2931 P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:55:02.739590 3295 consensus_queue.cc:1035] T 2f11ba75567f46709e48075f6b60ce5a P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:55:02.743544 3295 consensus_queue.cc:1035] T 2f11ba75567f46709e48075f6b60ce5a P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:55:02.790402 3553 consensus_queue.cc:1035] T 29203140e57a4cacb70e3a6115272738 P 2441fafe1d62429386f4631ad423567d [LEADER]: Connected to new peer: Peer: permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:55:02.794971 3501 consensus_queue.cc:1035] T 29203140e57a4cacb70e3a6115272738 P 2441fafe1d62429386f4631ad423567d [LEADER]: Connected to new peer: Peer: permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:55:02.842672 3647 raft_consensus.cc:491] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ac75f6e7a0634a89beb9670950e95220)
I20250831 19:55:02.842846 3647 raft_consensus.cc:513] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } }
I20250831 19:55:02.843457 3647 leader_election.cc:290] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259), ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943)
W20250831 19:55:02.845191 2105 leader_election.cc:336] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259): Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111)
W20250831 19:55:02.845340 2100 leader_election.cc:336] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943): Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
I20250831 19:55:02.845425 2100 leader_election.cc:304] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4d46bc3ef5a4fbb8c9e4349c86c54a5; no voters: 6c830f6055d64a3b8a9f78b405ad8aa3, ac75f6e7a0634a89beb9670950e95220
I20250831 19:55:02.845630 3647 raft_consensus.cc:2747] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20250831 19:55:02.958940 1031 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskfwTdIj/build/asan/bin/kudu
/tmp/dist-test-taskfwTdIj/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.1.254:34259
--webserver_interface=127.1.1.254
--webserver_port=34345
--builtin_ntp_servers=127.1.1.212:44077
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943
--hive_metastore_uris=thrift://127.0.0.1:46163
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20250831 19:55:02.976862 3466 consensus_queue.cc:1035] T f0f12cd5b1354e73990c0cced8e29fd8 P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:55:02.991247 3464 consensus_queue.cc:1035] T f0f12cd5b1354e73990c0cced8e29fd8 P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:55:03.141384 2943 consensus_queue.cc:1035] T e030c417e8c64c72a509258b74f72ff2 P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:55:03.164659 3295 consensus_queue.cc:1035] T e030c417e8c64c72a509258b74f72ff2 P de831f40fa1348a48a1f0260f4130197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:55:03.196010 3430 consensus_queue.cc:1035] T be23b28b74554b03a10a278c55b1d382 P 2441fafe1d62429386f4631ad423567d [LEADER]: Connected to new peer: Peer: permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:55:03.196309 3553 consensus_queue.cc:1035] T be23b28b74554b03a10a278c55b1d382 P 2441fafe1d62429386f4631ad423567d [LEADER]: Connected to new peer: Peer: permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250831 19:55:03.298234 2101 catalog_manager.cc:4726] Async tablet task AlterTable RPC for tablet e47844d025bf42ecbfd2d3f34a31538e (table default.table_c7390b7344da4c3fbf7f2f502b096669 [id=1df66f6230794e939a25c0f2254d6e17], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet e47844d025bf42ecbfd2d3f34a31538e consensus state has no leader
W20250831 19:55:03.312261 3651 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20250831 19:55:03.312534 3651 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20250831 19:55:03.312618 3651 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20250831 19:55:03.320212 3651 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20250831 19:55:03.320295 3651 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20250831 19:55:03.320346 3651 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20250831 19:55:03.320386 3651 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20250831 19:55:03.329952 3651 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.1.212:44077
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-0/wal
--hive_metastore_uris=thrift://127.0.0.1:46163
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.1.254:34259
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.1.254
--webserver_port=34345
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 06466b25e294b4d7d455e6c56263318dc34a80ef
build type FASTDEBUG
built by None at 31 Aug 2025 19:43:25 UTC on 24a791456cd2
build id 7836
ASAN enabled
I20250831 19:55:03.331418 3651 env_posix.cc:2264] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20250831 19:55:03.333102 3651 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250831 19:55:03.340472 3667 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250831 19:55:03.340396 3664 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250831 19:55:03.340426 3665 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250831 19:55:03.341015 3651 server_base.cc:1047] running on GCE node
I20250831 19:55:03.341953 3651 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20250831 19:55:03.343232 3651 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20250831 19:55:03.344439 3651 hybrid_clock.cc:648] HybridClock initialized: now 1756670103344393 us; error 36 us; skew 500 ppm
I20250831 19:55:03.344775 3651 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250831 19:55:03.347366 3651 webserver.cc:480] Webserver started at http://127.1.1.254:34345/ using document root <none> and password file <none>
I20250831 19:55:03.348038 3651 fs_manager.cc:362] Metadata directory not provided
I20250831 19:55:03.348138 3651 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250831 19:55:03.353509 3651 fs_manager.cc:714] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20250831 19:55:03.356174 3673 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250831 19:55:03.357228 3651 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20250831 19:55:03.357359 3651 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-0/data,/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-0/wal
uuid: "6c830f6055d64a3b8a9f78b405ad8aa3"
format_stamp: "Formatted at 2025-08-31 19:54:38 on dist-test-slave-v4kn"
I20250831 19:55:03.357981 3651 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250831 19:55:03.361006 3674 raft_consensus.cc:491] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ac75f6e7a0634a89beb9670950e95220)
I20250831 19:55:03.361167 3674 raft_consensus.cc:513] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } }
I20250831 19:55:03.361819 3674 leader_election.cc:290] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259), ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943)
W20250831 19:55:03.365183 2105 leader_election.cc:336] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259): Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111)
W20250831 19:55:03.365325 2100 leader_election.cc:336] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943): Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
I20250831 19:55:03.365427 2100 leader_election.cc:304] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4d46bc3ef5a4fbb8c9e4349c86c54a5; no voters: 6c830f6055d64a3b8a9f78b405ad8aa3, ac75f6e7a0634a89beb9670950e95220
I20250831 19:55:03.365662 3674 raft_consensus.cc:2747] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20250831 19:55:03.374452 3651 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250831 19:55:03.375136 3651 env_posix.cc:2264] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20250831 19:55:03.375371 3651 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250831 19:55:03.392632 3651 rpc_server.cc:307] RPC server started. Bound to: 127.1.1.254:34259
I20250831 19:55:03.392683 3728 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.1.254:34259 every 8 connection(s)
I20250831 19:55:03.394217 3651 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-0/data/info.pb
I20250831 19:55:03.395138 1031 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskfwTdIj/build/asan/bin/kudu as pid 3651
I20250831 19:55:03.400895 3729 sys_catalog.cc:263] Verifying existing consensus state
I20250831 19:55:03.404605 3729 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3: Bootstrap starting.
I20250831 19:55:03.457295 3729 log.cc:826] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3: Log is configured to *not* fsync() on all Append() calls
I20250831 19:55:03.575914 1680 heartbeater.cc:344] Connected to a master server at 127.1.1.254:34259
I20250831 19:55:03.678154 1818 heartbeater.cc:344] Connected to a master server at 127.1.1.254:34259
I20250831 19:55:03.727295 1952 heartbeater.cc:344] Connected to a master server at 127.1.1.254:34259
I20250831 19:55:03.795320 3729 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3: Bootstrap replayed 1/1 log segments. Stats: ops{read=549 overwritten=0 applied=549 ignored=0} inserts{seen=358 ignored=0} mutations{seen=500 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250831 19:55:03.795792 3729 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3: Bootstrap complete.
I20250831 19:55:03.801009 3729 raft_consensus.cc:357] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [term 4 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } }
I20250831 19:55:03.801620 3729 raft_consensus.cc:738] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [term 4 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c830f6055d64a3b8a9f78b405ad8aa3, State: Initialized, Role: FOLLOWER
I20250831 19:55:03.802098 3729 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 549, Last appended: 4.549, Last appended by leader: 549, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } }
I20250831 19:55:03.802706 3737 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 4 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } } }
I20250831 19:55:03.802934 3737 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [sys.catalog]: This master's current role is: FOLLOWER
I20250831 19:55:03.803629 3729 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [sys.catalog]: configured and running, proceeding with master startup.
I20250831 19:55:03.833026 3754 catalog_manager.cc:1261] Loaded cluster ID: 003a9cb4df1f460dbfc9d2f57d96ced1
I20250831 19:55:03.833144 3754 catalog_manager.cc:1554] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3: loading cluster ID for follower catalog manager: success
I20250831 19:55:03.840333 3754 catalog_manager.cc:1576] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3: acquiring CA information for follower catalog manager: success
I20250831 19:55:03.847054 3754 catalog_manager.cc:1604] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20250831 19:55:03.849545 3651 master_runner.cc:186] Error getting master registration for 127.1.1.252:35943: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111),
I20250831 19:55:03.854548 3651 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20250831 19:55:03.984200 1818 heartbeater.cc:344] Connected to a master server at 127.1.1.254:34259
I20250831 19:55:03.988961 3694 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "de831f40fa1348a48a1f0260f4130197" instance_seqno: 1756670080362800) as {username='slave'} at 127.1.1.194:46519; Asking this server to re-register.
I20250831 19:55:03.990185 1818 heartbeater.cc:461] Registering TS with master...
I20250831 19:55:03.994472 3694 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" instance_seqno: 1756670079933967) as {username='slave'} at 127.1.1.193:54641; Asking this server to re-register.
I20250831 19:55:03.995543 1680 heartbeater.cc:461] Registering TS with master...
I20250831 19:55:03.997022 3694 ts_manager.cc:194] Registered new tserver with Master: de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:55:03.998241 3693 ts_manager.cc:194] Registered new tserver with Master: 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:55:04.317764 3693 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "2441fafe1d62429386f4631ad423567d" instance_seqno: 1756670080785002) as {username='slave'} at 127.1.1.195:38993; Asking this server to re-register.
I20250831 19:55:04.318454 1952 heartbeater.cc:461] Registering TS with master...
I20250831 19:55:04.320518 3693 ts_manager.cc:194] Registered new tserver with Master: 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237)
I20250831 19:55:04.341557 2042 master_runner.cc:186] Error getting master registration for 127.1.1.252:35943: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111),
I20250831 19:55:04.341742 2042 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20250831 19:55:04.406256 3761 raft_consensus.cc:491] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:55:04.406500 3761 raft_consensus.cc:513] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } }
I20250831 19:55:04.408278 3761 leader_election.cc:290] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a4d46bc3ef5a4fbb8c9e4349c86c54a5 (127.1.1.253:45581), ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943)
I20250831 19:55:04.408730 2135 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" candidate_term: 5 candidate_status { last_received { term: 4 index: 549 } } ignore_live_leader: false dest_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" is_pre_election: true
I20250831 19:55:04.408977 2135 raft_consensus.cc:2466] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c830f6055d64a3b8a9f78b405ad8aa3 in term 4.
W20250831 19:55:04.409825 3677 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
I20250831 19:55:04.410579 3677 leader_election.cc:304] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c830f6055d64a3b8a9f78b405ad8aa3, a4d46bc3ef5a4fbb8c9e4349c86c54a5; no voters:
I20250831 19:55:04.410915 3761 raft_consensus.cc:2802] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20250831 19:55:04.411060 3761 raft_consensus.cc:491] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:55:04.411176 3761 raft_consensus.cc:3058] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [term 4 FOLLOWER]: Advancing to term 5
W20250831 19:55:04.411391 3677 leader_election.cc:336] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943): Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
I20250831 19:55:04.414592 3761 raft_consensus.cc:513] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } }
I20250831 19:55:04.415041 3761 leader_election.cc:290] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [CANDIDATE]: Term 5 election: Requested vote from peers a4d46bc3ef5a4fbb8c9e4349c86c54a5 (127.1.1.253:45581), ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943)
I20250831 19:55:04.415366 2135 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" candidate_term: 5 candidate_status { last_received { term: 4 index: 549 } } ignore_live_leader: false dest_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5"
I20250831 19:55:04.415511 2135 raft_consensus.cc:3058] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 4 FOLLOWER]: Advancing to term 5
W20250831 19:55:04.416049 3677 leader_election.cc:336] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943): Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
I20250831 19:55:04.417237 2135 raft_consensus.cc:2466] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c830f6055d64a3b8a9f78b405ad8aa3 in term 5.
I20250831 19:55:04.417577 3677 leader_election.cc:304] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c830f6055d64a3b8a9f78b405ad8aa3, a4d46bc3ef5a4fbb8c9e4349c86c54a5; no voters: ac75f6e7a0634a89beb9670950e95220
I20250831 19:55:04.417793 3761 raft_consensus.cc:2802] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [term 5 FOLLOWER]: Leader election won for term 5
I20250831 19:55:04.418104 3761 raft_consensus.cc:695] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [term 5 LEADER]: Becoming Leader. State: Replica: 6c830f6055d64a3b8a9f78b405ad8aa3, State: Running, Role: LEADER
I20250831 19:55:04.418471 3761 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 549, Committed index: 549, Last appended: 4.549, Last appended by leader: 549, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } }
I20250831 19:55:04.420837 3764 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6c830f6055d64a3b8a9f78b405ad8aa3. Latest consensus state: current_term: 5 leader_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } } }
I20250831 19:55:04.421116 3764 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [sys.catalog]: This master's current role is: LEADER
I20250831 19:55:04.421766 3766 catalog_manager.cc:1477] Loading table and tablet metadata into memory...
I20250831 19:55:04.426954 3766 catalog_manager.cc:671] Loaded metadata for table default.table_1d644a2c8bd54f89964228704cd693e6 [id=028e873d141c4006aca7d45be88d9ae3]
I20250831 19:55:04.427435 3766 catalog_manager.cc:671] Loaded metadata for table default.table_3f81774719a24ce68cce90f20487fa97 [id=08d05283df4c4408954c3793beaa4adb]
I20250831 19:55:04.427762 3766 catalog_manager.cc:671] Loaded metadata for table default.table_13fd718b01d445dbb3955c7804421b1e [id=096152b885a04bfd9cced171fb8a12af]
I20250831 19:55:04.428058 3766 catalog_manager.cc:671] Loaded metadata for table default.table_65ae80244c21495fad7b9e506a44ebcc [id=09c2744c9575474bba2df5503541accc]
I20250831 19:55:04.428349 3766 catalog_manager.cc:671] Loaded metadata for table default.table_fec0d0e06479419886c036a37df0cfdf [id=0e44d9b8a8044f2685d97f13e0b15ef3]
I20250831 19:55:04.428644 3766 catalog_manager.cc:671] Loaded metadata for table default.table_617124885d2e4d96b863e0e435bdf695 [id=0fc929ad819b48a9af984f8c301bad2b]
I20250831 19:55:04.428961 3766 catalog_manager.cc:671] Loaded metadata for table default.table_9e316239c779453a9a3a3b8b84d62adc [id=10598630389746d2886e5687fe074fd7]
I20250831 19:55:04.429495 3766 catalog_manager.cc:671] Loaded metadata for table default.table_a03aade65d4449ec87fdbd94f7edd5ca [id=124c069ee3d5449cb64e8a816f67a365]
I20250831 19:55:04.429773 3766 catalog_manager.cc:671] Loaded metadata for table default.table_dbeae8f9a2c34da78b7e284664c00cd1 [id=1aaaa30dc3cd4d8497bc2a18ab02ec3d]
I20250831 19:55:04.430104 3766 catalog_manager.cc:671] Loaded metadata for table default.table_492565dabb704c25b9c4d1849bcb8eeb [id=1c606e303bbe40afaf2ec496b8680b4c]
I20250831 19:55:04.430377 3766 catalog_manager.cc:671] Loaded metadata for table default.table_e3c1c1682df94256ae59468b2f23f6e9 [id=1c615ebd2b914a3f9ce6dc130e8c8d25]
I20250831 19:55:04.430673 3766 catalog_manager.cc:671] Loaded metadata for table default.table_c7390b7344da4c3fbf7f2f502b096669 [id=1df66f6230794e939a25c0f2254d6e17]
I20250831 19:55:04.431288 3766 catalog_manager.cc:671] Loaded metadata for table default.table_bced9a3b747a4c33b6fc5b05b2a4dd89 [id=2b57fa1ef98f4029bc75e981255c74da]
I20250831 19:55:04.431823 3766 catalog_manager.cc:671] Loaded metadata for table default.table_2f8e5422042942d6a683316fbd7ac45d [id=30b1e9d6cb5e486fbed42ac06053ebc3]
I20250831 19:55:04.432150 3766 catalog_manager.cc:671] Loaded metadata for table default.table_4021d3dbb7f04e50997c9cc51c7e3888 [id=321a68b57ebf4e3a80670c3c862403f1]
I20250831 19:55:04.432497 3766 catalog_manager.cc:671] Loaded metadata for table default.table_dbd9b94e2d224171acd87195ab912666 [id=3671adc17a134657a7e9b07c97bea371]
I20250831 19:55:04.432950 3766 catalog_manager.cc:671] Loaded metadata for table default.table_969c1fd9ed5340858aa7434d10785589 [id=416489b351d443ebb067fa9b8625e63e]
I20250831 19:55:04.433377 3766 catalog_manager.cc:671] Loaded metadata for table default.table_0409d51b133145c5b7e7d4d407a471b2 [id=4cfc2f0bed1f4f5c80524f8cf8d69f3e]
I20250831 19:55:04.433830 3766 catalog_manager.cc:671] Loaded metadata for table default.table_be7bbefda22d4660a8d257962bfe0979 [id=5579e4d41f7b456b8d92804eb3d03711]
I20250831 19:55:04.434154 3766 catalog_manager.cc:671] Loaded metadata for table default.table_76aceaaac1fb4aaeb55445d641a113d1 [id=5646c567b288436588bca1dde5d6e213]
I20250831 19:55:04.434593 3766 catalog_manager.cc:671] Loaded metadata for table default.table_f6d2041746f14f4a84962c26b1df1118 [id=59220fba0aa647bca189db2218f3e28f]
I20250831 19:55:04.435040 3766 catalog_manager.cc:671] Loaded metadata for table default.table_20d403c55682499a9ba3267b85aecde7 [id=5b8cc2293fc545e7bedbf645db8dd2ce]
I20250831 19:55:04.435392 3766 catalog_manager.cc:671] Loaded metadata for table default.table_9e76b4c3909b459c812cb7fbddc11988 [id=5cc9b389dd1f4a0289aaecd18be10263]
I20250831 19:55:04.435684 3766 catalog_manager.cc:671] Loaded metadata for table default.table_af003c3f30c04853bc025b34d543d0e0 [id=5ce6c4d5dcd34d73af61fd2c4bf28799]
I20250831 19:55:04.436295 3766 catalog_manager.cc:671] Loaded metadata for table default.table_b63fcfe30c4b42e4aab0afa9159eff8b [id=690a54011d784c13992fd596584eadb8]
I20250831 19:55:04.436592 3766 catalog_manager.cc:671] Loaded metadata for table default.table_6c90d2f731914735837fa73efe73971b [id=69ff45f06b4641a987204b04e7586cb7]
I20250831 19:55:04.437121 3766 catalog_manager.cc:671] Loaded metadata for table default.table_f205daa920134307a850938482f79a93 [id=7a926135e65e459cb72f8766db79f2cf]
I20250831 19:55:04.437423 3766 catalog_manager.cc:671] Loaded metadata for table default.table_87e693c7c4a14344a2fe8a792457842d [id=7ad45cd85b694203b15bae99967c8b19]
I20250831 19:55:04.437754 3766 catalog_manager.cc:671] Loaded metadata for table default.table_5546b3f364ce47768a100eec7bcf06af [id=7c4a0345486747339c3e158a950bc5aa]
I20250831 19:55:04.438056 3766 catalog_manager.cc:671] Loaded metadata for table default.table_4c0155db27d445829ea2e453cd3ad0f3 [id=7d31bd8f26c94d15b09cf05778a2f253]
I20250831 19:55:04.438328 3766 catalog_manager.cc:671] Loaded metadata for table default.table_0bd3ac197d96497390258988a7c498f4 [id=7d4c018fcf534133bcf67cf6c12e3607]
I20250831 19:55:04.438874 3766 catalog_manager.cc:671] Loaded metadata for table default.table_9ef01b3dfa2640dbbd4b622e06a1da94 [id=7e12dc19746647d790e1d0c465317f0d]
I20250831 19:55:04.439256 3766 catalog_manager.cc:671] Loaded metadata for table default.table_8df2121e4bed46549eeca09cee50f14b [id=86819fd5cdeb4d1bafa01e65ce6300e1]
I20250831 19:55:04.439771 3766 catalog_manager.cc:671] Loaded metadata for table default.table_1d29197c8463471d898f54b5dadaefc2 [id=8ef92f9201b34066b2b621ae3aa92ebe]
I20250831 19:55:04.440065 3766 catalog_manager.cc:671] Loaded metadata for table default.table_930d37393d93428bb6c9407bbd479a71 [id=921f83cf8ea14fd68e86ce2b90aac92c]
I20250831 19:55:04.440387 3766 catalog_manager.cc:671] Loaded metadata for table default.table_75aa254646a24998b06bc2c45a479df2 [id=93c25513734040679fce59ac7b69ba38]
I20250831 19:55:04.440685 3766 catalog_manager.cc:671] Loaded metadata for table default.table_30272e2642084b1390e459c21c0bee62 [id=957ba0c5f36f4524a898d3126ed9ec26]
I20250831 19:55:04.441071 3766 catalog_manager.cc:671] Loaded metadata for table default.table_ac609d4af0b748438a68966d468a56c6 [id=9b01227041494090854149aefbbc4a88]
I20250831 19:55:04.441334 3766 catalog_manager.cc:671] Loaded metadata for table default.table_06c3d3b006e64e1b8e20c6d64625ea64 [id=a0fbaa8ae6b54d03abdd641e2e0eb746]
I20250831 19:55:04.441635 3766 catalog_manager.cc:671] Loaded metadata for table default.table_c0b1a771fbef4422a91422a51e5dc1f6 [id=a2e1d51e394b45bdbb816beebada66e9]
I20250831 19:55:04.442026 3766 catalog_manager.cc:671] Loaded metadata for table default.table_1dd756d1d1c14b878105f242f44b087e [id=aabaa79336954b3ab0450dcff3afa7bf]
I20250831 19:55:04.442320 3766 catalog_manager.cc:671] Loaded metadata for table default.table_5bc22ff7931245ad82121fb433351a08 [id=acf00823fd974ac6bcbff016c1296aa5]
I20250831 19:55:04.442881 3766 catalog_manager.cc:671] Loaded metadata for table default.table_b4399bb161024e3eb0b69c23e3f9af47 [id=b3f794b4f5384662a4cdff8f76f56a66]
I20250831 19:55:04.443200 3766 catalog_manager.cc:671] Loaded metadata for table default.table_4e12fc12cae640b99d4f3794151b6915 [id=ba4c5ecf4ae94ede9bfb83af2ee894ab]
I20250831 19:55:04.444114 3766 catalog_manager.cc:671] Loaded metadata for table default.table_ba7cea85816c4b98a116ec6b7a569c98 [id=c8f8d410198f4e0ba51900271218aebe]
I20250831 19:55:04.444612 3766 catalog_manager.cc:671] Loaded metadata for table default.table_4dba59fc46824095bd698aa0ccc13224 [id=d340aa6d78a5421f9e03785004d551c7]
I20250831 19:55:04.444862 3766 catalog_manager.cc:671] Loaded metadata for table default.table_160ddd96ddce4f1788f276ea8535d70b [id=d39100e5184f4a9ca1932e0d3cd0b243]
I20250831 19:55:04.445103 3766 catalog_manager.cc:671] Loaded metadata for table default.table_c3cffc1117c341b0b3a7d4f82c01763a [id=da5a81d8cada4041bd31e0bb6369d108]
I20250831 19:55:04.445328 3766 catalog_manager.cc:671] Loaded metadata for table default.table_e28995f706a34a2cb421352cb92a7349 [id=dc8984dc66cb4a01813cb742320a34cc]
I20250831 19:55:04.445637 3766 catalog_manager.cc:671] Loaded metadata for table default.table_42c6b8d164fd442bb4d9d239110099aa [id=e5568b781ed34d098b2b97bf896dd3b0]
I20250831 19:55:04.446523 3766 catalog_manager.cc:671] Loaded metadata for table default.table_207ac87518bc487184a89bb52cd204b3 [id=f48af5bc3eff4c819be4aeeff4128c2a]
I20250831 19:55:04.446789 3766 catalog_manager.cc:671] Loaded metadata for table default.table_08b74e57795c4dd8a7f91f01e1b5ba4a [id=f63d391a9c824314bf6789cc7bbb5ffb]
I20250831 19:55:04.447034 3766 catalog_manager.cc:671] Loaded metadata for table default.table_c48f1c99f3174cb8acca698339447ed9 [id=f707909e6af44750a5fc5e3b15af0b24]
I20250831 19:55:04.447305 3766 catalog_manager.cc:671] Loaded metadata for table default.table_dd23f581be78471f98008014d30c3398 [id=fa5e29f502aa4eae9056a1e220d6e9bc]
I20250831 19:55:04.447615 3766 catalog_manager.cc:671] Loaded metadata for table default.table_ea8910dd3df74137a9832974c833f71e [id=fd551e0ec667492c86ff0aaed181366b]
I20250831 19:55:04.447999 3766 catalog_manager.cc:671] Loaded metadata for table default.table_afb8eb0248714122aa74efa2d6fcfce4 [id=fe54e4791a0d4e3c9a36e1968988ea0d]
I20250831 19:55:04.452664 3766 tablet_loader.cc:96] loaded metadata for tablet 06c27385b0b8460c9ea4f1d96ecb2966 (table default.table_4e12fc12cae640b99d4f3794151b6915 [id=ba4c5ecf4ae94ede9bfb83af2ee894ab])
I20250831 19:55:04.454100 3766 tablet_loader.cc:96] loaded metadata for tablet 1ea70a674686459d88265f5f5524fc10 (table default.table_dd23f581be78471f98008014d30c3398 [id=fa5e29f502aa4eae9056a1e220d6e9bc])
I20250831 19:55:04.454525 3766 tablet_loader.cc:96] loaded metadata for tablet 26637de652434209aafd5fc15d68146d (table default.table_8df2121e4bed46549eeca09cee50f14b [id=86819fd5cdeb4d1bafa01e65ce6300e1])
I20250831 19:55:04.454849 3766 tablet_loader.cc:96] loaded metadata for tablet 27a32ae2ed1a4b94b1a2e6a9aa9d0d8c (table default.table_5546b3f364ce47768a100eec7bcf06af [id=7c4a0345486747339c3e158a950bc5aa])
I20250831 19:55:04.455130 3766 tablet_loader.cc:96] loaded metadata for tablet 29203140e57a4cacb70e3a6115272738 (table default.table_42c6b8d164fd442bb4d9d239110099aa [id=e5568b781ed34d098b2b97bf896dd3b0])
I20250831 19:55:04.455425 3766 tablet_loader.cc:96] loaded metadata for tablet 2a0c12b9233244809b96121e034c029e (table default.table_af003c3f30c04853bc025b34d543d0e0 [id=5ce6c4d5dcd34d73af61fd2c4bf28799])
I20250831 19:55:04.456200 3766 tablet_loader.cc:96] loaded metadata for tablet 2c57c6e3bf0c4ffaa30abb7e800a3bea (table default.table_dbd9b94e2d224171acd87195ab912666 [id=3671adc17a134657a7e9b07c97bea371])
I20250831 19:55:04.456456 3766 tablet_loader.cc:96] loaded metadata for tablet 2f11ba75567f46709e48075f6b60ce5a (table default.table_e3c1c1682df94256ae59468b2f23f6e9 [id=1c615ebd2b914a3f9ce6dc130e8c8d25])
I20250831 19:55:04.457342 3766 tablet_loader.cc:96] loaded metadata for tablet 48c3872dbaee495fb80d1415b5631eaf (table default.table_08b74e57795c4dd8a7f91f01e1b5ba4a [id=f63d391a9c824314bf6789cc7bbb5ffb])
I20250831 19:55:04.458499 3766 tablet_loader.cc:96] loaded metadata for tablet 5a080bbabe8840c3ba954bdc0626dc39 (table default.table_492565dabb704c25b9c4d1849bcb8eeb [id=1c606e303bbe40afaf2ec496b8680b4c])
I20250831 19:55:04.459319 3766 tablet_loader.cc:96] loaded metadata for tablet 5fcb923d81a2495fa02dc76ddb9983b7 (table default.table_30272e2642084b1390e459c21c0bee62 [id=957ba0c5f36f4524a898d3126ed9ec26])
I20250831 19:55:04.459569 3766 tablet_loader.cc:96] loaded metadata for tablet 61101a699bb84b62af4e7a0cae243d4e (table default.table_207ac87518bc487184a89bb52cd204b3 [id=f48af5bc3eff4c819be4aeeff4128c2a])
I20250831 19:55:04.459940 3766 tablet_loader.cc:96] loaded metadata for tablet 644cb7245dcf4097a35de65c2767041a (table default.table_617124885d2e4d96b863e0e435bdf695 [id=0fc929ad819b48a9af984f8c301bad2b])
I20250831 19:55:04.460357 3766 tablet_loader.cc:96] loaded metadata for tablet 6952ee3fe766450993142c673d9509e8 (table default.table_f6d2041746f14f4a84962c26b1df1118 [id=59220fba0aa647bca189db2218f3e28f])
I20250831 19:55:04.461709 3766 tablet_loader.cc:96] loaded metadata for tablet 7a217324e97b43e5a7ec540e3b9f70a5 (table default.table_1dd756d1d1c14b878105f242f44b087e [id=aabaa79336954b3ab0450dcff3afa7bf])
I20250831 19:55:04.461980 3766 tablet_loader.cc:96] loaded metadata for tablet 7afc8e9259a548fe946265ea513fde2f (table default.table_bced9a3b747a4c33b6fc5b05b2a4dd89 [id=2b57fa1ef98f4029bc75e981255c74da])
I20250831 19:55:04.462963 3766 tablet_loader.cc:96] loaded metadata for tablet 84177615877240688a2d4b3b88915525 (table default.table_75aa254646a24998b06bc2c45a479df2 [id=93c25513734040679fce59ac7b69ba38])
I20250831 19:55:04.463357 3766 tablet_loader.cc:96] loaded metadata for tablet 876f49b43408443da6a867c03df891b9 (table default.table_6c90d2f731914735837fa73efe73971b [id=69ff45f06b4641a987204b04e7586cb7])
I20250831 19:55:04.463635 3766 tablet_loader.cc:96] loaded metadata for tablet 8aa9b1c1435545d7a212b2e97e7a2931 (table default.table_87e693c7c4a14344a2fe8a792457842d [id=7ad45cd85b694203b15bae99967c8b19])
I20250831 19:55:04.464035 3766 tablet_loader.cc:96] loaded metadata for tablet 8afbd19c84f14fbb8f957c2f10d97a4c (table default.table_c48f1c99f3174cb8acca698339447ed9 [id=f707909e6af44750a5fc5e3b15af0b24])
I20250831 19:55:04.464344 3766 tablet_loader.cc:96] loaded metadata for tablet 8ebf42e07edf40f9b95b0304a912b9b8 (table default.table_3f81774719a24ce68cce90f20487fa97 [id=08d05283df4c4408954c3793beaa4adb])
I20250831 19:55:04.465108 3766 tablet_loader.cc:96] loaded metadata for tablet 93bfd2c663634436a61211a406c9f92f (table default.table_969c1fd9ed5340858aa7434d10785589 [id=416489b351d443ebb067fa9b8625e63e])
I20250831 19:55:04.465482 3766 tablet_loader.cc:96] loaded metadata for tablet 9525ea0cb58146d6851936d749447c3f (table default.table_b4399bb161024e3eb0b69c23e3f9af47 [id=b3f794b4f5384662a4cdff8f76f56a66])
I20250831 19:55:04.466169 3766 tablet_loader.cc:96] loaded metadata for tablet 9c19b3ec9e844963a8392f0a2a97e25e (table default.table_e28995f706a34a2cb421352cb92a7349 [id=dc8984dc66cb4a01813cb742320a34cc])
I20250831 19:55:04.466569 3766 tablet_loader.cc:96] loaded metadata for tablet 9dd77008323943ceaf515422255c8a23 (table default.table_9ef01b3dfa2640dbbd4b622e06a1da94 [id=7e12dc19746647d790e1d0c465317f0d])
I20250831 19:55:04.466988 3766 tablet_loader.cc:96] loaded metadata for tablet 9fc4297f4d704acda823360fe6d406cf (table default.table_9e316239c779453a9a3a3b8b84d62adc [id=10598630389746d2886e5687fe074fd7])
I20250831 19:55:04.467339 3766 tablet_loader.cc:96] loaded metadata for tablet a4e2586021c046dd8c5acd838bb5e83f (table default.table_a03aade65d4449ec87fdbd94f7edd5ca [id=124c069ee3d5449cb64e8a816f67a365])
I20250831 19:55:04.467887 3766 tablet_loader.cc:96] loaded metadata for tablet a5e30fe82a41499caa5e79fa1560c1be (table default.table_1d29197c8463471d898f54b5dadaefc2 [id=8ef92f9201b34066b2b621ae3aa92ebe])
I20250831 19:55:04.468159 3766 tablet_loader.cc:96] loaded metadata for tablet a6a3938379c64baba6f5f2c1a2f7087a (table default.table_06c3d3b006e64e1b8e20c6d64625ea64 [id=a0fbaa8ae6b54d03abdd641e2e0eb746])
I20250831 19:55:04.468683 3766 tablet_loader.cc:96] loaded metadata for tablet a9d383f8caed44958fb3fa6ed1ca580e (table default.table_dbeae8f9a2c34da78b7e284664c00cd1 [id=1aaaa30dc3cd4d8497bc2a18ab02ec3d])
I20250831 19:55:04.468942 3766 tablet_loader.cc:96] loaded metadata for tablet b0d177e2e2f745b8969b65ab318321a1 (table default.table_2f8e5422042942d6a683316fbd7ac45d [id=30b1e9d6cb5e486fbed42ac06053ebc3])
I20250831 19:55:04.469437 3766 tablet_loader.cc:96] loaded metadata for tablet b54e648cf8e04022ad0bc099534424d1 (table default.table_76aceaaac1fb4aaeb55445d641a113d1 [id=5646c567b288436588bca1dde5d6e213])
I20250831 19:55:04.470142 3766 tablet_loader.cc:96] loaded metadata for tablet b7576e353a1c46b5af830f437afcb207 (table default.table_160ddd96ddce4f1788f276ea8535d70b [id=d39100e5184f4a9ca1932e0d3cd0b243])
I20250831 19:55:04.470528 3766 tablet_loader.cc:96] loaded metadata for tablet bd12184dd70f451fbd9a2025d2c00758 (table default.table_ba7cea85816c4b98a116ec6b7a569c98 [id=c8f8d410198f4e0ba51900271218aebe])
I20250831 19:55:04.470777 3766 tablet_loader.cc:96] loaded metadata for tablet bd2f43a6cd1d4782a420fe5e4e110ead (table default.table_65ae80244c21495fad7b9e506a44ebcc [id=09c2744c9575474bba2df5503541accc])
I20250831 19:55:04.471024 3766 tablet_loader.cc:96] loaded metadata for tablet bddbec77b8444036b0c5e8d325faceaa (table default.table_be7bbefda22d4660a8d257962bfe0979 [id=5579e4d41f7b456b8d92804eb3d03711])
I20250831 19:55:04.471385 3766 tablet_loader.cc:96] loaded metadata for tablet be23b28b74554b03a10a278c55b1d382 (table default.table_fec0d0e06479419886c036a37df0cfdf [id=0e44d9b8a8044f2685d97f13e0b15ef3])
I20250831 19:55:04.471887 3766 tablet_loader.cc:96] loaded metadata for tablet c1ccea09b6c34c52a9212a5a481c80f7 (table default.table_0409d51b133145c5b7e7d4d407a471b2 [id=4cfc2f0bed1f4f5c80524f8cf8d69f3e])
I20250831 19:55:04.472131 3766 tablet_loader.cc:96] loaded metadata for tablet c307e8673f164f509e0c5ebcfcc2a033 (table default.table_ac609d4af0b748438a68966d468a56c6 [id=9b01227041494090854149aefbbc4a88])
I20250831 19:55:04.472373 3766 tablet_loader.cc:96] loaded metadata for tablet c47f69c5eeda4044b5c0f796375c013b (table default.table_5bc22ff7931245ad82121fb433351a08 [id=acf00823fd974ac6bcbff016c1296aa5])
I20250831 19:55:04.472594 3766 tablet_loader.cc:96] loaded metadata for tablet c515598ee89b4f1a8839c28c7e7bc0c9 (table default.table_20d403c55682499a9ba3267b85aecde7 [id=5b8cc2293fc545e7bedbf645db8dd2ce])
I20250831 19:55:04.473167 3766 tablet_loader.cc:96] loaded metadata for tablet c6db2a319cbf4359846c5f930ce8f0de (table default.table_0bd3ac197d96497390258988a7c498f4 [id=7d4c018fcf534133bcf67cf6c12e3607])
I20250831 19:55:04.473654 3766 tablet_loader.cc:96] loaded metadata for tablet cb21c47c27ea4f34801e93bd647e41b5 (table default.table_ea8910dd3df74137a9832974c833f71e [id=fd551e0ec667492c86ff0aaed181366b])
I20250831 19:55:04.474186 3766 tablet_loader.cc:96] loaded metadata for tablet d1f811715ac64ca591a84b52be6e2621 (table default.table_c3cffc1117c341b0b3a7d4f82c01763a [id=da5a81d8cada4041bd31e0bb6369d108])
I20250831 19:55:04.474665 3766 tablet_loader.cc:96] loaded metadata for tablet d7551c6a0ebd493dba75b1f766c4db0f (table default.table_4021d3dbb7f04e50997c9cc51c7e3888 [id=321a68b57ebf4e3a80670c3c862403f1])
I20250831 19:55:04.474927 3766 tablet_loader.cc:96] loaded metadata for tablet dc6c1d165b5a484ab98ac55cd2330139 (table default.table_930d37393d93428bb6c9407bbd479a71 [id=921f83cf8ea14fd68e86ce2b90aac92c])
I20250831 19:55:04.475322 3766 tablet_loader.cc:96] loaded metadata for tablet e030c417e8c64c72a509258b74f72ff2 (table default.table_f205daa920134307a850938482f79a93 [id=7a926135e65e459cb72f8766db79f2cf])
I20250831 19:55:04.475589 3766 tablet_loader.cc:96] loaded metadata for tablet e47844d025bf42ecbfd2d3f34a31538e (table default.table_c7390b7344da4c3fbf7f2f502b096669 [id=1df66f6230794e939a25c0f2254d6e17])
I20250831 19:55:04.476224 3766 tablet_loader.cc:96] loaded metadata for tablet eb97839972ba4bda89287c30da49bb40 (table default.table_13fd718b01d445dbb3955c7804421b1e [id=096152b885a04bfd9cced171fb8a12af])
I20250831 19:55:04.476624 3766 tablet_loader.cc:96] loaded metadata for tablet eed712e77ad740ae95050fe589f3a61a (table default.table_9e76b4c3909b459c812cb7fbddc11988 [id=5cc9b389dd1f4a0289aaecd18be10263])
I20250831 19:55:04.476874 3766 tablet_loader.cc:96] loaded metadata for tablet f0f12cd5b1354e73990c0cced8e29fd8 (table default.table_c0b1a771fbef4422a91422a51e5dc1f6 [id=a2e1d51e394b45bdbb816beebada66e9])
I20250831 19:55:04.477365 3766 tablet_loader.cc:96] loaded metadata for tablet f42849cccf8a45ed95794eac0e3922e7 (table default.table_afb8eb0248714122aa74efa2d6fcfce4 [id=fe54e4791a0d4e3c9a36e1968988ea0d])
I20250831 19:55:04.477634 3766 tablet_loader.cc:96] loaded metadata for tablet f47cf07c9a4a43048123794e4a51904b (table default.table_4c0155db27d445829ea2e453cd3ad0f3 [id=7d31bd8f26c94d15b09cf05778a2f253])
I20250831 19:55:04.478011 3766 tablet_loader.cc:96] loaded metadata for tablet f7a7fad8a2ca4da297070dd3b49bc2d8 (table default.table_4dba59fc46824095bd698aa0ccc13224 [id=d340aa6d78a5421f9e03785004d551c7])
I20250831 19:55:04.478255 3766 tablet_loader.cc:96] loaded metadata for tablet f8578694650b4379a66d9ea3df34ca0c (table default.table_b63fcfe30c4b42e4aab0afa9159eff8b [id=690a54011d784c13992fd596584eadb8])
I20250831 19:55:04.478878 3766 tablet_loader.cc:96] loaded metadata for tablet fae02e9ed1434c7c82f6c5faa3a1acec (table default.table_1d644a2c8bd54f89964228704cd693e6 [id=028e873d141c4006aca7d45be88d9ae3])
I20250831 19:55:04.479390 3766 catalog_manager.cc:1486] Initializing Kudu cluster ID...
I20250831 19:55:04.483609 3766 catalog_manager.cc:1261] Loaded cluster ID: 003a9cb4df1f460dbfc9d2f57d96ced1
I20250831 19:55:04.483690 3766 catalog_manager.cc:1497] Initializing Kudu internal certificate authority...
I20250831 19:55:04.487918 3766 catalog_manager.cc:1506] Loading token signing keys...
I20250831 19:55:04.491647 3766 catalog_manager.cc:5966] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3: Loaded TSK: 0
I20250831 19:55:04.492512 3766 catalog_manager.cc:1516] Initializing in-progress tserver states...
I20250831 19:55:04.497874 3766 catalog_manager.cc:1529] Loading latest processed Hive Metastore notification log event ID...
I20250831 19:55:04.502266 3766 catalog_manager.cc:5804] Last processed Hive Metastore notification event ID: 185
I20250831 19:55:04.558840 3692 master_service.cc:948] ReplaceTablet: received request to replace tablet a9d383f8caed44958fb3fa6ed1ca580e from {username='slave'} at 127.0.0.1:41692
I20250831 19:55:04.559113 3693 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41692:
name: "default.Table_ca7adb92869942138e0f7dbe76fa583f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:55:04.560421 3694 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41692:
name: "default.Table_5b6b5bfafb524e0a9e93a06dbd4456c9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:55:04.560925 3690 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41692:
table { table_name: "default.Table_dbeae8f9a2c34da78b7e284664c00cd1" } modify_external_catalogs: true
I20250831 19:55:04.559664 3686 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41692:
name: "default.Table_7df244b2b2d94dfd8c1d1a8307701eec"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:55:04.560273 3689 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41692:
name: "default.Table_cb3a0c6747644556b5489c30ec6961c6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:55:04.564306 3690 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41692:
table { table_name: "default.Table_dbeae8f9a2c34da78b7e284664c00cd1" } modify_external_catalogs: true
I20250831 19:55:04.564296 3685 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41692:
name: "default.Table_0efe7540ba704807824c5dc191180122"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:55:04.559720 3691 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41692:
name: "default.Table_e67c4bc4d2824fcba93f12cb1ea9800b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:55:04.564884 3688 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41692:
name: "default.Table_43297737e5734e0e8d75c00e63045326"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:55:04.560492 3687 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41692:
name: "default.Table_2c3079d5b3444b8799b930f2c73ff70a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
F20250831 19:55:04.568039 3752 hms_notification_log_listener.cc:287] non-monotonous event IDs from HMS: current 191, previous 191; dumping first 7 out of 13 received events: NotificationEvent(eventId=186, eventTime=1756670100, eventType=ALTER_TABLE, dbName=default, tableName=table_dcdb51c187224f8c88da49b3ddd45493, message={"server":"","servicePrincipal":"","db":"default","table":"table_617124885d2e4d96b863e0e435bdf695","tableType":"MANAGED_TABLE","tableObjBeforeJson":"{\"1\":{\"str\":\"table_617124885d2e4d96b863e0e435bdf695\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1756670086},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/warehouse/table_617124885d2e4d96b863e0e435bdf695\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_617124885d2e4d96b863e0e435bdf695\",\"kudu.table_id\":\"0fc929ad819b48a9af984f8c301bad2b\",\"transient_lastDdlTime\":\"1756670086\",\"comment\":\"\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.master_addresses\":\"127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943\",\"kudu.cluster_id\":\"003a9cb4df1f460dbfc9d2f57d96ced1\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","tableObjAfterJson":"{\"1\":{\"str\":\"table_dcdb51c187224f8c88da49b3ddd45493\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1756670086},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/warehouse/table_dcdb51c187224f8c88da49b3ddd45493\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_dcdb51c187224f8c88da49b3ddd45493\",\"kudu.table_id\":\"0fc929ad819b48a9af984f8c301bad2b\",\"transient_lastDdlTime\":\"1756670086\",\"comment\":\"\",\"kudu.master_addresses\":\"127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"003a9cb4df1f460dbfc9d2f57d96ced1\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","isTruncateOp":"false","timestamp":1756670100}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=187, eventTime=1756670100, eventType=ALTER_TABLE, dbName=default, tableName=table_615fc2c3b7bb4650bee9ad184ed4e886, message={"server":"","servicePrincipal":"","db":"default","table":"table_0409d51b133145c5b7e7d4d407a471b2","tableType":"MANAGED_TABLE","tableObjBeforeJson":"{\"1\":{\"str\":\"table_0409d51b133145c5b7e7d4d407a471b2\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1756670093},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/warehouse/table_0409d51b133145c5b7e7d4d407a471b2\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_0409d51b133145c5b7e7d4d407a471b2\",\"kudu.table_id\":\"4cfc2f0bed1f4f5c80524f8cf8d69f3e\",\"transient_lastDdlTime\":\"1756670093\",\"comment\":\"\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.master_addresses\":\"127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943\",\"kudu.cluster_id\":\"003a9cb4df1f460dbfc9d2f57d96ced1\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","tableObjAfterJson":"{\"1\":{\"str\":\"table_615fc2c3b7bb4650bee9ad184ed4e886\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1756670093},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/warehouse/table_615fc2c3b7bb4650bee9ad184ed4e886\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_615fc2c3b7bb4650bee9ad184ed4e886\",\"kudu.table_id\":\"4cfc2f0bed1f4f5c80524f8cf8d69f3e\",\"transient_lastDdlTime\":\"1756670093\",\"comment\":\"\",\"kudu.master_addresses\":\"127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"003a9cb4df1f460dbfc9d2f57d96ced1\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","isTruncateOp":"false","timestamp":1756670100}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=188, eventTime=1756670100, eventType=CREATE_TABLE, dbName=default, tableName=table_5b6b5bfafb524e0a9e93a06dbd4456c9, message={"server":"","servicePrincipal":"","db":"default","table":"table_5b6b5bfafb524e0a9e93a06dbd4456c9","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_5b6b5bfafb524e0a9e93a06dbd4456c9\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1756670100},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/warehouse/table_5b6b5bfafb524e0a9e93a06dbd4456c9\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_5b6b5bfafb524e0a9e93a06dbd4456c9\",\"kudu.table_id\":\"53e85e8b37dd4a1eb36c7af9465f7304\",\"transient_lastDdlTime\":\"1756670100\",\"comment\":\"\",\"kudu.master_addresses\":\"127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"003a9cb4df1f460dbfc9d2f57d96ced1\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1756670100,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=189, eventTime=1756670100, eventType=CREATE_TABLE, dbName=default, tableName=table_8df2121e4bed46549eeca09cee50f14b, message={"server":"","servicePrincipal":"","db":"default","table":"table_8df2121e4bed46549eeca09cee50f14b","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_8df2121e4bed46549eeca09cee50f14b\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1756670100},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/warehouse/table_8df2121e4bed46549eeca09cee50f14b\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_8df2121e4bed46549eeca09cee50f14b\",\"kudu.table_id\":\"86819fd5cdeb4d1bafa01e65ce6300e1\",\"transient_lastDdlTime\":\"1756670100\",\"comment\":\"\",\"kudu.master_addresses\":\"127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"003a9cb4df1f460dbfc9d2f57d96ced1\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1756670100,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=190, eventTime=1756670100, eventType=CREATE_TABLE, dbName=default, tableName=table_c0b1a771fbef4422a91422a51e5dc1f6, message={"server":"","servicePrincipal":"","db":"default","table":"table_c0b1a771fbef4422a91422a51e5dc1f6","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_c0b1a771fbef4422a91422a51e5dc1f6\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1756670100},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/warehouse/table_c0b1a771fbef4422a91422a51e5dc1f6\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_c0b1a771fbef4422a91422a51e5dc1f6\",\"kudu.table_id\":\"a2e1d51e394b45bdbb816beebada66e9\",\"transient_lastDdlTime\":\"1756670100\",\"comment\":\"\",\"kudu.master_addresses\":\"127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"003a9cb4df1f460dbfc9d2f57d96ced1\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1756670100,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=191, eventTime=1756670101, eventType=DROP_TABLE, dbName=default, tableName=table_ca7adb92869942138e0f7dbe76fa583f, message={"server":"","servicePrincipal":"","db":"default","table":"table_ca7adb92869942138e0f7dbe76fa583f","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_ca7adb92869942138e0f7dbe76fa583f\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1756670100},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/warehouse/table_ca7adb92869942138e0f7dbe76fa583f\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_ca7adb92869942138e0f7dbe76fa583f\",\"kudu.table_id\":\"ee1df8f0a3e64e2684bb9cfde377d9f6\",\"transient_lastDdlTime\":\"1756670100\",\"comment\":\"\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.master_addresses\":\"127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943\",\"kudu.cluster_id\":\"003a9cb4df1f460dbfc9d2f57d96ced1\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1756670101}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=191, eventTime=1756670101, eventType=DROP_TABLE, dbName=default, tableName=table_c48f1c99f3174cb8acca698339447ed9, message={"server":"","servicePrincipal":"","db":"default","table":"table_c48f1c99f3174cb8acca698339447ed9","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_c48f1c99f3174cb8acca698339447ed9\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1756670094},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/warehouse/table_c48f1c99f3174cb8acca698339447ed9\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_c48f1c99f3174cb8acca698339447ed9\",\"kudu.table_id\":\"f707909e6af44750a5fc5e3b15af0b24\",\"transient_lastDdlTime\":\"1756670094\",\"comment\":\"\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.master_addresses\":\"127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943\",\"kudu.cluster_id\":\"003a9cb4df1f460dbfc9d2f57d96ced1\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1756670101}, messageFormat=json-0.2, catName=hive);
*** Check failure stack trace: ***
@ 0x7f4eb33aedcd google::LogMessage::Fail() at ??:0
@ 0x7f4eb33b2b93 google::LogMessage::SendToLog() at ??:0
W20250831 19:55:04.571964 3677 consensus_peers.cc:489] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 -> Peer ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943): Couldn't send request to peer ac75f6e7a0634a89beb9670950e95220. Status: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250831 19:55:04.571987 2135 raft_consensus.cc:1273] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 5 FOLLOWER]: Refusing update from remote peer 6c830f6055d64a3b8a9f78b405ad8aa3: Log matching property violated. Preceding OpId in replica: term: 4 index: 549. Preceding OpId from leader: term: 5 index: 551. (index mismatch)
I20250831 19:55:04.572611 3764 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 550, Last known committed idx: 549, Time since last communication: 0.000s
@ 0x7f4eb33ae7cc google::LogMessage::Flush() at ??:0
@ 0x7f4eb33aea11 google::LogMessage::~LogMessage() at ??:0
I20250831 19:55:04.575811 3771 sys_catalog.cc:455] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6c830f6055d64a3b8a9f78b405ad8aa3. Latest consensus state: current_term: 5 leader_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } } }
I20250831 19:55:04.575985 3771 sys_catalog.cc:458] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [sys.catalog]: This master's current role is: FOLLOWER
I20250831 19:55:04.577759 3771 sys_catalog.cc:455] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 5 leader_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } } }
I20250831 19:55:04.577915 3771 sys_catalog.cc:458] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [sys.catalog]: This master's current role is: FOLLOWER
I20250831 19:55:04.580546 3692 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3: Sending DeleteTablet for 3 replicas of tablet a9d383f8caed44958fb3fa6ed1ca580e
I20250831 19:55:04.582585 3692 catalog_manager.cc:6652] ReplaceTablet: tablet a9d383f8caed44958fb3fa6ed1ca580e deleted and replaced by tablet ce4d37816b1349cbaa51fad42b80e8bc
@ 0x7f4ec97e3794 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
I20250831 19:55:04.589941 3692 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41692:
table { table_name: "default.Table_afb8eb0248714122aa74efa2d6fcfce4" } new_table_name: "default.Table_7e54f56f02284b58b89745afe0cce787" modify_external_catalogs: true
I20250831 19:55:04.590529 3776 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 5 leader_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } } }
I20250831 19:55:04.590903 3776 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [sys.catalog]: This master's current role is: LEADER
I20250831 19:55:04.604043 1613 tablet_service.cc:1515] Processing DeleteTablet for tablet a9d383f8caed44958fb3fa6ed1ca580e with delete_type TABLET_DATA_DELETED (replaced by tablet ce4d37816b1349cbaa51fad42b80e8bc) from {username='slave'} at 127.0.0.1:43984
I20250831 19:55:04.604576 3786 tablet_replica.cc:331] T a9d383f8caed44958fb3fa6ed1ca580e P 89aa85d59c53436ebdf3074b13d14825: stopping tablet replica
I20250831 19:55:04.606511 1886 tablet_service.cc:1515] Processing DeleteTablet for tablet a9d383f8caed44958fb3fa6ed1ca580e with delete_type TABLET_DATA_DELETED (replaced by tablet ce4d37816b1349cbaa51fad42b80e8bc) from {username='slave'} at 127.0.0.1:33894
I20250831 19:55:04.606693 3786 raft_consensus.cc:2241] T a9d383f8caed44958fb3fa6ed1ca580e P 89aa85d59c53436ebdf3074b13d14825 [term 1 LEADER]: Raft consensus shutting down.
I20250831 19:55:04.607051 3786 raft_consensus.cc:2270] T a9d383f8caed44958fb3fa6ed1ca580e P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:55:04.607565 3786 ts_tablet_manager.cc:1905] T a9d383f8caed44958fb3fa6ed1ca580e P 89aa85d59c53436ebdf3074b13d14825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:55:04.613221 1748 tablet_service.cc:1515] Processing DeleteTablet for tablet a9d383f8caed44958fb3fa6ed1ca580e with delete_type TABLET_DATA_DELETED (replaced by tablet ce4d37816b1349cbaa51fad42b80e8bc) from {username='slave'} at 127.0.0.1:45078
I20250831 19:55:04.613756 3788 tablet_replica.cc:331] T a9d383f8caed44958fb3fa6ed1ca580e P de831f40fa1348a48a1f0260f4130197: stopping tablet replica
I20250831 19:55:04.613926 3788 raft_consensus.cc:2241] T a9d383f8caed44958fb3fa6ed1ca580e P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:55:04.614079 3788 raft_consensus.cc:2270] T a9d383f8caed44958fb3fa6ed1ca580e P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:55:04.614473 3788 ts_tablet_manager.cc:1905] T a9d383f8caed44958fb3fa6ed1ca580e P de831f40fa1348a48a1f0260f4130197: Deleting tablet data with delete state TABLET_DATA_DELETED
@ 0x7f4ec97e2041 kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
I20250831 19:55:04.617354 3786 ts_tablet_manager.cc:1918] T a9d383f8caed44958fb3fa6ed1ca580e P 89aa85d59c53436ebdf3074b13d14825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:55:04.617472 3786 log.cc:1199] T a9d383f8caed44958fb3fa6ed1ca580e P 89aa85d59c53436ebdf3074b13d14825: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-0/wal/wals/a9d383f8caed44958fb3fa6ed1ca580e
I20250831 19:55:04.617822 3786 ts_tablet_manager.cc:1939] T a9d383f8caed44958fb3fa6ed1ca580e P 89aa85d59c53436ebdf3074b13d14825: Deleting consensus metadata
I20250831 19:55:04.618673 3788 ts_tablet_manager.cc:1918] T a9d383f8caed44958fb3fa6ed1ca580e P de831f40fa1348a48a1f0260f4130197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:55:04.618767 3788 log.cc:1199] T a9d383f8caed44958fb3fa6ed1ca580e P de831f40fa1348a48a1f0260f4130197: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-1/wal/wals/a9d383f8caed44958fb3fa6ed1ca580e
I20250831 19:55:04.618774 3679 catalog_manager.cc:4928] TS 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197): tablet a9d383f8caed44958fb3fa6ed1ca580e (table default.table_dbeae8f9a2c34da78b7e284664c00cd1 [id=1aaaa30dc3cd4d8497bc2a18ab02ec3d]) successfully deleted
I20250831 19:55:04.619076 3788 ts_tablet_manager.cc:1939] T a9d383f8caed44958fb3fa6ed1ca580e P de831f40fa1348a48a1f0260f4130197: Deleting consensus metadata
@ 0x7f4ec97e9cbc kudu::master::HmsNotificationLogListenerTask::Init()::$_0::operator()() at ??:0
I20250831 19:55:04.621757 1613 tablet_service.cc:1468] Processing CreateTablet for tablet ce4d37816b1349cbaa51fad42b80e8bc (DEFAULT_TABLE table=default.table_dbeae8f9a2c34da78b7e284664c00cd1 [id=1aaaa30dc3cd4d8497bc2a18ab02ec3d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:55:04.622123 1613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce4d37816b1349cbaa51fad42b80e8bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:55:04.622053 1885 tablet_service.cc:1468] Processing CreateTablet for tablet ce4d37816b1349cbaa51fad42b80e8bc (DEFAULT_TABLE table=default.table_dbeae8f9a2c34da78b7e284664c00cd1 [id=1aaaa30dc3cd4d8497bc2a18ab02ec3d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:55:04.622416 1885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce4d37816b1349cbaa51fad42b80e8bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:55:04.625375 3681 catalog_manager.cc:4928] TS de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475): tablet a9d383f8caed44958fb3fa6ed1ca580e (table default.table_dbeae8f9a2c34da78b7e284664c00cd1 [id=1aaaa30dc3cd4d8497bc2a18ab02ec3d]) successfully deleted
I20250831 19:55:04.625672 1748 tablet_service.cc:1468] Processing CreateTablet for tablet ce4d37816b1349cbaa51fad42b80e8bc (DEFAULT_TABLE table=default.table_dbeae8f9a2c34da78b7e284664c00cd1 [id=1aaaa30dc3cd4d8497bc2a18ab02ec3d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250831 19:55:04.625953 1748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce4d37816b1349cbaa51fad42b80e8bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20250831 19:55:04.633738 3791 tablet_bootstrap.cc:492] T ce4d37816b1349cbaa51fad42b80e8bc P 89aa85d59c53436ebdf3074b13d14825: Bootstrap starting.
I20250831 19:55:04.633893 3793 tablet_bootstrap.cc:492] T ce4d37816b1349cbaa51fad42b80e8bc P de831f40fa1348a48a1f0260f4130197: Bootstrap starting.
I20250831 19:55:04.635378 3793 tablet_bootstrap.cc:654] T ce4d37816b1349cbaa51fad42b80e8bc P de831f40fa1348a48a1f0260f4130197: Neither blocks nor log segments found. Creating new log.
I20250831 19:55:04.636153 3791 tablet_bootstrap.cc:654] T ce4d37816b1349cbaa51fad42b80e8bc P 89aa85d59c53436ebdf3074b13d14825: Neither blocks nor log segments found. Creating new log.
@ 0x7f4ec97e9b39 std::_Function_handler<>::_M_invoke() at ??:0
@ 0xa774dd std::function<>::operator()() at ??:?
I20250831 19:55:04.645191 3791 tablet_bootstrap.cc:492] T ce4d37816b1349cbaa51fad42b80e8bc P 89aa85d59c53436ebdf3074b13d14825: No bootstrap required, opened a new log
@ 0x7f4eb610bcc9 kudu::Thread::SuperviseThread() at ??:0
I20250831 19:55:04.645339 3791 ts_tablet_manager.cc:1397] T ce4d37816b1349cbaa51fad42b80e8bc P 89aa85d59c53436ebdf3074b13d14825: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.007s
I20250831 19:55:04.645855 3792 tablet_bootstrap.cc:492] T ce4d37816b1349cbaa51fad42b80e8bc P 2441fafe1d62429386f4631ad423567d: Bootstrap starting.
I20250831 19:55:04.646553 3791 raft_consensus.cc:357] T ce4d37816b1349cbaa51fad42b80e8bc P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:55:04.646757 3791 raft_consensus.cc:383] T ce4d37816b1349cbaa51fad42b80e8bc P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:55:04.646829 3791 raft_consensus.cc:738] T ce4d37816b1349cbaa51fad42b80e8bc P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Initialized, Role: FOLLOWER
I20250831 19:55:04.647075 3791 consensus_queue.cc:260] T ce4d37816b1349cbaa51fad42b80e8bc P 89aa85d59c53436ebdf3074b13d14825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:55:04.649390 3792 tablet_bootstrap.cc:654] T ce4d37816b1349cbaa51fad42b80e8bc P 2441fafe1d62429386f4631ad423567d: Neither blocks nor log segments found. Creating new log.
I20250831 19:55:04.649509 3791 ts_tablet_manager.cc:1428] T ce4d37816b1349cbaa51fad42b80e8bc P 89aa85d59c53436ebdf3074b13d14825: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20250831 19:55:04.650380 3787 tablet_replica.cc:331] T a9d383f8caed44958fb3fa6ed1ca580e P 2441fafe1d62429386f4631ad423567d: stopping tablet replica
I20250831 19:55:04.650539 3787 raft_consensus.cc:2241] T a9d383f8caed44958fb3fa6ed1ca580e P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus shutting down.
I20250831 19:55:04.650656 3787 raft_consensus.cc:2270] T a9d383f8caed44958fb3fa6ed1ca580e P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250831 19:55:04.651021 3787 ts_tablet_manager.cc:1905] T a9d383f8caed44958fb3fa6ed1ca580e P 2441fafe1d62429386f4631ad423567d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250831 19:55:04.655613 3787 ts_tablet_manager.cc:1918] T a9d383f8caed44958fb3fa6ed1ca580e P 2441fafe1d62429386f4631ad423567d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250831 19:55:04.655717 3787 log.cc:1199] T a9d383f8caed44958fb3fa6ed1ca580e P 2441fafe1d62429386f4631ad423567d: Deleting WAL directory at /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/ts-2/wal/wals/a9d383f8caed44958fb3fa6ed1ca580e
I20250831 19:55:04.656083 3787 ts_tablet_manager.cc:1939] T a9d383f8caed44958fb3fa6ed1ca580e P 2441fafe1d62429386f4631ad423567d: Deleting consensus metadata
I20250831 19:55:04.657315 3793 tablet_bootstrap.cc:492] T ce4d37816b1349cbaa51fad42b80e8bc P de831f40fa1348a48a1f0260f4130197: No bootstrap required, opened a new log
I20250831 19:55:04.657472 3793 ts_tablet_manager.cc:1397] T ce4d37816b1349cbaa51fad42b80e8bc P de831f40fa1348a48a1f0260f4130197: Time spent bootstrapping tablet: real 0.024s user 0.008s sys 0.014s
I20250831 19:55:04.658197 3793 raft_consensus.cc:357] T ce4d37816b1349cbaa51fad42b80e8bc P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:55:04.658257 3678 catalog_manager.cc:4928] TS 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237): tablet a9d383f8caed44958fb3fa6ed1ca580e (table default.table_dbeae8f9a2c34da78b7e284664c00cd1 [id=1aaaa30dc3cd4d8497bc2a18ab02ec3d]) successfully deleted
I20250831 19:55:04.658371 3793 raft_consensus.cc:383] T ce4d37816b1349cbaa51fad42b80e8bc P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:55:04.658425 3793 raft_consensus.cc:738] T ce4d37816b1349cbaa51fad42b80e8bc P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de831f40fa1348a48a1f0260f4130197, State: Initialized, Role: FOLLOWER
I20250831 19:55:04.658617 3793 consensus_queue.cc:260] T ce4d37816b1349cbaa51fad42b80e8bc P de831f40fa1348a48a1f0260f4130197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
@ 0x7f4eb952d6db start_thread at ??:0
@ 0x7f4eb225f71f clone at ??:0
I20250831 19:55:04.661731 3793 ts_tablet_manager.cc:1428] T ce4d37816b1349cbaa51fad42b80e8bc P de831f40fa1348a48a1f0260f4130197: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20250831 19:55:04.663625 3792 tablet_bootstrap.cc:492] T ce4d37816b1349cbaa51fad42b80e8bc P 2441fafe1d62429386f4631ad423567d: No bootstrap required, opened a new log
I20250831 19:55:04.663753 3792 ts_tablet_manager.cc:1397] T ce4d37816b1349cbaa51fad42b80e8bc P 2441fafe1d62429386f4631ad423567d: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.001s
I20250831 19:55:04.664431 3792 raft_consensus.cc:357] T ce4d37816b1349cbaa51fad42b80e8bc P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:55:04.664582 3792 raft_consensus.cc:383] T ce4d37816b1349cbaa51fad42b80e8bc P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250831 19:55:04.664639 3792 raft_consensus.cc:738] T ce4d37816b1349cbaa51fad42b80e8bc P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441fafe1d62429386f4631ad423567d, State: Initialized, Role: FOLLOWER
I20250831 19:55:04.664825 3792 consensus_queue.cc:260] T ce4d37816b1349cbaa51fad42b80e8bc P 2441fafe1d62429386f4631ad423567d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:55:04.665344 3792 ts_tablet_manager.cc:1428] T ce4d37816b1349cbaa51fad42b80e8bc P 2441fafe1d62429386f4631ad423567d: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
W20250831 19:55:04.817792 1707 connection.cc:537] client connection to 127.1.1.254:34259 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20250831 19:55:04.818293 1961 connection.cc:537] client connection to 127.1.1.254:34259 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20250831 19:55:04.818396 1842 connection.cc:537] client connection to 127.1.1.254:34259 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20250831 19:55:04.819000 1961 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.1.1.254:34259)
W20250831 19:55:04.819204 1961 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.1.1.254:34259)
W20250831 19:55:04.819342 1961 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.1.1.254:34259)
W20250831 19:55:04.819603 1961 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.1.1.254:34259)
I20250831 19:55:04.846499 3466 raft_consensus.cc:491] T ce4d37816b1349cbaa51fad42b80e8bc P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250831 19:55:04.846693 3466 raft_consensus.cc:513] T ce4d37816b1349cbaa51fad42b80e8bc P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:55:04.847223 3466 leader_election.cc:290] T ce4d37816b1349cbaa51fad42b80e8bc P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:55:04.847599 1902 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ce4d37816b1349cbaa51fad42b80e8bc" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d" is_pre_election: true
I20250831 19:55:04.847793 1902 raft_consensus.cc:2466] T ce4d37816b1349cbaa51fad42b80e8bc P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 0.
I20250831 19:55:04.847757 1771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ce4d37816b1349cbaa51fad42b80e8bc" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197" is_pre_election: true
I20250831 19:55:04.847936 1771 raft_consensus.cc:2466] T ce4d37816b1349cbaa51fad42b80e8bc P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 0.
I20250831 19:55:04.848158 1568 leader_election.cc:304] T ce4d37816b1349cbaa51fad42b80e8bc P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:55:04.848402 3466 raft_consensus.cc:2802] T ce4d37816b1349cbaa51fad42b80e8bc P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250831 19:55:04.848484 3466 raft_consensus.cc:491] T ce4d37816b1349cbaa51fad42b80e8bc P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250831 19:55:04.848582 3466 raft_consensus.cc:3058] T ce4d37816b1349cbaa51fad42b80e8bc P 89aa85d59c53436ebdf3074b13d14825 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:55:04.850322 3466 raft_consensus.cc:513] T ce4d37816b1349cbaa51fad42b80e8bc P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:55:04.850777 3466 leader_election.cc:290] T ce4d37816b1349cbaa51fad42b80e8bc P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Requested vote from peers 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237), de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:55:04.851085 1902 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ce4d37816b1349cbaa51fad42b80e8bc" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441fafe1d62429386f4631ad423567d"
I20250831 19:55:04.851115 1771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ce4d37816b1349cbaa51fad42b80e8bc" candidate_uuid: "89aa85d59c53436ebdf3074b13d14825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de831f40fa1348a48a1f0260f4130197"
I20250831 19:55:04.851231 1902 raft_consensus.cc:3058] T ce4d37816b1349cbaa51fad42b80e8bc P 2441fafe1d62429386f4631ad423567d [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:55:04.851228 1771 raft_consensus.cc:3058] T ce4d37816b1349cbaa51fad42b80e8bc P de831f40fa1348a48a1f0260f4130197 [term 0 FOLLOWER]: Advancing to term 1
I20250831 19:55:04.852741 1902 raft_consensus.cc:2466] T ce4d37816b1349cbaa51fad42b80e8bc P 2441fafe1d62429386f4631ad423567d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1.
I20250831 19:55:04.852797 1771 raft_consensus.cc:2466] T ce4d37816b1349cbaa51fad42b80e8bc P de831f40fa1348a48a1f0260f4130197 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89aa85d59c53436ebdf3074b13d14825 in term 1.
I20250831 19:55:04.853185 1568 leader_election.cc:304] T ce4d37816b1349cbaa51fad42b80e8bc P 89aa85d59c53436ebdf3074b13d14825 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441fafe1d62429386f4631ad423567d, 89aa85d59c53436ebdf3074b13d14825; no voters:
I20250831 19:55:04.853470 3466 raft_consensus.cc:2802] T ce4d37816b1349cbaa51fad42b80e8bc P 89aa85d59c53436ebdf3074b13d14825 [term 1 FOLLOWER]: Leader election won for term 1
I20250831 19:55:04.853894 3466 raft_consensus.cc:695] T ce4d37816b1349cbaa51fad42b80e8bc P 89aa85d59c53436ebdf3074b13d14825 [term 1 LEADER]: Becoming Leader. State: Replica: 89aa85d59c53436ebdf3074b13d14825, State: Running, Role: LEADER
I20250831 19:55:04.854169 3466 consensus_queue.cc:237] T ce4d37816b1349cbaa51fad42b80e8bc P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" member_type: VOTER last_known_addr { host: "127.1.1.193" port: 46197 } } peers { permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 } } peers { permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 } }
I20250831 19:55:05.120945 3806 raft_consensus.cc:491] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6c830f6055d64a3b8a9f78b405ad8aa3)
I20250831 19:55:05.121101 3806 raft_consensus.cc:513] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } }
I20250831 19:55:05.121723 3806 leader_election.cc:290] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259), ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943)
W20250831 19:55:05.123328 2100 leader_election.cc:336] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943): Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
W20250831 19:55:05.123553 2105 leader_election.cc:336] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259): Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111)
I20250831 19:55:05.123694 2105 leader_election.cc:304] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4d46bc3ef5a4fbb8c9e4349c86c54a5; no voters: 6c830f6055d64a3b8a9f78b405ad8aa3, ac75f6e7a0634a89beb9670950e95220
I20250831 19:55:05.123929 3806 raft_consensus.cc:2747] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20250831 19:55:05.631655 3802 consensus_queue.cc:1035] T ce4d37816b1349cbaa51fad42b80e8bc P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441fafe1d62429386f4631ad423567d" member_type: VOTER last_known_addr { host: "127.1.1.195" port: 43237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:55:05.637533 3802 consensus_queue.cc:1035] T ce4d37816b1349cbaa51fad42b80e8bc P 89aa85d59c53436ebdf3074b13d14825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de831f40fa1348a48a1f0260f4130197" member_type: VOTER last_known_addr { host: "127.1.1.194" port: 41475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250831 19:55:05.735221 3819 raft_consensus.cc:491] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6c830f6055d64a3b8a9f78b405ad8aa3)
I20250831 19:55:05.735389 3819 raft_consensus.cc:513] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } }
I20250831 19:55:05.735965 3819 leader_election.cc:290] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259), ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943)
W20250831 19:55:05.737572 2105 leader_election.cc:336] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259): Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111)
W20250831 19:55:05.737739 2100 leader_election.cc:336] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943): Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
I20250831 19:55:05.737859 2100 leader_election.cc:304] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4d46bc3ef5a4fbb8c9e4349c86c54a5; no voters: 6c830f6055d64a3b8a9f78b405ad8aa3, ac75f6e7a0634a89beb9670950e95220
I20250831 19:55:05.738073 3819 raft_consensus.cc:2747] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20250831 19:55:06.708932 3826 raft_consensus.cc:491] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6c830f6055d64a3b8a9f78b405ad8aa3)
I20250831 19:55:06.709118 3826 raft_consensus.cc:513] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } }
I20250831 19:55:06.709712 3826 leader_election.cc:290] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259), ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943)
W20250831 19:55:06.711529 2100 leader_election.cc:336] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943): Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
W20250831 19:55:06.711706 2105 leader_election.cc:336] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259): Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111)
I20250831 19:55:06.711822 2105 leader_election.cc:304] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4d46bc3ef5a4fbb8c9e4349c86c54a5; no voters: 6c830f6055d64a3b8a9f78b405ad8aa3, ac75f6e7a0634a89beb9670950e95220
I20250831 19:55:06.712051 3826 raft_consensus.cc:2747] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20250831 19:55:06.878768 1031 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskfwTdIj/build/asan/bin/kudu
/tmp/dist-test-taskfwTdIj/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.1.254:34259
--webserver_interface=127.1.1.254
--webserver_port=34345
--builtin_ntp_servers=127.1.1.212:44077
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943
--hive_metastore_uris=thrift://127.0.0.1:46163
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20250831 19:55:07.213112 3832 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20250831 19:55:07.213382 3832 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20250831 19:55:07.213536 3832 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20250831 19:55:07.220563 3832 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20250831 19:55:07.220664 3832 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20250831 19:55:07.220755 3832 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20250831 19:55:07.220813 3832 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20250831 19:55:07.229267 3832 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.1.212:44077
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-0/wal
--hive_metastore_uris=thrift://127.0.0.1:46163
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.1.254:34259
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.1.254
--webserver_port=34345
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 06466b25e294b4d7d455e6c56263318dc34a80ef
build type FASTDEBUG
built by None at 31 Aug 2025 19:43:25 UTC on 24a791456cd2
build id 7836
ASAN enabled
I20250831 19:55:07.230772 3832 env_posix.cc:2264] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20250831 19:55:07.232393 3832 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250831 19:55:07.239727 3839 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250831 19:55:07.240965 3840 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250831 19:55:07.241125 3842 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250831 19:55:07.241564 3832 server_base.cc:1047] running on GCE node
I20250831 19:55:07.242353 3832 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20250831 19:55:07.243839 3832 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20250831 19:55:07.245028 3832 hybrid_clock.cc:648] HybridClock initialized: now 1756670107244994 us; error 29 us; skew 500 ppm
I20250831 19:55:07.245325 3832 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250831 19:55:07.247257 3832 webserver.cc:480] Webserver started at http://127.1.1.254:34345/ using document root <none> and password file <none>
I20250831 19:55:07.247963 3832 fs_manager.cc:362] Metadata directory not provided
I20250831 19:55:07.248061 3832 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250831 19:55:07.252656 3832 fs_manager.cc:714] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20250831 19:55:07.255201 3848 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250831 19:55:07.256440 3832 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20250831 19:55:07.256569 3832 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-0/data,/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-0/wal
uuid: "6c830f6055d64a3b8a9f78b405ad8aa3"
format_stamp: "Formatted at 2025-08-31 19:54:38 on dist-test-slave-v4kn"
I20250831 19:55:07.257282 3832 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250831 19:55:07.269919 3832 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250831 19:55:07.270519 3832 env_posix.cc:2264] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20250831 19:55:07.270745 3832 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250831 19:55:07.288491 3832 rpc_server.cc:307] RPC server started. Bound to: 127.1.1.254:34259
I20250831 19:55:07.288508 3899 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.1.254:34259 every 8 connection(s)
I20250831 19:55:07.290056 3832 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-0/data/info.pb
I20250831 19:55:07.295614 1031 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskfwTdIj/build/asan/bin/kudu as pid 3832
I20250831 19:55:07.295984 3900 sys_catalog.cc:263] Verifying existing consensus state
I20250831 19:55:07.300290 3900 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3: Bootstrap starting.
I20250831 19:55:07.360859 3900 log.cc:826] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3: Log is configured to *not* fsync() on all Append() calls
I20250831 19:55:07.370496 1680 heartbeater.cc:344] Connected to a master server at 127.1.1.254:34259
W20250831 19:55:07.427155 2101 catalog_manager.cc:4726] Async tablet task AlterTable RPC for tablet e47844d025bf42ecbfd2d3f34a31538e (table default.table_c7390b7344da4c3fbf7f2f502b096669 [id=1df66f6230794e939a25c0f2254d6e17], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet e47844d025bf42ecbfd2d3f34a31538e consensus state has no leader
I20250831 19:55:07.655905 1952 heartbeater.cc:344] Connected to a master server at 127.1.1.254:34259
I20250831 19:55:07.660305 1818 heartbeater.cc:344] Connected to a master server at 127.1.1.254:34259
I20250831 19:55:07.726951 3900 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3: Bootstrap replayed 1/1 log segments. Stats: ops{read=552 overwritten=0 applied=552 ignored=0} inserts{seen=359 ignored=0} mutations{seen=502 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250831 19:55:07.727515 3900 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3: Bootstrap complete.
I20250831 19:55:07.732158 3900 raft_consensus.cc:357] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [term 5 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } }
I20250831 19:55:07.732787 3900 raft_consensus.cc:738] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [term 5 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c830f6055d64a3b8a9f78b405ad8aa3, State: Initialized, Role: FOLLOWER
I20250831 19:55:07.733374 3900 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 552, Last appended: 5.552, Last appended by leader: 552, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } }
I20250831 19:55:07.734185 3912 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 5 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } } }
I20250831 19:55:07.734412 3912 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [sys.catalog]: This master's current role is: FOLLOWER
I20250831 19:55:07.735131 3900 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [sys.catalog]: configured and running, proceeding with master startup.
I20250831 19:55:07.753103 3926 catalog_manager.cc:1261] Loaded cluster ID: 003a9cb4df1f460dbfc9d2f57d96ced1
I20250831 19:55:07.753299 3926 catalog_manager.cc:1554] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3: loading cluster ID for follower catalog manager: success
I20250831 19:55:07.765082 3926 catalog_manager.cc:1576] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3: acquiring CA information for follower catalog manager: success
I20250831 19:55:07.761610 3832 master_runner.cc:186] Error getting master registration for 127.1.1.252:35943: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111),
I20250831 19:55:07.766450 3832 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20250831 19:55:07.773658 3926 catalog_manager.cc:1604] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20250831 19:55:07.875491 1680 heartbeater.cc:344] Connected to a master server at 127.1.1.254:34259
I20250831 19:55:07.879258 3864 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" instance_seqno: 1756670079933967) as {username='slave'} at 127.1.1.193:50671; Asking this server to re-register.
I20250831 19:55:07.880012 1680 heartbeater.cc:461] Registering TS with master...
I20250831 19:55:07.882448 3864 ts_manager.cc:194] Registered new tserver with Master: 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:55:08.161815 3864 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "2441fafe1d62429386f4631ad423567d" instance_seqno: 1756670080785002) as {username='slave'} at 127.1.1.195:39139; Asking this server to re-register.
I20250831 19:55:08.162477 1952 heartbeater.cc:461] Registering TS with master...
I20250831 19:55:08.164623 3864 ts_manager.cc:194] Registered new tserver with Master: 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237)
I20250831 19:55:08.164780 1818 heartbeater.cc:344] Connected to a master server at 127.1.1.254:34259
I20250831 19:55:08.169054 3864 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "de831f40fa1348a48a1f0260f4130197" instance_seqno: 1756670080362800) as {username='slave'} at 127.1.1.194:38395; Asking this server to re-register.
I20250831 19:55:08.169790 1818 heartbeater.cc:461] Registering TS with master...
I20250831 19:55:08.172921 3864 ts_manager.cc:194] Registered new tserver with Master: de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:55:08.198756 3931 raft_consensus.cc:491] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6c830f6055d64a3b8a9f78b405ad8aa3)
I20250831 19:55:08.198964 3931 raft_consensus.cc:513] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } }
I20250831 19:55:08.199616 3931 leader_election.cc:290] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259), ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943)
W20250831 19:55:08.200717 2100 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111) [suppressed 11 similar messages]
I20250831 19:55:08.211233 3875 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" candidate_term: 6 candidate_status { last_received { term: 5 index: 552 } } ignore_live_leader: false dest_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" is_pre_election: true
W20250831 19:55:08.211437 2100 leader_election.cc:336] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943): Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
I20250831 19:55:08.211738 3875 raft_consensus.cc:2466] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4d46bc3ef5a4fbb8c9e4349c86c54a5 in term 5.
I20250831 19:55:08.212129 2105 leader_election.cc:304] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c830f6055d64a3b8a9f78b405ad8aa3, a4d46bc3ef5a4fbb8c9e4349c86c54a5; no voters: ac75f6e7a0634a89beb9670950e95220
I20250831 19:55:08.212395 3931 raft_consensus.cc:2802] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20250831 19:55:08.212503 3931 raft_consensus.cc:491] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6c830f6055d64a3b8a9f78b405ad8aa3)
I20250831 19:55:08.212582 3931 raft_consensus.cc:3058] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 5 FOLLOWER]: Advancing to term 6
I20250831 19:55:08.215235 3931 raft_consensus.cc:513] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } }
I20250831 19:55:08.215780 3931 leader_election.cc:290] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 6 election: Requested vote from peers 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259), ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943)
I20250831 19:55:08.216251 3875 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" candidate_term: 6 candidate_status { last_received { term: 5 index: 552 } } ignore_live_leader: false dest_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3"
I20250831 19:55:08.216418 3875 raft_consensus.cc:3058] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [term 5 FOLLOWER]: Advancing to term 6
W20250831 19:55:08.216868 2100 leader_election.cc:336] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943): Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
I20250831 19:55:08.219816 3875 raft_consensus.cc:2466] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4d46bc3ef5a4fbb8c9e4349c86c54a5 in term 6.
I20250831 19:55:08.220125 2105 leader_election.cc:304] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c830f6055d64a3b8a9f78b405ad8aa3, a4d46bc3ef5a4fbb8c9e4349c86c54a5; no voters: ac75f6e7a0634a89beb9670950e95220
I20250831 19:55:08.220384 3931 raft_consensus.cc:2802] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 6 FOLLOWER]: Leader election won for term 6
I20250831 19:55:08.220736 3931 raft_consensus.cc:695] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 6 LEADER]: Becoming Leader. State: Replica: a4d46bc3ef5a4fbb8c9e4349c86c54a5, State: Running, Role: LEADER
I20250831 19:55:08.221004 3931 consensus_queue.cc:237] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 552, Committed index: 552, Last appended: 5.552, Last appended by leader: 552, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } }
I20250831 19:55:08.222218 3935 sys_catalog.cc:455] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a4d46bc3ef5a4fbb8c9e4349c86c54a5. Latest consensus state: current_term: 6 leader_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } } }
I20250831 19:55:08.222492 3935 sys_catalog.cc:458] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [sys.catalog]: This master's current role is: LEADER
I20250831 19:55:08.222991 3937 catalog_manager.cc:1477] Loading table and tablet metadata into memory...
W20250831 19:55:08.623992 2100 consensus_peers.cc:489] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 -> Peer ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943): Couldn't send request to peer ac75f6e7a0634a89beb9670950e95220. Status: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250831 19:55:08.714552 3875 raft_consensus.cc:1273] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [term 6 FOLLOWER]: Refusing update from remote peer a4d46bc3ef5a4fbb8c9e4349c86c54a5: Log matching property violated. Preceding OpId in replica: term: 5 index: 552. Preceding OpId from leader: term: 6 index: 553. (index mismatch)
I20250831 19:55:08.715373 3935 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 553, Last known committed idx: 552, Time since last communication: 0.000s
I20250831 19:55:08.718607 3941 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a4d46bc3ef5a4fbb8c9e4349c86c54a5. Latest consensus state: current_term: 6 leader_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } } }
I20250831 19:55:08.718906 3941 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [sys.catalog]: This master's current role is: FOLLOWER
I20250831 19:55:08.719483 3935 sys_catalog.cc:455] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 6 leader_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } } }
I20250831 19:55:08.719674 3935 sys_catalog.cc:458] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [sys.catalog]: This master's current role is: LEADER
I20250831 19:55:08.724251 3941 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 6 leader_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } } }
I20250831 19:55:08.724453 3941 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [sys.catalog]: This master's current role is: FOLLOWER
I20250831 19:55:09.220041 3941 raft_consensus.cc:491] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a4d46bc3ef5a4fbb8c9e4349c86c54a5)
I20250831 19:55:09.220223 3941 raft_consensus.cc:513] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } }
I20250831 19:55:09.221800 3941 leader_election.cc:290] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a4d46bc3ef5a4fbb8c9e4349c86c54a5 (127.1.1.253:45581), ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943)
W20250831 19:55:09.222970 3849 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
W20250831 19:55:09.224309 3849 leader_election.cc:336] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943): Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
I20250831 19:55:09.346359 2042 master_runner.cc:186] Error getting master registration for 127.1.1.252:35943: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111),
I20250831 19:55:09.346539 2042 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20250831 19:55:09.783492 1031 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-taskfwTdIj/build/asan/bin/kudu pid 2042
I20250831 19:55:09.794613 2156 generic_service.cc:196] Checking for leaks (request via RPC)
I20250831 19:55:09.978310 1031 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskfwTdIj/build/asan/bin/kudu with pid 2042
W20250831 19:55:10.002485 3849 connection.cc:537] server connection from 127.0.0.1:42480 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20250831 19:55:10.002869 3849 leader_election.cc:336] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer a4d46bc3ef5a4fbb8c9e4349c86c54a5 (127.1.1.253:45581): Network error: recv got EOF from 127.1.1.253:45581 (error 108)
I20250831 19:55:10.003067 3849 leader_election.cc:304] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c830f6055d64a3b8a9f78b405ad8aa3; no voters: a4d46bc3ef5a4fbb8c9e4349c86c54a5, ac75f6e7a0634a89beb9670950e95220
I20250831 19:55:10.003868 3964 raft_consensus.cc:2747] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20250831 19:55:10.694607 3971 raft_consensus.cc:491] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a4d46bc3ef5a4fbb8c9e4349c86c54a5)
I20250831 19:55:10.694818 3971 raft_consensus.cc:513] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } }
I20250831 19:55:10.695325 3971 leader_election.cc:290] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a4d46bc3ef5a4fbb8c9e4349c86c54a5 (127.1.1.253:45581), ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943)
W20250831 19:55:10.697073 3849 leader_election.cc:336] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer a4d46bc3ef5a4fbb8c9e4349c86c54a5 (127.1.1.253:45581): Network error: Client connection negotiation failed: client connection to 127.1.1.253:45581: connect: Connection refused (error 111)
W20250831 19:55:10.697237 3849 leader_election.cc:336] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943): Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
I20250831 19:55:10.697314 3849 leader_election.cc:304] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c830f6055d64a3b8a9f78b405ad8aa3; no voters: a4d46bc3ef5a4fbb8c9e4349c86c54a5, ac75f6e7a0634a89beb9670950e95220
I20250831 19:55:10.697558 3971 raft_consensus.cc:2747] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20250831 19:55:10.745544 1031 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskfwTdIj/build/asan/bin/kudu
/tmp/dist-test-taskfwTdIj/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.1.253:45581
--webserver_interface=127.1.1.253
--webserver_port=43003
--builtin_ntp_servers=127.1.1.212:44077
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943
--hive_metastore_uris=thrift://127.0.0.1:46163
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20250831 19:55:11.056766 3975 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20250831 19:55:11.057063 3975 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20250831 19:55:11.057171 3975 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20250831 19:55:11.065946 3975 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20250831 19:55:11.066026 3975 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20250831 19:55:11.066087 3975 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20250831 19:55:11.066147 3975 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20250831 19:55:11.075505 3975 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.1.212:44077
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-1/wal
--hive_metastore_uris=thrift://127.0.0.1:46163
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.1.253:45581
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.1.1.253
--webserver_port=43003
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 06466b25e294b4d7d455e6c56263318dc34a80ef
build type FASTDEBUG
built by None at 31 Aug 2025 19:43:25 UTC on 24a791456cd2
build id 7836
ASAN enabled
I20250831 19:55:11.076983 3975 env_posix.cc:2264] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20250831 19:55:11.078895 3975 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250831 19:55:11.086195 3985 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250831 19:55:11.086525 3984 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250831 19:55:11.087098 3987 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250831 19:55:11.087270 3975 server_base.cc:1047] running on GCE node
I20250831 19:55:11.088032 3975 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20250831 19:55:11.089339 3975 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20250831 19:55:11.090517 3975 hybrid_clock.cc:648] HybridClock initialized: now 1756670111090475 us; error 36 us; skew 500 ppm
I20250831 19:55:11.090919 3975 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250831 19:55:11.092942 3975 webserver.cc:480] Webserver started at http://127.1.1.253:43003/ using document root <none> and password file <none>
I20250831 19:55:11.093648 3975 fs_manager.cc:362] Metadata directory not provided
I20250831 19:55:11.093750 3975 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250831 19:55:11.098786 3975 fs_manager.cc:714] Time spent opening directory manager: real 0.003s user 0.001s sys 0.003s
I20250831 19:55:11.101284 3993 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250831 19:55:11.102468 3975 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20250831 19:55:11.102598 3975 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-1/data,/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-1/wal
uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5"
format_stamp: "Formatted at 2025-08-31 19:54:38 on dist-test-slave-v4kn"
I20250831 19:55:11.103173 3975 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250831 19:55:11.138296 3975 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250831 19:55:11.139086 3975 env_posix.cc:2264] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20250831 19:55:11.139366 3975 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250831 19:55:11.159812 4044 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.1.253:45581 every 8 connection(s)
I20250831 19:55:11.159818 3975 rpc_server.cc:307] RPC server started. Bound to: 127.1.1.253:45581
I20250831 19:55:11.161387 3975 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/master-1/data/info.pb
I20250831 19:55:11.162395 1031 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskfwTdIj/build/asan/bin/kudu as pid 3975
I20250831 19:55:11.170706 4045 sys_catalog.cc:263] Verifying existing consensus state
I20250831 19:55:11.176230 4045 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Bootstrap starting.
I20250831 19:55:11.182020 1953 heartbeater.cc:344] Connected to a master server at 127.1.1.253:45581
I20250831 19:55:11.190534 1819 heartbeater.cc:344] Connected to a master server at 127.1.1.253:45581
I20250831 19:55:11.218719 4050 raft_consensus.cc:491] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a4d46bc3ef5a4fbb8c9e4349c86c54a5)
I20250831 19:55:11.218885 4050 raft_consensus.cc:513] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } }
I20250831 19:55:11.219434 4050 leader_election.cc:290] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a4d46bc3ef5a4fbb8c9e4349c86c54a5 (127.1.1.253:45581), ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943)
W20250831 19:55:11.222904 3849 leader_election.cc:336] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943): Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
I20250831 19:55:11.248178 4045 log.cc:826] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Log is configured to *not* fsync() on all Append() calls
I20250831 19:55:11.384644 1681 heartbeater.cc:344] Connected to a master server at 127.1.1.253:45581
I20250831 19:55:11.649421 4045 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Bootstrap replayed 1/1 log segments. Stats: ops{read=553 overwritten=0 applied=553 ignored=0} inserts{seen=359 ignored=0} mutations{seen=502 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250831 19:55:11.650116 4045 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Bootstrap complete.
I20250831 19:55:11.657133 4045 raft_consensus.cc:357] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 6 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } }
I20250831 19:55:11.657826 4045 raft_consensus.cc:738] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 6 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4d46bc3ef5a4fbb8c9e4349c86c54a5, State: Initialized, Role: FOLLOWER
I20250831 19:55:11.658484 4045 consensus_queue.cc:260] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 553, Last appended: 6.553, Last appended by leader: 553, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } }
I20250831 19:55:11.659170 4057 sys_catalog.cc:455] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 6 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } } }
I20250831 19:55:11.659397 4057 sys_catalog.cc:458] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [sys.catalog]: This master's current role is: FOLLOWER
I20250831 19:55:11.660176 4045 sys_catalog.cc:564] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [sys.catalog]: configured and running, proceeding with master startup.
I20250831 19:55:11.660200 4020 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" candidate_term: 7 candidate_status { last_received { term: 6 index: 553 } } ignore_live_leader: false dest_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" is_pre_election: true
I20250831 19:55:11.660660 4020 raft_consensus.cc:2466] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c830f6055d64a3b8a9f78b405ad8aa3 in term 6.
I20250831 19:55:11.661131 3849 leader_election.cc:304] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c830f6055d64a3b8a9f78b405ad8aa3, a4d46bc3ef5a4fbb8c9e4349c86c54a5; no voters: ac75f6e7a0634a89beb9670950e95220
I20250831 19:55:11.661697 4050 raft_consensus.cc:2802] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20250831 19:55:11.661803 4050 raft_consensus.cc:491] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a4d46bc3ef5a4fbb8c9e4349c86c54a5)
I20250831 19:55:11.661890 4050 raft_consensus.cc:3058] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [term 6 FOLLOWER]: Advancing to term 7
I20250831 19:55:11.663975 4050 raft_consensus.cc:513] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } }
I20250831 19:55:11.664523 4050 leader_election.cc:290] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [CANDIDATE]: Term 7 election: Requested vote from peers a4d46bc3ef5a4fbb8c9e4349c86c54a5 (127.1.1.253:45581), ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943)
I20250831 19:55:11.665719 4020 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" candidate_term: 7 candidate_status { last_received { term: 6 index: 553 } } ignore_live_leader: false dest_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5"
I20250831 19:55:11.665886 4020 raft_consensus.cc:3058] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 6 FOLLOWER]: Advancing to term 7
W20250831 19:55:11.666709 3849 leader_election.cc:336] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943): Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
I20250831 19:55:11.669662 4020 raft_consensus.cc:2466] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c830f6055d64a3b8a9f78b405ad8aa3 in term 7.
I20250831 19:55:11.670092 3849 leader_election.cc:304] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c830f6055d64a3b8a9f78b405ad8aa3, a4d46bc3ef5a4fbb8c9e4349c86c54a5; no voters: ac75f6e7a0634a89beb9670950e95220
I20250831 19:55:11.670353 4050 raft_consensus.cc:2802] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [term 7 FOLLOWER]: Leader election won for term 7
I20250831 19:55:11.671406 4050 raft_consensus.cc:695] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [term 7 LEADER]: Becoming Leader. State: Replica: 6c830f6055d64a3b8a9f78b405ad8aa3, State: Running, Role: LEADER
I20250831 19:55:11.671828 4050 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 553, Committed index: 553, Last appended: 6.553, Last appended by leader: 553, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } }
I20250831 19:55:11.674095 4063 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6c830f6055d64a3b8a9f78b405ad8aa3. Latest consensus state: current_term: 7 leader_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } } }
I20250831 19:55:11.674422 4063 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [sys.catalog]: This master's current role is: LEADER
I20250831 19:55:11.675140 4072 catalog_manager.cc:1477] Loading table and tablet metadata into memory...
I20250831 19:55:11.688030 4072 catalog_manager.cc:671] Loaded metadata for table default.table_1d644a2c8bd54f89964228704cd693e6 [id=028e873d141c4006aca7d45be88d9ae3]
I20250831 19:55:11.688808 4072 catalog_manager.cc:671] Loaded metadata for table default.table_3f81774719a24ce68cce90f20487fa97 [id=08d05283df4c4408954c3793beaa4adb]
I20250831 19:55:11.689291 4072 catalog_manager.cc:671] Loaded metadata for table default.table_13fd718b01d445dbb3955c7804421b1e [id=096152b885a04bfd9cced171fb8a12af]
I20250831 19:55:11.689778 4072 catalog_manager.cc:671] Loaded metadata for table default.table_65ae80244c21495fad7b9e506a44ebcc [id=09c2744c9575474bba2df5503541accc]
I20250831 19:55:11.689977 4010 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "2441fafe1d62429386f4631ad423567d" instance_seqno: 1756670080785002) as {username='slave'} at 127.1.1.195:47675; Asking this server to re-register.
I20250831 19:55:11.690312 4072 catalog_manager.cc:671] Loaded metadata for table default.table_fec0d0e06479419886c036a37df0cfdf [id=0e44d9b8a8044f2685d97f13e0b15ef3]
I20250831 19:55:11.691006 4072 catalog_manager.cc:671] Loaded metadata for table default.table_617124885d2e4d96b863e0e435bdf695 [id=0fc929ad819b48a9af984f8c301bad2b]
I20250831 19:55:11.691447 4072 catalog_manager.cc:671] Loaded metadata for table default.table_9e316239c779453a9a3a3b8b84d62adc [id=10598630389746d2886e5687fe074fd7]
I20250831 19:55:11.692345 4072 catalog_manager.cc:671] Loaded metadata for table default.table_a03aade65d4449ec87fdbd94f7edd5ca [id=124c069ee3d5449cb64e8a816f67a365]
I20250831 19:55:11.692782 4072 catalog_manager.cc:671] Loaded metadata for table default.table_dbeae8f9a2c34da78b7e284664c00cd1 [id=1aaaa30dc3cd4d8497bc2a18ab02ec3d]
I20250831 19:55:11.693274 4072 catalog_manager.cc:671] Loaded metadata for table default.table_492565dabb704c25b9c4d1849bcb8eeb [id=1c606e303bbe40afaf2ec496b8680b4c]
I20250831 19:55:11.693780 4072 catalog_manager.cc:671] Loaded metadata for table default.table_e3c1c1682df94256ae59468b2f23f6e9 [id=1c615ebd2b914a3f9ce6dc130e8c8d25]
I20250831 19:55:11.694263 4072 catalog_manager.cc:671] Loaded metadata for table default.table_c7390b7344da4c3fbf7f2f502b096669 [id=1df66f6230794e939a25c0f2254d6e17]
I20250831 19:55:11.695484 4072 catalog_manager.cc:671] Loaded metadata for table default.table_bced9a3b747a4c33b6fc5b05b2a4dd89 [id=2b57fa1ef98f4029bc75e981255c74da]
I20250831 19:55:11.696612 4072 catalog_manager.cc:671] Loaded metadata for table default.table_2f8e5422042942d6a683316fbd7ac45d [id=30b1e9d6cb5e486fbed42ac06053ebc3]
I20250831 19:55:11.697075 4072 catalog_manager.cc:671] Loaded metadata for table default.table_4021d3dbb7f04e50997c9cc51c7e3888 [id=321a68b57ebf4e3a80670c3c862403f1]
I20250831 19:55:11.697160 4009 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "de831f40fa1348a48a1f0260f4130197" instance_seqno: 1756670080362800) as {username='slave'} at 127.1.1.194:59375; Asking this server to re-register.
I20250831 19:55:11.697597 4072 catalog_manager.cc:671] Loaded metadata for table default.table_dbd9b94e2d224171acd87195ab912666 [id=3671adc17a134657a7e9b07c97bea371]
I20250831 19:55:11.698602 1953 heartbeater.cc:461] Registering TS with master...
I20250831 19:55:11.698866 1819 heartbeater.cc:461] Registering TS with master...
I20250831 19:55:11.700138 4075 catalog_manager.cc:1261] Loaded cluster ID: 003a9cb4df1f460dbfc9d2f57d96ced1
I20250831 19:55:11.698252 4072 catalog_manager.cc:671] Loaded metadata for table default.table_969c1fd9ed5340858aa7434d10785589 [id=416489b351d443ebb067fa9b8625e63e]
I20250831 19:55:11.700213 4075 catalog_manager.cc:1554] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: loading cluster ID for follower catalog manager: success
I20250831 19:55:11.700847 4072 catalog_manager.cc:671] Loaded metadata for table default.table_0409d51b133145c5b7e7d4d407a471b2 [id=4cfc2f0bed1f4f5c80524f8cf8d69f3e]
I20250831 19:55:11.701498 4072 catalog_manager.cc:671] Loaded metadata for table default.table_be7bbefda22d4660a8d257962bfe0979 [id=5579e4d41f7b456b8d92804eb3d03711]
I20250831 19:55:11.701673 4009 ts_manager.cc:194] Registered new tserver with Master: 2441fafe1d62429386f4631ad423567d (127.1.1.195:43237)
I20250831 19:55:11.701977 4072 catalog_manager.cc:671] Loaded metadata for table default.table_76aceaaac1fb4aaeb55445d641a113d1 [id=5646c567b288436588bca1dde5d6e213]
I20250831 19:55:11.702593 4072 catalog_manager.cc:671] Loaded metadata for table default.table_f6d2041746f14f4a84962c26b1df1118 [id=59220fba0aa647bca189db2218f3e28f]
I20250831 19:55:11.703234 4072 catalog_manager.cc:671] Loaded metadata for table default.table_20d403c55682499a9ba3267b85aecde7 [id=5b8cc2293fc545e7bedbf645db8dd2ce]
I20250831 19:55:11.704247 4072 catalog_manager.cc:671] Loaded metadata for table default.table_9e76b4c3909b459c812cb7fbddc11988 [id=5cc9b389dd1f4a0289aaecd18be10263]
I20250831 19:55:11.704563 4009 ts_manager.cc:194] Registered new tserver with Master: de831f40fa1348a48a1f0260f4130197 (127.1.1.194:41475)
I20250831 19:55:11.704777 4072 catalog_manager.cc:671] Loaded metadata for table default.table_af003c3f30c04853bc025b34d543d0e0 [id=5ce6c4d5dcd34d73af61fd2c4bf28799]
I20250831 19:55:11.705734 4072 catalog_manager.cc:671] Loaded metadata for table default.table_b63fcfe30c4b42e4aab0afa9159eff8b [id=690a54011d784c13992fd596584eadb8]
I20250831 19:55:11.706288 4072 catalog_manager.cc:671] Loaded metadata for table default.table_6c90d2f731914735837fa73efe73971b [id=69ff45f06b4641a987204b04e7586cb7]
I20250831 19:55:11.707223 4072 catalog_manager.cc:671] Loaded metadata for table default.table_f205daa920134307a850938482f79a93 [id=7a926135e65e459cb72f8766db79f2cf]
I20250831 19:55:11.707755 4072 catalog_manager.cc:671] Loaded metadata for table default.table_87e693c7c4a14344a2fe8a792457842d [id=7ad45cd85b694203b15bae99967c8b19]
I20250831 19:55:11.708213 4072 catalog_manager.cc:671] Loaded metadata for table default.table_5546b3f364ce47768a100eec7bcf06af [id=7c4a0345486747339c3e158a950bc5aa]
I20250831 19:55:11.708698 4072 catalog_manager.cc:671] Loaded metadata for table default.table_4c0155db27d445829ea2e453cd3ad0f3 [id=7d31bd8f26c94d15b09cf05778a2f253]
I20250831 19:55:11.709278 4072 catalog_manager.cc:671] Loaded metadata for table default.table_0bd3ac197d96497390258988a7c498f4 [id=7d4c018fcf534133bcf67cf6c12e3607]
I20250831 19:55:11.709781 4075 catalog_manager.cc:1576] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: acquiring CA information for follower catalog manager: success
I20250831 19:55:11.710304 4072 catalog_manager.cc:671] Loaded metadata for table default.table_9ef01b3dfa2640dbbd4b622e06a1da94 [id=7e12dc19746647d790e1d0c465317f0d]
I20250831 19:55:11.710915 4072 catalog_manager.cc:671] Loaded metadata for table default.table_8df2121e4bed46549eeca09cee50f14b [id=86819fd5cdeb4d1bafa01e65ce6300e1]
I20250831 19:55:11.711689 4072 catalog_manager.cc:671] Loaded metadata for table default.table_1d29197c8463471d898f54b5dadaefc2 [id=8ef92f9201b34066b2b621ae3aa92ebe]
I20250831 19:55:11.712105 4072 catalog_manager.cc:671] Loaded metadata for table default.table_930d37393d93428bb6c9407bbd479a71 [id=921f83cf8ea14fd68e86ce2b90aac92c]
I20250831 19:55:11.712716 4072 catalog_manager.cc:671] Loaded metadata for table default.table_75aa254646a24998b06bc2c45a479df2 [id=93c25513734040679fce59ac7b69ba38]
I20250831 19:55:11.713168 4072 catalog_manager.cc:671] Loaded metadata for table default.table_30272e2642084b1390e459c21c0bee62 [id=957ba0c5f36f4524a898d3126ed9ec26]
I20250831 19:55:11.713815 4072 catalog_manager.cc:671] Loaded metadata for table default.table_ac609d4af0b748438a68966d468a56c6 [id=9b01227041494090854149aefbbc4a88]
I20250831 19:55:11.714274 4072 catalog_manager.cc:671] Loaded metadata for table default.table_06c3d3b006e64e1b8e20c6d64625ea64 [id=a0fbaa8ae6b54d03abdd641e2e0eb746]
I20250831 19:55:11.714865 4072 catalog_manager.cc:671] Loaded metadata for table default.table_c0b1a771fbef4422a91422a51e5dc1f6 [id=a2e1d51e394b45bdbb816beebada66e9]
I20250831 19:55:11.716058 4072 catalog_manager.cc:671] Loaded metadata for table default.table_1dd756d1d1c14b878105f242f44b087e [id=aabaa79336954b3ab0450dcff3afa7bf]
I20250831 19:55:11.716519 4072 catalog_manager.cc:671] Loaded metadata for table default.table_5bc22ff7931245ad82121fb433351a08 [id=acf00823fd974ac6bcbff016c1296aa5]
I20250831 19:55:11.717394 4072 catalog_manager.cc:671] Loaded metadata for table default.table_b4399bb161024e3eb0b69c23e3f9af47 [id=b3f794b4f5384662a4cdff8f76f56a66]
I20250831 19:55:11.717908 4072 catalog_manager.cc:671] Loaded metadata for table default.table_4e12fc12cae640b99d4f3794151b6915 [id=ba4c5ecf4ae94ede9bfb83af2ee894ab]
I20250831 19:55:11.718369 4075 catalog_manager.cc:1604] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20250831 19:55:11.719424 4072 catalog_manager.cc:671] Loaded metadata for table default.table_ba7cea85816c4b98a116ec6b7a569c98 [id=c8f8d410198f4e0ba51900271218aebe]
I20250831 19:55:11.720418 4072 catalog_manager.cc:671] Loaded metadata for table default.table_4dba59fc46824095bd698aa0ccc13224 [id=d340aa6d78a5421f9e03785004d551c7]
I20250831 19:55:11.720844 4072 catalog_manager.cc:671] Loaded metadata for table default.table_160ddd96ddce4f1788f276ea8535d70b [id=d39100e5184f4a9ca1932e0d3cd0b243]
I20250831 19:55:11.725097 4072 catalog_manager.cc:671] Loaded metadata for table default.table_c3cffc1117c341b0b3a7d4f82c01763a [id=da5a81d8cada4041bd31e0bb6369d108]
I20250831 19:55:11.725586 4072 catalog_manager.cc:671] Loaded metadata for table default.table_e28995f706a34a2cb421352cb92a7349 [id=dc8984dc66cb4a01813cb742320a34cc]
I20250831 19:55:11.725903 4072 catalog_manager.cc:671] Loaded metadata for table default.table_42c6b8d164fd442bb4d9d239110099aa [id=e5568b781ed34d098b2b97bf896dd3b0]
I20250831 19:55:11.726866 4072 catalog_manager.cc:671] Loaded metadata for table default.table_207ac87518bc487184a89bb52cd204b3 [id=f48af5bc3eff4c819be4aeeff4128c2a]
I20250831 19:55:11.727216 4072 catalog_manager.cc:671] Loaded metadata for table default.table_08b74e57795c4dd8a7f91f01e1b5ba4a [id=f63d391a9c824314bf6789cc7bbb5ffb]
I20250831 19:55:11.727952 4072 catalog_manager.cc:671] Loaded metadata for table default.table_c48f1c99f3174cb8acca698339447ed9 [id=f707909e6af44750a5fc5e3b15af0b24]
I20250831 19:55:11.728356 4072 catalog_manager.cc:671] Loaded metadata for table default.table_dd23f581be78471f98008014d30c3398 [id=fa5e29f502aa4eae9056a1e220d6e9bc]
I20250831 19:55:11.728833 4072 catalog_manager.cc:671] Loaded metadata for table default.table_ea8910dd3df74137a9832974c833f71e [id=fd551e0ec667492c86ff0aaed181366b]
I20250831 19:55:11.729274 4072 catalog_manager.cc:671] Loaded metadata for table default.table_afb8eb0248714122aa74efa2d6fcfce4 [id=fe54e4791a0d4e3c9a36e1968988ea0d]
I20250831 19:55:11.736814 4072 tablet_loader.cc:96] loaded metadata for tablet 06c27385b0b8460c9ea4f1d96ecb2966 (table default.table_4e12fc12cae640b99d4f3794151b6915 [id=ba4c5ecf4ae94ede9bfb83af2ee894ab])
I20250831 19:55:11.739133 4072 tablet_loader.cc:96] loaded metadata for tablet 1ea70a674686459d88265f5f5524fc10 (table default.table_dd23f581be78471f98008014d30c3398 [id=fa5e29f502aa4eae9056a1e220d6e9bc])
I20250831 19:55:11.739777 4072 tablet_loader.cc:96] loaded metadata for tablet 26637de652434209aafd5fc15d68146d (table default.table_8df2121e4bed46549eeca09cee50f14b [id=86819fd5cdeb4d1bafa01e65ce6300e1])
I20250831 19:55:11.740144 4072 tablet_loader.cc:96] loaded metadata for tablet 27a32ae2ed1a4b94b1a2e6a9aa9d0d8c (table default.table_5546b3f364ce47768a100eec7bcf06af [id=7c4a0345486747339c3e158a950bc5aa])
I20250831 19:55:11.740496 4072 tablet_loader.cc:96] loaded metadata for tablet 29203140e57a4cacb70e3a6115272738 (table default.table_42c6b8d164fd442bb4d9d239110099aa [id=e5568b781ed34d098b2b97bf896dd3b0])
I20250831 19:55:11.740839 4072 tablet_loader.cc:96] loaded metadata for tablet 2a0c12b9233244809b96121e034c029e (table default.table_af003c3f30c04853bc025b34d543d0e0 [id=5ce6c4d5dcd34d73af61fd2c4bf28799])
I20250831 19:55:11.742020 4072 tablet_loader.cc:96] loaded metadata for tablet 2c57c6e3bf0c4ffaa30abb7e800a3bea (table default.table_dbd9b94e2d224171acd87195ab912666 [id=3671adc17a134657a7e9b07c97bea371])
I20250831 19:55:11.742342 4072 tablet_loader.cc:96] loaded metadata for tablet 2f11ba75567f46709e48075f6b60ce5a (table default.table_e3c1c1682df94256ae59468b2f23f6e9 [id=1c615ebd2b914a3f9ce6dc130e8c8d25])
I20250831 19:55:11.743870 4072 tablet_loader.cc:96] loaded metadata for tablet 48c3872dbaee495fb80d1415b5631eaf (table default.table_08b74e57795c4dd8a7f91f01e1b5ba4a [id=f63d391a9c824314bf6789cc7bbb5ffb])
I20250831 19:55:11.745760 4072 tablet_loader.cc:96] loaded metadata for tablet 5a080bbabe8840c3ba954bdc0626dc39 (table default.table_492565dabb704c25b9c4d1849bcb8eeb [id=1c606e303bbe40afaf2ec496b8680b4c])
I20250831 19:55:11.747152 4072 tablet_loader.cc:96] loaded metadata for tablet 5fcb923d81a2495fa02dc76ddb9983b7 (table default.table_30272e2642084b1390e459c21c0bee62 [id=957ba0c5f36f4524a898d3126ed9ec26])
I20250831 19:55:11.747507 4072 tablet_loader.cc:96] loaded metadata for tablet 61101a699bb84b62af4e7a0cae243d4e (table default.table_207ac87518bc487184a89bb52cd204b3 [id=f48af5bc3eff4c819be4aeeff4128c2a])
I20250831 19:55:11.748075 4072 tablet_loader.cc:96] loaded metadata for tablet 644cb7245dcf4097a35de65c2767041a (table default.table_617124885d2e4d96b863e0e435bdf695 [id=0fc929ad819b48a9af984f8c301bad2b])
I20250831 19:55:11.748625 4072 tablet_loader.cc:96] loaded metadata for tablet 6952ee3fe766450993142c673d9509e8 (table default.table_f6d2041746f14f4a84962c26b1df1118 [id=59220fba0aa647bca189db2218f3e28f])
I20250831 19:55:11.750945 4072 tablet_loader.cc:96] loaded metadata for tablet 7a217324e97b43e5a7ec540e3b9f70a5 (table default.table_1dd756d1d1c14b878105f242f44b087e [id=aabaa79336954b3ab0450dcff3afa7bf])
I20250831 19:55:11.751309 4072 tablet_loader.cc:96] loaded metadata for tablet 7afc8e9259a548fe946265ea513fde2f (table default.table_bced9a3b747a4c33b6fc5b05b2a4dd89 [id=2b57fa1ef98f4029bc75e981255c74da])
I20250831 19:55:11.752879 4072 tablet_loader.cc:96] loaded metadata for tablet 84177615877240688a2d4b3b88915525 (table default.table_75aa254646a24998b06bc2c45a479df2 [id=93c25513734040679fce59ac7b69ba38])
I20250831 19:55:11.753409 4072 tablet_loader.cc:96] loaded metadata for tablet 876f49b43408443da6a867c03df891b9 (table default.table_6c90d2f731914735837fa73efe73971b [id=69ff45f06b4641a987204b04e7586cb7])
I20250831 19:55:11.753813 4072 tablet_loader.cc:96] loaded metadata for tablet 8aa9b1c1435545d7a212b2e97e7a2931 (table default.table_87e693c7c4a14344a2fe8a792457842d [id=7ad45cd85b694203b15bae99967c8b19])
I20250831 19:55:11.754369 4072 tablet_loader.cc:96] loaded metadata for tablet 8afbd19c84f14fbb8f957c2f10d97a4c (table default.table_c48f1c99f3174cb8acca698339447ed9 [id=f707909e6af44750a5fc5e3b15af0b24])
I20250831 19:55:11.754730 4072 tablet_loader.cc:96] loaded metadata for tablet 8ebf42e07edf40f9b95b0304a912b9b8 (table default.table_3f81774719a24ce68cce90f20487fa97 [id=08d05283df4c4408954c3793beaa4adb])
I20250831 19:55:11.755707 4072 tablet_loader.cc:96] loaded metadata for tablet 93bfd2c663634436a61211a406c9f92f (table default.table_969c1fd9ed5340858aa7434d10785589 [id=416489b351d443ebb067fa9b8625e63e])
I20250831 19:55:11.756044 4072 tablet_loader.cc:96] loaded metadata for tablet 9525ea0cb58146d6851936d749447c3f (table default.table_b4399bb161024e3eb0b69c23e3f9af47 [id=b3f794b4f5384662a4cdff8f76f56a66])
I20250831 19:55:11.756992 4072 tablet_loader.cc:96] loaded metadata for tablet 9c19b3ec9e844963a8392f0a2a97e25e (table default.table_e28995f706a34a2cb421352cb92a7349 [id=dc8984dc66cb4a01813cb742320a34cc])
I20250831 19:55:11.757563 4072 tablet_loader.cc:96] loaded metadata for tablet 9dd77008323943ceaf515422255c8a23 (table default.table_9ef01b3dfa2640dbbd4b622e06a1da94 [id=7e12dc19746647d790e1d0c465317f0d])
I20250831 19:55:11.758185 4072 tablet_loader.cc:96] loaded metadata for tablet 9fc4297f4d704acda823360fe6d406cf (table default.table_9e316239c779453a9a3a3b8b84d62adc [id=10598630389746d2886e5687fe074fd7])
I20250831 19:55:11.758749 4072 tablet_loader.cc:96] loaded metadata for tablet a4e2586021c046dd8c5acd838bb5e83f (table default.table_a03aade65d4449ec87fdbd94f7edd5ca [id=124c069ee3d5449cb64e8a816f67a365])
I20250831 19:55:11.759503 4072 tablet_loader.cc:96] loaded metadata for tablet a5e30fe82a41499caa5e79fa1560c1be (table default.table_1d29197c8463471d898f54b5dadaefc2 [id=8ef92f9201b34066b2b621ae3aa92ebe])
I20250831 19:55:11.759843 4072 tablet_loader.cc:96] loaded metadata for tablet a6a3938379c64baba6f5f2c1a2f7087a (table default.table_06c3d3b006e64e1b8e20c6d64625ea64 [id=a0fbaa8ae6b54d03abdd641e2e0eb746])
I20250831 19:55:11.760800 4072 tablet_loader.cc:96] loaded metadata for tablet b0d177e2e2f745b8969b65ab318321a1 (table default.table_2f8e5422042942d6a683316fbd7ac45d [id=30b1e9d6cb5e486fbed42ac06053ebc3])
I20250831 19:55:11.761583 4072 tablet_loader.cc:96] loaded metadata for tablet b54e648cf8e04022ad0bc099534424d1 (table default.table_76aceaaac1fb4aaeb55445d641a113d1 [id=5646c567b288436588bca1dde5d6e213])
I20250831 19:55:11.762698 4072 tablet_loader.cc:96] loaded metadata for tablet b7576e353a1c46b5af830f437afcb207 (table default.table_160ddd96ddce4f1788f276ea8535d70b [id=d39100e5184f4a9ca1932e0d3cd0b243])
I20250831 19:55:11.763350 4072 tablet_loader.cc:96] loaded metadata for tablet bd12184dd70f451fbd9a2025d2c00758 (table default.table_ba7cea85816c4b98a116ec6b7a569c98 [id=c8f8d410198f4e0ba51900271218aebe])
I20250831 19:55:11.763732 4072 tablet_loader.cc:96] loaded metadata for tablet bd2f43a6cd1d4782a420fe5e4e110ead (table default.table_65ae80244c21495fad7b9e506a44ebcc [id=09c2744c9575474bba2df5503541accc])
I20250831 19:55:11.764081 4072 tablet_loader.cc:96] loaded metadata for tablet bddbec77b8444036b0c5e8d325faceaa (table default.table_be7bbefda22d4660a8d257962bfe0979 [id=5579e4d41f7b456b8d92804eb3d03711])
I20250831 19:55:11.764645 4072 tablet_loader.cc:96] loaded metadata for tablet be23b28b74554b03a10a278c55b1d382 (table default.table_fec0d0e06479419886c036a37df0cfdf [id=0e44d9b8a8044f2685d97f13e0b15ef3])
I20250831 19:55:11.765410 4072 tablet_loader.cc:96] loaded metadata for tablet c1ccea09b6c34c52a9212a5a481c80f7 (table default.table_0409d51b133145c5b7e7d4d407a471b2 [id=4cfc2f0bed1f4f5c80524f8cf8d69f3e])
I20250831 19:55:11.765854 4072 tablet_loader.cc:96] loaded metadata for tablet c307e8673f164f509e0c5ebcfcc2a033 (table default.table_ac609d4af0b748438a68966d468a56c6 [id=9b01227041494090854149aefbbc4a88])
I20250831 19:55:11.766180 4072 tablet_loader.cc:96] loaded metadata for tablet c47f69c5eeda4044b5c0f796375c013b (table default.table_5bc22ff7931245ad82121fb433351a08 [id=acf00823fd974ac6bcbff016c1296aa5])
I20250831 19:55:11.766510 4072 tablet_loader.cc:96] loaded metadata for tablet c515598ee89b4f1a8839c28c7e7bc0c9 (table default.table_20d403c55682499a9ba3267b85aecde7 [id=5b8cc2293fc545e7bedbf645db8dd2ce])
I20250831 19:55:11.767293 4072 tablet_loader.cc:96] loaded metadata for tablet c6db2a319cbf4359846c5f930ce8f0de (table default.table_0bd3ac197d96497390258988a7c498f4 [id=7d4c018fcf534133bcf67cf6c12e3607])
I20250831 19:55:11.767931 4072 tablet_loader.cc:96] loaded metadata for tablet cb21c47c27ea4f34801e93bd647e41b5 (table default.table_ea8910dd3df74137a9832974c833f71e [id=fd551e0ec667492c86ff0aaed181366b])
I20250831 19:55:11.768492 4072 tablet_loader.cc:96] loaded metadata for tablet ce4d37816b1349cbaa51fad42b80e8bc (table default.table_dbeae8f9a2c34da78b7e284664c00cd1 [id=1aaaa30dc3cd4d8497bc2a18ab02ec3d])
I20250831 19:55:11.769021 4072 tablet_loader.cc:96] loaded metadata for tablet d1f811715ac64ca591a84b52be6e2621 (table default.table_c3cffc1117c341b0b3a7d4f82c01763a [id=da5a81d8cada4041bd31e0bb6369d108])
I20250831 19:55:11.769804 4072 tablet_loader.cc:96] loaded metadata for tablet d7551c6a0ebd493dba75b1f766c4db0f (table default.table_4021d3dbb7f04e50997c9cc51c7e3888 [id=321a68b57ebf4e3a80670c3c862403f1])
I20250831 19:55:11.770134 4072 tablet_loader.cc:96] loaded metadata for tablet dc6c1d165b5a484ab98ac55cd2330139 (table default.table_930d37393d93428bb6c9407bbd479a71 [id=921f83cf8ea14fd68e86ce2b90aac92c])
I20250831 19:55:11.770695 4072 tablet_loader.cc:96] loaded metadata for tablet e030c417e8c64c72a509258b74f72ff2 (table default.table_f205daa920134307a850938482f79a93 [id=7a926135e65e459cb72f8766db79f2cf])
I20250831 19:55:11.771029 4072 tablet_loader.cc:96] loaded metadata for tablet e47844d025bf42ecbfd2d3f34a31538e (table default.table_c7390b7344da4c3fbf7f2f502b096669 [id=1df66f6230794e939a25c0f2254d6e17])
I20250831 19:55:11.771997 4072 tablet_loader.cc:96] loaded metadata for tablet eb97839972ba4bda89287c30da49bb40 (table default.table_13fd718b01d445dbb3955c7804421b1e [id=096152b885a04bfd9cced171fb8a12af])
I20250831 19:55:11.772526 4072 tablet_loader.cc:96] loaded metadata for tablet eed712e77ad740ae95050fe589f3a61a (table default.table_9e76b4c3909b459c812cb7fbddc11988 [id=5cc9b389dd1f4a0289aaecd18be10263])
I20250831 19:55:11.772868 4072 tablet_loader.cc:96] loaded metadata for tablet f0f12cd5b1354e73990c0cced8e29fd8 (table default.table_c0b1a771fbef4422a91422a51e5dc1f6 [id=a2e1d51e394b45bdbb816beebada66e9])
I20250831 19:55:11.773699 4072 tablet_loader.cc:96] loaded metadata for tablet f42849cccf8a45ed95794eac0e3922e7 (table default.table_afb8eb0248714122aa74efa2d6fcfce4 [id=fe54e4791a0d4e3c9a36e1968988ea0d])
I20250831 19:55:11.774055 4072 tablet_loader.cc:96] loaded metadata for tablet f47cf07c9a4a43048123794e4a51904b (table default.table_4c0155db27d445829ea2e453cd3ad0f3 [id=7d31bd8f26c94d15b09cf05778a2f253])
I20250831 19:55:11.774668 4072 tablet_loader.cc:96] loaded metadata for tablet f7a7fad8a2ca4da297070dd3b49bc2d8 (table default.table_4dba59fc46824095bd698aa0ccc13224 [id=d340aa6d78a5421f9e03785004d551c7])
I20250831 19:55:11.775035 4072 tablet_loader.cc:96] loaded metadata for tablet f8578694650b4379a66d9ea3df34ca0c (table default.table_b63fcfe30c4b42e4aab0afa9159eff8b [id=690a54011d784c13992fd596584eadb8])
I20250831 19:55:11.776051 4072 tablet_loader.cc:96] loaded metadata for tablet fae02e9ed1434c7c82f6c5faa3a1acec (table default.table_1d644a2c8bd54f89964228704cd693e6 [id=028e873d141c4006aca7d45be88d9ae3])
I20250831 19:55:11.776821 4072 catalog_manager.cc:1486] Initializing Kudu cluster ID...
I20250831 19:55:11.785861 4072 catalog_manager.cc:1261] Loaded cluster ID: 003a9cb4df1f460dbfc9d2f57d96ced1
I20250831 19:55:11.785957 4072 catalog_manager.cc:1497] Initializing Kudu internal certificate authority...
I20250831 19:55:11.792378 4072 catalog_manager.cc:1506] Loading token signing keys...
I20250831 19:55:11.790381 3975 master_runner.cc:186] Error getting master registration for 127.1.1.252:35943: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111),
I20250831 19:55:11.795351 3975 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20250831 19:55:11.797243 4072 catalog_manager.cc:5966] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3: Loaded TSK: 0
I20250831 19:55:11.798043 4072 catalog_manager.cc:1516] Initializing in-progress tserver states...
I20250831 19:55:11.801345 4072 catalog_manager.cc:1529] Loading latest processed Hive Metastore notification log event ID...
I20250831 19:55:11.804673 4072 catalog_manager.cc:5804] Last processed Hive Metastore notification event ID: 185
I20250831 19:55:11.888846 3863 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42460:
table { table_name: "default.Table_c48f1c99f3174cb8acca698339447ed9" } modify_external_catalogs: true
I20250831 19:55:11.889142 3863 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42460:
table { table_name: "default.Table_c48f1c99f3174cb8acca698339447ed9" } modify_external_catalogs: true
I20250831 19:55:11.889638 3858 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42460:
table { table_name: "default.Table_6c90d2f731914735837fa73efe73971b" } modify_external_catalogs: true
I20250831 19:55:11.889868 3858 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42460:
table { table_name: "default.Table_6c90d2f731914735837fa73efe73971b" } modify_external_catalogs: true
I20250831 19:55:11.890211 3856 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42460:
table { table_name: "default.Table_1dd756d1d1c14b878105f242f44b087e" } modify_external_catalogs: true
I20250831 19:55:11.890313 3857 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42460:
table { table_name: "default.Table_5546b3f364ce47768a100eec7bcf06af" } new_table_name: "default.Table_189482ae066d4f3788e6dc385456891c" modify_external_catalogs: true
I20250831 19:55:11.890427 3856 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42460:
table { table_name: "default.Table_1dd756d1d1c14b878105f242f44b087e" } modify_external_catalogs: true
I20250831 19:55:11.889798 3865 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42460:
table { table_name: "default.Table_0409d51b133145c5b7e7d4d407a471b2" } new_table_name: "default.Table_615fc2c3b7bb4650bee9ad184ed4e886" modify_external_catalogs: true
I20250831 19:55:11.890869 3859 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42460:
table { table_name: "default.Table_9ef01b3dfa2640dbbd4b622e06a1da94" } new_table_name: "default.Table_4c80ce33565e497686cb53f6a100c6e0" modify_external_catalogs: true
I20250831 19:55:11.891501 3860 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42460:
name: "default.Table_a9e5115b40204ad6afb299f06aa717a2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:55:11.891773 4009 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "89aa85d59c53436ebdf3074b13d14825" instance_seqno: 1756670079933967) as {username='slave'} at 127.1.1.193:44607; Asking this server to re-register.
I20250831 19:55:11.892266 3861 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42460:
name: "default.Table_e3b5fcc868e34263984dd116c032f2ac"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250831 19:55:11.892768 3862 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42460:
table { table_name: "default.Table_76aceaaac1fb4aaeb55445d641a113d1" } new_table_name: "default.Table_4898d53becde4f898538edc03de0d520" modify_external_catalogs: true
I20250831 19:55:11.893359 1681 heartbeater.cc:461] Registering TS with master...
F20250831 19:55:11.895596 3925 hms_notification_log_listener.cc:287] non-monotonous event IDs from HMS: current 191, previous 191; dumping first 7 out of 13 received events: NotificationEvent(eventId=186, eventTime=1756670100, eventType=ALTER_TABLE, dbName=default, tableName=table_dcdb51c187224f8c88da49b3ddd45493, message={"server":"","servicePrincipal":"","db":"default","table":"table_617124885d2e4d96b863e0e435bdf695","tableType":"MANAGED_TABLE","tableObjBeforeJson":"{\"1\":{\"str\":\"table_617124885d2e4d96b863e0e435bdf695\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1756670086},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/warehouse/table_617124885d2e4d96b863e0e435bdf695\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_617124885d2e4d96b863e0e435bdf695\",\"kudu.table_id\":\"0fc929ad819b48a9af984f8c301bad2b\",\"transient_lastDdlTime\":\"1756670086\",\"comment\":\"\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.master_addresses\":\"127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943\",\"kudu.cluster_id\":\"003a9cb4df1f460dbfc9d2f57d96ced1\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","tableObjAfterJson":"{\"1\":{\"str\":\"table_dcdb51c187224f8c88da49b3ddd45493\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1756670086},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/warehouse/table_dcdb51c187224f8c88da49b3ddd45493\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_dcdb51c187224f8c88da49b3ddd45493\",\"kudu.table_id\":\"0fc929ad819b48a9af984f8c301bad2b\",\"transient_lastDdlTime\":\"1756670086\",\"comment\":\"\",\"kudu.master_addresses\":\"127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"003a9cb4df1f460dbfc9d2f57d96ced1\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","isTruncateOp":"false","timestamp":1756670100}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=187, eventTime=1756670100, eventType=ALTER_TABLE, dbName=default, tableName=table_615fc2c3b7bb4650bee9ad184ed4e886, message={"server":"","servicePrincipal":"","db":"default","table":"table_0409d51b133145c5b7e7d4d407a471b2","tableType":"MANAGED_TABLE","tableObjBeforeJson":"{\"1\":{\"str\":\"table_0409d51b133145c5b7e7d4d407a471b2\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1756670093},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/warehouse/table_0409d51b133145c5b7e7d4d407a471b2\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_0409d51b133145c5b7e7d4d407a471b2\",\"kudu.table_id\":\"4cfc2f0bed1f4f5c80524f8cf8d69f3e\",\"transient_lastDdlTime\":\"1756670093\",\"comment\":\"\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.master_addresses\":\"127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943\",\"kudu.cluster_id\":\"003a9cb4df1f460dbfc9d2f57d96ced1\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","tableObjAfterJson":"{\"1\":{\"str\":\"table_615fc2c3b7bb4650bee9ad184ed4e886\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1756670093},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/warehouse/table_615fc2c3b7bb4650bee9ad184ed4e886\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_615fc2c3b7bb4650bee9ad184ed4e886\",\"kudu.table_id\":\"4cfc2f0bed1f4f5c80524f8cf8d69f3e\",\"transient_lastDdlTime\":\"1756670093\",\"comment\":\"\",\"kudu.master_addresses\":\"127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"003a9cb4df1f460dbfc9d2f57d96ced1\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","isTruncateOp":"false","timestamp":1756670100}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=188, eventTime=1756670100, eventType=CREATE_TABLE, dbName=default, tableName=table_5b6b5bfafb524e0a9e93a06dbd4456c9, message={"server":"","servicePrincipal":"","db":"default","table":"table_5b6b5bfafb524e0a9e93a06dbd4456c9","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_5b6b5bfafb524e0a9e93a06dbd4456c9\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1756670100},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/warehouse/table_5b6b5bfafb524e0a9e93a06dbd4456c9\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_5b6b5bfafb524e0a9e93a06dbd4456c9\",\"kudu.table_id\":\"53e85e8b37dd4a1eb36c7af9465f7304\",\"transient_lastDdlTime\":\"1756670100\",\"comment\":\"\",\"kudu.master_addresses\":\"127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"003a9cb4df1f460dbfc9d2f57d96ced1\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1756670100,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=189, eventTime=1756670100, eventType=CREATE_TABLE, dbName=default, tableName=table_8df2121e4bed46549eeca09cee50f14b, message={"server":"","servicePrincipal":"","db":"default","table":"table_8df2121e4bed46549eeca09cee50f14b","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_8df2121e4bed46549eeca09cee50f14b\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1756670100},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/warehouse/table_8df2121e4bed46549eeca09cee50f14b\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_8df2121e4bed46549eeca09cee50f14b\",\"kudu.table_id\":\"86819fd5cdeb4d1bafa01e65ce6300e1\",\"transient_lastDdlTime\":\"1756670100\",\"comment\":\"\",\"kudu.master_addresses\":\"127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"003a9cb4df1f460dbfc9d2f57d96ced1\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1756670100,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=190, eventTime=1756670100, eventType=CREATE_TABLE, dbName=default, tableName=table_c0b1a771fbef4422a91422a51e5dc1f6, message={"server":"","servicePrincipal":"","db":"default","table":"table_c0b1a771fbef4422a91422a51e5dc1f6","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_c0b1a771fbef4422a91422a51e5dc1f6\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1756670100},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/warehouse/table_c0b1a771fbef4422a91422a51e5dc1f6\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_c0b1a771fbef4422a91422a51e5dc1f6\",\"kudu.table_id\":\"a2e1d51e394b45bdbb816beebada66e9\",\"transient_lastDdlTime\":\"1756670100\",\"comment\":\"\",\"kudu.master_addresses\":\"127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"003a9cb4df1f460dbfc9d2f57d96ced1\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1756670100,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=191, eventTime=1756670101, eventType=DROP_TABLE, dbName=default, tableName=table_ca7adb92869942138e0f7dbe76fa583f, message={"server":"","servicePrincipal":"","db":"default","table":"table_ca7adb92869942138e0f7dbe76fa583f","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_ca7adb92869942138e0f7dbe76fa583f\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1756670100},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/warehouse/table_ca7adb92869942138e0f7dbe76fa583f\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_ca7adb92869942138e0f7dbe76fa583f\",\"kudu.table_id\":\"ee1df8f0a3e64e2684bb9cfde377d9f6\",\"transient_lastDdlTime\":\"1756670100\",\"comment\":\"\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.master_addresses\":\"127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943\",\"kudu.cluster_id\":\"003a9cb4df1f460dbfc9d2f57d96ced1\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1756670101}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=191, eventTime=1756670101, eventType=DROP_TABLE, dbName=default, tableName=table_c48f1c99f3174cb8acca698339447ed9, message={"server":"","servicePrincipal":"","db":"default","table":"table_c48f1c99f3174cb8acca698339447ed9","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_c48f1c99f3174cb8acca698339447ed9\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1756670094},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskfwTdIj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1756670064990897-1031-0/minicluster-data/warehouse/table_c48f1c99f3174cb8acca698339447ed9\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_c48f1c99f3174cb8acca698339447ed9\",\"kudu.table_id\":\"f707909e6af44750a5fc5e3b15af0b24\",\"transient_lastDdlTime\":\"1756670094\",\"comment\":\"\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.master_addresses\":\"127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943\",\"kudu.cluster_id\":\"003a9cb4df1f460dbfc9d2f57d96ced1\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1756670101}, messageFormat=json-0.2, catName=hive);
*** Check failure stack trace: ***
I20250831 19:55:11.896405 4009 ts_manager.cc:194] Registered new tserver with Master: 89aa85d59c53436ebdf3074b13d14825 (127.1.1.193:46197)
I20250831 19:55:11.896018 3864 master_service.cc:948] ReplaceTablet: received request to replace tablet e47844d025bf42ecbfd2d3f34a31538e from {username='slave'} at 127.0.0.1:42460
@ 0x7ff788cd1dcd google::LogMessage::Fail() at ??:0
@ 0x7ff788cd5b93 google::LogMessage::SendToLog() at ??:0
@ 0x7ff788cd17cc google::LogMessage::Flush() at ??:0
@ 0x7ff788cd1a11 google::LogMessage::~LogMessage() at ??:0
@ 0x7ff79f106794 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
@ 0x7ff79f105041 kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
W20250831 19:55:11.923043 3849 consensus_peers.cc:489] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 -> Peer ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943): Couldn't send request to peer ac75f6e7a0634a89beb9670950e95220. Status: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250831 19:55:11.924541 4020 raft_consensus.cc:1273] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Refusing update from remote peer 6c830f6055d64a3b8a9f78b405ad8aa3: Log matching property violated. Preceding OpId in replica: term: 6 index: 553. Preceding OpId from leader: term: 7 index: 555. (index mismatch)
I20250831 19:55:11.925487 4063 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 6c830f6055d64a3b8a9f78b405ad8aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 554, Last known committed idx: 553, Time since last communication: 0.000s
@ 0x7ff79f10ccbc kudu::master::HmsNotificationLogListenerTask::Init()::$_0::operator()() at ??:0
@ 0x7ff79f10cb39 std::_Function_handler<>::_M_invoke() at ??:0
@ 0xa774dd std::function<>::operator()() at ??:?
@ 0x7ff78ba2ecc9 kudu::Thread::SuperviseThread() at ??:0
@ 0x7ff78ee506db start_thread at ??:0
@ 0x7ff787b8271f clone at ??:0
I20250831 19:55:11.959189 4057 sys_catalog.cc:455] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6c830f6055d64a3b8a9f78b405ad8aa3. Latest consensus state: current_term: 7 leader_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } } }
I20250831 19:55:11.959446 4057 sys_catalog.cc:458] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [sys.catalog]: This master's current role is: FOLLOWER
W20250831 19:55:12.201417 3995 connection.cc:537] server connection from 127.0.0.1:35442 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20250831 19:55:12.202065 1961 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.1.1.254:34259)
W20250831 19:55:12.202608 1961 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.1.1.254:34259)
W20250831 19:55:12.202816 1961 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.1.1.254:34259)
W20250831 19:55:12.202895 1842 connection.cc:537] client connection to 127.1.1.254:34259 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20250831 19:55:12.203032 1961 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.1.1.254:34259)
I20250831 19:55:12.395654 1680 heartbeater.cc:499] Master 127.1.1.254:34259 was elected leader, sending a full tablet report...
I20250831 19:55:12.428020 4057 raft_consensus.cc:491] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6c830f6055d64a3b8a9f78b405ad8aa3)
I20250831 19:55:12.428228 4057 raft_consensus.cc:513] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } }
I20250831 19:55:12.430024 4057 leader_election.cc:290] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259), ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943)
W20250831 19:55:12.430852 3997 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111)
W20250831 19:55:12.431802 3994 leader_election.cc:336] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943): Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
W20250831 19:55:12.431998 3997 leader_election.cc:336] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259): Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111)
I20250831 19:55:12.432128 3997 leader_election.cc:304] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4d46bc3ef5a4fbb8c9e4349c86c54a5; no voters: 6c830f6055d64a3b8a9f78b405ad8aa3, ac75f6e7a0634a89beb9670950e95220
I20250831 19:55:12.432420 4057 raft_consensus.cc:2747] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20250831 19:55:12.987390 4102 raft_consensus.cc:491] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6c830f6055d64a3b8a9f78b405ad8aa3)
I20250831 19:55:12.987555 4102 raft_consensus.cc:513] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } }
I20250831 19:55:12.988157 4102 leader_election.cc:290] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259), ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943)
W20250831 19:55:12.989895 3997 leader_election.cc:336] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259): Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111)
W20250831 19:55:12.990020 3994 leader_election.cc:336] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943): Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
I20250831 19:55:12.990144 3994 leader_election.cc:304] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4d46bc3ef5a4fbb8c9e4349c86c54a5; no voters: 6c830f6055d64a3b8a9f78b405ad8aa3, ac75f6e7a0634a89beb9670950e95220
I20250831 19:55:12.990346 4102 raft_consensus.cc:2747] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20250831 19:55:13.636019 4107 raft_consensus.cc:491] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6c830f6055d64a3b8a9f78b405ad8aa3)
I20250831 19:55:13.636199 4107 raft_consensus.cc:513] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } }
I20250831 19:55:13.636742 4107 leader_election.cc:290] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259), ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943)
W20250831 19:55:13.638396 3997 leader_election.cc:336] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259): Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111)
W20250831 19:55:13.638532 3994 leader_election.cc:336] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943): Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
I20250831 19:55:13.638697 3994 leader_election.cc:304] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4d46bc3ef5a4fbb8c9e4349c86c54a5; no voters: 6c830f6055d64a3b8a9f78b405ad8aa3, ac75f6e7a0634a89beb9670950e95220
I20250831 19:55:13.638906 4107 raft_consensus.cc:2747] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20250831 19:55:13.995523 1031 master-stress-test.cc:577] Killing test thread 1/25
I20250831 19:55:14.624992 4114 raft_consensus.cc:491] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6c830f6055d64a3b8a9f78b405ad8aa3)
I20250831 19:55:14.625176 4114 raft_consensus.cc:513] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } }
I20250831 19:55:14.625748 4114 leader_election.cc:290] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259), ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943)
W20250831 19:55:14.627671 3997 leader_election.cc:336] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259): Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111)
W20250831 19:55:14.627823 3994 leader_election.cc:336] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943): Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
I20250831 19:55:14.627950 3994 leader_election.cc:304] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4d46bc3ef5a4fbb8c9e4349c86c54a5; no voters: 6c830f6055d64a3b8a9f78b405ad8aa3, ac75f6e7a0634a89beb9670950e95220
I20250831 19:55:14.628190 4114 raft_consensus.cc:2747] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20250831 19:55:15.995141 4119 raft_consensus.cc:491] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6c830f6055d64a3b8a9f78b405ad8aa3)
I20250831 19:55:15.995317 4119 raft_consensus.cc:513] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } }
I20250831 19:55:15.995810 4119 leader_election.cc:290] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259), ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943)
W20250831 19:55:15.997406 3997 leader_election.cc:336] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259): Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111)
W20250831 19:55:15.997573 3994 leader_election.cc:336] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943): Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
I20250831 19:55:15.997715 3994 leader_election.cc:304] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4d46bc3ef5a4fbb8c9e4349c86c54a5; no voters: 6c830f6055d64a3b8a9f78b405ad8aa3, ac75f6e7a0634a89beb9670950e95220
I20250831 19:55:15.997921 4119 raft_consensus.cc:2747] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20250831 19:55:16.796568 3975 master_runner.cc:186] Error getting master registration for 127.1.1.254:34259: Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111),
I20250831 19:55:16.796765 3975 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20250831 19:55:17.981258 4130 raft_consensus.cc:491] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6c830f6055d64a3b8a9f78b405ad8aa3)
I20250831 19:55:17.981487 4130 raft_consensus.cc:513] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } }
I20250831 19:55:17.982007 4130 leader_election.cc:290] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259), ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943)
W20250831 19:55:17.982822 3994 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111) [suppressed 9 similar messages]
W20250831 19:55:17.983820 3997 leader_election.cc:336] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259): Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111)
W20250831 19:55:17.984010 3994 leader_election.cc:336] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943): Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
I20250831 19:55:17.984133 3994 leader_election.cc:304] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4d46bc3ef5a4fbb8c9e4349c86c54a5; no voters: 6c830f6055d64a3b8a9f78b405ad8aa3, ac75f6e7a0634a89beb9670950e95220
I20250831 19:55:17.984365 4130 raft_consensus.cc:2747] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20250831 19:55:20.595091 4141 raft_consensus.cc:491] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6c830f6055d64a3b8a9f78b405ad8aa3)
I20250831 19:55:20.595279 4141 raft_consensus.cc:513] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } }
I20250831 19:55:20.595912 4141 leader_election.cc:290] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259), ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943)
W20250831 19:55:20.597719 3997 leader_election.cc:336] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259): Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111)
W20250831 19:55:20.598038 3994 leader_election.cc:336] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943): Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
I20250831 19:55:20.598121 3994 leader_election.cc:304] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4d46bc3ef5a4fbb8c9e4349c86c54a5; no voters: 6c830f6055d64a3b8a9f78b405ad8aa3, ac75f6e7a0634a89beb9670950e95220
I20250831 19:55:20.598341 4141 raft_consensus.cc:2747] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20250831 19:55:21.798097 3975 master_runner.cc:186] Error getting master registration for 127.1.1.254:34259: Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111),
I20250831 19:55:21.798282 3975 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20250831 19:55:22.514858 4152 raft_consensus.cc:491] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6c830f6055d64a3b8a9f78b405ad8aa3)
I20250831 19:55:22.515069 4152 raft_consensus.cc:513] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } }
I20250831 19:55:22.515708 4152 leader_election.cc:290] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259), ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943)
W20250831 19:55:22.517482 3997 leader_election.cc:336] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259): Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111)
W20250831 19:55:22.517640 3994 leader_election.cc:336] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943): Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
I20250831 19:55:22.517740 3994 leader_election.cc:304] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4d46bc3ef5a4fbb8c9e4349c86c54a5; no voters: 6c830f6055d64a3b8a9f78b405ad8aa3, ac75f6e7a0634a89beb9670950e95220
I20250831 19:55:22.517944 4152 raft_consensus.cc:2747] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20250831 19:55:26.799666 3975 master_runner.cc:186] Error getting master registration for 127.1.1.254:34259: Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111),
I20250831 19:55:26.799860 3975 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20250831 19:55:28.079416 4168 raft_consensus.cc:491] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6c830f6055d64a3b8a9f78b405ad8aa3)
I20250831 19:55:28.079598 4168 raft_consensus.cc:513] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } }
I20250831 19:55:28.080291 4168 leader_election.cc:290] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259), ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943)
W20250831 19:55:28.081241 3997 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111) [suppressed 5 similar messages]
W20250831 19:55:28.082485 3997 leader_election.cc:336] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259): Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111)
W20250831 19:55:28.082626 3994 leader_election.cc:336] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943): Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
I20250831 19:55:28.082748 3994 leader_election.cc:304] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4d46bc3ef5a4fbb8c9e4349c86c54a5; no voters: 6c830f6055d64a3b8a9f78b405ad8aa3, ac75f6e7a0634a89beb9670950e95220
I20250831 19:55:28.082969 4168 raft_consensus.cc:2747] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20250831 19:55:31.801261 3975 master_runner.cc:186] Error getting master registration for 127.1.1.254:34259: Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111),
I20250831 19:55:31.801504 3975 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20250831 19:55:36.802974 3975 master_runner.cc:186] Error getting master registration for 127.1.1.254:34259: Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111),
I20250831 19:55:36.803167 3975 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20250831 19:55:41.226929 1817 heartbeater.cc:646] Failed to heartbeat to 127.1.1.252:35943 (98 consecutive failures): Network error: Failed to ping master at 127.1.1.252:35943: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
W20250831 19:55:41.437242 1679 heartbeater.cc:646] Failed to heartbeat to 127.1.1.252:35943 (99 consecutive failures): Network error: Failed to ping master at 127.1.1.252:35943: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
I20250831 19:55:41.668993 4200 raft_consensus.cc:491] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6c830f6055d64a3b8a9f78b405ad8aa3)
I20250831 19:55:41.669171 4200 raft_consensus.cc:513] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } }
I20250831 19:55:41.669901 4200 leader_election.cc:290] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259), ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943)
W20250831 19:55:41.670953 3994 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20250831 19:55:41.671926 3997 leader_election.cc:336] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259): Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111)
W20250831 19:55:41.672047 3994 leader_election.cc:336] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943): Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
I20250831 19:55:41.672169 3994 leader_election.cc:304] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4d46bc3ef5a4fbb8c9e4349c86c54a5; no voters: 6c830f6055d64a3b8a9f78b405ad8aa3, ac75f6e7a0634a89beb9670950e95220
I20250831 19:55:41.672349 4200 raft_consensus.cc:2747] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20250831 19:55:41.718451 1951 heartbeater.cc:646] Failed to heartbeat to 127.1.1.252:35943 (102 consecutive failures): Network error: Failed to ping master at 127.1.1.252:35943: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
I20250831 19:55:41.804028 3975 master_runner.cc:186] Error getting master registration for 127.1.1.254:34259: Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111),
I20250831 19:55:41.804203 3975 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20250831 19:55:43.149120 4207 raft_consensus.cc:491] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6c830f6055d64a3b8a9f78b405ad8aa3)
I20250831 19:55:43.149291 4207 raft_consensus.cc:513] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } }
I20250831 19:55:43.149885 4207 leader_election.cc:290] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259), ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943)
W20250831 19:55:43.151909 3994 leader_election.cc:336] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943): Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
W20250831 19:55:43.152112 3997 leader_election.cc:336] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259): Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111)
I20250831 19:55:43.152215 3997 leader_election.cc:304] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4d46bc3ef5a4fbb8c9e4349c86c54a5; no voters: 6c830f6055d64a3b8a9f78b405ad8aa3, ac75f6e7a0634a89beb9670950e95220
I20250831 19:55:43.152426 4207 raft_consensus.cc:2747] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20250831 19:55:46.805588 3975 master_runner.cc:186] Error getting master registration for 127.1.1.254:34259: Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111),
I20250831 19:55:46.805778 3975 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20250831 19:55:51.806947 3975 master_runner.cc:186] Error getting master registration for 127.1.1.254:34259: Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111),
I20250831 19:55:51.807121 3975 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20250831 19:55:53.398702 4229 raft_consensus.cc:491] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6c830f6055d64a3b8a9f78b405ad8aa3)
I20250831 19:55:53.398886 4229 raft_consensus.cc:513] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } }
I20250831 19:55:53.399379 4229 leader_election.cc:290] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259), ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943)
W20250831 19:55:53.400259 3997 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20250831 19:55:53.401410 3997 leader_election.cc:336] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259): Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111)
W20250831 19:55:53.401597 3994 leader_election.cc:336] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943): Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
I20250831 19:55:53.401714 3994 leader_election.cc:304] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4d46bc3ef5a4fbb8c9e4349c86c54a5; no voters: 6c830f6055d64a3b8a9f78b405ad8aa3, ac75f6e7a0634a89beb9670950e95220
I20250831 19:55:53.401937 4229 raft_consensus.cc:2747] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20250831 19:55:56.813555 3975 master_runner.cc:186] Error getting master registration for 127.1.1.254:34259: Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111),
I20250831 19:55:56.813747 3975 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20250831 19:56:01.815079 3975 master_runner.cc:186] Error getting master registration for 127.1.1.254:34259: Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111),
I20250831 19:56:01.815327 3975 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20250831 19:56:06.816659 3975 master_runner.cc:186] Error getting master registration for 127.1.1.254:34259: Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111),
I20250831 19:56:06.816861 3975 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20250831 19:56:08.745867 4271 raft_consensus.cc:491] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6c830f6055d64a3b8a9f78b405ad8aa3)
I20250831 19:56:08.746085 4271 raft_consensus.cc:513] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } }
I20250831 19:56:08.746740 4271 leader_election.cc:290] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259), ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943)
W20250831 19:56:08.747617 3997 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20250831 19:56:08.748734 3997 leader_election.cc:336] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259): Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111)
W20250831 19:56:08.748903 3994 leader_election.cc:336] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943): Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
I20250831 19:56:08.749034 3994 leader_election.cc:304] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4d46bc3ef5a4fbb8c9e4349c86c54a5; no voters: 6c830f6055d64a3b8a9f78b405ad8aa3, ac75f6e7a0634a89beb9670950e95220
I20250831 19:56:08.749277 4271 raft_consensus.cc:2747] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20250831 19:56:11.818215 3975 master_runner.cc:186] Error getting master registration for 127.1.1.254:34259: Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111),
I20250831 19:56:11.818394 3975 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20250831 19:56:14.375805 4288 raft_consensus.cc:491] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6c830f6055d64a3b8a9f78b405ad8aa3)
I20250831 19:56:14.375975 4288 raft_consensus.cc:513] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } }
I20250831 19:56:14.376550 4288 leader_election.cc:290] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259), ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943)
W20250831 19:56:14.377496 3997 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20250831 19:56:14.378667 3997 leader_election.cc:336] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259): Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111)
W20250831 19:56:14.378818 3994 leader_election.cc:336] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943): Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
I20250831 19:56:14.378927 3994 leader_election.cc:304] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4d46bc3ef5a4fbb8c9e4349c86c54a5; no voters: 6c830f6055d64a3b8a9f78b405ad8aa3, ac75f6e7a0634a89beb9670950e95220
I20250831 19:56:14.379158 4288 raft_consensus.cc:2747] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20250831 19:56:16.819479 3975 master_runner.cc:186] Error getting master registration for 127.1.1.254:34259: Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111),
I20250831 19:56:16.819643 3975 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20250831 19:56:16.853947 4306 raft_consensus.cc:491] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6c830f6055d64a3b8a9f78b405ad8aa3)
I20250831 19:56:16.854121 4306 raft_consensus.cc:513] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } }
I20250831 19:56:16.854664 4306 leader_election.cc:290] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259), ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943)
W20250831 19:56:16.856614 3994 leader_election.cc:336] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943): Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
W20250831 19:56:16.856781 3997 leader_election.cc:336] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259): Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111)
I20250831 19:56:16.856927 3997 leader_election.cc:304] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4d46bc3ef5a4fbb8c9e4349c86c54a5; no voters: 6c830f6055d64a3b8a9f78b405ad8aa3, ac75f6e7a0634a89beb9670950e95220
I20250831 19:56:16.857129 4306 raft_consensus.cc:2747] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20250831 19:56:21.820890 3975 master_runner.cc:186] Error getting master registration for 127.1.1.254:34259: Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111),
I20250831 19:56:21.821064 3975 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20250831 19:56:26.822484 3975 master_runner.cc:186] Error getting master registration for 127.1.1.254:34259: Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111),
I20250831 19:56:26.822677 3975 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20250831 19:56:31.823809 3975 master_runner.cc:186] Error getting master registration for 127.1.1.254:34259: Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111),
I20250831 19:56:31.823992 3975 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20250831 19:56:34.341204 4375 raft_consensus.cc:491] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6c830f6055d64a3b8a9f78b405ad8aa3)
I20250831 19:56:34.341427 4375 raft_consensus.cc:513] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } }
I20250831 19:56:34.342217 4375 leader_election.cc:290] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259), ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943)
W20250831 19:56:34.343050 3997 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20250831 19:56:34.344386 3994 leader_election.cc:336] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943): Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
W20250831 19:56:34.344543 3997 leader_election.cc:336] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259): Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111)
I20250831 19:56:34.344630 3997 leader_election.cc:304] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4d46bc3ef5a4fbb8c9e4349c86c54a5; no voters: 6c830f6055d64a3b8a9f78b405ad8aa3, ac75f6e7a0634a89beb9670950e95220
I20250831 19:56:34.344827 4375 raft_consensus.cc:2747] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20250831 19:56:35.397454 4385 raft_consensus.cc:491] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6c830f6055d64a3b8a9f78b405ad8aa3)
I20250831 19:56:35.397627 4385 raft_consensus.cc:513] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } }
I20250831 19:56:35.398162 4385 leader_election.cc:290] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259), ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943)
W20250831 19:56:35.399847 3997 leader_election.cc:336] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259): Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111)
W20250831 19:56:35.399994 3994 leader_election.cc:336] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943): Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
I20250831 19:56:35.400100 3994 leader_election.cc:304] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4d46bc3ef5a4fbb8c9e4349c86c54a5; no voters: 6c830f6055d64a3b8a9f78b405ad8aa3, ac75f6e7a0634a89beb9670950e95220
I20250831 19:56:35.400293 4385 raft_consensus.cc:2747] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20250831 19:56:36.825225 3975 master_runner.cc:186] Error getting master registration for 127.1.1.254:34259: Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111),
I20250831 19:56:36.825397 3975 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20250831 19:56:41.333312 1817 heartbeater.cc:646] Failed to heartbeat to 127.1.1.252:35943 (218 consecutive failures): Network error: Failed to ping master at 127.1.1.252:35943: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
W20250831 19:56:41.571273 1680 heartbeater.cc:646] Failed to heartbeat to 127.1.1.254:34259 (178 consecutive failures): Network error: Failed to ping master at 127.1.1.254:34259: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111)
I20250831 19:56:41.826674 3975 master_runner.cc:186] Error getting master registration for 127.1.1.254:34259: Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111),
I20250831 19:56:41.826843 3975 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20250831 19:56:41.831713 1951 heartbeater.cc:646] Failed to heartbeat to 127.1.1.252:35943 (222 consecutive failures): Network error: Failed to ping master at 127.1.1.252:35943: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
I20250831 19:56:46.828366 3975 master_runner.cc:186] Error getting master registration for 127.1.1.254:34259: Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111),
I20250831 19:56:46.828584 3975 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20250831 19:56:51.829958 3975 master_runner.cc:186] Error getting master registration for 127.1.1.254:34259: Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111),
I20250831 19:56:51.830140 3975 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20250831 19:56:54.857419 4506 raft_consensus.cc:491] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6c830f6055d64a3b8a9f78b405ad8aa3)
I20250831 19:56:54.857625 4506 raft_consensus.cc:513] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } }
I20250831 19:56:54.858369 4506 leader_election.cc:290] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259), ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943)
W20250831 19:56:54.859154 3997 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20250831 19:56:54.860123 3994 leader_election.cc:336] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943): Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
W20250831 19:56:54.860252 3997 leader_election.cc:336] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259): Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111)
I20250831 19:56:54.860355 3997 leader_election.cc:304] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4d46bc3ef5a4fbb8c9e4349c86c54a5; no voters: 6c830f6055d64a3b8a9f78b405ad8aa3, ac75f6e7a0634a89beb9670950e95220
I20250831 19:56:54.860556 4506 raft_consensus.cc:2747] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20250831 19:56:56.831298 3975 master_runner.cc:186] Error getting master registration for 127.1.1.254:34259: Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111),
I20250831 19:56:56.831471 3975 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20250831 19:56:57.214509 4524 raft_consensus.cc:491] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6c830f6055d64a3b8a9f78b405ad8aa3)
I20250831 19:56:57.214722 4524 raft_consensus.cc:513] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } }
I20250831 19:56:57.215433 4524 leader_election.cc:290] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259), ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943)
W20250831 19:56:57.217149 3994 leader_election.cc:336] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943): Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
W20250831 19:56:57.217353 3997 leader_election.cc:336] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259): Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111)
I20250831 19:56:57.217483 3997 leader_election.cc:304] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4d46bc3ef5a4fbb8c9e4349c86c54a5; no voters: 6c830f6055d64a3b8a9f78b405ad8aa3, ac75f6e7a0634a89beb9670950e95220
I20250831 19:56:57.217708 4524 raft_consensus.cc:2747] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20250831 19:56:58.384738 4533 raft_consensus.cc:491] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6c830f6055d64a3b8a9f78b405ad8aa3)
I20250831 19:56:58.384954 4533 raft_consensus.cc:513] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } }
I20250831 19:56:58.385563 4533 leader_election.cc:290] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259), ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943)
W20250831 19:56:58.387295 3997 leader_election.cc:336] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259): Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111)
W20250831 19:56:58.387454 3994 leader_election.cc:336] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943): Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
I20250831 19:56:58.387571 3994 leader_election.cc:304] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4d46bc3ef5a4fbb8c9e4349c86c54a5; no voters: 6c830f6055d64a3b8a9f78b405ad8aa3, ac75f6e7a0634a89beb9670950e95220
I20250831 19:56:58.387815 4533 raft_consensus.cc:2747] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20250831 19:57:01.832909 3975 master_runner.cc:186] Error getting master registration for 127.1.1.254:34259: Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111),
I20250831 19:57:01.833199 3975 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20250831 19:57:06.834630 3975 master_runner.cc:186] Error getting master registration for 127.1.1.254:34259: Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111),
I20250831 19:57:06.834875 3975 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20250831 19:57:11.796587 3999 maintenance_manager.cc:419] P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033371
I20250831 19:57:11.836544 3975 master_runner.cc:186] Error getting master registration for 127.1.1.254:34259: Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111),
I20250831 19:57:11.836752 3975 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20250831 19:57:11.856130 3998 maintenance_manager.cc:643] P a4d46bc3ef5a4fbb8c9e4349c86c54a5: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.059s user 0.039s sys 0.001s Metrics: {"bytes_written":83236,"cfile_init":1,"dirs.queue_time_us":410,"dirs.run_cpu_time_us":201,"dirs.run_wall_time_us":1039,"drs_written":1,"lbm_read_time_us":83,"lbm_reads_lt_1ms":4,"lbm_write_time_us":898,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":251,"thread_start_us":555,"threads_started":2,"wal-append.queue_time_us":387}
I20250831 19:57:11.857273 3999 maintenance_manager.cc:419] P a4d46bc3ef5a4fbb8c9e4349c86c54a5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 23806 bytes on disk
I20250831 19:57:11.857942 3998 maintenance_manager.cc:643] P a4d46bc3ef5a4fbb8c9e4349c86c54a5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":63,"lbm_reads_lt_1ms":4}
I20250831 19:57:12.337298 4630 raft_consensus.cc:491] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6c830f6055d64a3b8a9f78b405ad8aa3)
I20250831 19:57:12.337507 4630 raft_consensus.cc:513] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } }
I20250831 19:57:12.338245 4630 leader_election.cc:290] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259), ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943)
W20250831 19:57:12.339323 3994 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111) [suppressed 5 similar messages]
W20250831 19:57:12.341936 3997 leader_election.cc:336] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259): Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111)
W20250831 19:57:12.342073 3994 leader_election.cc:336] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943): Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
I20250831 19:57:12.342207 3994 leader_election.cc:304] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4d46bc3ef5a4fbb8c9e4349c86c54a5; no voters: 6c830f6055d64a3b8a9f78b405ad8aa3, ac75f6e7a0634a89beb9670950e95220
I20250831 19:57:12.342427 4630 raft_consensus.cc:2747] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20250831 19:57:15.270839 4653 raft_consensus.cc:491] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6c830f6055d64a3b8a9f78b405ad8aa3)
I20250831 19:57:15.271034 4653 raft_consensus.cc:513] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } }
I20250831 19:57:15.271755 4653 leader_election.cc:290] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259), ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943)
W20250831 19:57:15.273854 3997 leader_election.cc:336] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259): Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111)
W20250831 19:57:15.274013 3994 leader_election.cc:336] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943): Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
I20250831 19:57:15.274151 3994 leader_election.cc:304] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4d46bc3ef5a4fbb8c9e4349c86c54a5; no voters: 6c830f6055d64a3b8a9f78b405ad8aa3, ac75f6e7a0634a89beb9670950e95220
I20250831 19:57:15.274401 4653 raft_consensus.cc:2747] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20250831 19:57:16.578073 4662 raft_consensus.cc:491] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6c830f6055d64a3b8a9f78b405ad8aa3)
I20250831 19:57:16.578275 4662 raft_consensus.cc:513] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } }
I20250831 19:57:16.578835 4662 leader_election.cc:290] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259), ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943)
W20250831 19:57:16.580724 3997 leader_election.cc:336] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259): Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111)
W20250831 19:57:16.580893 3994 leader_election.cc:336] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943): Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
I20250831 19:57:16.581022 3994 leader_election.cc:304] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4d46bc3ef5a4fbb8c9e4349c86c54a5; no voters: 6c830f6055d64a3b8a9f78b405ad8aa3, ac75f6e7a0634a89beb9670950e95220
I20250831 19:57:16.581229 4662 raft_consensus.cc:2747] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20250831 19:57:16.837880 3975 master_runner.cc:186] Error getting master registration for 127.1.1.254:34259: Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111),
I20250831 19:57:16.838106 3975 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20250831 19:57:21.839433 3975 master_runner.cc:186] Error getting master registration for 127.1.1.254:34259: Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111),
I20250831 19:57:21.839630 3975 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20250831 19:57:26.841048 3975 master_runner.cc:186] Error getting master registration for 127.1.1.254:34259: Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111),
I20250831 19:57:26.841223 3975 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20250831 19:57:30.570894 4805 raft_consensus.cc:491] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6c830f6055d64a3b8a9f78b405ad8aa3)
I20250831 19:57:30.571111 4805 raft_consensus.cc:513] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } }
I20250831 19:57:30.571877 4805 leader_election.cc:290] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259), ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943)
W20250831 19:57:30.572826 3997 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111) [suppressed 5 similar messages]
W20250831 19:57:30.574105 3994 leader_election.cc:336] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943): Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
W20250831 19:57:30.574307 3997 leader_election.cc:336] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259): Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111)
I20250831 19:57:30.574457 3997 leader_election.cc:304] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4d46bc3ef5a4fbb8c9e4349c86c54a5; no voters: 6c830f6055d64a3b8a9f78b405ad8aa3, ac75f6e7a0634a89beb9670950e95220
I20250831 19:57:30.574719 4805 raft_consensus.cc:2747] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20250831 19:57:31.842816 3975 master_runner.cc:186] Error getting master registration for 127.1.1.254:34259: Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111),
I20250831 19:57:31.843051 3975 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20250831 19:57:36.844476 3975 master_runner.cc:186] Error getting master registration for 127.1.1.254:34259: Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111),
I20250831 19:57:36.844694 3975 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20250831 19:57:38.840135 4890 raft_consensus.cc:491] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6c830f6055d64a3b8a9f78b405ad8aa3)
I20250831 19:57:38.840346 4890 raft_consensus.cc:513] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } }
I20250831 19:57:38.840997 4890 leader_election.cc:290] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259), ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943)
W20250831 19:57:38.841962 3994 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20250831 19:57:38.843122 3997 leader_election.cc:336] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259): Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111)
W20250831 19:57:38.843255 3994 leader_election.cc:336] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943): Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
I20250831 19:57:38.843364 3994 leader_election.cc:304] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4d46bc3ef5a4fbb8c9e4349c86c54a5; no voters: 6c830f6055d64a3b8a9f78b405ad8aa3, ac75f6e7a0634a89beb9670950e95220
I20250831 19:57:38.843546 4890 raft_consensus.cc:2747] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20250831 19:57:41.457765 1817 heartbeater.cc:646] Failed to heartbeat to 127.1.1.252:35943 (338 consecutive failures): Network error: Failed to ping master at 127.1.1.252:35943: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
W20250831 19:57:41.808975 1679 heartbeater.cc:646] Failed to heartbeat to 127.1.1.252:35943 (339 consecutive failures): Network error: Failed to ping master at 127.1.1.252:35943: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
I20250831 19:57:41.846220 3975 master_runner.cc:186] Error getting master registration for 127.1.1.254:34259: Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111),
I20250831 19:57:41.846401 3975 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20250831 19:57:41.958685 1951 heartbeater.cc:646] Failed to heartbeat to 127.1.1.252:35943 (342 consecutive failures): Network error: Failed to ping master at 127.1.1.252:35943: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
I20250831 19:57:46.847659 3975 master_runner.cc:186] Error getting master registration for 127.1.1.254:34259: Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111),
I20250831 19:57:46.847887 3975 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20250831 19:57:50.295215 4997 raft_consensus.cc:491] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6c830f6055d64a3b8a9f78b405ad8aa3)
I20250831 19:57:50.295387 4997 raft_consensus.cc:513] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } }
I20250831 19:57:50.296038 4997 leader_election.cc:290] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259), ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943)
W20250831 19:57:50.296958 3997 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20250831 19:57:50.298036 3994 leader_election.cc:336] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943): Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
W20250831 19:57:50.298197 3997 leader_election.cc:336] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259): Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111)
I20250831 19:57:50.298344 3997 leader_election.cc:304] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4d46bc3ef5a4fbb8c9e4349c86c54a5; no voters: 6c830f6055d64a3b8a9f78b405ad8aa3, ac75f6e7a0634a89beb9670950e95220
I20250831 19:57:50.298584 4997 raft_consensus.cc:2747] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20250831 19:57:51.849520 3975 master_runner.cc:186] Error getting master registration for 127.1.1.254:34259: Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111),
I20250831 19:57:51.849709 3975 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20250831 19:57:56.851383 3975 master_runner.cc:186] Error getting master registration for 127.1.1.254:34259: Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111),
I20250831 19:57:56.851579 3975 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20250831 19:58:01.853168 3975 master_runner.cc:186] Error getting master registration for 127.1.1.254:34259: Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111),
I20250831 19:58:01.853376 3975 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20250831 19:58:06.854812 3975 master_runner.cc:186] Error getting master registration for 127.1.1.254:34259: Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111),
I20250831 19:58:06.854987 3975 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20250831 19:58:08.090344 5204 raft_consensus.cc:491] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6c830f6055d64a3b8a9f78b405ad8aa3)
I20250831 19:58:08.090535 5204 raft_consensus.cc:513] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } }
I20250831 19:58:08.091367 5204 leader_election.cc:290] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259), ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943)
W20250831 19:58:08.092391 3997 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20250831 19:58:08.093523 3997 leader_election.cc:336] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259): Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111)
W20250831 19:58:08.095821 3994 leader_election.cc:336] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943): Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
I20250831 19:58:08.095966 3994 leader_election.cc:304] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4d46bc3ef5a4fbb8c9e4349c86c54a5; no voters: 6c830f6055d64a3b8a9f78b405ad8aa3, ac75f6e7a0634a89beb9670950e95220
I20250831 19:58:08.096240 5204 raft_consensus.cc:2747] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20250831 19:58:11.856575 3975 master_runner.cc:186] Error getting master registration for 127.1.1.254:34259: Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111),
I20250831 19:58:11.856786 3975 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20250831 19:58:15.113739 5310 raft_consensus.cc:491] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6c830f6055d64a3b8a9f78b405ad8aa3)
I20250831 19:58:15.114035 5310 raft_consensus.cc:513] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } }
I20250831 19:58:15.114758 5310 leader_election.cc:290] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259), ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943)
W20250831 19:58:15.115937 3997 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20250831 19:58:15.117277 3997 leader_election.cc:336] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259): Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111)
W20250831 19:58:15.117468 3994 leader_election.cc:336] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943): Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
I20250831 19:58:15.117583 3994 leader_election.cc:304] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4d46bc3ef5a4fbb8c9e4349c86c54a5; no voters: 6c830f6055d64a3b8a9f78b405ad8aa3, ac75f6e7a0634a89beb9670950e95220
I20250831 19:58:15.117849 5310 raft_consensus.cc:2747] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20250831 19:58:16.858436 3975 master_runner.cc:186] Error getting master registration for 127.1.1.254:34259: Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111),
I20250831 19:58:16.858654 3975 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20250831 19:58:21.860095 3975 master_runner.cc:186] Error getting master registration for 127.1.1.254:34259: Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111),
I20250831 19:58:21.860296 3975 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20250831 19:58:26.861825 3975 master_runner.cc:186] Error getting master registration for 127.1.1.254:34259: Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111),
I20250831 19:58:26.862011 3975 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20250831 19:58:30.329810 5495 raft_consensus.cc:491] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6c830f6055d64a3b8a9f78b405ad8aa3)
I20250831 19:58:30.330003 5495 raft_consensus.cc:513] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } }
I20250831 19:58:30.330793 5495 leader_election.cc:290] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259), ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943)
W20250831 19:58:30.331720 3997 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20250831 19:58:30.333025 3997 leader_election.cc:336] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259): Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111)
W20250831 19:58:30.333217 3994 leader_election.cc:336] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943): Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
I20250831 19:58:30.333333 3994 leader_election.cc:304] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4d46bc3ef5a4fbb8c9e4349c86c54a5; no voters: 6c830f6055d64a3b8a9f78b405ad8aa3, ac75f6e7a0634a89beb9670950e95220
I20250831 19:58:30.333595 5495 raft_consensus.cc:2747] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20250831 19:58:31.863236 3975 master_runner.cc:186] Error getting master registration for 127.1.1.254:34259: Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111),
I20250831 19:58:31.863436 3975 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20250831 19:58:36.864935 3975 master_runner.cc:186] Error getting master registration for 127.1.1.254:34259: Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111),
I20250831 19:58:36.865137 3975 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20250831 19:58:41.585562 1817 heartbeater.cc:646] Failed to heartbeat to 127.1.1.252:35943 (458 consecutive failures): Network error: Failed to ping master at 127.1.1.252:35943: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
I20250831 19:58:41.866772 3975 master_runner.cc:186] Error getting master registration for 127.1.1.254:34259: Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111),
I20250831 19:58:41.866974 3975 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20250831 19:58:42.059849 1679 heartbeater.cc:646] Failed to heartbeat to 127.1.1.252:35943 (459 consecutive failures): Network error: Failed to ping master at 127.1.1.252:35943: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
W20250831 19:58:42.203760 1952 heartbeater.cc:646] Failed to heartbeat to 127.1.1.254:34259 (419 consecutive failures): Network error: Failed to ping master at 127.1.1.254:34259: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111)
I20250831 19:58:44.547600 5676 raft_consensus.cc:491] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6c830f6055d64a3b8a9f78b405ad8aa3)
I20250831 19:58:44.547786 5676 raft_consensus.cc:513] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } }
I20250831 19:58:44.548537 5676 leader_election.cc:290] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259), ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943)
W20250831 19:58:44.549563 3997 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20250831 19:58:44.550626 3994 leader_election.cc:336] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943): Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
W20250831 19:58:44.550772 3997 leader_election.cc:336] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259): Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111)
I20250831 19:58:44.550913 3997 leader_election.cc:304] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4d46bc3ef5a4fbb8c9e4349c86c54a5; no voters: 6c830f6055d64a3b8a9f78b405ad8aa3, ac75f6e7a0634a89beb9670950e95220
I20250831 19:58:44.551159 5676 raft_consensus.cc:2747] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20250831 19:58:46.868373 3975 master_runner.cc:186] Error getting master registration for 127.1.1.254:34259: Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111),
I20250831 19:58:46.868552 3975 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20250831 19:58:51.870011 3975 master_runner.cc:186] Error getting master registration for 127.1.1.254:34259: Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111),
I20250831 19:58:51.870203 3975 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20250831 19:58:54.325227 5772 raft_consensus.cc:491] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6c830f6055d64a3b8a9f78b405ad8aa3)
I20250831 19:58:54.325418 5772 raft_consensus.cc:513] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } }
I20250831 19:58:54.326134 5772 leader_election.cc:290] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259), ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943)
W20250831 19:58:54.327193 3997 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20250831 19:58:54.328326 3994 leader_election.cc:336] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943): Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
W20250831 19:58:54.328490 3997 leader_election.cc:336] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259): Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111)
I20250831 19:58:54.328627 3997 leader_election.cc:304] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4d46bc3ef5a4fbb8c9e4349c86c54a5; no voters: 6c830f6055d64a3b8a9f78b405ad8aa3, ac75f6e7a0634a89beb9670950e95220
I20250831 19:58:54.328868 5772 raft_consensus.cc:2747] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20250831 19:58:56.871712 3975 master_runner.cc:186] Error getting master registration for 127.1.1.254:34259: Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111),
I20250831 19:58:56.871902 3975 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20250831 19:59:01.873080 3975 master_runner.cc:186] Error getting master registration for 127.1.1.254:34259: Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111),
I20250831 19:59:01.873260 3975 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20250831 19:59:06.874485 3975 master_runner.cc:186] Error getting master registration for 127.1.1.254:34259: Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111),
I20250831 19:59:06.874657 3975 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20250831 19:59:08.460984 5952 raft_consensus.cc:491] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6c830f6055d64a3b8a9f78b405ad8aa3)
I20250831 19:59:08.461182 5952 raft_consensus.cc:513] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } }
I20250831 19:59:08.461843 5952 leader_election.cc:290] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259), ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943)
W20250831 19:59:08.462620 3994 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20250831 19:59:08.463557 3997 leader_election.cc:336] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259): Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111)
W20250831 19:59:08.463716 3994 leader_election.cc:336] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943): Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
I20250831 19:59:08.463826 3994 leader_election.cc:304] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4d46bc3ef5a4fbb8c9e4349c86c54a5; no voters: 6c830f6055d64a3b8a9f78b405ad8aa3, ac75f6e7a0634a89beb9670950e95220
I20250831 19:59:08.464056 5952 raft_consensus.cc:2747] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20250831 19:59:11.876070 3975 master_runner.cc:186] Error getting master registration for 127.1.1.254:34259: Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111),
I20250831 19:59:11.876247 3975 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20250831 19:59:14.835425 6036 raft_consensus.cc:491] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6c830f6055d64a3b8a9f78b405ad8aa3)
I20250831 19:59:14.835589 6036 raft_consensus.cc:513] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } }
I20250831 19:59:14.836182 6036 leader_election.cc:290] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259), ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943)
W20250831 19:59:14.837003 3997 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20250831 19:59:14.837978 3994 leader_election.cc:336] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943): Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
W20250831 19:59:14.838128 3997 leader_election.cc:336] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259): Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111)
I20250831 19:59:14.838238 3997 leader_election.cc:304] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4d46bc3ef5a4fbb8c9e4349c86c54a5; no voters: 6c830f6055d64a3b8a9f78b405ad8aa3, ac75f6e7a0634a89beb9670950e95220
I20250831 19:59:14.838475 6036 raft_consensus.cc:2747] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20250831 19:59:16.877744 3975 master_runner.cc:186] Error getting master registration for 127.1.1.254:34259: Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111),
I20250831 19:59:16.877889 3975 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20250831 19:59:21.879226 3975 master_runner.cc:186] Error getting master registration for 127.1.1.254:34259: Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111),
I20250831 19:59:21.879383 3975 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20250831 19:59:21.917166 6133 raft_consensus.cc:491] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6c830f6055d64a3b8a9f78b405ad8aa3)
I20250831 19:59:21.917378 6133 raft_consensus.cc:513] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } }
I20250831 19:59:21.917982 6133 leader_election.cc:290] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259), ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943)
W20250831 19:59:21.918505 3997 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20250831 19:59:21.919569 3997 leader_election.cc:336] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259): Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111)
W20250831 19:59:21.919730 3994 leader_election.cc:336] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943): Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
I20250831 19:59:21.919806 3994 leader_election.cc:304] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4d46bc3ef5a4fbb8c9e4349c86c54a5; no voters: 6c830f6055d64a3b8a9f78b405ad8aa3, ac75f6e7a0634a89beb9670950e95220
I20250831 19:59:21.920014 6133 raft_consensus.cc:2747] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20250831 19:59:26.880858 3975 master_runner.cc:186] Error getting master registration for 127.1.1.254:34259: Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111),
I20250831 19:59:26.881043 3975 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20250831 19:59:31.882345 3975 master_runner.cc:186] Error getting master registration for 127.1.1.254:34259: Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111),
I20250831 19:59:31.882544 3975 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20250831 19:59:34.985757 6293 raft_consensus.cc:491] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6c830f6055d64a3b8a9f78b405ad8aa3)
I20250831 19:59:34.985968 6293 raft_consensus.cc:513] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } }
I20250831 19:59:34.986744 6293 leader_election.cc:290] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259), ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943)
W20250831 19:59:34.987540 3997 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20250831 19:59:34.988699 3997 leader_election.cc:336] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259): Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111)
W20250831 19:59:34.988867 3994 leader_election.cc:336] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943): Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
I20250831 19:59:34.988972 3994 leader_election.cc:304] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4d46bc3ef5a4fbb8c9e4349c86c54a5; no voters: 6c830f6055d64a3b8a9f78b405ad8aa3, ac75f6e7a0634a89beb9670950e95220
I20250831 19:59:34.989233 6293 raft_consensus.cc:2747] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20250831 19:59:36.883822 3975 master_runner.cc:186] Error getting master registration for 127.1.1.254:34259: Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111),
I20250831 19:59:36.884004 3975 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20250831 19:59:41.715090 1817 heartbeater.cc:646] Failed to heartbeat to 127.1.1.252:35943 (578 consecutive failures): Network error: Failed to ping master at 127.1.1.252:35943: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
I20250831 19:59:41.885717 3975 master_runner.cc:186] Error getting master registration for 127.1.1.254:34259: Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111),
I20250831 19:59:41.885882 3975 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20250831 19:59:42.310523 1680 heartbeater.cc:646] Failed to heartbeat to 127.1.1.254:34259 (538 consecutive failures): Network error: Failed to ping master at 127.1.1.254:34259: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111)
W20250831 19:59:42.460549 1952 heartbeater.cc:646] Failed to heartbeat to 127.1.1.254:34259 (539 consecutive failures): Network error: Failed to ping master at 127.1.1.254:34259: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111)
I20250831 19:59:46.887213 3975 master_runner.cc:186] Error getting master registration for 127.1.1.254:34259: Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111),
I20250831 19:59:46.887392 3975 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20250831 19:59:48.557852 6476 raft_consensus.cc:491] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6c830f6055d64a3b8a9f78b405ad8aa3)
I20250831 19:59:48.558048 6476 raft_consensus.cc:513] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } }
I20250831 19:59:48.558640 6476 leader_election.cc:290] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259), ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943)
W20250831 19:59:48.559582 3997 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20250831 19:59:48.560669 3994 leader_election.cc:336] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943): Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
W20250831 19:59:48.560798 3997 leader_election.cc:336] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259): Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111)
I20250831 19:59:48.560914 3997 leader_election.cc:304] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4d46bc3ef5a4fbb8c9e4349c86c54a5; no voters: 6c830f6055d64a3b8a9f78b405ad8aa3, ac75f6e7a0634a89beb9670950e95220
I20250831 19:59:48.561122 6476 raft_consensus.cc:2747] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20250831 19:59:51.888614 3975 master_runner.cc:186] Error getting master registration for 127.1.1.254:34259: Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111),
I20250831 19:59:51.888772 3975 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20250831 19:59:55.372980 6568 raft_consensus.cc:491] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6c830f6055d64a3b8a9f78b405ad8aa3)
I20250831 19:59:55.373194 6568 raft_consensus.cc:513] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c830f6055d64a3b8a9f78b405ad8aa3" member_type: VOTER last_known_addr { host: "127.1.1.254" port: 34259 } } peers { permanent_uuid: "a4d46bc3ef5a4fbb8c9e4349c86c54a5" member_type: VOTER last_known_addr { host: "127.1.1.253" port: 45581 } } peers { permanent_uuid: "ac75f6e7a0634a89beb9670950e95220" member_type: VOTER last_known_addr { host: "127.1.1.252" port: 35943 } }
I20250831 19:59:55.373924 6568 leader_election.cc:290] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259), ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943)
W20250831 19:59:55.374825 3997 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20250831 19:59:55.375902 3994 leader_election.cc:336] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer ac75f6e7a0634a89beb9670950e95220 (127.1.1.252:35943): Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
W20250831 19:59:55.376070 3997 leader_election.cc:336] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6c830f6055d64a3b8a9f78b405ad8aa3 (127.1.1.254:34259): Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111)
I20250831 19:59:55.376168 3997 leader_election.cc:304] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4d46bc3ef5a4fbb8c9e4349c86c54a5; no voters: 6c830f6055d64a3b8a9f78b405ad8aa3, ac75f6e7a0634a89beb9670950e95220
I20250831 19:59:55.376398 6568 raft_consensus.cc:2747] T 00000000000000000000000000000000 P a4d46bc3ef5a4fbb8c9e4349c86c54a5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20250831 19:59:56.890202 3975 master_runner.cc:186] Error getting master registration for 127.1.1.254:34259: Network error: Client connection negotiation failed: client connection to 127.1.1.254:34259: connect: Connection refused (error 111),
I20250831 19:59:56.890399 3975 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20250831 20:00:00.828035 1961 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
W20250831 20:00:00.828323 1961 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
W20250831 20:00:00.828408 1961 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
W20250831 20:00:00.828502 1961 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
F20250831 20:00:00.839461 1972 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_e3b5fcc868e34263984dd116c032f2ac on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
*** Check failure stack trace: ***
*** Aborted at 1756670400 (unix time) try "date -d @1756670400" if you are using GNU date ***
F20250831 20:00:00.840484 1991 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20250831 20:00:00.840484 1991 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.841143 1985 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20250831 20:00:00.840484 1991 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.841143 1985 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.842090 1980 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
*** Check failure stack trace: ***
W20250831 20:00:00.842852 1961 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.1.1.254:34259)
W20250831 20:00:00.843133 1961 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.1.1.254:34259)
W20250831 20:00:00.843459 1961 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.1.1.254:34259)
W20250831 20:00:00.843704 1961 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.1.1.254:34259)
F20250831 20:00:00.840484 1991 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.841143 1985 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.842090 1980 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.844436 1982 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20250831 20:00:00.840484 1991 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.841143 1985 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.842090 1980 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.844436 1982 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.844471 1983 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20250831 20:00:00.840484 1991 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.841143 1985 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.842090 1980 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.844436 1982 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.844471 1983 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.844892 1974 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_5b6b5bfafb524e0a9e93a06dbd4456c9 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20250831 20:00:00.840484 1991 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.841143 1985 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.842090 1980 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.844436 1982 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.844471 1983 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.844892 1974 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_5b6b5bfafb524e0a9e93a06dbd4456c9 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.844911 1990 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20250831 20:00:00.840484 1991 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.841143 1985 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.842090 1980 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.844436 1982 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.844471 1983 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.844892 1974 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_5b6b5bfafb524e0a9e93a06dbd4456c9 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.844911 1990 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.845248 1977 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20250831 20:00:00.840484 1991 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.841143 1985 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.842090 1980 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.844436 1982 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.844471 1983 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.844892 1974 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_5b6b5bfafb524e0a9e93a06dbd4456c9 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.844911 1990 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.845248 1977 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.845953 1987 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20250831 20:00:00.840484 1991 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.841143 1985 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.842090 1980 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.844436 1982 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.844471 1983 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.844892 1974 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_5b6b5bfafb524e0a9e93a06dbd4456c9 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.844911 1990 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.845248 1977 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.845953 1987 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.846097 1981 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
*** Check failure stack trace: ***
PC: @ 0x0 (unknown)
*** SIGABRT (@0x3e800000407) received by PID 1031 (TID 0x7f77189ae700) from PID 1031; stack trace: ***
F20250831 20:00:00.840484 1991 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.841143 1985 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.842090 1980 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.844436 1982 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.844471 1983 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.844892 1974 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_5b6b5bfafb524e0a9e93a06dbd4456c9 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.844911 1990 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.845248 1977 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.845953 1987 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.846097 1981 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.847556 1979 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20250831 20:00:00.840484 1991 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.841143 1985 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.842090 1980 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.844436 1982 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.844471 1983 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.844892 1974 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_5b6b5bfafb524e0a9e93a06dbd4456c9 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.844911 1990 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.845248 1977 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.845953 1987 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.846097 1981 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.847556 1979 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.847757 1992 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20250831 20:00:00.840484 1991 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.841143 1985 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.842090 1980 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.844436 1982 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.844471 1983 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.844892 1974 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_5b6b5bfafb524e0a9e93a06dbd4456c9 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.844911 1990 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.845248 1977 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.845953 1987 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.846097 1981 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.847556 1979 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.847757 1992 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.848078 1976 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20250831 20:00:00.840484 1991 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.841143 1985 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.842090 1980 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.844436 1982 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.844471 1983 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.844892 1974 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_5b6b5bfafb524e0a9e93a06dbd4456c9 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.844911 1990 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.845248 1977 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.845953 1987 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.846097 1981 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.847556 1979 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.847757 1992 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.848078 1976 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.848546 1973 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_a9e5115b40204ad6afb299f06aa717a2 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20250831 20:00:00.840484 1991 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.841143 1985 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.842090 1980 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.844436 1982 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.844471 1983 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.844892 1974 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_5b6b5bfafb524e0a9e93a06dbd4456c9 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.844911 1990 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.845248 1977 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.845953 1987 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.846097 1981 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.847556 1979 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.847757 1992 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.848078 1976 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.848546 1973 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_a9e5115b40204ad6afb299f06aa717a2 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)F20250831 20:00:00.848551 1966 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ca7adb92869942138e0f7dbe76fa583f on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.1.254:34259,127.1.1.253:45581,127.1.1.252:35943, num_attempts: 756) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.1.252:35943: connect: Connection refused (error 111)
*** Check failure stack trace: ***
@ 0x7f772e2e9980 (unknown) at ??:0
@ 0x7f77272bdfb7 gsignal at ??:0
@ 0x7f77272bf921 abort at ??:0
@ 0x7f7729ff5dcd google::LogMessage::Fail() at ??:0
@ 0x7f7729ff9b93 google::LogMessage::SendToLog() at ??:0
@ 0x7f7729ff57cc google::LogMessage::Flush() at ??:0
@ 0x7f7729ff6f59 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x40b582 kudu::MasterStressTest::CreateTableThread() at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/integration-tests/master-stress-test.cc:297
@ 0x44aaf4 std::__invoke_impl<>() at /usr/lib/gcc/x86_64-linux-gnu/7.5.0/../../../../include/c++/7.5.0/bits/invoke.h:73
@ 0x44a9ad std::__invoke<>() at /usr/lib/gcc/x86_64-linux-gnu/7.5.0/../../../../include/c++/7.5.0/bits/invoke.h:95
@ 0x44a96a _ZNSt6thread8_InvokerISt5tupleIJMN4kudu16MasterStressTestEFvvEPNS2_26MasterStressTest_Test_TestEEEE9_M_invokeIJLm0ELm1EEEEDTclsr3stdE8__invokespcl10_S_declvalIXT_EEEEESt12_Index_tupleIJXspT_EEE at /usr/lib/gcc/x86_64-linux-gnu/7.5.0/../../../../include/c++/7.5.0/thread:234
@ 0x44a91e std::thread::_Invoker<>::operator()() at /usr/lib/gcc/x86_64-linux-gnu/7.5.0/../../../../include/c++/7.5.0/thread:243
@ 0x44a659 std::thread::_State_impl<>::_M_run() at /usr/lib/gcc/x86_64-linux-gnu/7.5.0/../../../../include/c++/7.5.0/thread:186
@ 0x7f77279456df (unknown) at ??:0
@ 0x7f772e2de6db start_thread at ??:0
@ 0x7f77273a071f clone at ??:0