Note: This is test shard 3 of 3.
[==========] Running 1 test from 1 test suite.
[----------] Global test environment set-up.
[----------] 1 test from CatalogManagerConfigurations/MasterStressTest
[ RUN ] CatalogManagerConfigurations/MasterStressTest.Test/2
2026-03-21T03:02:07Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-03-21T03:02:07Z Disabled control of system clock
Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/derby.log -Djava.security.properties=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/security.properties
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/tmp/dist-test-taskZ5BwAx/thirdparty/src/hive-3.1.2/lib/log4j-slf4j-impl-2.10.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/tmp/dist-test-taskZ5BwAx/thirdparty/src/hadoop-3.4.1/share/hadoop/common/lib/slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
Metastore connection URL: jdbc:derby:/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/metadb;create=true
Metastore Connection Driver : org.apache.derby.jdbc.EmbeddedDriver
Metastore connection User: APP
Starting metastore schema initialization to 3.1.0
Initialization script hive-schema-3.1.0.derby.sql
Initialization script completed
schemaTool completed
Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/derby.log -Djava.security.properties=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/security.properties
2026-03-21 03:02:15: Starting Hive Metastore Server
Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/derby.log -Djava.security.properties=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/security.properties
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/tmp/dist-test-taskZ5BwAx/thirdparty/src/hive-3.1.2/lib/log4j-slf4j-impl-2.10.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/tmp/dist-test-taskZ5BwAx/thirdparty/src/hadoop-3.4.1/share/hadoop/common/lib/slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
Starting hive metastore on port 0
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260321 03:02:26.893669 7883 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskZ5BwAx/build/debug/bin/kudu
/tmp/dist-test-taskZ5BwAx/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.178.254:38651
--webserver_interface=127.7.178.254
--webserver_port=0
--builtin_ntp_servers=127.7.178.212:39683
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145
--hive_metastore_uris=thrift://127.0.0.1:35641
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260321 03:02:27.010682 8171 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260321 03:02:27.010944 8171 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260321 03:02:27.010989 8171 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260321 03:02:27.015399 8171 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260321 03:02:27.015497 8171 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260321 03:02:27.015522 8171 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260321 03:02:27.015540 8171 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260321 03:02:27.020346 8171 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.178.212:39683
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-0/wal
--hive_metastore_uris=thrift://127.0.0.1:35641
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.178.254:38651
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.178.254
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.8171
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 68f10dd41067059260a5fb5c725b178b69c38aed
build type DEBUG
built by None at 21 Mar 2026 02:43:15 UTC on bdcb31816ec0
build id 11028
I20260321 03:02:27.021718 8171 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260321 03:02:27.023038 8171 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260321 03:02:27.030771 8177 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260321 03:02:27.030781 8179 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260321 03:02:27.030958 8171 server_base.cc:1061] running on GCE node
W20260321 03:02:27.031049 8176 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260321 03:02:27.031953 8171 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260321 03:02:27.033850 8171 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260321 03:02:27.035104 8171 hybrid_clock.cc:648] HybridClock initialized: now 1774062147035036 us; error 94 us; skew 500 ppm
I20260321 03:02:27.037609 8171 webserver.cc:492] Webserver started at http://127.7.178.254:43827/ using document root <none> and password file <none>
I20260321 03:02:27.038295 8171 fs_manager.cc:362] Metadata directory not provided
I20260321 03:02:27.038470 8171 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260321 03:02:27.038723 8171 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260321 03:02:27.040673 8171 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-0/data/instance:
uuid: "4a187d1fb5804686b4aff01e47fd0284"
format_stamp: "Formatted at 2026-03-21 03:02:27 on dist-test-slave-bwf0"
I20260321 03:02:27.041360 8171 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-0/wal/instance:
uuid: "4a187d1fb5804686b4aff01e47fd0284"
format_stamp: "Formatted at 2026-03-21 03:02:27 on dist-test-slave-bwf0"
I20260321 03:02:27.045652 8171 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260321 03:02:27.048728 8185 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260321 03:02:27.050014 8171 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260321 03:02:27.050189 8171 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-0/wal
uuid: "4a187d1fb5804686b4aff01e47fd0284"
format_stamp: "Formatted at 2026-03-21 03:02:27 on dist-test-slave-bwf0"
I20260321 03:02:27.050400 8171 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260321 03:02:27.062829 8171 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260321 03:02:27.063622 8171 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260321 03:02:27.063850 8171 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260321 03:02:27.076108 8171 rpc_server.cc:307] RPC server started. Bound to: 127.7.178.254:38651
I20260321 03:02:27.076164 8237 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.178.254:38651 every 8 connection(s)
I20260321 03:02:27.077448 8171 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-0/data/info.pb
I20260321 03:02:27.081084 7883 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskZ5BwAx/build/debug/bin/kudu as pid 8171
I20260321 03:02:27.081303 7883 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-0/wal/instance
I20260321 03:02:27.081797 8238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:27.083156 7883 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskZ5BwAx/build/debug/bin/kudu
/tmp/dist-test-taskZ5BwAx/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.178.253:46595
--webserver_interface=127.7.178.253
--webserver_port=0
--builtin_ntp_servers=127.7.178.212:39683
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145
--hive_metastore_uris=thrift://127.0.0.1:35641
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260321 03:02:27.086103 8238 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } has no permanent_uuid. Determining permanent_uuid...
I20260321 03:02:27.103278 8238 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } has no permanent_uuid. Determining permanent_uuid...
W20260321 03:02:27.104409 8188 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
W20260321 03:02:27.105602 8238 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.7.178.253:46595: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
I20260321 03:02:27.154906 8238 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } attempt: 1
W20260321 03:02:27.157102 8238 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.7.178.253:46595: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
W20260321 03:02:27.206285 8239 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260321 03:02:27.206597 8239 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260321 03:02:27.206645 8239 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260321 03:02:27.210175 8239 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260321 03:02:27.210268 8239 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260321 03:02:27.210292 8239 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260321 03:02:27.210314 8239 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260321 03:02:27.214622 8239 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.178.212:39683
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-1/wal
--hive_metastore_uris=thrift://127.0.0.1:35641
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.178.253:46595
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.7.178.253
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.8239
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 68f10dd41067059260a5fb5c725b178b69c38aed
build type DEBUG
built by None at 21 Mar 2026 02:43:15 UTC on bdcb31816ec0
build id 11028
I20260321 03:02:27.215839 8239 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260321 03:02:27.217024 8239 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260321 03:02:27.223341 8250 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260321 03:02:27.223423 8247 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260321 03:02:27.223562 8248 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260321 03:02:27.223724 8239 server_base.cc:1061] running on GCE node
I20260321 03:02:27.224535 8239 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260321 03:02:27.225395 8238 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } attempt: 2
I20260321 03:02:27.225809 8239 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260321 03:02:27.227037 8239 hybrid_clock.cc:648] HybridClock initialized: now 1774062147227005 us; error 40 us; skew 500 ppm
W20260321 03:02:27.227223 8238 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.7.178.253:46595: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
I20260321 03:02:27.229213 8239 webserver.cc:492] Webserver started at http://127.7.178.253:43169/ using document root <none> and password file <none>
I20260321 03:02:27.229893 8239 fs_manager.cc:362] Metadata directory not provided
I20260321 03:02:27.229951 8239 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260321 03:02:27.230116 8239 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260321 03:02:27.231779 8239 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-1/data/instance:
uuid: "7451d7c0a71f4620a6607f74b5a22f2e"
format_stamp: "Formatted at 2026-03-21 03:02:27 on dist-test-slave-bwf0"
I20260321 03:02:27.232285 8239 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-1/wal/instance:
uuid: "7451d7c0a71f4620a6607f74b5a22f2e"
format_stamp: "Formatted at 2026-03-21 03:02:27 on dist-test-slave-bwf0"
I20260321 03:02:27.236850 8239 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.000s sys 0.006s
I20260321 03:02:27.239604 8256 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260321 03:02:27.240849 8239 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260321 03:02:27.241021 8239 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-1/data,/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-1/wal
uuid: "7451d7c0a71f4620a6607f74b5a22f2e"
format_stamp: "Formatted at 2026-03-21 03:02:27 on dist-test-slave-bwf0"
I20260321 03:02:27.241150 8239 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260321 03:02:27.257052 8239 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260321 03:02:27.257915 8239 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260321 03:02:27.258133 8239 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260321 03:02:27.267755 8239 rpc_server.cc:307] RPC server started. Bound to: 127.7.178.253:46595
I20260321 03:02:27.267755 8308 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.178.253:46595 every 8 connection(s)
I20260321 03:02:27.268895 8239 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-1/data/info.pb
I20260321 03:02:27.270320 7883 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskZ5BwAx/build/debug/bin/kudu as pid 8239
I20260321 03:02:27.270468 7883 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-1/wal/instance
I20260321 03:02:27.271193 7883 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskZ5BwAx/build/debug/bin/kudu
/tmp/dist-test-taskZ5BwAx/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.178.252:45145
--webserver_interface=127.7.178.252
--webserver_port=0
--builtin_ntp_servers=127.7.178.212:39683
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145
--hive_metastore_uris=thrift://127.0.0.1:35641
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260321 03:02:27.272404 8309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:27.278021 8309 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } has no permanent_uuid. Determining permanent_uuid...
I20260321 03:02:27.290993 8309 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } has no permanent_uuid. Determining permanent_uuid...
I20260321 03:02:27.298208 8309 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } has no permanent_uuid. Determining permanent_uuid...
W20260321 03:02:27.299158 8257 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.178.252:45145: connect: Connection refused (error 111)
W20260321 03:02:27.300396 8309 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.7.178.252:45145: Network error: Client connection negotiation failed: client connection to 127.7.178.252:45145: connect: Connection refused (error 111)
I20260321 03:02:27.318439 8238 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } attempt: 3
I20260321 03:02:27.323752 8238 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } has no permanent_uuid. Determining permanent_uuid...
W20260321 03:02:27.325383 8238 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.7.178.252:45145: Network error: Client connection negotiation failed: client connection to 127.7.178.252:45145: connect: Connection refused (error 111)
I20260321 03:02:27.349654 8309 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } attempt: 1
W20260321 03:02:27.351389 8309 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.7.178.252:45145: Network error: Client connection negotiation failed: client connection to 127.7.178.252:45145: connect: Connection refused (error 111)
I20260321 03:02:27.356598 8238 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } attempt: 1
W20260321 03:02:27.358199 8238 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.7.178.252:45145: Network error: Client connection negotiation failed: client connection to 127.7.178.252:45145: connect: Connection refused (error 111)
W20260321 03:02:27.393894 8310 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260321 03:02:27.394138 8310 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260321 03:02:27.394179 8310 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260321 03:02:27.397694 8310 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260321 03:02:27.397764 8310 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260321 03:02:27.397785 8310 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260321 03:02:27.397842 8310 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260321 03:02:27.401940 8310 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.178.212:39683
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-2/wal
--hive_metastore_uris=thrift://127.0.0.1:35641
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.178.252:45145
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.7.178.252
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.8310
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 68f10dd41067059260a5fb5c725b178b69c38aed
build type DEBUG
built by None at 21 Mar 2026 02:43:15 UTC on bdcb31816ec0
build id 11028
I20260321 03:02:27.403226 8310 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260321 03:02:27.404469 8310 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260321 03:02:27.410450 8318 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260321 03:02:27.410516 8319 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260321 03:02:27.410452 8321 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260321 03:02:27.410706 8310 server_base.cc:1061] running on GCE node
I20260321 03:02:27.411221 8310 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260321 03:02:27.412147 8310 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260321 03:02:27.413409 8310 hybrid_clock.cc:648] HybridClock initialized: now 1774062147413386 us; error 44 us; skew 500 ppm
I20260321 03:02:27.415431 8310 webserver.cc:492] Webserver started at http://127.7.178.252:36797/ using document root <none> and password file <none>
I20260321 03:02:27.416071 8310 fs_manager.cc:362] Metadata directory not provided
I20260321 03:02:27.416153 8310 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260321 03:02:27.416364 8310 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260321 03:02:27.418038 8310 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-2/data/instance:
uuid: "3df5e4492f3049c1b09fea013b92f863"
format_stamp: "Formatted at 2026-03-21 03:02:27 on dist-test-slave-bwf0"
I20260321 03:02:27.418552 8310 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-2/wal/instance:
uuid: "3df5e4492f3049c1b09fea013b92f863"
format_stamp: "Formatted at 2026-03-21 03:02:27 on dist-test-slave-bwf0"
I20260321 03:02:27.419582 8309 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } attempt: 2
W20260321 03:02:27.421155 8309 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.7.178.252:45145: Network error: Client connection negotiation failed: client connection to 127.7.178.252:45145: connect: Connection refused (error 111)
I20260321 03:02:27.422554 8310 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260321 03:02:27.425002 8327 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260321 03:02:27.426270 8310 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260321 03:02:27.426426 8310 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-2/data,/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-2/wal
uuid: "3df5e4492f3049c1b09fea013b92f863"
format_stamp: "Formatted at 2026-03-21 03:02:27 on dist-test-slave-bwf0"
I20260321 03:02:27.426558 8310 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260321 03:02:27.433434 8238 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } attempt: 2
W20260321 03:02:27.434960 8238 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.7.178.252:45145: Network error: Client connection negotiation failed: client connection to 127.7.178.252:45145: connect: Connection refused (error 111)
I20260321 03:02:27.446062 8310 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260321 03:02:27.446825 8310 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260321 03:02:27.447037 8310 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260321 03:02:27.455188 8310 rpc_server.cc:307] RPC server started. Bound to: 127.7.178.252:45145
I20260321 03:02:27.455216 8379 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.178.252:45145 every 8 connection(s)
I20260321 03:02:27.456606 8310 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-2/data/info.pb
I20260321 03:02:27.458808 7883 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskZ5BwAx/build/debug/bin/kudu as pid 8310
I20260321 03:02:27.458907 7883 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-2/wal/instance
I20260321 03:02:27.459924 8380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:27.464110 8380 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } has no permanent_uuid. Determining permanent_uuid...
I20260321 03:02:27.473874 8380 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } has no permanent_uuid. Determining permanent_uuid...
I20260321 03:02:27.479926 8380 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } has no permanent_uuid. Determining permanent_uuid...
I20260321 03:02:27.489080 8380 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863: Bootstrap starting.
I20260321 03:02:27.491636 8380 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:27.492472 8380 log.cc:826] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863: Log is configured to *not* fsync() on all Append() calls
I20260321 03:02:27.494673 8380 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863: No bootstrap required, opened a new log
I20260321 03:02:27.497856 8380 raft_consensus.cc:359] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:02:27.498111 8380 raft_consensus.cc:385] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:27.498207 8380 raft_consensus.cc:740] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3df5e4492f3049c1b09fea013b92f863, State: Initialized, Role: FOLLOWER
I20260321 03:02:27.498788 8380 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:02:27.499356 8386 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } } }
I20260321 03:02:27.499485 8386 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [sys.catalog]: This master's current role is: FOLLOWER
I20260321 03:02:27.500178 8380 sys_catalog.cc:565] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [sys.catalog]: configured and running, proceeding with master startup.
W20260321 03:02:27.507403 8400 catalog_manager.cc:1568] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260321 03:02:27.505385 8310 master_runner.cc:186] Error getting master registration for 127.7.178.254:38651: OK, instance_id { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" instance_seqno: 1774062147071896 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
W20260321 03:02:27.507658 8400 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260321 03:02:27.507807 8310 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260321 03:02:27.512452 8309 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } attempt: 3
I20260321 03:02:27.521024 8309 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e: Bootstrap starting.
I20260321 03:02:27.525856 8309 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:27.527043 8309 log.cc:826] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e: Log is configured to *not* fsync() on all Append() calls
I20260321 03:02:27.529544 8309 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e: No bootstrap required, opened a new log
I20260321 03:02:27.534175 8238 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } attempt: 3
I20260321 03:02:27.536739 8309 raft_consensus.cc:359] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:02:27.537083 8309 raft_consensus.cc:385] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:27.537190 8309 raft_consensus.cc:740] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7451d7c0a71f4620a6607f74b5a22f2e, State: Initialized, Role: FOLLOWER
I20260321 03:02:27.537894 8309 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:02:27.539829 8309 sys_catalog.cc:565] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [sys.catalog]: configured and running, proceeding with master startup.
I20260321 03:02:27.543427 8238 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284: Bootstrap starting.
I20260321 03:02:27.545411 8239 master_runner.cc:186] Error getting master registration for 127.7.178.254:38651: OK, instance_id { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" instance_seqno: 1774062147071896 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260321 03:02:27.548400 8239 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260321 03:02:27.551411 8238 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:27.552704 8238 log.cc:826] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284: Log is configured to *not* fsync() on all Append() calls
I20260321 03:02:27.553457 8404 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } } }
I20260321 03:02:27.554219 8404 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [sys.catalog]: This master's current role is: FOLLOWER
I20260321 03:02:27.554412 8404 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260321 03:02:27.554618 8404 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
W20260321 03:02:27.554112 8418 catalog_manager.cc:1568] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260321 03:02:27.555136 8418 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260321 03:02:27.556326 8404 leader_election.cc:290] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651), 3df5e4492f3049c1b09fea013b92f863 (127.7.178.252:45145)
I20260321 03:02:27.556946 8354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3df5e4492f3049c1b09fea013b92f863" is_pre_election: true
I20260321 03:02:27.557296 8354 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7451d7c0a71f4620a6607f74b5a22f2e in term 0.
I20260321 03:02:27.558009 8257 leader_election.cc:304] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3df5e4492f3049c1b09fea013b92f863, 7451d7c0a71f4620a6607f74b5a22f2e; no voters:
I20260321 03:02:27.558429 8404 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260321 03:02:27.558586 8404 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260321 03:02:27.558691 8404 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:27.559973 8404 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:02:27.562510 8354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3df5e4492f3049c1b09fea013b92f863"
I20260321 03:02:27.562690 8354 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:27.563952 8354 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7451d7c0a71f4620a6607f74b5a22f2e in term 1.
I20260321 03:02:27.564523 8238 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284: No bootstrap required, opened a new log
I20260321 03:02:27.564719 8257 leader_election.cc:304] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3df5e4492f3049c1b09fea013b92f863, 7451d7c0a71f4620a6607f74b5a22f2e; no voters:
I20260321 03:02:27.564996 8421 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [term 1 FOLLOWER]: Leader election won for term 1
I20260321 03:02:27.565732 8421 raft_consensus.cc:697] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [term 1 LEADER]: Becoming Leader. State: Replica: 7451d7c0a71f4620a6607f74b5a22f2e, State: Running, Role: LEADER
I20260321 03:02:27.566771 8421 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:02:27.570894 8421 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7451d7c0a71f4620a6607f74b5a22f2e. Latest consensus state: current_term: 1 leader_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } } }
I20260321 03:02:27.571390 8421 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [sys.catalog]: This master's current role is: LEADER
I20260321 03:02:27.571734 8238 raft_consensus.cc:359] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:02:27.571977 8238 raft_consensus.cc:385] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:27.572052 8238 raft_consensus.cc:740] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a187d1fb5804686b4aff01e47fd0284, State: Initialized, Role: FOLLOWER
I20260321 03:02:27.572649 8238 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:02:27.573539 8426 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } } }
I20260321 03:02:27.573848 8426 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [sys.catalog]: This master's current role is: FOLLOWER
I20260321 03:02:27.574194 8238 sys_catalog.cc:565] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [sys.catalog]: configured and running, proceeding with master startup.
I20260321 03:02:27.574234 8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a187d1fb5804686b4aff01e47fd0284" is_pre_election: true
I20260321 03:02:27.574519 8212 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7451d7c0a71f4620a6607f74b5a22f2e in term 0.
I20260321 03:02:27.575632 8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a187d1fb5804686b4aff01e47fd0284"
I20260321 03:02:27.575785 8211 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:27.577085 8211 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7451d7c0a71f4620a6607f74b5a22f2e in term 1.
I20260321 03:02:27.579715 8404 leader_election.cc:290] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [CANDIDATE]: Term 1 election: Requested vote from peers 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651), 3df5e4492f3049c1b09fea013b92f863 (127.7.178.252:45145)
I20260321 03:02:27.582283 8425 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260321 03:02:27.585793 8425 catalog_manager.cc:1494] Initializing Kudu cluster ID...
W20260321 03:02:27.601378 8440 catalog_manager.cc:1568] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260321 03:02:27.605048 8440 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260321 03:02:27.614576 8354 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 1 FOLLOWER]: Refusing update from remote peer 7451d7c0a71f4620a6607f74b5a22f2e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260321 03:02:27.615579 8211 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 1 FOLLOWER]: Refusing update from remote peer 7451d7c0a71f4620a6607f74b5a22f2e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260321 03:02:27.616531 8404 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260321 03:02:27.617802 8404 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260321 03:02:27.629848 8386 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7451d7c0a71f4620a6607f74b5a22f2e. Latest consensus state: current_term: 1 leader_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } } }
I20260321 03:02:27.630012 8386 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [sys.catalog]: This master's current role is: FOLLOWER
I20260321 03:02:27.630723 8426 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7451d7c0a71f4620a6607f74b5a22f2e. Latest consensus state: current_term: 1 leader_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } } }
I20260321 03:02:27.630872 8426 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [sys.catalog]: This master's current role is: FOLLOWER
I20260321 03:02:27.633486 8404 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } } }
I20260321 03:02:27.633641 8404 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [sys.catalog]: This master's current role is: LEADER
I20260321 03:02:27.634953 8386 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } } }
I20260321 03:02:27.635094 8386 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [sys.catalog]: This master's current role is: FOLLOWER
I20260321 03:02:27.637518 8425 catalog_manager.cc:1357] Generated new cluster ID: 30588dbe2d29416e8c640adf9bfaba1f
I20260321 03:02:27.637606 8425 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260321 03:02:27.640098 8421 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } } }
I20260321 03:02:27.640293 8421 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [sys.catalog]: This master's current role is: LEADER
I20260321 03:02:27.641590 8426 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } } }
I20260321 03:02:27.641728 8426 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [sys.catalog]: This master's current role is: FOLLOWER
I20260321 03:02:27.657639 8444 mvcc.cc:204] Tried to move back new op lower bound from 7266558556615987200 to 7266558556440838144. Current Snapshot: MvccSnapshot[applied={T|T < 7266558556615987200}]
I20260321 03:02:27.659166 8445 mvcc.cc:204] Tried to move back new op lower bound from 7266558556615987200 to 7266558556440838144. Current Snapshot: MvccSnapshot[applied={T|T < 7266558556615987200}]
I20260321 03:02:27.687849 8425 catalog_manager.cc:1380] Generated new certificate authority record
I20260321 03:02:27.689414 8425 catalog_manager.cc:1514] Loading token signing keys...
I20260321 03:02:27.706451 8425 catalog_manager.cc:6044] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e: Generated new TSK 0
I20260321 03:02:27.707566 8425 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260321 03:02:27.708396 8425 catalog_manager.cc:1537] Loading latest processed Hive Metastore notification log event ID...
I20260321 03:02:27.708971 8425 catalog_manager.cc:5893] Last processed Hive Metastore notification event ID: -1
I20260321 03:02:27.725005 7883 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskZ5BwAx/build/debug/bin/kudu
/tmp/dist-test-taskZ5BwAx/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.178.193:0
--local_ip_for_outbound_sockets=127.7.178.193
--webserver_interface=127.7.178.193
--webserver_port=0
--tserver_master_addrs=127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145
--builtin_ntp_servers=127.7.178.212:39683
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
W20260321 03:02:27.889482 8451 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260321 03:02:27.889830 8451 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260321 03:02:27.889910 8451 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260321 03:02:27.895077 8451 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260321 03:02:27.895269 8451 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.178.193
I20260321 03:02:27.900141 8451 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.178.212:39683
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--fs_data_dirs=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.178.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.178.193
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145
--never_fsync=true
--heap_profile_path=/tmp/kudu.8451
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.178.193
--log_dir=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 68f10dd41067059260a5fb5c725b178b69c38aed
build type DEBUG
built by None at 21 Mar 2026 02:43:15 UTC on bdcb31816ec0
build id 11028
I20260321 03:02:27.901568 8451 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260321 03:02:27.902999 8451 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260321 03:02:27.910733 8457 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260321 03:02:27.910760 8459 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260321 03:02:27.910733 8456 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260321 03:02:27.911377 8451 server_base.cc:1061] running on GCE node
I20260321 03:02:27.911808 8451 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260321 03:02:27.912468 8451 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260321 03:02:27.913681 8451 hybrid_clock.cc:648] HybridClock initialized: now 1774062147913654 us; error 42 us; skew 500 ppm
I20260321 03:02:27.915799 8451 webserver.cc:492] Webserver started at http://127.7.178.193:40599/ using document root <none> and password file <none>
I20260321 03:02:27.916436 8451 fs_manager.cc:362] Metadata directory not provided
I20260321 03:02:27.916529 8451 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260321 03:02:27.916751 8451 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260321 03:02:27.918515 8451 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-0/data/instance:
uuid: "4532b54a008a4a39b663112e6d0aacc0"
format_stamp: "Formatted at 2026-03-21 03:02:27 on dist-test-slave-bwf0"
I20260321 03:02:27.919054 8451 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-0/wal/instance:
uuid: "4532b54a008a4a39b663112e6d0aacc0"
format_stamp: "Formatted at 2026-03-21 03:02:27 on dist-test-slave-bwf0"
I20260321 03:02:27.922916 8451 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260321 03:02:27.925505 8465 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260321 03:02:27.926703 8451 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260321 03:02:27.926867 8451 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-0/wal
uuid: "4532b54a008a4a39b663112e6d0aacc0"
format_stamp: "Formatted at 2026-03-21 03:02:27 on dist-test-slave-bwf0"
I20260321 03:02:27.926988 8451 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260321 03:02:27.944335 8451 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260321 03:02:27.945043 8451 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260321 03:02:27.945245 8451 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260321 03:02:27.946224 8451 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260321 03:02:27.947469 8451 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260321 03:02:27.947554 8451 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260321 03:02:27.947624 8451 ts_tablet_manager.cc:616] Registered 0 tablets
I20260321 03:02:27.947674 8451 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260321 03:02:27.958650 8451 rpc_server.cc:307] RPC server started. Bound to: 127.7.178.193:46171
I20260321 03:02:27.958673 8578 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.178.193:46171 every 8 connection(s)
I20260321 03:02:27.959672 8451 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-0/data/info.pb
I20260321 03:02:27.963335 7883 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskZ5BwAx/build/debug/bin/kudu as pid 8451
I20260321 03:02:27.963438 7883 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-0/wal/instance
I20260321 03:02:27.966418 7883 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskZ5BwAx/build/debug/bin/kudu
/tmp/dist-test-taskZ5BwAx/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.178.194:0
--local_ip_for_outbound_sockets=127.7.178.194
--webserver_interface=127.7.178.194
--webserver_port=0
--tserver_master_addrs=127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145
--builtin_ntp_servers=127.7.178.212:39683
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260321 03:02:27.971668 8580 heartbeater.cc:344] Connected to a master server at 127.7.178.254:38651
I20260321 03:02:27.972009 8580 heartbeater.cc:461] Registering TS with master...
I20260321 03:02:27.972807 8579 heartbeater.cc:344] Connected to a master server at 127.7.178.252:45145
I20260321 03:02:27.972895 8580 heartbeater.cc:507] Master 127.7.178.254:38651 requested a full tablet report, sending...
I20260321 03:02:27.972965 8581 heartbeater.cc:344] Connected to a master server at 127.7.178.253:46595
I20260321 03:02:27.973074 8581 heartbeater.cc:461] Registering TS with master...
I20260321 03:02:27.973428 8581 heartbeater.cc:507] Master 127.7.178.253:46595 requested a full tablet report, sending...
I20260321 03:02:27.972901 8579 heartbeater.cc:461] Registering TS with master...
I20260321 03:02:27.973711 8579 heartbeater.cc:507] Master 127.7.178.252:45145 requested a full tablet report, sending...
I20260321 03:02:27.974969 8202 ts_manager.cc:194] Registered new tserver with Master: 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171)
I20260321 03:02:27.975220 8344 ts_manager.cc:194] Registered new tserver with Master: 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171)
I20260321 03:02:27.976281 8273 ts_manager.cc:194] Registered new tserver with Master: 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171)
I20260321 03:02:27.978125 8273 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.7.178.193:47073
W20260321 03:02:28.086913 8586 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260321 03:02:28.087242 8586 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260321 03:02:28.087316 8586 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260321 03:02:28.092322 8586 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260321 03:02:28.092506 8586 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.178.194
I20260321 03:02:28.096796 8586 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.178.212:39683
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--fs_data_dirs=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.178.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.178.194
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145
--never_fsync=true
--heap_profile_path=/tmp/kudu.8586
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.178.194
--log_dir=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 68f10dd41067059260a5fb5c725b178b69c38aed
build type DEBUG
built by None at 21 Mar 2026 02:43:15 UTC on bdcb31816ec0
build id 11028
I20260321 03:02:28.098060 8586 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260321 03:02:28.099165 8586 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260321 03:02:28.106819 8594 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260321 03:02:28.106788 8591 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260321 03:02:28.106783 8592 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260321 03:02:28.106868 8586 server_base.cc:1061] running on GCE node
I20260321 03:02:28.107589 8586 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260321 03:02:28.108206 8586 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260321 03:02:28.109380 8586 hybrid_clock.cc:648] HybridClock initialized: now 1774062148109349 us; error 47 us; skew 500 ppm
I20260321 03:02:28.111426 8586 webserver.cc:492] Webserver started at http://127.7.178.194:38653/ using document root <none> and password file <none>
I20260321 03:02:28.112155 8586 fs_manager.cc:362] Metadata directory not provided
I20260321 03:02:28.112215 8586 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260321 03:02:28.112428 8586 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260321 03:02:28.114182 8586 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-1/data/instance:
uuid: "70e7666c46844503beb466fdc054a6fc"
format_stamp: "Formatted at 2026-03-21 03:02:28 on dist-test-slave-bwf0"
I20260321 03:02:28.114699 8586 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-1/wal/instance:
uuid: "70e7666c46844503beb466fdc054a6fc"
format_stamp: "Formatted at 2026-03-21 03:02:28 on dist-test-slave-bwf0"
I20260321 03:02:28.118345 8586 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260321 03:02:28.120899 8600 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260321 03:02:28.122367 8586 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260321 03:02:28.122592 8586 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-1/wal
uuid: "70e7666c46844503beb466fdc054a6fc"
format_stamp: "Formatted at 2026-03-21 03:02:28 on dist-test-slave-bwf0"
I20260321 03:02:28.122740 8586 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260321 03:02:28.145417 8586 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260321 03:02:28.146312 8586 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260321 03:02:28.146535 8586 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260321 03:02:28.147487 8586 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260321 03:02:28.148732 8586 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260321 03:02:28.148815 8586 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260321 03:02:28.148896 8586 ts_tablet_manager.cc:616] Registered 0 tablets
I20260321 03:02:28.148952 8586 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260321 03:02:28.161988 8586 rpc_server.cc:307] RPC server started. Bound to: 127.7.178.194:44713
I20260321 03:02:28.162012 8713 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.178.194:44713 every 8 connection(s)
I20260321 03:02:28.163040 8586 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-1/data/info.pb
I20260321 03:02:28.164497 7883 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskZ5BwAx/build/debug/bin/kudu as pid 8586
I20260321 03:02:28.164613 7883 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-1/wal/instance
I20260321 03:02:28.167629 7883 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskZ5BwAx/build/debug/bin/kudu
/tmp/dist-test-taskZ5BwAx/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.178.195:0
--local_ip_for_outbound_sockets=127.7.178.195
--webserver_interface=127.7.178.195
--webserver_port=0
--tserver_master_addrs=127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145
--builtin_ntp_servers=127.7.178.212:39683
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260321 03:02:28.175392 8714 heartbeater.cc:344] Connected to a master server at 127.7.178.252:45145
I20260321 03:02:28.175447 8715 heartbeater.cc:344] Connected to a master server at 127.7.178.254:38651
I20260321 03:02:28.175489 8716 heartbeater.cc:344] Connected to a master server at 127.7.178.253:46595
I20260321 03:02:28.175697 8715 heartbeater.cc:461] Registering TS with master...
I20260321 03:02:28.175696 8716 heartbeater.cc:461] Registering TS with master...
I20260321 03:02:28.175696 8714 heartbeater.cc:461] Registering TS with master...
I20260321 03:02:28.176496 8714 heartbeater.cc:507] Master 127.7.178.252:45145 requested a full tablet report, sending...
I20260321 03:02:28.176496 8716 heartbeater.cc:507] Master 127.7.178.253:46595 requested a full tablet report, sending...
I20260321 03:02:28.176496 8715 heartbeater.cc:507] Master 127.7.178.254:38651 requested a full tablet report, sending...
I20260321 03:02:28.177788 8273 ts_manager.cc:194] Registered new tserver with Master: 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713)
I20260321 03:02:28.177913 8344 ts_manager.cc:194] Registered new tserver with Master: 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713)
I20260321 03:02:28.178064 8202 ts_manager.cc:194] Registered new tserver with Master: 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713)
I20260321 03:02:28.178555 8273 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.7.178.194:60557
I20260321 03:02:28.205925 8722 raft_consensus.cc:493] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7451d7c0a71f4620a6607f74b5a22f2e)
I20260321 03:02:28.206127 8722 raft_consensus.cc:515] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:02:28.207114 8722 leader_election.cc:290] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595), 3df5e4492f3049c1b09fea013b92f863 (127.7.178.252:45145)
I20260321 03:02:28.207616 8354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4a187d1fb5804686b4aff01e47fd0284" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3df5e4492f3049c1b09fea013b92f863" is_pre_election: true
I20260321 03:02:28.207682 8283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4a187d1fb5804686b4aff01e47fd0284" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" is_pre_election: true
I20260321 03:02:28.208298 8188 leader_election.cc:304] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a187d1fb5804686b4aff01e47fd0284; no voters: 3df5e4492f3049c1b09fea013b92f863, 7451d7c0a71f4620a6607f74b5a22f2e
I20260321 03:02:28.208575 8722 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260321 03:02:28.290164 8721 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260321 03:02:28.290445 8721 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260321 03:02:28.290504 8721 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260321 03:02:28.294499 8721 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260321 03:02:28.294647 8721 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.178.195
I20260321 03:02:28.299321 8721 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.178.212:39683
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--fs_data_dirs=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.178.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.178.195
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145
--never_fsync=true
--heap_profile_path=/tmp/kudu.8721
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.178.195
--log_dir=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 68f10dd41067059260a5fb5c725b178b69c38aed
build type DEBUG
built by None at 21 Mar 2026 02:43:15 UTC on bdcb31816ec0
build id 11028
I20260321 03:02:28.300618 8721 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260321 03:02:28.302021 8721 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260321 03:02:28.310014 8727 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260321 03:02:28.309957 8730 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260321 03:02:28.310189 8721 server_base.cc:1061] running on GCE node
W20260321 03:02:28.309966 8728 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260321 03:02:28.310873 8721 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260321 03:02:28.311484 8721 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260321 03:02:28.312680 8721 hybrid_clock.cc:648] HybridClock initialized: now 1774062148312653 us; error 47 us; skew 500 ppm
I20260321 03:02:28.314983 8721 webserver.cc:492] Webserver started at http://127.7.178.195:34151/ using document root <none> and password file <none>
I20260321 03:02:28.315625 8721 fs_manager.cc:362] Metadata directory not provided
I20260321 03:02:28.315685 8721 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260321 03:02:28.315924 8721 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260321 03:02:28.317793 8721 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-2/data/instance:
uuid: "a97f7dd77cf2444f8fdb441019081f79"
format_stamp: "Formatted at 2026-03-21 03:02:28 on dist-test-slave-bwf0"
I20260321 03:02:28.318337 8721 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-2/wal/instance:
uuid: "a97f7dd77cf2444f8fdb441019081f79"
format_stamp: "Formatted at 2026-03-21 03:02:28 on dist-test-slave-bwf0"
I20260321 03:02:28.322316 8721 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260321 03:02:28.324901 8736 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260321 03:02:28.326350 8721 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260321 03:02:28.326519 8721 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-2/wal
uuid: "a97f7dd77cf2444f8fdb441019081f79"
format_stamp: "Formatted at 2026-03-21 03:02:28 on dist-test-slave-bwf0"
I20260321 03:02:28.326660 8721 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260321 03:02:28.346227 8721 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260321 03:02:28.347055 8721 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260321 03:02:28.347565 8721 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260321 03:02:28.348636 8721 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260321 03:02:28.350448 8721 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260321 03:02:28.350553 8721 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260321 03:02:28.350638 8721 ts_tablet_manager.cc:616] Registered 0 tablets
I20260321 03:02:28.350672 8721 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260321 03:02:28.364001 8721 rpc_server.cc:307] RPC server started. Bound to: 127.7.178.195:42091
I20260321 03:02:28.364071 8849 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.178.195:42091 every 8 connection(s)
I20260321 03:02:28.365155 8721 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-2/data/info.pb
I20260321 03:02:28.367117 7883 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskZ5BwAx/build/debug/bin/kudu as pid 8721
I20260321 03:02:28.367266 7883 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-2/wal/instance
I20260321 03:02:28.377862 8850 heartbeater.cc:344] Connected to a master server at 127.7.178.252:45145
I20260321 03:02:28.377894 8851 heartbeater.cc:344] Connected to a master server at 127.7.178.254:38651
I20260321 03:02:28.377851 8852 heartbeater.cc:344] Connected to a master server at 127.7.178.253:46595
I20260321 03:02:28.378206 8852 heartbeater.cc:461] Registering TS with master...
I20260321 03:02:28.378204 8851 heartbeater.cc:461] Registering TS with master...
I20260321 03:02:28.378204 8850 heartbeater.cc:461] Registering TS with master...
I20260321 03:02:28.378994 8852 heartbeater.cc:507] Master 127.7.178.253:46595 requested a full tablet report, sending...
I20260321 03:02:28.378994 8851 heartbeater.cc:507] Master 127.7.178.254:38651 requested a full tablet report, sending...
I20260321 03:02:28.378994 8850 heartbeater.cc:507] Master 127.7.178.252:45145 requested a full tablet report, sending...
I20260321 03:02:28.380301 8273 ts_manager.cc:194] Registered new tserver with Master: a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
I20260321 03:02:28.380416 8202 ts_manager.cc:194] Registered new tserver with Master: a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
I20260321 03:02:28.380443 8344 ts_manager.cc:194] Registered new tserver with Master: a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
I20260321 03:02:28.381119 8273 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.7.178.195:39935
I20260321 03:02:28.393131 7883 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
I20260321 03:02:28.410866 7883 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskZ5BwAx/build/debug/bin/kudu with pid 8310
I20260321 03:02:28.412985 8273 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39954:
name: "default.Table_628c329100ff4b269d91d561af863424"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260321 03:02:28.413821 8271 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39954:
name: "default.Table_9bbd1f43ebe347ed99a9be3a6ffb3d86"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260321 03:02:28.414166 8270 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39954:
name: "default.Table_337c18c13bb24e78bad2738358717d2d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260321 03:02:28.414474 8269 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39954:
name: "default.Table_a658f97fed3c4b3eabbfcbb9018b388f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260321 03:02:28.414758 8268 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39954:
name: "default.Table_9731292f060b48d7a3b304a142988570"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260321 03:02:28.412986 8272 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39954:
name: "default.Table_ec53d9a55a4c47b8a9b0fa3916c9c561"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260321 03:02:28.416199 8266 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39954:
name: "default.Table_0e0c55f293274457aed5e8d315334903"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260321 03:02:28.416258 8265 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39954:
name: "default.Table_06e0fbe90fe0411d95d76f56b53fb175"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260321 03:02:28.417534 8267 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39954:
name: "default.Table_f8b27d78677b44468e403c75afa5245a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260321 03:02:28.423754 8264 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39954:
name: "default.Table_0e444e840fa14c16a1a1f2e750c73045"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260321 03:02:28.453739 8273 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_628c329100ff4b269d91d561af863424 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260321 03:02:28.475478 8257 consensus_peers.cc:597] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e -> Peer 3df5e4492f3049c1b09fea013b92f863 (127.7.178.252:45145): Couldn't send request to peer 3df5e4492f3049c1b09fea013b92f863. Status: Network error: Client connection negotiation failed: client connection to 127.7.178.252:45145: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260321 03:02:28.477666 8579 heartbeater.cc:646] Failed to heartbeat to 127.7.178.252:45145 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.7.178.252:45145: connect: Connection refused (error 111)
I20260321 03:02:28.480921 8581 heartbeater.cc:499] Master 127.7.178.253:46595 was elected leader, sending a full tablet report...
I20260321 03:02:28.606890 8440 catalog_manager.cc:1269] Loaded cluster ID: 30588dbe2d29416e8c640adf9bfaba1f
I20260321 03:02:28.607003 8440 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284: loading cluster ID for follower catalog manager: success
I20260321 03:02:28.609917 8440 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284: acquiring CA information for follower catalog manager: success
I20260321 03:02:28.611878 8440 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260321 03:02:28.680301 8716 heartbeater.cc:499] Master 127.7.178.253:46595 was elected leader, sending a full tablet report...
W20260321 03:02:28.685393 8714 heartbeater.cc:646] Failed to heartbeat to 127.7.178.252:45145 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.7.178.252:45145: connect: Connection refused (error 111)
I20260321 03:02:28.833904 8901 raft_consensus.cc:493] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7451d7c0a71f4620a6607f74b5a22f2e)
I20260321 03:02:28.834136 8901 raft_consensus.cc:515] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:02:28.835189 8283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4a187d1fb5804686b4aff01e47fd0284" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" is_pre_election: true
I20260321 03:02:28.836304 8901 leader_election.cc:290] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595), 3df5e4492f3049c1b09fea013b92f863 (127.7.178.252:45145)
W20260321 03:02:28.839787 8186 leader_election.cc:336] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3df5e4492f3049c1b09fea013b92f863 (127.7.178.252:45145): Network error: Client connection negotiation failed: client connection to 127.7.178.252:45145: connect: Connection refused (error 111)
I20260321 03:02:28.839893 8186 leader_election.cc:304] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a187d1fb5804686b4aff01e47fd0284; no voters: 3df5e4492f3049c1b09fea013b92f863, 7451d7c0a71f4620a6607f74b5a22f2e
I20260321 03:02:28.840128 8901 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:02:28.882963 8852 heartbeater.cc:499] Master 127.7.178.253:46595 was elected leader, sending a full tablet report...
W20260321 03:02:28.890841 8850 heartbeater.cc:646] Failed to heartbeat to 127.7.178.252:45145 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.7.178.252:45145: connect: Connection refused (error 111)
I20260321 03:02:28.900234 8421 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } } }
I20260321 03:02:28.900400 8421 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [sys.catalog]: This master's current role is: LEADER
I20260321 03:02:28.931056 8273 catalog_manager.cc:2174] created HMS catalog entry for table [id=94ef39d020ab428b9e0392bedab9483d]
W20260321 03:02:28.934780 8271 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_9bbd1f43ebe347ed99a9be3a6ffb3d86 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260321 03:02:28.935762 8270 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_337c18c13bb24e78bad2738358717d2d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260321 03:02:28.936528 8269 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_a658f97fed3c4b3eabbfcbb9018b388f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260321 03:02:28.937243 8268 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_9731292f060b48d7a3b304a142988570 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260321 03:02:28.937947 8272 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_ec53d9a55a4c47b8a9b0fa3916c9c561 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260321 03:02:28.938616 8266 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_0e0c55f293274457aed5e8d315334903 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260321 03:02:28.939384 8265 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_06e0fbe90fe0411d95d76f56b53fb175 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260321 03:02:28.940194 8267 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_f8b27d78677b44468e403c75afa5245a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260321 03:02:28.940943 8264 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_0e444e840fa14c16a1a1f2e750c73045 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260321 03:02:28.948940 8273 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39954:
table { table_name: "default.Table_628c329100ff4b269d91d561af863424" } new_table_name: "default.Table_10dd23c6f33c4aa0bad0a534fb770d4a" modify_external_catalogs: true
I20260321 03:02:28.967860 8783 tablet_service.cc:1511] Processing CreateTablet for tablet cce1588111a245a48d503c4072c8cadc (DEFAULT_TABLE table=default.table_628c329100ff4b269d91d561af863424 [id=94ef39d020ab428b9e0392bedab9483d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:28.969100 8783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cce1588111a245a48d503c4072c8cadc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:28.974149 8513 tablet_service.cc:1511] Processing CreateTablet for tablet cce1588111a245a48d503c4072c8cadc (DEFAULT_TABLE table=default.table_628c329100ff4b269d91d561af863424 [id=94ef39d020ab428b9e0392bedab9483d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:28.975391 8513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cce1588111a245a48d503c4072c8cadc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:28.985543 8648 tablet_service.cc:1511] Processing CreateTablet for tablet cce1588111a245a48d503c4072c8cadc (DEFAULT_TABLE table=default.table_628c329100ff4b269d91d561af863424 [id=94ef39d020ab428b9e0392bedab9483d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:28.986795 8648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cce1588111a245a48d503c4072c8cadc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:28.994225 8271 catalog_manager.cc:2174] created HMS catalog entry for table [id=4ac1925a391a48ea86c63da0c1d8c442]
I20260321 03:02:29.000444 7883 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskZ5BwAx/build/debug/bin/kudu
/tmp/dist-test-taskZ5BwAx/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.178.252:45145
--webserver_interface=127.7.178.252
--webserver_port=36797
--builtin_ntp_servers=127.7.178.212:39683
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145
--hive_metastore_uris=thrift://127.0.0.1:35641
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260321 03:02:29.001892 8271 master_service.cc:954] ReplaceTablet: received request to replace tablet cce1588111a245a48d503c4072c8cadc from {username='slave'} at 127.0.0.1:39954
I20260321 03:02:29.007668 8923 tablet_bootstrap.cc:492] T cce1588111a245a48d503c4072c8cadc P 70e7666c46844503beb466fdc054a6fc: Bootstrap starting.
I20260321 03:02:29.010355 8923 tablet_bootstrap.cc:654] T cce1588111a245a48d503c4072c8cadc P 70e7666c46844503beb466fdc054a6fc: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:29.010468 8271 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e: Sending DeleteTablet for 3 replicas of tablet cce1588111a245a48d503c4072c8cadc
I20260321 03:02:29.010931 8271 catalog_manager.cc:6741] ReplaceTablet: tablet cce1588111a245a48d503c4072c8cadc deleted and replaced by tablet a4bfa1cd32ac40cb800860d336c99fd7
I20260321 03:02:29.011124 8271 master_service.cc:954] ReplaceTablet: received request to replace tablet cce1588111a245a48d503c4072c8cadc from {username='slave'} at 127.0.0.1:39954
I20260321 03:02:29.011454 8271 master_service.cc:954] ReplaceTablet: received request to replace tablet cce1588111a245a48d503c4072c8cadc from {username='slave'} at 127.0.0.1:39954
I20260321 03:02:29.011713 8271 master_service.cc:954] ReplaceTablet: received request to replace tablet cce1588111a245a48d503c4072c8cadc from {username='slave'} at 127.0.0.1:39954
I20260321 03:02:29.012676 8648 tablet_service.cc:1558] Processing DeleteTablet for tablet cce1588111a245a48d503c4072c8cadc with delete_type TABLET_DATA_DELETED (replaced by tablet a4bfa1cd32ac40cb800860d336c99fd7) from {username='slave'} at 127.0.0.1:35520
I20260321 03:02:29.013196 8513 tablet_service.cc:1558] Processing DeleteTablet for tablet cce1588111a245a48d503c4072c8cadc with delete_type TABLET_DATA_DELETED (replaced by tablet a4bfa1cd32ac40cb800860d336c99fd7) from {username='slave'} at 127.0.0.1:51684
I20260321 03:02:29.013691 8783 tablet_service.cc:1558] Processing DeleteTablet for tablet cce1588111a245a48d503c4072c8cadc with delete_type TABLET_DATA_DELETED (replaced by tablet a4bfa1cd32ac40cb800860d336c99fd7) from {username='slave'} at 127.0.0.1:58810
I20260321 03:02:29.014372 8921 tablet_bootstrap.cc:492] T cce1588111a245a48d503c4072c8cadc P 4532b54a008a4a39b663112e6d0aacc0: Bootstrap starting.
W20260321 03:02:29.018791 8257 catalog_manager.cc:4982] TS 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): delete failed for tablet cce1588111a245a48d503c4072c8cadc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cce1588111a245a48d503c4072c8cadc already in progress: creating tablet
W20260321 03:02:29.019786 8258 catalog_manager.cc:4982] TS 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171): delete failed for tablet cce1588111a245a48d503c4072c8cadc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cce1588111a245a48d503c4072c8cadc already in progress: creating tablet
I20260321 03:02:29.021656 8648 tablet_service.cc:1511] Processing CreateTablet for tablet 21aed83ce6884ca4859df11cc5bcf49c (DEFAULT_TABLE table=default.table_9bbd1f43ebe347ed99a9be3a6ffb3d86 [id=4ac1925a391a48ea86c63da0c1d8c442]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:29.022168 8648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21aed83ce6884ca4859df11cc5bcf49c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:29.025722 8271 master_service.cc:954] ReplaceTablet: received request to replace tablet cce1588111a245a48d503c4072c8cadc from {username='slave'} at 127.0.0.1:39954
I20260321 03:02:29.026151 8271 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39954:
table { table_name: "default.Table_9bbd1f43ebe347ed99a9be3a6ffb3d86" } new_table_name: "default.Table_c8e5202d265f463bbcf568d34a1e64a2" modify_external_catalogs: true
I20260321 03:02:29.026875 8783 tablet_service.cc:1511] Processing CreateTablet for tablet 21aed83ce6884ca4859df11cc5bcf49c (DEFAULT_TABLE table=default.table_9bbd1f43ebe347ed99a9be3a6ffb3d86 [id=4ac1925a391a48ea86c63da0c1d8c442]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:29.027580 8783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21aed83ce6884ca4859df11cc5bcf49c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:29.031136 8784 tablet_service.cc:1511] Processing CreateTablet for tablet a4bfa1cd32ac40cb800860d336c99fd7 (DEFAULT_TABLE table=default.table_628c329100ff4b269d91d561af863424 [id=94ef39d020ab428b9e0392bedab9483d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:29.031427 8784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4bfa1cd32ac40cb800860d336c99fd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:29.031445 8647 tablet_service.cc:1511] Processing CreateTablet for tablet a4bfa1cd32ac40cb800860d336c99fd7 (DEFAULT_TABLE table=default.table_628c329100ff4b269d91d561af863424 [id=94ef39d020ab428b9e0392bedab9483d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:29.031699 8647 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4bfa1cd32ac40cb800860d336c99fd7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260321 03:02:29.038080 8260 catalog_manager.cc:4982] TS a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): delete failed for tablet cce1588111a245a48d503c4072c8cadc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cce1588111a245a48d503c4072c8cadc already in progress: creating tablet
I20260321 03:02:29.017195 8921 tablet_bootstrap.cc:654] T cce1588111a245a48d503c4072c8cadc P 4532b54a008a4a39b663112e6d0aacc0: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:29.025569 8513 tablet_service.cc:1511] Processing CreateTablet for tablet 21aed83ce6884ca4859df11cc5bcf49c (DEFAULT_TABLE table=default.table_9bbd1f43ebe347ed99a9be3a6ffb3d86 [id=4ac1925a391a48ea86c63da0c1d8c442]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:29.030474 8512 tablet_service.cc:1511] Processing CreateTablet for tablet a4bfa1cd32ac40cb800860d336c99fd7 (DEFAULT_TABLE table=default.table_628c329100ff4b269d91d561af863424 [id=94ef39d020ab428b9e0392bedab9483d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:29.038978 8512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4bfa1cd32ac40cb800860d336c99fd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:29.041729 8922 tablet_bootstrap.cc:492] T cce1588111a245a48d503c4072c8cadc P a97f7dd77cf2444f8fdb441019081f79: Bootstrap starting.
I20260321 03:02:29.042091 8513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21aed83ce6884ca4859df11cc5bcf49c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:29.044416 8922 tablet_bootstrap.cc:654] T cce1588111a245a48d503c4072c8cadc P a97f7dd77cf2444f8fdb441019081f79: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:29.045966 8923 log.cc:826] T cce1588111a245a48d503c4072c8cadc P 70e7666c46844503beb466fdc054a6fc: Log is configured to *not* fsync() on all Append() calls
I20260321 03:02:29.046347 8921 log.cc:826] T cce1588111a245a48d503c4072c8cadc P 4532b54a008a4a39b663112e6d0aacc0: Log is configured to *not* fsync() on all Append() calls
I20260321 03:02:29.045506 8922 log.cc:826] T cce1588111a245a48d503c4072c8cadc P a97f7dd77cf2444f8fdb441019081f79: Log is configured to *not* fsync() on all Append() calls
I20260321 03:02:29.055817 8923 tablet_bootstrap.cc:492] T cce1588111a245a48d503c4072c8cadc P 70e7666c46844503beb466fdc054a6fc: No bootstrap required, opened a new log
I20260321 03:02:29.056157 8923 ts_tablet_manager.cc:1403] T cce1588111a245a48d503c4072c8cadc P 70e7666c46844503beb466fdc054a6fc: Time spent bootstrapping tablet: real 0.049s user 0.006s sys 0.000s
I20260321 03:02:29.060566 8923 raft_consensus.cc:359] T cce1588111a245a48d503c4072c8cadc P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.062598 8921 tablet_bootstrap.cc:492] T cce1588111a245a48d503c4072c8cadc P 4532b54a008a4a39b663112e6d0aacc0: No bootstrap required, opened a new log
I20260321 03:02:29.062953 8921 ts_tablet_manager.cc:1403] T cce1588111a245a48d503c4072c8cadc P 4532b54a008a4a39b663112e6d0aacc0: Time spent bootstrapping tablet: real 0.049s user 0.002s sys 0.004s
I20260321 03:02:29.067281 8921 raft_consensus.cc:359] T cce1588111a245a48d503c4072c8cadc P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.067866 8923 raft_consensus.cc:385] T cce1588111a245a48d503c4072c8cadc P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:29.068185 8922 tablet_bootstrap.cc:492] T cce1588111a245a48d503c4072c8cadc P a97f7dd77cf2444f8fdb441019081f79: No bootstrap required, opened a new log
I20260321 03:02:29.068341 8923 raft_consensus.cc:740] T cce1588111a245a48d503c4072c8cadc P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70e7666c46844503beb466fdc054a6fc, State: Initialized, Role: FOLLOWER
I20260321 03:02:29.068467 8922 ts_tablet_manager.cc:1403] T cce1588111a245a48d503c4072c8cadc P a97f7dd77cf2444f8fdb441019081f79: Time spent bootstrapping tablet: real 0.027s user 0.005s sys 0.000s
I20260321 03:02:29.071997 8922 raft_consensus.cc:359] T cce1588111a245a48d503c4072c8cadc P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.072281 8922 raft_consensus.cc:385] T cce1588111a245a48d503c4072c8cadc P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:29.072346 8922 raft_consensus.cc:740] T cce1588111a245a48d503c4072c8cadc P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a97f7dd77cf2444f8fdb441019081f79, State: Initialized, Role: FOLLOWER
I20260321 03:02:29.072487 8921 raft_consensus.cc:385] T cce1588111a245a48d503c4072c8cadc P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:29.072860 8921 raft_consensus.cc:740] T cce1588111a245a48d503c4072c8cadc P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4532b54a008a4a39b663112e6d0aacc0, State: Initialized, Role: FOLLOWER
I20260321 03:02:29.072929 8922 consensus_queue.cc:260] T cce1588111a245a48d503c4072c8cadc P a97f7dd77cf2444f8fdb441019081f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.073598 8923 consensus_queue.cc:260] T cce1588111a245a48d503c4072c8cadc P 70e7666c46844503beb466fdc054a6fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.074065 8922 ts_tablet_manager.cc:1434] T cce1588111a245a48d503c4072c8cadc P a97f7dd77cf2444f8fdb441019081f79: Time spent starting tablet: real 0.006s user 0.006s sys 0.001s
I20260321 03:02:29.075032 8923 ts_tablet_manager.cc:1434] T cce1588111a245a48d503c4072c8cadc P 70e7666c46844503beb466fdc054a6fc: Time spent starting tablet: real 0.019s user 0.006s sys 0.000s
I20260321 03:02:29.076035 8270 catalog_manager.cc:2174] created HMS catalog entry for table [id=06718ed7d99744ff818ac2fc5bdbf11c]
I20260321 03:02:29.078358 8922 tablet_bootstrap.cc:492] T a4bfa1cd32ac40cb800860d336c99fd7 P a97f7dd77cf2444f8fdb441019081f79: Bootstrap starting.
I20260321 03:02:29.079596 8922 tablet_bootstrap.cc:654] T a4bfa1cd32ac40cb800860d336c99fd7 P a97f7dd77cf2444f8fdb441019081f79: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:29.084276 8783 tablet_service.cc:1558] Processing DeleteTablet for tablet cce1588111a245a48d503c4072c8cadc with delete_type TABLET_DATA_DELETED (replaced by tablet a4bfa1cd32ac40cb800860d336c99fd7) from {username='slave'} at 127.0.0.1:58810
I20260321 03:02:29.084550 8927 tablet_replica.cc:333] T cce1588111a245a48d503c4072c8cadc P a97f7dd77cf2444f8fdb441019081f79: stopping tablet replica
I20260321 03:02:29.084884 8927 raft_consensus.cc:2243] T cce1588111a245a48d503c4072c8cadc P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260321 03:02:29.085186 8927 raft_consensus.cc:2272] T cce1588111a245a48d503c4072c8cadc P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260321 03:02:29.085668 8270 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39954:
table { table_name: "default.Table_337c18c13bb24e78bad2738358717d2d" } modify_external_catalogs: true
I20260321 03:02:29.085837 8270 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39954:
table { table_name: "default.Table_337c18c13bb24e78bad2738358717d2d" } modify_external_catalogs: true
I20260321 03:02:29.086664 8927 ts_tablet_manager.cc:1916] T cce1588111a245a48d503c4072c8cadc P a97f7dd77cf2444f8fdb441019081f79: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260321 03:02:29.089357 8927 ts_tablet_manager.cc:1929] T cce1588111a245a48d503c4072c8cadc P a97f7dd77cf2444f8fdb441019081f79: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260321 03:02:29.089481 8927 log.cc:1199] T cce1588111a245a48d503c4072c8cadc P a97f7dd77cf2444f8fdb441019081f79: Deleting WAL directory at /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-2/wal/wals/cce1588111a245a48d503c4072c8cadc
I20260321 03:02:29.089783 8927 ts_tablet_manager.cc:1950] T cce1588111a245a48d503c4072c8cadc P a97f7dd77cf2444f8fdb441019081f79: Deleting consensus metadata
I20260321 03:02:29.091295 8513 tablet_service.cc:1511] Processing CreateTablet for tablet cc5de6cf47b84822810e38f094ff99ea (DEFAULT_TABLE table=default.table_337c18c13bb24e78bad2738358717d2d [id=06718ed7d99744ff818ac2fc5bdbf11c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:29.091542 8260 catalog_manager.cc:5002] TS a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): tablet cce1588111a245a48d503c4072c8cadc (table default.table_628c329100ff4b269d91d561af863424 [id=94ef39d020ab428b9e0392bedab9483d]) successfully deleted
I20260321 03:02:29.091655 8513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc5de6cf47b84822810e38f094ff99ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:29.095439 8783 tablet_service.cc:1511] Processing CreateTablet for tablet cc5de6cf47b84822810e38f094ff99ea (DEFAULT_TABLE table=default.table_337c18c13bb24e78bad2738358717d2d [id=06718ed7d99744ff818ac2fc5bdbf11c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:29.095702 8922 tablet_bootstrap.cc:492] T a4bfa1cd32ac40cb800860d336c99fd7 P a97f7dd77cf2444f8fdb441019081f79: No bootstrap required, opened a new log
I20260321 03:02:29.095782 8783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc5de6cf47b84822810e38f094ff99ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:29.095818 8922 ts_tablet_manager.cc:1403] T a4bfa1cd32ac40cb800860d336c99fd7 P a97f7dd77cf2444f8fdb441019081f79: Time spent bootstrapping tablet: real 0.018s user 0.000s sys 0.002s
I20260321 03:02:29.096298 8922 raft_consensus.cc:359] T a4bfa1cd32ac40cb800860d336c99fd7 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.096558 8922 raft_consensus.cc:385] T a4bfa1cd32ac40cb800860d336c99fd7 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:29.096629 8922 raft_consensus.cc:740] T a4bfa1cd32ac40cb800860d336c99fd7 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a97f7dd77cf2444f8fdb441019081f79, State: Initialized, Role: FOLLOWER
I20260321 03:02:29.096792 8922 consensus_queue.cc:260] T a4bfa1cd32ac40cb800860d336c99fd7 P a97f7dd77cf2444f8fdb441019081f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.097075 8922 ts_tablet_manager.cc:1434] T a4bfa1cd32ac40cb800860d336c99fd7 P a97f7dd77cf2444f8fdb441019081f79: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
I20260321 03:02:29.097362 8922 tablet_bootstrap.cc:492] T 21aed83ce6884ca4859df11cc5bcf49c P a97f7dd77cf2444f8fdb441019081f79: Bootstrap starting.
I20260321 03:02:29.098420 8922 tablet_bootstrap.cc:654] T 21aed83ce6884ca4859df11cc5bcf49c P a97f7dd77cf2444f8fdb441019081f79: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:29.102281 8922 tablet_bootstrap.cc:492] T 21aed83ce6884ca4859df11cc5bcf49c P a97f7dd77cf2444f8fdb441019081f79: No bootstrap required, opened a new log
I20260321 03:02:29.102399 8922 ts_tablet_manager.cc:1403] T 21aed83ce6884ca4859df11cc5bcf49c P a97f7dd77cf2444f8fdb441019081f79: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260321 03:02:29.103060 8922 raft_consensus.cc:359] T 21aed83ce6884ca4859df11cc5bcf49c P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.074046 8921 consensus_queue.cc:260] T cce1588111a245a48d503c4072c8cadc P 4532b54a008a4a39b663112e6d0aacc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.103199 8922 raft_consensus.cc:385] T 21aed83ce6884ca4859df11cc5bcf49c P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:29.103240 8922 raft_consensus.cc:740] T 21aed83ce6884ca4859df11cc5bcf49c P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a97f7dd77cf2444f8fdb441019081f79, State: Initialized, Role: FOLLOWER
I20260321 03:02:29.103410 8922 consensus_queue.cc:260] T 21aed83ce6884ca4859df11cc5bcf49c P a97f7dd77cf2444f8fdb441019081f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.104311 8921 ts_tablet_manager.cc:1434] T cce1588111a245a48d503c4072c8cadc P 4532b54a008a4a39b663112e6d0aacc0: Time spent starting tablet: real 0.041s user 0.005s sys 0.000s
I20260321 03:02:29.094452 8648 tablet_service.cc:1511] Processing CreateTablet for tablet cc5de6cf47b84822810e38f094ff99ea (DEFAULT_TABLE table=default.table_337c18c13bb24e78bad2738358717d2d [id=06718ed7d99744ff818ac2fc5bdbf11c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:29.104965 8648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc5de6cf47b84822810e38f094ff99ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:29.105948 8922 ts_tablet_manager.cc:1434] T 21aed83ce6884ca4859df11cc5bcf49c P a97f7dd77cf2444f8fdb441019081f79: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260321 03:02:29.107897 8922 tablet_bootstrap.cc:492] T cc5de6cf47b84822810e38f094ff99ea P a97f7dd77cf2444f8fdb441019081f79: Bootstrap starting.
I20260321 03:02:29.109481 8922 tablet_bootstrap.cc:654] T cc5de6cf47b84822810e38f094ff99ea P a97f7dd77cf2444f8fdb441019081f79: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:29.109751 8923 tablet_bootstrap.cc:492] T 21aed83ce6884ca4859df11cc5bcf49c P 70e7666c46844503beb466fdc054a6fc: Bootstrap starting.
I20260321 03:02:29.114455 8921 tablet_bootstrap.cc:492] T a4bfa1cd32ac40cb800860d336c99fd7 P 4532b54a008a4a39b663112e6d0aacc0: Bootstrap starting.
I20260321 03:02:29.115787 8921 tablet_bootstrap.cc:654] T a4bfa1cd32ac40cb800860d336c99fd7 P 4532b54a008a4a39b663112e6d0aacc0: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:29.117048 8923 tablet_bootstrap.cc:654] T 21aed83ce6884ca4859df11cc5bcf49c P 70e7666c46844503beb466fdc054a6fc: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:29.117786 8922 tablet_bootstrap.cc:492] T cc5de6cf47b84822810e38f094ff99ea P a97f7dd77cf2444f8fdb441019081f79: No bootstrap required, opened a new log
I20260321 03:02:29.117913 8922 ts_tablet_manager.cc:1403] T cc5de6cf47b84822810e38f094ff99ea P a97f7dd77cf2444f8fdb441019081f79: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
W20260321 03:02:29.118022 8853 tablet.cc:2379] T 21aed83ce6884ca4859df11cc5bcf49c P a97f7dd77cf2444f8fdb441019081f79: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260321 03:02:29.118183 8921 tablet_bootstrap.cc:492] T a4bfa1cd32ac40cb800860d336c99fd7 P 4532b54a008a4a39b663112e6d0aacc0: No bootstrap required, opened a new log
I20260321 03:02:29.118278 8921 ts_tablet_manager.cc:1403] T a4bfa1cd32ac40cb800860d336c99fd7 P 4532b54a008a4a39b663112e6d0aacc0: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.001s
I20260321 03:02:29.118448 8922 raft_consensus.cc:359] T cc5de6cf47b84822810e38f094ff99ea P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.118573 8922 raft_consensus.cc:385] T cc5de6cf47b84822810e38f094ff99ea P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:29.118619 8922 raft_consensus.cc:740] T cc5de6cf47b84822810e38f094ff99ea P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a97f7dd77cf2444f8fdb441019081f79, State: Initialized, Role: FOLLOWER
I20260321 03:02:29.118788 8922 consensus_queue.cc:260] T cc5de6cf47b84822810e38f094ff99ea P a97f7dd77cf2444f8fdb441019081f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.118875 8921 raft_consensus.cc:359] T a4bfa1cd32ac40cb800860d336c99fd7 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.119015 8921 raft_consensus.cc:385] T a4bfa1cd32ac40cb800860d336c99fd7 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:29.119065 8921 raft_consensus.cc:740] T a4bfa1cd32ac40cb800860d336c99fd7 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4532b54a008a4a39b663112e6d0aacc0, State: Initialized, Role: FOLLOWER
I20260321 03:02:29.119196 8921 consensus_queue.cc:260] T a4bfa1cd32ac40cb800860d336c99fd7 P 4532b54a008a4a39b663112e6d0aacc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.119612 8921 ts_tablet_manager.cc:1434] T a4bfa1cd32ac40cb800860d336c99fd7 P 4532b54a008a4a39b663112e6d0aacc0: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20260321 03:02:29.120157 8923 tablet_bootstrap.cc:492] T 21aed83ce6884ca4859df11cc5bcf49c P 70e7666c46844503beb466fdc054a6fc: No bootstrap required, opened a new log
I20260321 03:02:29.120282 8923 ts_tablet_manager.cc:1403] T 21aed83ce6884ca4859df11cc5bcf49c P 70e7666c46844503beb466fdc054a6fc: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.000s
I20260321 03:02:29.120986 8923 raft_consensus.cc:359] T 21aed83ce6884ca4859df11cc5bcf49c P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.121061 8922 ts_tablet_manager.cc:1434] T cc5de6cf47b84822810e38f094ff99ea P a97f7dd77cf2444f8fdb441019081f79: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260321 03:02:29.121117 8923 raft_consensus.cc:385] T 21aed83ce6884ca4859df11cc5bcf49c P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:29.121160 8923 raft_consensus.cc:740] T 21aed83ce6884ca4859df11cc5bcf49c P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70e7666c46844503beb466fdc054a6fc, State: Initialized, Role: FOLLOWER
I20260321 03:02:29.121373 8923 consensus_queue.cc:260] T 21aed83ce6884ca4859df11cc5bcf49c P 70e7666c46844503beb466fdc054a6fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.121796 8923 ts_tablet_manager.cc:1434] T 21aed83ce6884ca4859df11cc5bcf49c P 70e7666c46844503beb466fdc054a6fc: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
I20260321 03:02:29.123206 8923 tablet_bootstrap.cc:492] T a4bfa1cd32ac40cb800860d336c99fd7 P 70e7666c46844503beb466fdc054a6fc: Bootstrap starting.
I20260321 03:02:29.126132 8921 tablet_bootstrap.cc:492] T 21aed83ce6884ca4859df11cc5bcf49c P 4532b54a008a4a39b663112e6d0aacc0: Bootstrap starting.
I20260321 03:02:29.127931 8921 tablet_bootstrap.cc:654] T 21aed83ce6884ca4859df11cc5bcf49c P 4532b54a008a4a39b663112e6d0aacc0: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:29.128782 8923 tablet_bootstrap.cc:654] T a4bfa1cd32ac40cb800860d336c99fd7 P 70e7666c46844503beb466fdc054a6fc: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:29.130017 8921 tablet_bootstrap.cc:492] T 21aed83ce6884ca4859df11cc5bcf49c P 4532b54a008a4a39b663112e6d0aacc0: No bootstrap required, opened a new log
I20260321 03:02:29.130125 8921 ts_tablet_manager.cc:1403] T 21aed83ce6884ca4859df11cc5bcf49c P 4532b54a008a4a39b663112e6d0aacc0: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.001s
I20260321 03:02:29.130672 8921 raft_consensus.cc:359] T 21aed83ce6884ca4859df11cc5bcf49c P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.130810 8921 raft_consensus.cc:385] T 21aed83ce6884ca4859df11cc5bcf49c P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:29.130841 8921 raft_consensus.cc:740] T 21aed83ce6884ca4859df11cc5bcf49c P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4532b54a008a4a39b663112e6d0aacc0, State: Initialized, Role: FOLLOWER
I20260321 03:02:29.131443 8923 tablet_bootstrap.cc:492] T a4bfa1cd32ac40cb800860d336c99fd7 P 70e7666c46844503beb466fdc054a6fc: No bootstrap required, opened a new log
I20260321 03:02:29.131560 8923 ts_tablet_manager.cc:1403] T a4bfa1cd32ac40cb800860d336c99fd7 P 70e7666c46844503beb466fdc054a6fc: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.002s
I20260321 03:02:29.132094 8923 raft_consensus.cc:359] T a4bfa1cd32ac40cb800860d336c99fd7 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.132220 8923 raft_consensus.cc:385] T a4bfa1cd32ac40cb800860d336c99fd7 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:29.132259 8923 raft_consensus.cc:740] T a4bfa1cd32ac40cb800860d336c99fd7 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70e7666c46844503beb466fdc054a6fc, State: Initialized, Role: FOLLOWER
I20260321 03:02:29.132449 8923 consensus_queue.cc:260] T a4bfa1cd32ac40cb800860d336c99fd7 P 70e7666c46844503beb466fdc054a6fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.132982 8923 ts_tablet_manager.cc:1434] T a4bfa1cd32ac40cb800860d336c99fd7 P 70e7666c46844503beb466fdc054a6fc: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
I20260321 03:02:29.134387 8923 tablet_bootstrap.cc:492] T cc5de6cf47b84822810e38f094ff99ea P 70e7666c46844503beb466fdc054a6fc: Bootstrap starting.
I20260321 03:02:29.135774 8923 tablet_bootstrap.cc:654] T cc5de6cf47b84822810e38f094ff99ea P 70e7666c46844503beb466fdc054a6fc: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:29.133121 8921 consensus_queue.cc:260] T 21aed83ce6884ca4859df11cc5bcf49c P 4532b54a008a4a39b663112e6d0aacc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.136807 8921 ts_tablet_manager.cc:1434] T 21aed83ce6884ca4859df11cc5bcf49c P 4532b54a008a4a39b663112e6d0aacc0: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260321 03:02:29.137043 8921 tablet_bootstrap.cc:492] T cc5de6cf47b84822810e38f094ff99ea P 4532b54a008a4a39b663112e6d0aacc0: Bootstrap starting.
I20260321 03:02:29.138264 8921 tablet_bootstrap.cc:654] T cc5de6cf47b84822810e38f094ff99ea P 4532b54a008a4a39b663112e6d0aacc0: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:29.139791 8921 tablet_bootstrap.cc:492] T cc5de6cf47b84822810e38f094ff99ea P 4532b54a008a4a39b663112e6d0aacc0: No bootstrap required, opened a new log
I20260321 03:02:29.139890 8921 ts_tablet_manager.cc:1403] T cc5de6cf47b84822810e38f094ff99ea P 4532b54a008a4a39b663112e6d0aacc0: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260321 03:02:29.140375 8921 raft_consensus.cc:359] T cc5de6cf47b84822810e38f094ff99ea P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.140499 8921 raft_consensus.cc:385] T cc5de6cf47b84822810e38f094ff99ea P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:29.140535 8921 raft_consensus.cc:740] T cc5de6cf47b84822810e38f094ff99ea P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4532b54a008a4a39b663112e6d0aacc0, State: Initialized, Role: FOLLOWER
I20260321 03:02:29.140681 8921 consensus_queue.cc:260] T cc5de6cf47b84822810e38f094ff99ea P 4532b54a008a4a39b663112e6d0aacc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.140952 8921 ts_tablet_manager.cc:1434] T cc5de6cf47b84822810e38f094ff99ea P 4532b54a008a4a39b663112e6d0aacc0: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260321 03:02:29.150280 8923 tablet_bootstrap.cc:492] T cc5de6cf47b84822810e38f094ff99ea P 70e7666c46844503beb466fdc054a6fc: No bootstrap required, opened a new log
I20260321 03:02:29.150496 8923 ts_tablet_manager.cc:1403] T cc5de6cf47b84822810e38f094ff99ea P 70e7666c46844503beb466fdc054a6fc: Time spent bootstrapping tablet: real 0.016s user 0.000s sys 0.003s
I20260321 03:02:29.151325 8923 raft_consensus.cc:359] T cc5de6cf47b84822810e38f094ff99ea P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.151476 8923 raft_consensus.cc:385] T cc5de6cf47b84822810e38f094ff99ea P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:29.151511 8923 raft_consensus.cc:740] T cc5de6cf47b84822810e38f094ff99ea P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70e7666c46844503beb466fdc054a6fc, State: Initialized, Role: FOLLOWER
I20260321 03:02:29.151643 8923 consensus_queue.cc:260] T cc5de6cf47b84822810e38f094ff99ea P 70e7666c46844503beb466fdc054a6fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.151937 8923 ts_tablet_manager.cc:1434] T cc5de6cf47b84822810e38f094ff99ea P 70e7666c46844503beb466fdc054a6fc: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260321 03:02:29.160748 8269 catalog_manager.cc:2174] created HMS catalog entry for table [id=9bc91b7f6cb8477ab6ed1ee5ed74f608]
W20260321 03:02:29.168058 8717 tablet.cc:2379] T 21aed83ce6884ca4859df11cc5bcf49c P 70e7666c46844503beb466fdc054a6fc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260321 03:02:29.168681 8648 tablet_service.cc:1558] Processing DeleteTablet for tablet cce1588111a245a48d503c4072c8cadc with delete_type TABLET_DATA_DELETED (replaced by tablet a4bfa1cd32ac40cb800860d336c99fd7) from {username='slave'} at 127.0.0.1:35520
I20260321 03:02:29.169133 8925 tablet_replica.cc:333] T cce1588111a245a48d503c4072c8cadc P 70e7666c46844503beb466fdc054a6fc: stopping tablet replica
I20260321 03:02:29.169483 8925 raft_consensus.cc:2243] T cce1588111a245a48d503c4072c8cadc P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Raft consensus shutting down.
I20260321 03:02:29.169788 8925 raft_consensus.cc:2272] T cce1588111a245a48d503c4072c8cadc P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Raft consensus is shut down!
I20260321 03:02:29.170146 8513 tablet_service.cc:1558] Processing DeleteTablet for tablet cce1588111a245a48d503c4072c8cadc with delete_type TABLET_DATA_DELETED (replaced by tablet a4bfa1cd32ac40cb800860d336c99fd7) from {username='slave'} at 127.0.0.1:51684
I20260321 03:02:29.170394 8926 tablet_replica.cc:333] T cce1588111a245a48d503c4072c8cadc P 4532b54a008a4a39b663112e6d0aacc0: stopping tablet replica
I20260321 03:02:29.170713 8926 raft_consensus.cc:2243] T cce1588111a245a48d503c4072c8cadc P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260321 03:02:29.170965 8926 raft_consensus.cc:2272] T cce1588111a245a48d503c4072c8cadc P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260321 03:02:29.172185 8926 ts_tablet_manager.cc:1916] T cce1588111a245a48d503c4072c8cadc P 4532b54a008a4a39b663112e6d0aacc0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260321 03:02:29.173506 8925 ts_tablet_manager.cc:1916] T cce1588111a245a48d503c4072c8cadc P 70e7666c46844503beb466fdc054a6fc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260321 03:02:29.174932 8926 ts_tablet_manager.cc:1929] T cce1588111a245a48d503c4072c8cadc P 4532b54a008a4a39b663112e6d0aacc0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260321 03:02:29.175031 8926 log.cc:1199] T cce1588111a245a48d503c4072c8cadc P 4532b54a008a4a39b663112e6d0aacc0: Deleting WAL directory at /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-0/wal/wals/cce1588111a245a48d503c4072c8cadc
I20260321 03:02:29.175354 8926 ts_tablet_manager.cc:1950] T cce1588111a245a48d503c4072c8cadc P 4532b54a008a4a39b663112e6d0aacc0: Deleting consensus metadata
I20260321 03:02:29.176936 8925 ts_tablet_manager.cc:1929] T cce1588111a245a48d503c4072c8cadc P 70e7666c46844503beb466fdc054a6fc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260321 03:02:29.177105 8925 log.cc:1199] T cce1588111a245a48d503c4072c8cadc P 70e7666c46844503beb466fdc054a6fc: Deleting WAL directory at /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-1/wal/wals/cce1588111a245a48d503c4072c8cadc
I20260321 03:02:29.177525 8925 ts_tablet_manager.cc:1950] T cce1588111a245a48d503c4072c8cadc P 70e7666c46844503beb466fdc054a6fc: Deleting consensus metadata
I20260321 03:02:29.179883 8513 tablet_service.cc:1511] Processing CreateTablet for tablet 47e6f8a096804dc7900db99f931d14fc (DEFAULT_TABLE table=default.table_a658f97fed3c4b3eabbfcbb9018b388f [id=9bc91b7f6cb8477ab6ed1ee5ed74f608]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:29.180205 8513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47e6f8a096804dc7900db99f931d14fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:29.180217 8648 tablet_service.cc:1511] Processing CreateTablet for tablet 47e6f8a096804dc7900db99f931d14fc (DEFAULT_TABLE table=default.table_a658f97fed3c4b3eabbfcbb9018b388f [id=9bc91b7f6cb8477ab6ed1ee5ed74f608]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:29.180474 8648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47e6f8a096804dc7900db99f931d14fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:29.182750 8923 tablet_bootstrap.cc:492] T 47e6f8a096804dc7900db99f931d14fc P 70e7666c46844503beb466fdc054a6fc: Bootstrap starting.
I20260321 03:02:29.184008 8923 tablet_bootstrap.cc:654] T 47e6f8a096804dc7900db99f931d14fc P 70e7666c46844503beb466fdc054a6fc: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:29.183941 8269 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39954:
name: "default.Table_01a908196f6d4a1ba499b382b6932d90"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260321 03:02:29.185432 8783 tablet_service.cc:1511] Processing CreateTablet for tablet 47e6f8a096804dc7900db99f931d14fc (DEFAULT_TABLE table=default.table_a658f97fed3c4b3eabbfcbb9018b388f [id=9bc91b7f6cb8477ab6ed1ee5ed74f608]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:29.185716 8783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47e6f8a096804dc7900db99f931d14fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:29.187986 8922 tablet_bootstrap.cc:492] T 47e6f8a096804dc7900db99f931d14fc P a97f7dd77cf2444f8fdb441019081f79: Bootstrap starting.
I20260321 03:02:29.189116 8922 tablet_bootstrap.cc:654] T 47e6f8a096804dc7900db99f931d14fc P a97f7dd77cf2444f8fdb441019081f79: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:29.190196 8257 catalog_manager.cc:5002] TS 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): tablet cce1588111a245a48d503c4072c8cadc (table default.table_628c329100ff4b269d91d561af863424 [id=94ef39d020ab428b9e0392bedab9483d]) successfully deleted
I20260321 03:02:29.191370 8921 tablet_bootstrap.cc:492] T 47e6f8a096804dc7900db99f931d14fc P 4532b54a008a4a39b663112e6d0aacc0: Bootstrap starting.
I20260321 03:02:29.192529 8921 tablet_bootstrap.cc:654] T 47e6f8a096804dc7900db99f931d14fc P 4532b54a008a4a39b663112e6d0aacc0: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:29.193185 8258 catalog_manager.cc:5002] TS 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171): tablet cce1588111a245a48d503c4072c8cadc (table default.table_628c329100ff4b269d91d561af863424 [id=94ef39d020ab428b9e0392bedab9483d]) successfully deleted
I20260321 03:02:29.193774 8921 tablet_bootstrap.cc:492] T 47e6f8a096804dc7900db99f931d14fc P 4532b54a008a4a39b663112e6d0aacc0: No bootstrap required, opened a new log
I20260321 03:02:29.193864 8921 ts_tablet_manager.cc:1403] T 47e6f8a096804dc7900db99f931d14fc P 4532b54a008a4a39b663112e6d0aacc0: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260321 03:02:29.194478 8921 raft_consensus.cc:359] T 47e6f8a096804dc7900db99f931d14fc P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.194666 8921 raft_consensus.cc:385] T 47e6f8a096804dc7900db99f931d14fc P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:29.194707 8921 raft_consensus.cc:740] T 47e6f8a096804dc7900db99f931d14fc P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4532b54a008a4a39b663112e6d0aacc0, State: Initialized, Role: FOLLOWER
I20260321 03:02:29.194850 8921 consensus_queue.cc:260] T 47e6f8a096804dc7900db99f931d14fc P 4532b54a008a4a39b663112e6d0aacc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.195149 8921 ts_tablet_manager.cc:1434] T 47e6f8a096804dc7900db99f931d14fc P 4532b54a008a4a39b663112e6d0aacc0: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20260321 03:02:29.201160 8923 tablet_bootstrap.cc:492] T 47e6f8a096804dc7900db99f931d14fc P 70e7666c46844503beb466fdc054a6fc: No bootstrap required, opened a new log
I20260321 03:02:29.201246 8922 tablet_bootstrap.cc:492] T 47e6f8a096804dc7900db99f931d14fc P a97f7dd77cf2444f8fdb441019081f79: No bootstrap required, opened a new log
I20260321 03:02:29.201344 8923 ts_tablet_manager.cc:1403] T 47e6f8a096804dc7900db99f931d14fc P 70e7666c46844503beb466fdc054a6fc: Time spent bootstrapping tablet: real 0.019s user 0.002s sys 0.001s
I20260321 03:02:29.201366 8922 ts_tablet_manager.cc:1403] T 47e6f8a096804dc7900db99f931d14fc P a97f7dd77cf2444f8fdb441019081f79: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.000s
I20260321 03:02:29.201886 8923 raft_consensus.cc:359] T 47e6f8a096804dc7900db99f931d14fc P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.201886 8922 raft_consensus.cc:359] T 47e6f8a096804dc7900db99f931d14fc P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.202008 8923 raft_consensus.cc:385] T 47e6f8a096804dc7900db99f931d14fc P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:29.202018 8922 raft_consensus.cc:385] T 47e6f8a096804dc7900db99f931d14fc P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:29.202047 8923 raft_consensus.cc:740] T 47e6f8a096804dc7900db99f931d14fc P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70e7666c46844503beb466fdc054a6fc, State: Initialized, Role: FOLLOWER
I20260321 03:02:29.202052 8922 raft_consensus.cc:740] T 47e6f8a096804dc7900db99f931d14fc P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a97f7dd77cf2444f8fdb441019081f79, State: Initialized, Role: FOLLOWER
I20260321 03:02:29.202209 8923 consensus_queue.cc:260] T 47e6f8a096804dc7900db99f931d14fc P 70e7666c46844503beb466fdc054a6fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.202216 8922 consensus_queue.cc:260] T 47e6f8a096804dc7900db99f931d14fc P a97f7dd77cf2444f8fdb441019081f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.202488 8922 ts_tablet_manager.cc:1434] T 47e6f8a096804dc7900db99f931d14fc P a97f7dd77cf2444f8fdb441019081f79: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260321 03:02:29.202505 8923 ts_tablet_manager.cc:1434] T 47e6f8a096804dc7900db99f931d14fc P 70e7666c46844503beb466fdc054a6fc: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260321 03:02:29.202980 8940 raft_consensus.cc:493] T 47e6f8a096804dc7900db99f931d14fc P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260321 03:02:29.203125 8940 raft_consensus.cc:515] T 47e6f8a096804dc7900db99f931d14fc P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.204356 8940 leader_election.cc:290] T 47e6f8a096804dc7900db99f931d14fc P 70e7666c46844503beb466fdc054a6fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:02:29.211825 8582 tablet.cc:2379] T 21aed83ce6884ca4859df11cc5bcf49c P 4532b54a008a4a39b663112e6d0aacc0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260321 03:02:29.215570 8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e6f8a096804dc7900db99f931d14fc" candidate_uuid: "70e7666c46844503beb466fdc054a6fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4532b54a008a4a39b663112e6d0aacc0" is_pre_election: true
I20260321 03:02:29.215922 8532 raft_consensus.cc:2468] T 47e6f8a096804dc7900db99f931d14fc P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70e7666c46844503beb466fdc054a6fc in term 0.
I20260321 03:02:29.216518 8935 raft_consensus.cc:493] T a4bfa1cd32ac40cb800860d336c99fd7 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260321 03:02:29.216517 8602 leader_election.cc:304] T 47e6f8a096804dc7900db99f931d14fc P 70e7666c46844503beb466fdc054a6fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0, 70e7666c46844503beb466fdc054a6fc; no voters:
I20260321 03:02:29.216620 8935 raft_consensus.cc:515] T a4bfa1cd32ac40cb800860d336c99fd7 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.216842 8932 raft_consensus.cc:2804] T 47e6f8a096804dc7900db99f931d14fc P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260321 03:02:29.216910 8932 raft_consensus.cc:493] T 47e6f8a096804dc7900db99f931d14fc P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260321 03:02:29.216954 8932 raft_consensus.cc:3060] T 47e6f8a096804dc7900db99f931d14fc P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:29.217856 8935 leader_election.cc:290] T a4bfa1cd32ac40cb800860d336c99fd7 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
I20260321 03:02:29.218214 8932 raft_consensus.cc:515] T 47e6f8a096804dc7900db99f931d14fc P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.218631 8932 leader_election.cc:290] T 47e6f8a096804dc7900db99f931d14fc P 70e7666c46844503beb466fdc054a6fc [CANDIDATE]: Term 1 election: Requested vote from peers 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
I20260321 03:02:29.221630 8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e6f8a096804dc7900db99f931d14fc" candidate_uuid: "70e7666c46844503beb466fdc054a6fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4532b54a008a4a39b663112e6d0aacc0"
I20260321 03:02:29.221801 8532 raft_consensus.cc:3060] T 47e6f8a096804dc7900db99f931d14fc P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:29.223001 8532 raft_consensus.cc:2468] T 47e6f8a096804dc7900db99f931d14fc P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70e7666c46844503beb466fdc054a6fc in term 1.
I20260321 03:02:29.223393 8602 leader_election.cc:304] T 47e6f8a096804dc7900db99f931d14fc P 70e7666c46844503beb466fdc054a6fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0, 70e7666c46844503beb466fdc054a6fc; no voters:
I20260321 03:02:29.223685 8932 raft_consensus.cc:2804] T 47e6f8a096804dc7900db99f931d14fc P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Leader election won for term 1
I20260321 03:02:29.223804 8932 raft_consensus.cc:697] T 47e6f8a096804dc7900db99f931d14fc P 70e7666c46844503beb466fdc054a6fc [term 1 LEADER]: Becoming Leader. State: Replica: 70e7666c46844503beb466fdc054a6fc, State: Running, Role: LEADER
I20260321 03:02:29.224061 8932 consensus_queue.cc:237] T 47e6f8a096804dc7900db99f931d14fc P 70e7666c46844503beb466fdc054a6fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.230010 8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4bfa1cd32ac40cb800860d336c99fd7" candidate_uuid: "4532b54a008a4a39b663112e6d0aacc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a97f7dd77cf2444f8fdb441019081f79" is_pre_election: true
I20260321 03:02:29.230332 8804 raft_consensus.cc:2468] T a4bfa1cd32ac40cb800860d336c99fd7 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4532b54a008a4a39b663112e6d0aacc0 in term 0.
I20260321 03:02:29.232148 8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e6f8a096804dc7900db99f931d14fc" candidate_uuid: "70e7666c46844503beb466fdc054a6fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a97f7dd77cf2444f8fdb441019081f79"
I20260321 03:02:29.232303 8803 raft_consensus.cc:3060] T 47e6f8a096804dc7900db99f931d14fc P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:29.232343 8469 leader_election.cc:304] T a4bfa1cd32ac40cb800860d336c99fd7 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0, a97f7dd77cf2444f8fdb441019081f79; no voters:
I20260321 03:02:29.232661 8935 raft_consensus.cc:2804] T a4bfa1cd32ac40cb800860d336c99fd7 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260321 03:02:29.232728 8935 raft_consensus.cc:493] T a4bfa1cd32ac40cb800860d336c99fd7 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260321 03:02:29.232766 8935 raft_consensus.cc:3060] T a4bfa1cd32ac40cb800860d336c99fd7 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:29.233394 8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e6f8a096804dc7900db99f931d14fc" candidate_uuid: "70e7666c46844503beb466fdc054a6fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a97f7dd77cf2444f8fdb441019081f79" is_pre_election: true
I20260321 03:02:29.233479 8803 raft_consensus.cc:2468] T 47e6f8a096804dc7900db99f931d14fc P a97f7dd77cf2444f8fdb441019081f79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70e7666c46844503beb466fdc054a6fc in term 1.
I20260321 03:02:29.233829 8935 raft_consensus.cc:515] T a4bfa1cd32ac40cb800860d336c99fd7 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.234237 8935 leader_election.cc:290] T a4bfa1cd32ac40cb800860d336c99fd7 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 1 election: Requested vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
I20260321 03:02:29.234756 8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4bfa1cd32ac40cb800860d336c99fd7" candidate_uuid: "4532b54a008a4a39b663112e6d0aacc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a97f7dd77cf2444f8fdb441019081f79"
I20260321 03:02:29.234875 8804 raft_consensus.cc:3060] T a4bfa1cd32ac40cb800860d336c99fd7 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:29.235920 8804 raft_consensus.cc:2468] T a4bfa1cd32ac40cb800860d336c99fd7 P a97f7dd77cf2444f8fdb441019081f79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4532b54a008a4a39b663112e6d0aacc0 in term 1.
I20260321 03:02:29.236274 8469 leader_election.cc:304] T a4bfa1cd32ac40cb800860d336c99fd7 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0, a97f7dd77cf2444f8fdb441019081f79; no voters:
I20260321 03:02:29.236519 8935 raft_consensus.cc:2804] T a4bfa1cd32ac40cb800860d336c99fd7 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader election won for term 1
I20260321 03:02:29.236619 8935 raft_consensus.cc:697] T a4bfa1cd32ac40cb800860d336c99fd7 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 LEADER]: Becoming Leader. State: Replica: 4532b54a008a4a39b663112e6d0aacc0, State: Running, Role: LEADER
I20260321 03:02:29.236594 8668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4bfa1cd32ac40cb800860d336c99fd7" candidate_uuid: "4532b54a008a4a39b663112e6d0aacc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70e7666c46844503beb466fdc054a6fc" is_pre_election: true
I20260321 03:02:29.236799 8668 raft_consensus.cc:2468] T a4bfa1cd32ac40cb800860d336c99fd7 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4532b54a008a4a39b663112e6d0aacc0 in term 0.
I20260321 03:02:29.236857 8935 consensus_queue.cc:237] T a4bfa1cd32ac40cb800860d336c99fd7 P 4532b54a008a4a39b663112e6d0aacc0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.237093 8667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4bfa1cd32ac40cb800860d336c99fd7" candidate_uuid: "4532b54a008a4a39b663112e6d0aacc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70e7666c46844503beb466fdc054a6fc"
I20260321 03:02:29.237192 8667 raft_consensus.cc:3060] T a4bfa1cd32ac40cb800860d336c99fd7 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:29.238363 8667 raft_consensus.cc:2468] T a4bfa1cd32ac40cb800860d336c99fd7 P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4532b54a008a4a39b663112e6d0aacc0 in term 1.
I20260321 03:02:29.262435 8268 catalog_manager.cc:2174] created HMS catalog entry for table [id=3fbb48538eb34ee9ae7b462f2af6d628]
I20260321 03:02:29.270499 8268 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39954:
table { table_name: "default.Table_a658f97fed3c4b3eabbfcbb9018b388f" } new_table_name: "default.Table_60888690371e4e1d8d9e6a31f44b55a5" modify_external_catalogs: true
I20260321 03:02:29.281838 8513 tablet_service.cc:1511] Processing CreateTablet for tablet 1806a588d8d24b18a405e1a545d9cdda (DEFAULT_TABLE table=default.table_9731292f060b48d7a3b304a142988570 [id=3fbb48538eb34ee9ae7b462f2af6d628]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:29.281909 8783 tablet_service.cc:1511] Processing CreateTablet for tablet 1806a588d8d24b18a405e1a545d9cdda (DEFAULT_TABLE table=default.table_9731292f060b48d7a3b304a142988570 [id=3fbb48538eb34ee9ae7b462f2af6d628]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:29.282226 8513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1806a588d8d24b18a405e1a545d9cdda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:29.282243 8783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1806a588d8d24b18a405e1a545d9cdda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:29.284914 8921 tablet_bootstrap.cc:492] T 1806a588d8d24b18a405e1a545d9cdda P 4532b54a008a4a39b663112e6d0aacc0: Bootstrap starting.
I20260321 03:02:29.284936 8648 tablet_service.cc:1511] Processing CreateTablet for tablet 1806a588d8d24b18a405e1a545d9cdda (DEFAULT_TABLE table=default.table_9731292f060b48d7a3b304a142988570 [id=3fbb48538eb34ee9ae7b462f2af6d628]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:29.285247 8648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1806a588d8d24b18a405e1a545d9cdda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:29.286046 8921 tablet_bootstrap.cc:654] T 1806a588d8d24b18a405e1a545d9cdda P 4532b54a008a4a39b663112e6d0aacc0: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:29.288105 8922 tablet_bootstrap.cc:492] T 1806a588d8d24b18a405e1a545d9cdda P a97f7dd77cf2444f8fdb441019081f79: Bootstrap starting.
W20260321 03:02:29.288488 8924 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260321 03:02:29.288941 8924 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260321 03:02:29.289037 8924 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260321 03:02:29.289435 8923 tablet_bootstrap.cc:492] T 1806a588d8d24b18a405e1a545d9cdda P 70e7666c46844503beb466fdc054a6fc: Bootstrap starting.
I20260321 03:02:29.290536 8923 tablet_bootstrap.cc:654] T 1806a588d8d24b18a405e1a545d9cdda P 70e7666c46844503beb466fdc054a6fc: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:29.293867 8922 tablet_bootstrap.cc:654] T 1806a588d8d24b18a405e1a545d9cdda P a97f7dd77cf2444f8fdb441019081f79: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:29.295157 8922 tablet_bootstrap.cc:492] T 1806a588d8d24b18a405e1a545d9cdda P a97f7dd77cf2444f8fdb441019081f79: No bootstrap required, opened a new log
W20260321 03:02:29.295205 8924 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260321 03:02:29.295257 8924 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260321 03:02:29.295295 8924 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
I20260321 03:02:29.295285 8922 ts_tablet_manager.cc:1403] T 1806a588d8d24b18a405e1a545d9cdda P a97f7dd77cf2444f8fdb441019081f79: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.001s
W20260321 03:02:29.295326 8924 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260321 03:02:29.295789 8922 raft_consensus.cc:359] T 1806a588d8d24b18a405e1a545d9cdda P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.295924 8922 raft_consensus.cc:385] T 1806a588d8d24b18a405e1a545d9cdda P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:29.295965 8922 raft_consensus.cc:740] T 1806a588d8d24b18a405e1a545d9cdda P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a97f7dd77cf2444f8fdb441019081f79, State: Initialized, Role: FOLLOWER
I20260321 03:02:29.296106 8922 consensus_queue.cc:260] T 1806a588d8d24b18a405e1a545d9cdda P a97f7dd77cf2444f8fdb441019081f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.296391 8922 ts_tablet_manager.cc:1434] T 1806a588d8d24b18a405e1a545d9cdda P a97f7dd77cf2444f8fdb441019081f79: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260321 03:02:29.300863 8924 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.178.212:39683
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-2/wal
--hive_metastore_uris=thrift://127.0.0.1:35641
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.178.252:45145
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.7.178.252
--webserver_port=36797
--never_fsync=true
--heap_profile_path=/tmp/kudu.8924
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 68f10dd41067059260a5fb5c725b178b69c38aed
build type DEBUG
built by None at 21 Mar 2026 02:43:15 UTC on bdcb31816ec0
build id 11028
I20260321 03:02:29.302378 8924 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260321 03:02:29.303735 8924 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260321 03:02:29.305315 8921 tablet_bootstrap.cc:492] T 1806a588d8d24b18a405e1a545d9cdda P 4532b54a008a4a39b663112e6d0aacc0: No bootstrap required, opened a new log
I20260321 03:02:29.305444 8921 ts_tablet_manager.cc:1403] T 1806a588d8d24b18a405e1a545d9cdda P 4532b54a008a4a39b663112e6d0aacc0: Time spent bootstrapping tablet: real 0.021s user 0.002s sys 0.000s
I20260321 03:02:29.305685 8923 tablet_bootstrap.cc:492] T 1806a588d8d24b18a405e1a545d9cdda P 70e7666c46844503beb466fdc054a6fc: No bootstrap required, opened a new log
I20260321 03:02:29.305781 8923 ts_tablet_manager.cc:1403] T 1806a588d8d24b18a405e1a545d9cdda P 70e7666c46844503beb466fdc054a6fc: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.000s
I20260321 03:02:29.305967 8921 raft_consensus.cc:359] T 1806a588d8d24b18a405e1a545d9cdda P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.306105 8921 raft_consensus.cc:385] T 1806a588d8d24b18a405e1a545d9cdda P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:29.306139 8921 raft_consensus.cc:740] T 1806a588d8d24b18a405e1a545d9cdda P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4532b54a008a4a39b663112e6d0aacc0, State: Initialized, Role: FOLLOWER
I20260321 03:02:29.306288 8921 consensus_queue.cc:260] T 1806a588d8d24b18a405e1a545d9cdda P 4532b54a008a4a39b663112e6d0aacc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.306284 8923 raft_consensus.cc:359] T 1806a588d8d24b18a405e1a545d9cdda P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.306399 8923 raft_consensus.cc:385] T 1806a588d8d24b18a405e1a545d9cdda P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:29.306430 8923 raft_consensus.cc:740] T 1806a588d8d24b18a405e1a545d9cdda P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70e7666c46844503beb466fdc054a6fc, State: Initialized, Role: FOLLOWER
I20260321 03:02:29.306582 8921 ts_tablet_manager.cc:1434] T 1806a588d8d24b18a405e1a545d9cdda P 4532b54a008a4a39b663112e6d0aacc0: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260321 03:02:29.306562 8923 consensus_queue.cc:260] T 1806a588d8d24b18a405e1a545d9cdda P 70e7666c46844503beb466fdc054a6fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.306835 8923 ts_tablet_manager.cc:1434] T 1806a588d8d24b18a405e1a545d9cdda P 70e7666c46844503beb466fdc054a6fc: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
W20260321 03:02:29.313957 8962 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260321 03:02:29.314384 8961 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260321 03:02:29.314518 8964 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260321 03:02:29.316851 8924 server_base.cc:1061] running on GCE node
I20260321 03:02:29.317709 8924 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260321 03:02:29.319056 8924 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260321 03:02:29.320269 8924 hybrid_clock.cc:648] HybridClock initialized: now 1774062149320243 us; error 43 us; skew 500 ppm
I20260321 03:02:29.322935 8924 webserver.cc:492] Webserver started at http://127.7.178.252:36797/ using document root <none> and password file <none>
I20260321 03:02:29.323722 8924 fs_manager.cc:362] Metadata directory not provided
I20260321 03:02:29.323832 8924 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260321 03:02:29.335857 8924 fs_manager.cc:714] Time spent opening directory manager: real 0.010s user 0.000s sys 0.002s
I20260321 03:02:29.338989 8970 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260321 03:02:29.340600 8924 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260321 03:02:29.340797 8924 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-2/data,/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-2/wal
uuid: "3df5e4492f3049c1b09fea013b92f863"
format_stamp: "Formatted at 2026-03-21 03:02:27 on dist-test-slave-bwf0"
I20260321 03:02:29.341513 8924 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260321 03:02:29.355875 8932 raft_consensus.cc:493] T cc5de6cf47b84822810e38f094ff99ea P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260321 03:02:29.356040 8932 raft_consensus.cc:515] T cc5de6cf47b84822810e38f094ff99ea P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.356491 8932 leader_election.cc:290] T cc5de6cf47b84822810e38f094ff99ea P 70e7666c46844503beb466fdc054a6fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
I20260321 03:02:29.357230 8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc5de6cf47b84822810e38f094ff99ea" candidate_uuid: "70e7666c46844503beb466fdc054a6fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4532b54a008a4a39b663112e6d0aacc0" is_pre_election: true
I20260321 03:02:29.357415 8532 raft_consensus.cc:2468] T cc5de6cf47b84822810e38f094ff99ea P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70e7666c46844503beb466fdc054a6fc in term 0.
I20260321 03:02:29.357698 8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc5de6cf47b84822810e38f094ff99ea" candidate_uuid: "70e7666c46844503beb466fdc054a6fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a97f7dd77cf2444f8fdb441019081f79" is_pre_election: true
I20260321 03:02:29.357826 8804 raft_consensus.cc:2468] T cc5de6cf47b84822810e38f094ff99ea P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70e7666c46844503beb466fdc054a6fc in term 0.
I20260321 03:02:29.358562 8604 leader_election.cc:304] T cc5de6cf47b84822810e38f094ff99ea P 70e7666c46844503beb466fdc054a6fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79; no voters:
I20260321 03:02:29.359163 8932 raft_consensus.cc:2804] T cc5de6cf47b84822810e38f094ff99ea P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260321 03:02:29.359270 8932 raft_consensus.cc:493] T cc5de6cf47b84822810e38f094ff99ea P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260321 03:02:29.359310 8932 raft_consensus.cc:3060] T cc5de6cf47b84822810e38f094ff99ea P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:29.360440 8932 raft_consensus.cc:515] T cc5de6cf47b84822810e38f094ff99ea P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.360872 8932 leader_election.cc:290] T cc5de6cf47b84822810e38f094ff99ea P 70e7666c46844503beb466fdc054a6fc [CANDIDATE]: Term 1 election: Requested vote from peers 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
I20260321 03:02:29.361908 8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc5de6cf47b84822810e38f094ff99ea" candidate_uuid: "70e7666c46844503beb466fdc054a6fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4532b54a008a4a39b663112e6d0aacc0"
I20260321 03:02:29.361959 8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc5de6cf47b84822810e38f094ff99ea" candidate_uuid: "70e7666c46844503beb466fdc054a6fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a97f7dd77cf2444f8fdb441019081f79"
I20260321 03:02:29.362040 8532 raft_consensus.cc:3060] T cc5de6cf47b84822810e38f094ff99ea P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:29.362111 8804 raft_consensus.cc:3060] T cc5de6cf47b84822810e38f094ff99ea P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:29.363093 8532 raft_consensus.cc:2468] T cc5de6cf47b84822810e38f094ff99ea P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70e7666c46844503beb466fdc054a6fc in term 1.
I20260321 03:02:29.363229 8804 raft_consensus.cc:2468] T cc5de6cf47b84822810e38f094ff99ea P a97f7dd77cf2444f8fdb441019081f79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70e7666c46844503beb466fdc054a6fc in term 1.
I20260321 03:02:29.365340 8602 leader_election.cc:304] T cc5de6cf47b84822810e38f094ff99ea P 70e7666c46844503beb466fdc054a6fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0, 70e7666c46844503beb466fdc054a6fc; no voters:
I20260321 03:02:29.366055 8932 raft_consensus.cc:2804] T cc5de6cf47b84822810e38f094ff99ea P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Leader election won for term 1
I20260321 03:02:29.366154 8932 raft_consensus.cc:697] T cc5de6cf47b84822810e38f094ff99ea P 70e7666c46844503beb466fdc054a6fc [term 1 LEADER]: Becoming Leader. State: Replica: 70e7666c46844503beb466fdc054a6fc, State: Running, Role: LEADER
I20260321 03:02:29.366294 8932 consensus_queue.cc:237] T cc5de6cf47b84822810e38f094ff99ea P 70e7666c46844503beb466fdc054a6fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.375207 8931 raft_consensus.cc:493] T 21aed83ce6884ca4859df11cc5bcf49c P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260321 03:02:29.375363 8931 raft_consensus.cc:515] T 21aed83ce6884ca4859df11cc5bcf49c P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.377080 8931 leader_election.cc:290] T 21aed83ce6884ca4859df11cc5bcf49c P a97f7dd77cf2444f8fdb441019081f79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171), 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713)
I20260321 03:02:29.380661 8924 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260321 03:02:29.381664 8924 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260321 03:02:29.382280 8924 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260321 03:02:29.383406 8667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21aed83ce6884ca4859df11cc5bcf49c" candidate_uuid: "a97f7dd77cf2444f8fdb441019081f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70e7666c46844503beb466fdc054a6fc" is_pre_election: true
I20260321 03:02:29.383689 8667 raft_consensus.cc:2468] T 21aed83ce6884ca4859df11cc5bcf49c P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a97f7dd77cf2444f8fdb441019081f79 in term 0.
I20260321 03:02:29.384333 8737 leader_election.cc:304] T 21aed83ce6884ca4859df11cc5bcf49c P a97f7dd77cf2444f8fdb441019081f79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79; no voters:
I20260321 03:02:29.384709 8931 raft_consensus.cc:2804] T 21aed83ce6884ca4859df11cc5bcf49c P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260321 03:02:29.384773 8931 raft_consensus.cc:493] T 21aed83ce6884ca4859df11cc5bcf49c P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260321 03:02:29.384811 8931 raft_consensus.cc:3060] T 21aed83ce6884ca4859df11cc5bcf49c P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:29.385982 8931 raft_consensus.cc:515] T 21aed83ce6884ca4859df11cc5bcf49c P a97f7dd77cf2444f8fdb441019081f79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.386456 8931 leader_election.cc:290] T 21aed83ce6884ca4859df11cc5bcf49c P a97f7dd77cf2444f8fdb441019081f79 [CANDIDATE]: Term 1 election: Requested vote from peers 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171), 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713)
I20260321 03:02:29.388324 8667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21aed83ce6884ca4859df11cc5bcf49c" candidate_uuid: "a97f7dd77cf2444f8fdb441019081f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70e7666c46844503beb466fdc054a6fc"
I20260321 03:02:29.388486 8667 raft_consensus.cc:3060] T 21aed83ce6884ca4859df11cc5bcf49c P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:29.389492 8272 catalog_manager.cc:2174] created HMS catalog entry for table [id=b792550a4b344d24a9d33f468884c107]
I20260321 03:02:29.390297 8667 raft_consensus.cc:2468] T 21aed83ce6884ca4859df11cc5bcf49c P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a97f7dd77cf2444f8fdb441019081f79 in term 1.
I20260321 03:02:29.390820 8737 leader_election.cc:304] T 21aed83ce6884ca4859df11cc5bcf49c P a97f7dd77cf2444f8fdb441019081f79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79; no voters:
I20260321 03:02:29.394452 8924 rpc_server.cc:307] RPC server started. Bound to: 127.7.178.252:45145
I20260321 03:02:29.395910 8924 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-2/data/info.pb
I20260321 03:02:29.395670 8272 catalog_manager.cc:5671] T a4bfa1cd32ac40cb800860d336c99fd7 P 4532b54a008a4a39b663112e6d0aacc0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193). New cstate: current_term: 1 leader_uuid: "4532b54a008a4a39b663112e6d0aacc0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } health_report { overall_health: UNKNOWN } } }
I20260321 03:02:29.398638 9024 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.178.252:45145 every 8 connection(s)
I20260321 03:02:29.402616 7883 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskZ5BwAx/build/debug/bin/kudu as pid 8924
I20260321 03:02:29.405066 8272 catalog_manager.cc:5671] T 47e6f8a096804dc7900db99f931d14fc P 70e7666c46844503beb466fdc054a6fc reported cstate change: term changed from 0 to 1, leader changed from <none> to 70e7666c46844503beb466fdc054a6fc (127.7.178.194). New cstate: current_term: 1 leader_uuid: "70e7666c46844503beb466fdc054a6fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } health_report { overall_health: UNKNOWN } } }
I20260321 03:02:29.405874 9025 sys_catalog.cc:263] Verifying existing consensus state
I20260321 03:02:29.408179 9025 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863: Bootstrap starting.
I20260321 03:02:29.411329 8932 raft_consensus.cc:493] T 1806a588d8d24b18a405e1a545d9cdda P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260321 03:02:29.411448 8932 raft_consensus.cc:515] T 1806a588d8d24b18a405e1a545d9cdda P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.411901 8932 leader_election.cc:290] T 1806a588d8d24b18a405e1a545d9cdda P 70e7666c46844503beb466fdc054a6fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
I20260321 03:02:29.412526 8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1806a588d8d24b18a405e1a545d9cdda" candidate_uuid: "70e7666c46844503beb466fdc054a6fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4532b54a008a4a39b663112e6d0aacc0" is_pre_election: true
I20260321 03:02:29.412663 8532 raft_consensus.cc:2468] T 1806a588d8d24b18a405e1a545d9cdda P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70e7666c46844503beb466fdc054a6fc in term 0.
I20260321 03:02:29.412989 8602 leader_election.cc:304] T 1806a588d8d24b18a405e1a545d9cdda P 70e7666c46844503beb466fdc054a6fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0, 70e7666c46844503beb466fdc054a6fc; no voters:
I20260321 03:02:29.413163 8932 raft_consensus.cc:2804] T 1806a588d8d24b18a405e1a545d9cdda P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260321 03:02:29.413210 8932 raft_consensus.cc:493] T 1806a588d8d24b18a405e1a545d9cdda P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260321 03:02:29.413273 8932 raft_consensus.cc:3060] T 1806a588d8d24b18a405e1a545d9cdda P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:29.414165 8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21aed83ce6884ca4859df11cc5bcf49c" candidate_uuid: "a97f7dd77cf2444f8fdb441019081f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4532b54a008a4a39b663112e6d0aacc0"
I20260321 03:02:29.414304 8533 raft_consensus.cc:3060] T 21aed83ce6884ca4859df11cc5bcf49c P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:29.414291 8932 raft_consensus.cc:515] T 1806a588d8d24b18a405e1a545d9cdda P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.414695 8932 leader_election.cc:290] T 1806a588d8d24b18a405e1a545d9cdda P 70e7666c46844503beb466fdc054a6fc [CANDIDATE]: Term 1 election: Requested vote from peers 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
I20260321 03:02:29.415230 8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1806a588d8d24b18a405e1a545d9cdda" candidate_uuid: "70e7666c46844503beb466fdc054a6fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4532b54a008a4a39b663112e6d0aacc0"
I20260321 03:02:29.415333 8531 raft_consensus.cc:3060] T 1806a588d8d24b18a405e1a545d9cdda P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:29.415460 8533 raft_consensus.cc:2468] T 21aed83ce6884ca4859df11cc5bcf49c P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a97f7dd77cf2444f8fdb441019081f79 in term 1.
I20260321 03:02:29.415684 8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21aed83ce6884ca4859df11cc5bcf49c" candidate_uuid: "a97f7dd77cf2444f8fdb441019081f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4532b54a008a4a39b663112e6d0aacc0" is_pre_election: true
I20260321 03:02:29.415802 8532 raft_consensus.cc:2376] T 21aed83ce6884ca4859df11cc5bcf49c P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a97f7dd77cf2444f8fdb441019081f79 in term 1. Re-sending same reply.
I20260321 03:02:29.416126 9025 log.cc:826] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863: Log is configured to *not* fsync() on all Append() calls
I20260321 03:02:29.416283 8531 raft_consensus.cc:2468] T 1806a588d8d24b18a405e1a545d9cdda P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70e7666c46844503beb466fdc054a6fc in term 1.
I20260321 03:02:29.416674 8602 leader_election.cc:304] T 1806a588d8d24b18a405e1a545d9cdda P 70e7666c46844503beb466fdc054a6fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0, 70e7666c46844503beb466fdc054a6fc; no voters:
I20260321 03:02:29.416864 8932 raft_consensus.cc:2804] T 1806a588d8d24b18a405e1a545d9cdda P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Leader election won for term 1
I20260321 03:02:29.416949 8932 raft_consensus.cc:697] T 1806a588d8d24b18a405e1a545d9cdda P 70e7666c46844503beb466fdc054a6fc [term 1 LEADER]: Becoming Leader. State: Replica: 70e7666c46844503beb466fdc054a6fc, State: Running, Role: LEADER
I20260321 03:02:29.416944 8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1806a588d8d24b18a405e1a545d9cdda" candidate_uuid: "70e7666c46844503beb466fdc054a6fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a97f7dd77cf2444f8fdb441019081f79" is_pre_election: true
I20260321 03:02:29.417079 8804 raft_consensus.cc:2468] T 1806a588d8d24b18a405e1a545d9cdda P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70e7666c46844503beb466fdc054a6fc in term 0.
I20260321 03:02:29.417085 8932 consensus_queue.cc:237] T 1806a588d8d24b18a405e1a545d9cdda P 70e7666c46844503beb466fdc054a6fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.417361 8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1806a588d8d24b18a405e1a545d9cdda" candidate_uuid: "70e7666c46844503beb466fdc054a6fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a97f7dd77cf2444f8fdb441019081f79"
I20260321 03:02:29.417464 8803 raft_consensus.cc:3060] T 1806a588d8d24b18a405e1a545d9cdda P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:29.418449 8803 raft_consensus.cc:2468] T 1806a588d8d24b18a405e1a545d9cdda P a97f7dd77cf2444f8fdb441019081f79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70e7666c46844503beb466fdc054a6fc in term 1.
I20260321 03:02:29.422434 8931 raft_consensus.cc:2804] T 21aed83ce6884ca4859df11cc5bcf49c P a97f7dd77cf2444f8fdb441019081f79 [term 1 FOLLOWER]: Leader election won for term 1
I20260321 03:02:29.429147 8513 tablet_service.cc:1511] Processing CreateTablet for tablet c8b7587407f64cbd8f6cbe2dd048547e (DEFAULT_TABLE table=default.table_ec53d9a55a4c47b8a9b0fa3916c9c561 [id=b792550a4b344d24a9d33f468884c107]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:29.429668 8513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8b7587407f64cbd8f6cbe2dd048547e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:29.432158 8921 tablet_bootstrap.cc:492] T c8b7587407f64cbd8f6cbe2dd048547e P 4532b54a008a4a39b663112e6d0aacc0: Bootstrap starting.
I20260321 03:02:29.433362 8921 tablet_bootstrap.cc:654] T c8b7587407f64cbd8f6cbe2dd048547e P 4532b54a008a4a39b663112e6d0aacc0: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:29.434566 8714 heartbeater.cc:344] Connected to a master server at 127.7.178.252:45145
I20260321 03:02:29.435369 8648 tablet_service.cc:1511] Processing CreateTablet for tablet c8b7587407f64cbd8f6cbe2dd048547e (DEFAULT_TABLE table=default.table_ec53d9a55a4c47b8a9b0fa3916c9c561 [id=b792550a4b344d24a9d33f468884c107]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:29.435667 8648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8b7587407f64cbd8f6cbe2dd048547e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:29.439847 8923 tablet_bootstrap.cc:492] T c8b7587407f64cbd8f6cbe2dd048547e P 70e7666c46844503beb466fdc054a6fc: Bootstrap starting.
I20260321 03:02:29.442327 8923 tablet_bootstrap.cc:654] T c8b7587407f64cbd8f6cbe2dd048547e P 70e7666c46844503beb466fdc054a6fc: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:29.438055 8783 tablet_service.cc:1511] Processing CreateTablet for tablet c8b7587407f64cbd8f6cbe2dd048547e (DEFAULT_TABLE table=default.table_ec53d9a55a4c47b8a9b0fa3916c9c561 [id=b792550a4b344d24a9d33f468884c107]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:29.443698 8783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8b7587407f64cbd8f6cbe2dd048547e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:29.446295 9025 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260321 03:02:29.446307 8922 tablet_bootstrap.cc:492] T c8b7587407f64cbd8f6cbe2dd048547e P a97f7dd77cf2444f8fdb441019081f79: Bootstrap starting.
I20260321 03:02:29.446758 9025 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863: Bootstrap complete.
I20260321 03:02:29.447413 8922 tablet_bootstrap.cc:654] T c8b7587407f64cbd8f6cbe2dd048547e P a97f7dd77cf2444f8fdb441019081f79: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:29.450870 9025 raft_consensus.cc:359] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:02:29.451423 9025 raft_consensus.cc:740] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3df5e4492f3049c1b09fea013b92f863, State: Initialized, Role: FOLLOWER
I20260321 03:02:29.452045 9025 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:02:29.453583 9025 sys_catalog.cc:565] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [sys.catalog]: configured and running, proceeding with master startup.
I20260321 03:02:29.454598 8272 catalog_manager.cc:5671] T 1806a588d8d24b18a405e1a545d9cdda P 70e7666c46844503beb466fdc054a6fc reported cstate change: term changed from 0 to 1, leader changed from <none> to 70e7666c46844503beb466fdc054a6fc (127.7.178.194). New cstate: current_term: 1 leader_uuid: "70e7666c46844503beb466fdc054a6fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } health_report { overall_health: UNKNOWN } } }
I20260321 03:02:29.455056 8272 catalog_manager.cc:5671] T cc5de6cf47b84822810e38f094ff99ea P 70e7666c46844503beb466fdc054a6fc reported cstate change: term changed from 0 to 1, leader changed from <none> to 70e7666c46844503beb466fdc054a6fc (127.7.178.194). New cstate: current_term: 1 leader_uuid: "70e7666c46844503beb466fdc054a6fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } health_report { overall_health: UNKNOWN } } }
I20260321 03:02:29.449187 8931 raft_consensus.cc:697] T 21aed83ce6884ca4859df11cc5bcf49c P a97f7dd77cf2444f8fdb441019081f79 [term 1 LEADER]: Becoming Leader. State: Replica: a97f7dd77cf2444f8fdb441019081f79, State: Running, Role: LEADER
I20260321 03:02:29.456212 8931 consensus_queue.cc:237] T 21aed83ce6884ca4859df11cc5bcf49c P a97f7dd77cf2444f8fdb441019081f79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.462481 9049 catalog_manager.cc:1269] Loaded cluster ID: 30588dbe2d29416e8c640adf9bfaba1f
I20260321 03:02:29.462566 9049 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863: loading cluster ID for follower catalog manager: success
I20260321 03:02:29.465148 9049 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863: acquiring CA information for follower catalog manager: success
I20260321 03:02:29.470446 8850 heartbeater.cc:344] Connected to a master server at 127.7.178.252:45145
I20260321 03:02:29.472465 8989 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" instance_seqno: 1774062148360782) as {username='slave'} at 127.7.178.195:48281; Asking this server to re-register.
I20260321 03:02:29.473237 8850 heartbeater.cc:461] Registering TS with master...
I20260321 03:02:29.475062 8989 ts_manager.cc:194] Registered new tserver with Master: a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
I20260321 03:02:29.478843 8272 catalog_manager.cc:5671] T 21aed83ce6884ca4859df11cc5bcf49c P a97f7dd77cf2444f8fdb441019081f79 reported cstate change: term changed from 0 to 1, leader changed from <none> to a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195). New cstate: current_term: 1 leader_uuid: "a97f7dd77cf2444f8fdb441019081f79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } health_report { overall_health: HEALTHY } } }
I20260321 03:02:29.479043 8922 tablet_bootstrap.cc:492] T c8b7587407f64cbd8f6cbe2dd048547e P a97f7dd77cf2444f8fdb441019081f79: No bootstrap required, opened a new log
I20260321 03:02:29.479143 8922 ts_tablet_manager.cc:1403] T c8b7587407f64cbd8f6cbe2dd048547e P a97f7dd77cf2444f8fdb441019081f79: Time spent bootstrapping tablet: real 0.033s user 0.001s sys 0.000s
I20260321 03:02:29.478971 9049 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260321 03:02:29.479722 8922 raft_consensus.cc:359] T c8b7587407f64cbd8f6cbe2dd048547e P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.479866 8922 raft_consensus.cc:385] T c8b7587407f64cbd8f6cbe2dd048547e P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:29.479902 8922 raft_consensus.cc:740] T c8b7587407f64cbd8f6cbe2dd048547e P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a97f7dd77cf2444f8fdb441019081f79, State: Initialized, Role: FOLLOWER
I20260321 03:02:29.480036 8922 consensus_queue.cc:260] T c8b7587407f64cbd8f6cbe2dd048547e P a97f7dd77cf2444f8fdb441019081f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.480324 8922 ts_tablet_manager.cc:1434] T c8b7587407f64cbd8f6cbe2dd048547e P a97f7dd77cf2444f8fdb441019081f79: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260321 03:02:29.484211 8921 tablet_bootstrap.cc:492] T c8b7587407f64cbd8f6cbe2dd048547e P 4532b54a008a4a39b663112e6d0aacc0: No bootstrap required, opened a new log
I20260321 03:02:29.484391 8921 ts_tablet_manager.cc:1403] T c8b7587407f64cbd8f6cbe2dd048547e P 4532b54a008a4a39b663112e6d0aacc0: Time spent bootstrapping tablet: real 0.052s user 0.001s sys 0.002s
I20260321 03:02:29.484995 8921 raft_consensus.cc:359] T c8b7587407f64cbd8f6cbe2dd048547e P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.485116 8921 raft_consensus.cc:385] T c8b7587407f64cbd8f6cbe2dd048547e P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:29.485148 8921 raft_consensus.cc:740] T c8b7587407f64cbd8f6cbe2dd048547e P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4532b54a008a4a39b663112e6d0aacc0, State: Initialized, Role: FOLLOWER
I20260321 03:02:29.485348 8921 consensus_queue.cc:260] T c8b7587407f64cbd8f6cbe2dd048547e P 4532b54a008a4a39b663112e6d0aacc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.487807 8921 ts_tablet_manager.cc:1434] T c8b7587407f64cbd8f6cbe2dd048547e P 4532b54a008a4a39b663112e6d0aacc0: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260321 03:02:29.489810 8272 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39954:
name: "default.Table_79533ce61645417d9d18b6b2820ee1af"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260321 03:02:29.493578 8579 heartbeater.cc:344] Connected to a master server at 127.7.178.252:45145
I20260321 03:02:29.494189 8923 tablet_bootstrap.cc:492] T c8b7587407f64cbd8f6cbe2dd048547e P 70e7666c46844503beb466fdc054a6fc: No bootstrap required, opened a new log
I20260321 03:02:29.494416 8923 ts_tablet_manager.cc:1403] T c8b7587407f64cbd8f6cbe2dd048547e P 70e7666c46844503beb466fdc054a6fc: Time spent bootstrapping tablet: real 0.055s user 0.000s sys 0.003s
I20260321 03:02:29.495188 8989 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" instance_seqno: 1774062147955760) as {username='slave'} at 127.7.178.193:51251; Asking this server to re-register.
I20260321 03:02:29.495348 8923 raft_consensus.cc:359] T c8b7587407f64cbd8f6cbe2dd048547e P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.495502 8923 raft_consensus.cc:385] T c8b7587407f64cbd8f6cbe2dd048547e P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:29.495548 8923 raft_consensus.cc:740] T c8b7587407f64cbd8f6cbe2dd048547e P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70e7666c46844503beb466fdc054a6fc, State: Initialized, Role: FOLLOWER
I20260321 03:02:29.495704 8923 consensus_queue.cc:260] T c8b7587407f64cbd8f6cbe2dd048547e P 70e7666c46844503beb466fdc054a6fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.495996 8579 heartbeater.cc:461] Registering TS with master...
I20260321 03:02:29.496024 8923 ts_tablet_manager.cc:1434] T c8b7587407f64cbd8f6cbe2dd048547e P 70e7666c46844503beb466fdc054a6fc: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
I20260321 03:02:29.497219 8989 ts_manager.cc:194] Registered new tserver with Master: 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171)
I20260321 03:02:29.499164 8989 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "70e7666c46844503beb466fdc054a6fc" instance_seqno: 1774062148158895) as {username='slave'} at 127.7.178.194:51737; Asking this server to re-register.
I20260321 03:02:29.500023 9035 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } } }
I20260321 03:02:29.500192 9035 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [sys.catalog]: This master's current role is: FOLLOWER
I20260321 03:02:29.500489 8714 heartbeater.cc:461] Registering TS with master...
I20260321 03:02:29.501381 8266 catalog_manager.cc:2174] created HMS catalog entry for table [id=850c888ac63d4c048f27ceeb1ddd4f83]
I20260321 03:02:29.501675 8989 ts_manager.cc:194] Registered new tserver with Master: 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713)
I20260321 03:02:29.509120 8266 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:39954 (request call id 8) took 1093 ms. Trace:
I20260321 03:02:29.509246 8266 rpcz_store.cc:276] 0321 03:02:28.416030 (+ 0us) service_pool.cc:168] Inserting onto call queue
0321 03:02:28.416088 (+ 58us) service_pool.cc:225] Handling call
0321 03:02:28.938692 (+522604us) catalog_manager.cc:2101] Acquired catalog manager lock
0321 03:02:28.938983 (+ 291us) catalog_manager.cc:2147] Created new table and tablet info
0321 03:02:29.501371 (+562388us) catalog_manager.cc:2173] Created new table in HMS catalog
0321 03:02:29.508862 (+ 7491us) catalog_manager.cc:2207] Wrote table and tablets to system table
0321 03:02:29.508979 (+ 117us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0321 03:02:29.509094 (+ 115us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0321 03:02:29.502127 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0321 03:02:29.502366 (+ 239us) write_op.cc:432] Acquiring schema lock in shared mode
0321 03:02:29.502371 (+ 5us) write_op.cc:435] Acquired schema lock
0321 03:02:29.502373 (+ 2us) tablet.cc:661] Decoding operations
0321 03:02:29.502469 (+ 96us) write_op.cc:620] Acquiring the partition lock for write op
0321 03:02:29.502481 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0321 03:02:29.502484 (+ 3us) tablet.cc:684] Acquiring locks for 2 operations
0321 03:02:29.502549 (+ 65us) tablet.cc:700] Row locks acquired
0321 03:02:29.502551 (+ 2us) write_op.cc:260] PREPARE: finished
0321 03:02:29.502592 (+ 41us) write_op.cc:270] Start()
0321 03:02:29.502623 (+ 31us) write_op.cc:276] Timestamp: P: 1774062149502537 usec, L: 0
0321 03:02:29.502626 (+ 3us) op_driver.cc:348] REPLICATION: starting
0321 03:02:29.502825 (+ 199us) log.cc:844] Serialized 432 byte log entry
0321 03:02:29.506402 (+ 3577us) op_driver.cc:464] REPLICATION: finished
0321 03:02:29.506858 (+ 456us) write_op.cc:301] APPLY: starting
0321 03:02:29.506882 (+ 24us) tablet.cc:1366] starting BulkCheckPresence
0321 03:02:29.506919 (+ 37us) tablet.cc:1369] finished BulkCheckPresence
0321 03:02:29.506941 (+ 22us) tablet.cc:1371] starting ApplyRowOperation cycle
0321 03:02:29.507034 (+ 93us) tablet.cc:1382] finished ApplyRowOperation cycle
0321 03:02:29.507070 (+ 36us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0321 03:02:29.507075 (+ 5us) write_op.cc:312] APPLY: finished
0321 03:02:29.507152 (+ 77us) log.cc:844] Serialized 28 byte log entry
0321 03:02:29.507345 (+ 193us) write_op.cc:489] Releasing partition, row and schema locks
0321 03:02:29.507370 (+ 25us) write_op.cc:454] Released schema lock
0321 03:02:29.507378 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0321 03:02:29.507473 (+ 95us) write_op.cc:489] Releasing partition, row and schema locks
0321 03:02:29.507475 (+ 2us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":450371,"Hive Metastore.run_cpu_time_us":256,"Hive Metastore.run_wall_time_us":111693,"child_traces":[["op",{"apply.queue_time_us":390,"apply.run_cpu_time_us":606,"apply.run_wall_time_us":605,"num_ops":2,"prepare.queue_time_us":150,"prepare.run_cpu_time_us":823,"prepare.run_wall_time_us":824,"raft.queue_time_us":146,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":200,"replication_time_us":3741}]]}
I20260321 03:02:29.520291 8783 tablet_service.cc:1511] Processing CreateTablet for tablet 89ae9cb00ef14b5d9d88dfb94a55e5d5 (DEFAULT_TABLE table=default.table_0e0c55f293274457aed5e8d315334903 [id=850c888ac63d4c048f27ceeb1ddd4f83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:29.520655 8783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89ae9cb00ef14b5d9d88dfb94a55e5d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:29.521729 8266 master_service.cc:954] ReplaceTablet: received request to replace tablet a4bfa1cd32ac40cb800860d336c99fd7 from {username='slave'} at 127.0.0.1:39954
I20260321 03:02:29.523890 8513 tablet_service.cc:1511] Processing CreateTablet for tablet 89ae9cb00ef14b5d9d88dfb94a55e5d5 (DEFAULT_TABLE table=default.table_0e0c55f293274457aed5e8d315334903 [id=850c888ac63d4c048f27ceeb1ddd4f83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:29.524052 8922 tablet_bootstrap.cc:492] T 89ae9cb00ef14b5d9d88dfb94a55e5d5 P a97f7dd77cf2444f8fdb441019081f79: Bootstrap starting.
I20260321 03:02:29.524215 8513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89ae9cb00ef14b5d9d88dfb94a55e5d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:29.525182 8922 tablet_bootstrap.cc:654] T 89ae9cb00ef14b5d9d88dfb94a55e5d5 P a97f7dd77cf2444f8fdb441019081f79: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:29.526922 8648 tablet_service.cc:1511] Processing CreateTablet for tablet 89ae9cb00ef14b5d9d88dfb94a55e5d5 (DEFAULT_TABLE table=default.table_0e0c55f293274457aed5e8d315334903 [id=850c888ac63d4c048f27ceeb1ddd4f83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:29.527247 8648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89ae9cb00ef14b5d9d88dfb94a55e5d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:29.530839 8922 tablet_bootstrap.cc:492] T 89ae9cb00ef14b5d9d88dfb94a55e5d5 P a97f7dd77cf2444f8fdb441019081f79: No bootstrap required, opened a new log
I20260321 03:02:29.530973 8922 ts_tablet_manager.cc:1403] T 89ae9cb00ef14b5d9d88dfb94a55e5d5 P a97f7dd77cf2444f8fdb441019081f79: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260321 03:02:29.531662 8922 raft_consensus.cc:359] T 89ae9cb00ef14b5d9d88dfb94a55e5d5 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.531821 8922 raft_consensus.cc:385] T 89ae9cb00ef14b5d9d88dfb94a55e5d5 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:29.531859 8922 raft_consensus.cc:740] T 89ae9cb00ef14b5d9d88dfb94a55e5d5 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a97f7dd77cf2444f8fdb441019081f79, State: Initialized, Role: FOLLOWER
I20260321 03:02:29.532040 8922 consensus_queue.cc:260] T 89ae9cb00ef14b5d9d88dfb94a55e5d5 P a97f7dd77cf2444f8fdb441019081f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.532362 8922 ts_tablet_manager.cc:1434] T 89ae9cb00ef14b5d9d88dfb94a55e5d5 P a97f7dd77cf2444f8fdb441019081f79: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260321 03:02:29.532720 8923 tablet_bootstrap.cc:492] T 89ae9cb00ef14b5d9d88dfb94a55e5d5 P 70e7666c46844503beb466fdc054a6fc: Bootstrap starting.
I20260321 03:02:29.534017 8923 tablet_bootstrap.cc:654] T 89ae9cb00ef14b5d9d88dfb94a55e5d5 P 70e7666c46844503beb466fdc054a6fc: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:29.538013 8921 tablet_bootstrap.cc:492] T 89ae9cb00ef14b5d9d88dfb94a55e5d5 P 4532b54a008a4a39b663112e6d0aacc0: Bootstrap starting.
I20260321 03:02:29.539361 8921 tablet_bootstrap.cc:654] T 89ae9cb00ef14b5d9d88dfb94a55e5d5 P 4532b54a008a4a39b663112e6d0aacc0: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:29.541723 8266 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e: Sending DeleteTablet for 3 replicas of tablet a4bfa1cd32ac40cb800860d336c99fd7
I20260321 03:02:29.542804 8513 tablet_service.cc:1558] Processing DeleteTablet for tablet a4bfa1cd32ac40cb800860d336c99fd7 with delete_type TABLET_DATA_DELETED (replaced by tablet 4718c06ec4ed4452b91483eb6e1ae067) from {username='slave'} at 127.0.0.1:51684
I20260321 03:02:29.543455 8648 tablet_service.cc:1558] Processing DeleteTablet for tablet a4bfa1cd32ac40cb800860d336c99fd7 with delete_type TABLET_DATA_DELETED (replaced by tablet 4718c06ec4ed4452b91483eb6e1ae067) from {username='slave'} at 127.0.0.1:35520
I20260321 03:02:29.543582 8783 tablet_service.cc:1558] Processing DeleteTablet for tablet a4bfa1cd32ac40cb800860d336c99fd7 with delete_type TABLET_DATA_DELETED (replaced by tablet 4718c06ec4ed4452b91483eb6e1ae067) from {username='slave'} at 127.0.0.1:58810
I20260321 03:02:29.543766 8926 tablet_replica.cc:333] T a4bfa1cd32ac40cb800860d336c99fd7 P 4532b54a008a4a39b663112e6d0aacc0: stopping tablet replica
I20260321 03:02:29.543785 8927 tablet_replica.cc:333] T a4bfa1cd32ac40cb800860d336c99fd7 P a97f7dd77cf2444f8fdb441019081f79: stopping tablet replica
I20260321 03:02:29.543907 8926 raft_consensus.cc:2243] T a4bfa1cd32ac40cb800860d336c99fd7 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 LEADER]: Raft consensus shutting down.
I20260321 03:02:29.543916 8927 raft_consensus.cc:2243] T a4bfa1cd32ac40cb800860d336c99fd7 P a97f7dd77cf2444f8fdb441019081f79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260321 03:02:29.544037 8927 raft_consensus.cc:2272] T a4bfa1cd32ac40cb800860d336c99fd7 P a97f7dd77cf2444f8fdb441019081f79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260321 03:02:29.544198 8926 pending_rounds.cc:70] T a4bfa1cd32ac40cb800860d336c99fd7 P 4532b54a008a4a39b663112e6d0aacc0: Trying to abort 1 pending ops.
I20260321 03:02:29.544314 8926 pending_rounds.cc:77] T a4bfa1cd32ac40cb800860d336c99fd7 P 4532b54a008a4a39b663112e6d0aacc0: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7266558563277430784 op_type: NO_OP noop_request { }
I20260321 03:02:29.544433 8926 raft_consensus.cc:2889] T a4bfa1cd32ac40cb800860d336c99fd7 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260321 03:02:29.544535 8926 raft_consensus.cc:2272] T a4bfa1cd32ac40cb800860d336c99fd7 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260321 03:02:29.544606 8927 ts_tablet_manager.cc:1916] T a4bfa1cd32ac40cb800860d336c99fd7 P a97f7dd77cf2444f8fdb441019081f79: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260321 03:02:29.545795 8926 ts_tablet_manager.cc:1916] T a4bfa1cd32ac40cb800860d336c99fd7 P 4532b54a008a4a39b663112e6d0aacc0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260321 03:02:29.547595 8927 ts_tablet_manager.cc:1929] T a4bfa1cd32ac40cb800860d336c99fd7 P a97f7dd77cf2444f8fdb441019081f79: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260321 03:02:29.547705 8927 log.cc:1199] T a4bfa1cd32ac40cb800860d336c99fd7 P a97f7dd77cf2444f8fdb441019081f79: Deleting WAL directory at /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-2/wal/wals/a4bfa1cd32ac40cb800860d336c99fd7
I20260321 03:02:29.547940 8927 ts_tablet_manager.cc:1950] T a4bfa1cd32ac40cb800860d336c99fd7 P a97f7dd77cf2444f8fdb441019081f79: Deleting consensus metadata
I20260321 03:02:29.548851 8260 catalog_manager.cc:5002] TS a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): tablet a4bfa1cd32ac40cb800860d336c99fd7 (table default.table_628c329100ff4b269d91d561af863424 [id=94ef39d020ab428b9e0392bedab9483d]) successfully deleted
I20260321 03:02:29.548976 8266 catalog_manager.cc:6741] ReplaceTablet: tablet a4bfa1cd32ac40cb800860d336c99fd7 deleted and replaced by tablet 4718c06ec4ed4452b91483eb6e1ae067
I20260321 03:02:29.550400 8266 master_service.cc:954] ReplaceTablet: received request to replace tablet a4bfa1cd32ac40cb800860d336c99fd7 from {username='slave'} at 127.0.0.1:39954
I20260321 03:02:29.550765 8266 master_service.cc:954] ReplaceTablet: received request to replace tablet 21aed83ce6884ca4859df11cc5bcf49c from {username='slave'} at 127.0.0.1:39954
I20260321 03:02:29.554491 8925 tablet_replica.cc:333] T a4bfa1cd32ac40cb800860d336c99fd7 P 70e7666c46844503beb466fdc054a6fc: stopping tablet replica
I20260321 03:02:29.554679 8925 raft_consensus.cc:2243] T a4bfa1cd32ac40cb800860d336c99fd7 P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260321 03:02:29.554806 8925 raft_consensus.cc:2272] T a4bfa1cd32ac40cb800860d336c99fd7 P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260321 03:02:29.555588 8925 ts_tablet_manager.cc:1916] T a4bfa1cd32ac40cb800860d336c99fd7 P 70e7666c46844503beb466fdc054a6fc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260321 03:02:29.558070 8925 ts_tablet_manager.cc:1929] T a4bfa1cd32ac40cb800860d336c99fd7 P 70e7666c46844503beb466fdc054a6fc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260321 03:02:29.558152 8925 log.cc:1199] T a4bfa1cd32ac40cb800860d336c99fd7 P 70e7666c46844503beb466fdc054a6fc: Deleting WAL directory at /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-1/wal/wals/a4bfa1cd32ac40cb800860d336c99fd7
I20260321 03:02:29.558380 8925 ts_tablet_manager.cc:1950] T a4bfa1cd32ac40cb800860d336c99fd7 P 70e7666c46844503beb466fdc054a6fc: Deleting consensus metadata
I20260321 03:02:29.559399 8257 catalog_manager.cc:5002] TS 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): tablet a4bfa1cd32ac40cb800860d336c99fd7 (table default.table_628c329100ff4b269d91d561af863424 [id=94ef39d020ab428b9e0392bedab9483d]) successfully deleted
I20260321 03:02:29.560693 8266 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e: Sending DeleteTablet for 3 replicas of tablet 21aed83ce6884ca4859df11cc5bcf49c
I20260321 03:02:29.560988 8266 catalog_manager.cc:6741] ReplaceTablet: tablet 21aed83ce6884ca4859df11cc5bcf49c deleted and replaced by tablet 27330be65bac450a8ead355d41fe780e
I20260321 03:02:29.561131 8266 master_service.cc:954] ReplaceTablet: received request to replace tablet 21aed83ce6884ca4859df11cc5bcf49c from {username='slave'} at 127.0.0.1:39954
I20260321 03:02:29.561379 8512 tablet_service.cc:1558] Processing DeleteTablet for tablet 21aed83ce6884ca4859df11cc5bcf49c with delete_type TABLET_DATA_DELETED (replaced by tablet 27330be65bac450a8ead355d41fe780e) from {username='slave'} at 127.0.0.1:51684
I20260321 03:02:29.561512 8266 master_service.cc:954] ReplaceTablet: received request to replace tablet 47e6f8a096804dc7900db99f931d14fc from {username='slave'} at 127.0.0.1:39954
I20260321 03:02:29.561901 8647 tablet_service.cc:1558] Processing DeleteTablet for tablet 21aed83ce6884ca4859df11cc5bcf49c with delete_type TABLET_DATA_DELETED (replaced by tablet 27330be65bac450a8ead355d41fe780e) from {username='slave'} at 127.0.0.1:35520
I20260321 03:02:29.562788 8783 tablet_service.cc:1511] Processing CreateTablet for tablet 4718c06ec4ed4452b91483eb6e1ae067 (DEFAULT_TABLE table=default.table_628c329100ff4b269d91d561af863424 [id=94ef39d020ab428b9e0392bedab9483d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:29.563107 8783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4718c06ec4ed4452b91483eb6e1ae067. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:29.565409 8784 tablet_service.cc:1558] Processing DeleteTablet for tablet 21aed83ce6884ca4859df11cc5bcf49c with delete_type TABLET_DATA_DELETED (replaced by tablet 27330be65bac450a8ead355d41fe780e) from {username='slave'} at 127.0.0.1:58810
I20260321 03:02:29.566231 8927 tablet_replica.cc:333] T 21aed83ce6884ca4859df11cc5bcf49c P a97f7dd77cf2444f8fdb441019081f79: stopping tablet replica
I20260321 03:02:29.566386 8927 raft_consensus.cc:2243] T 21aed83ce6884ca4859df11cc5bcf49c P a97f7dd77cf2444f8fdb441019081f79 [term 1 LEADER]: Raft consensus shutting down.
I20260321 03:02:29.566730 8927 pending_rounds.cc:70] T 21aed83ce6884ca4859df11cc5bcf49c P a97f7dd77cf2444f8fdb441019081f79: Trying to abort 1 pending ops.
I20260321 03:02:29.566852 8927 pending_rounds.cc:77] T 21aed83ce6884ca4859df11cc5bcf49c P a97f7dd77cf2444f8fdb441019081f79: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7266558564186509312 op_type: NO_OP noop_request { }
I20260321 03:02:29.566967 8927 raft_consensus.cc:2889] T 21aed83ce6884ca4859df11cc5bcf49c P a97f7dd77cf2444f8fdb441019081f79 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260321 03:02:29.567045 8927 raft_consensus.cc:2272] T 21aed83ce6884ca4859df11cc5bcf49c P a97f7dd77cf2444f8fdb441019081f79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260321 03:02:29.574306 8927 ts_tablet_manager.cc:1916] T 21aed83ce6884ca4859df11cc5bcf49c P a97f7dd77cf2444f8fdb441019081f79: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260321 03:02:29.577505 8921 tablet_bootstrap.cc:492] T 89ae9cb00ef14b5d9d88dfb94a55e5d5 P 4532b54a008a4a39b663112e6d0aacc0: No bootstrap required, opened a new log
I20260321 03:02:29.577639 8921 ts_tablet_manager.cc:1403] T 89ae9cb00ef14b5d9d88dfb94a55e5d5 P 4532b54a008a4a39b663112e6d0aacc0: Time spent bootstrapping tablet: real 0.040s user 0.002s sys 0.001s
I20260321 03:02:29.577917 8927 ts_tablet_manager.cc:1929] T 21aed83ce6884ca4859df11cc5bcf49c P a97f7dd77cf2444f8fdb441019081f79: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260321 03:02:29.577999 8927 log.cc:1199] T 21aed83ce6884ca4859df11cc5bcf49c P a97f7dd77cf2444f8fdb441019081f79: Deleting WAL directory at /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-2/wal/wals/21aed83ce6884ca4859df11cc5bcf49c
I20260321 03:02:29.578271 8927 ts_tablet_manager.cc:1950] T 21aed83ce6884ca4859df11cc5bcf49c P a97f7dd77cf2444f8fdb441019081f79: Deleting consensus metadata
I20260321 03:02:29.578307 8921 raft_consensus.cc:359] T 89ae9cb00ef14b5d9d88dfb94a55e5d5 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.578531 8921 raft_consensus.cc:385] T 89ae9cb00ef14b5d9d88dfb94a55e5d5 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:29.578576 8921 raft_consensus.cc:740] T 89ae9cb00ef14b5d9d88dfb94a55e5d5 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4532b54a008a4a39b663112e6d0aacc0, State: Initialized, Role: FOLLOWER
I20260321 03:02:29.579250 8260 catalog_manager.cc:5002] TS a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): tablet 21aed83ce6884ca4859df11cc5bcf49c (table default.table_9bbd1f43ebe347ed99a9be3a6ffb3d86 [id=4ac1925a391a48ea86c63da0c1d8c442]) successfully deleted
I20260321 03:02:29.580253 8921 consensus_queue.cc:260] T 89ae9cb00ef14b5d9d88dfb94a55e5d5 P 4532b54a008a4a39b663112e6d0aacc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.584800 8921 ts_tablet_manager.cc:1434] T 89ae9cb00ef14b5d9d88dfb94a55e5d5 P 4532b54a008a4a39b663112e6d0aacc0: Time spent starting tablet: real 0.007s user 0.001s sys 0.000s
I20260321 03:02:29.585484 8266 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e: Sending DeleteTablet for 3 replicas of tablet 47e6f8a096804dc7900db99f931d14fc
I20260321 03:02:29.586217 8512 tablet_service.cc:1558] Processing DeleteTablet for tablet 47e6f8a096804dc7900db99f931d14fc with delete_type TABLET_DATA_DELETED (replaced by tablet ffa603a7e8404c968e09e26e5b277911) from {username='slave'} at 127.0.0.1:51684
I20260321 03:02:29.586941 8647 tablet_service.cc:1558] Processing DeleteTablet for tablet 47e6f8a096804dc7900db99f931d14fc with delete_type TABLET_DATA_DELETED (replaced by tablet ffa603a7e8404c968e09e26e5b277911) from {username='slave'} at 127.0.0.1:35520
I20260321 03:02:29.587838 8784 tablet_service.cc:1558] Processing DeleteTablet for tablet 47e6f8a096804dc7900db99f931d14fc with delete_type TABLET_DATA_DELETED (replaced by tablet ffa603a7e8404c968e09e26e5b277911) from {username='slave'} at 127.0.0.1:58810
I20260321 03:02:29.588081 8927 tablet_replica.cc:333] T 47e6f8a096804dc7900db99f931d14fc P a97f7dd77cf2444f8fdb441019081f79: stopping tablet replica
I20260321 03:02:29.588312 8927 raft_consensus.cc:2243] T 47e6f8a096804dc7900db99f931d14fc P a97f7dd77cf2444f8fdb441019081f79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260321 03:02:29.588542 8927 raft_consensus.cc:2272] T 47e6f8a096804dc7900db99f931d14fc P a97f7dd77cf2444f8fdb441019081f79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260321 03:02:29.588837 8266 catalog_manager.cc:6741] ReplaceTablet: tablet 47e6f8a096804dc7900db99f931d14fc deleted and replaced by tablet ffa603a7e8404c968e09e26e5b277911
I20260321 03:02:29.590571 8922 tablet_bootstrap.cc:492] T 4718c06ec4ed4452b91483eb6e1ae067 P a97f7dd77cf2444f8fdb441019081f79: Bootstrap starting.
I20260321 03:02:29.590819 8513 tablet_service.cc:1511] Processing CreateTablet for tablet 4718c06ec4ed4452b91483eb6e1ae067 (DEFAULT_TABLE table=default.table_628c329100ff4b269d91d561af863424 [id=94ef39d020ab428b9e0392bedab9483d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:29.591120 8513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4718c06ec4ed4452b91483eb6e1ae067. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:29.591746 8922 tablet_bootstrap.cc:654] T 4718c06ec4ed4452b91483eb6e1ae067 P a97f7dd77cf2444f8fdb441019081f79: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:29.594379 8648 tablet_service.cc:1511] Processing CreateTablet for tablet 4718c06ec4ed4452b91483eb6e1ae067 (DEFAULT_TABLE table=default.table_628c329100ff4b269d91d561af863424 [id=94ef39d020ab428b9e0392bedab9483d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:29.594748 8648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4718c06ec4ed4452b91483eb6e1ae067. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:29.598150 8266 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39954:
table { table_name: "default.Table_9731292f060b48d7a3b304a142988570" } modify_external_catalogs: true
I20260321 03:02:29.598327 8266 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39954:
table { table_name: "default.Table_9731292f060b48d7a3b304a142988570" } modify_external_catalogs: true
I20260321 03:02:29.600637 8783 tablet_service.cc:1511] Processing CreateTablet for tablet 27330be65bac450a8ead355d41fe780e (DEFAULT_TABLE table=default.table_9bbd1f43ebe347ed99a9be3a6ffb3d86 [id=4ac1925a391a48ea86c63da0c1d8c442]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:29.601073 8783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27330be65bac450a8ead355d41fe780e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:29.603996 8513 tablet_service.cc:1511] Processing CreateTablet for tablet 27330be65bac450a8ead355d41fe780e (DEFAULT_TABLE table=default.table_9bbd1f43ebe347ed99a9be3a6ffb3d86 [id=4ac1925a391a48ea86c63da0c1d8c442]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:29.604436 8648 tablet_service.cc:1511] Processing CreateTablet for tablet 27330be65bac450a8ead355d41fe780e (DEFAULT_TABLE table=default.table_9bbd1f43ebe347ed99a9be3a6ffb3d86 [id=4ac1925a391a48ea86c63da0c1d8c442]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:29.604831 8513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27330be65bac450a8ead355d41fe780e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:29.605095 8648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27330be65bac450a8ead355d41fe780e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:29.606624 8926 ts_tablet_manager.cc:1929] T a4bfa1cd32ac40cb800860d336c99fd7 P 4532b54a008a4a39b663112e6d0aacc0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260321 03:02:29.606727 8926 log.cc:1199] T a4bfa1cd32ac40cb800860d336c99fd7 P 4532b54a008a4a39b663112e6d0aacc0: Deleting WAL directory at /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-0/wal/wals/a4bfa1cd32ac40cb800860d336c99fd7
I20260321 03:02:29.607030 8926 ts_tablet_manager.cc:1950] T a4bfa1cd32ac40cb800860d336c99fd7 P 4532b54a008a4a39b663112e6d0aacc0: Deleting consensus metadata
I20260321 03:02:29.607331 8925 tablet_replica.cc:333] T 21aed83ce6884ca4859df11cc5bcf49c P 70e7666c46844503beb466fdc054a6fc: stopping tablet replica
I20260321 03:02:29.607481 8925 raft_consensus.cc:2243] T 21aed83ce6884ca4859df11cc5bcf49c P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260321 03:02:29.607611 8925 raft_consensus.cc:2272] T 21aed83ce6884ca4859df11cc5bcf49c P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260321 03:02:29.607959 8921 tablet_bootstrap.cc:492] T 4718c06ec4ed4452b91483eb6e1ae067 P 4532b54a008a4a39b663112e6d0aacc0: Bootstrap starting.
I20260321 03:02:29.609040 8921 tablet_bootstrap.cc:654] T 4718c06ec4ed4452b91483eb6e1ae067 P 4532b54a008a4a39b663112e6d0aacc0: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:29.610009 8925 ts_tablet_manager.cc:1916] T 21aed83ce6884ca4859df11cc5bcf49c P 70e7666c46844503beb466fdc054a6fc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260321 03:02:29.610867 8922 tablet_bootstrap.cc:492] T 4718c06ec4ed4452b91483eb6e1ae067 P a97f7dd77cf2444f8fdb441019081f79: No bootstrap required, opened a new log
I20260321 03:02:29.610980 8922 ts_tablet_manager.cc:1403] T 4718c06ec4ed4452b91483eb6e1ae067 P a97f7dd77cf2444f8fdb441019081f79: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.000s
I20260321 03:02:29.611622 8922 raft_consensus.cc:359] T 4718c06ec4ed4452b91483eb6e1ae067 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.611745 8922 raft_consensus.cc:385] T 4718c06ec4ed4452b91483eb6e1ae067 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:29.611783 8922 raft_consensus.cc:740] T 4718c06ec4ed4452b91483eb6e1ae067 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a97f7dd77cf2444f8fdb441019081f79, State: Initialized, Role: FOLLOWER
I20260321 03:02:29.611910 8922 consensus_queue.cc:260] T 4718c06ec4ed4452b91483eb6e1ae067 P a97f7dd77cf2444f8fdb441019081f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.612213 8922 ts_tablet_manager.cc:1434] T 4718c06ec4ed4452b91483eb6e1ae067 P a97f7dd77cf2444f8fdb441019081f79: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260321 03:02:29.612411 8922 tablet_bootstrap.cc:492] T 27330be65bac450a8ead355d41fe780e P a97f7dd77cf2444f8fdb441019081f79: Bootstrap starting.
I20260321 03:02:29.612468 8927 ts_tablet_manager.cc:1916] T 47e6f8a096804dc7900db99f931d14fc P a97f7dd77cf2444f8fdb441019081f79: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260321 03:02:29.613726 8922 tablet_bootstrap.cc:654] T 27330be65bac450a8ead355d41fe780e P a97f7dd77cf2444f8fdb441019081f79: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:29.615003 8927 ts_tablet_manager.cc:1929] T 47e6f8a096804dc7900db99f931d14fc P a97f7dd77cf2444f8fdb441019081f79: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260321 03:02:29.615079 8927 log.cc:1199] T 47e6f8a096804dc7900db99f931d14fc P a97f7dd77cf2444f8fdb441019081f79: Deleting WAL directory at /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-2/wal/wals/47e6f8a096804dc7900db99f931d14fc
I20260321 03:02:29.615091 8926 tablet_replica.cc:333] T 21aed83ce6884ca4859df11cc5bcf49c P 4532b54a008a4a39b663112e6d0aacc0: stopping tablet replica
I20260321 03:02:29.615247 8926 raft_consensus.cc:2243] T 21aed83ce6884ca4859df11cc5bcf49c P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260321 03:02:29.615295 8927 ts_tablet_manager.cc:1950] T 47e6f8a096804dc7900db99f931d14fc P a97f7dd77cf2444f8fdb441019081f79: Deleting consensus metadata
I20260321 03:02:29.615253 8258 catalog_manager.cc:5002] TS 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171): tablet a4bfa1cd32ac40cb800860d336c99fd7 (table default.table_628c329100ff4b269d91d561af863424 [id=94ef39d020ab428b9e0392bedab9483d]) successfully deleted
I20260321 03:02:29.615362 8926 raft_consensus.cc:2272] T 21aed83ce6884ca4859df11cc5bcf49c P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260321 03:02:29.615896 8926 ts_tablet_manager.cc:1916] T 21aed83ce6884ca4859df11cc5bcf49c P 4532b54a008a4a39b663112e6d0aacc0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260321 03:02:29.616259 8260 catalog_manager.cc:5002] TS a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): tablet 47e6f8a096804dc7900db99f931d14fc (table default.table_a658f97fed3c4b3eabbfcbb9018b388f [id=9bc91b7f6cb8477ab6ed1ee5ed74f608]) successfully deleted
I20260321 03:02:29.618109 8926 ts_tablet_manager.cc:1929] T 21aed83ce6884ca4859df11cc5bcf49c P 4532b54a008a4a39b663112e6d0aacc0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260321 03:02:29.618221 8926 log.cc:1199] T 21aed83ce6884ca4859df11cc5bcf49c P 4532b54a008a4a39b663112e6d0aacc0: Deleting WAL directory at /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-0/wal/wals/21aed83ce6884ca4859df11cc5bcf49c
I20260321 03:02:29.618427 8926 ts_tablet_manager.cc:1950] T 21aed83ce6884ca4859df11cc5bcf49c P 4532b54a008a4a39b663112e6d0aacc0: Deleting consensus metadata
I20260321 03:02:29.619449 8258 catalog_manager.cc:5002] TS 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171): tablet 21aed83ce6884ca4859df11cc5bcf49c (table default.table_9bbd1f43ebe347ed99a9be3a6ffb3d86 [id=4ac1925a391a48ea86c63da0c1d8c442]) successfully deleted
I20260321 03:02:29.620122 8925 ts_tablet_manager.cc:1929] T 21aed83ce6884ca4859df11cc5bcf49c P 70e7666c46844503beb466fdc054a6fc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260321 03:02:29.620219 8925 log.cc:1199] T 21aed83ce6884ca4859df11cc5bcf49c P 70e7666c46844503beb466fdc054a6fc: Deleting WAL directory at /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-1/wal/wals/21aed83ce6884ca4859df11cc5bcf49c
I20260321 03:02:29.620443 8925 ts_tablet_manager.cc:1950] T 21aed83ce6884ca4859df11cc5bcf49c P 70e7666c46844503beb466fdc054a6fc: Deleting consensus metadata
I20260321 03:02:29.620405 8783 tablet_service.cc:1511] Processing CreateTablet for tablet ffa603a7e8404c968e09e26e5b277911 (DEFAULT_TABLE table=default.table_a658f97fed3c4b3eabbfcbb9018b388f [id=9bc91b7f6cb8477ab6ed1ee5ed74f608]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:29.620630 8513 tablet_service.cc:1511] Processing CreateTablet for tablet ffa603a7e8404c968e09e26e5b277911 (DEFAULT_TABLE table=default.table_a658f97fed3c4b3eabbfcbb9018b388f [id=9bc91b7f6cb8477ab6ed1ee5ed74f608]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:29.620766 8783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffa603a7e8404c968e09e26e5b277911. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:29.620985 8513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffa603a7e8404c968e09e26e5b277911. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:29.621156 8925 tablet_replica.cc:333] T 47e6f8a096804dc7900db99f931d14fc P 70e7666c46844503beb466fdc054a6fc: stopping tablet replica
I20260321 03:02:29.621330 8925 raft_consensus.cc:2243] T 47e6f8a096804dc7900db99f931d14fc P 70e7666c46844503beb466fdc054a6fc [term 1 LEADER]: Raft consensus shutting down.
I20260321 03:02:29.621320 8257 catalog_manager.cc:5002] TS 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): tablet 21aed83ce6884ca4859df11cc5bcf49c (table default.table_9bbd1f43ebe347ed99a9be3a6ffb3d86 [id=4ac1925a391a48ea86c63da0c1d8c442]) successfully deleted
I20260321 03:02:29.621631 8925 pending_rounds.cc:70] T 47e6f8a096804dc7900db99f931d14fc P 70e7666c46844503beb466fdc054a6fc: Trying to abort 1 pending ops.
I20260321 03:02:29.621752 8925 pending_rounds.cc:77] T 47e6f8a096804dc7900db99f931d14fc P 70e7666c46844503beb466fdc054a6fc: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7266558563225088000 op_type: NO_OP noop_request { }
I20260321 03:02:29.621865 8925 raft_consensus.cc:2889] T 47e6f8a096804dc7900db99f931d14fc P 70e7666c46844503beb466fdc054a6fc [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260321 03:02:29.621948 8925 raft_consensus.cc:2272] T 47e6f8a096804dc7900db99f931d14fc P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260321 03:02:29.623703 8648 tablet_service.cc:1511] Processing CreateTablet for tablet ffa603a7e8404c968e09e26e5b277911 (DEFAULT_TABLE table=default.table_a658f97fed3c4b3eabbfcbb9018b388f [id=9bc91b7f6cb8477ab6ed1ee5ed74f608]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:29.623986 8648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffa603a7e8404c968e09e26e5b277911. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:29.624128 8926 tablet_replica.cc:333] T 47e6f8a096804dc7900db99f931d14fc P 4532b54a008a4a39b663112e6d0aacc0: stopping tablet replica
I20260321 03:02:29.624318 8926 raft_consensus.cc:2243] T 47e6f8a096804dc7900db99f931d14fc P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260321 03:02:29.624475 8926 raft_consensus.cc:2272] T 47e6f8a096804dc7900db99f931d14fc P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260321 03:02:29.625221 8925 ts_tablet_manager.cc:1916] T 47e6f8a096804dc7900db99f931d14fc P 70e7666c46844503beb466fdc054a6fc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260321 03:02:29.625993 8926 ts_tablet_manager.cc:1916] T 47e6f8a096804dc7900db99f931d14fc P 4532b54a008a4a39b663112e6d0aacc0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260321 03:02:29.627615 8925 ts_tablet_manager.cc:1929] T 47e6f8a096804dc7900db99f931d14fc P 70e7666c46844503beb466fdc054a6fc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260321 03:02:29.627753 8925 log.cc:1199] T 47e6f8a096804dc7900db99f931d14fc P 70e7666c46844503beb466fdc054a6fc: Deleting WAL directory at /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-1/wal/wals/47e6f8a096804dc7900db99f931d14fc
I20260321 03:02:29.628065 8925 ts_tablet_manager.cc:1950] T 47e6f8a096804dc7900db99f931d14fc P 70e7666c46844503beb466fdc054a6fc: Deleting consensus metadata
I20260321 03:02:29.628312 8926 ts_tablet_manager.cc:1929] T 47e6f8a096804dc7900db99f931d14fc P 4532b54a008a4a39b663112e6d0aacc0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260321 03:02:29.628392 8926 log.cc:1199] T 47e6f8a096804dc7900db99f931d14fc P 4532b54a008a4a39b663112e6d0aacc0: Deleting WAL directory at /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-0/wal/wals/47e6f8a096804dc7900db99f931d14fc
I20260321 03:02:29.628604 8926 ts_tablet_manager.cc:1950] T 47e6f8a096804dc7900db99f931d14fc P 4532b54a008a4a39b663112e6d0aacc0: Deleting consensus metadata
I20260321 03:02:29.629163 8257 catalog_manager.cc:5002] TS 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): tablet 47e6f8a096804dc7900db99f931d14fc (table default.table_a658f97fed3c4b3eabbfcbb9018b388f [id=9bc91b7f6cb8477ab6ed1ee5ed74f608]) successfully deleted
I20260321 03:02:29.629532 8923 tablet_bootstrap.cc:492] T 89ae9cb00ef14b5d9d88dfb94a55e5d5 P 70e7666c46844503beb466fdc054a6fc: No bootstrap required, opened a new log
I20260321 03:02:29.629575 8921 tablet_bootstrap.cc:492] T 4718c06ec4ed4452b91483eb6e1ae067 P 4532b54a008a4a39b663112e6d0aacc0: No bootstrap required, opened a new log
I20260321 03:02:29.629633 8923 ts_tablet_manager.cc:1403] T 89ae9cb00ef14b5d9d88dfb94a55e5d5 P 70e7666c46844503beb466fdc054a6fc: Time spent bootstrapping tablet: real 0.097s user 0.000s sys 0.002s
I20260321 03:02:29.629652 8921 ts_tablet_manager.cc:1403] T 4718c06ec4ed4452b91483eb6e1ae067 P 4532b54a008a4a39b663112e6d0aacc0: Time spent bootstrapping tablet: real 0.022s user 0.000s sys 0.002s
I20260321 03:02:29.630138 8921 raft_consensus.cc:359] T 4718c06ec4ed4452b91483eb6e1ae067 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.630138 8923 raft_consensus.cc:359] T 89ae9cb00ef14b5d9d88dfb94a55e5d5 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.630266 8921 raft_consensus.cc:385] T 4718c06ec4ed4452b91483eb6e1ae067 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:29.630271 8923 raft_consensus.cc:385] T 89ae9cb00ef14b5d9d88dfb94a55e5d5 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:29.630309 8923 raft_consensus.cc:740] T 89ae9cb00ef14b5d9d88dfb94a55e5d5 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70e7666c46844503beb466fdc054a6fc, State: Initialized, Role: FOLLOWER
I20260321 03:02:29.630309 8921 raft_consensus.cc:740] T 4718c06ec4ed4452b91483eb6e1ae067 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4532b54a008a4a39b663112e6d0aacc0, State: Initialized, Role: FOLLOWER
I20260321 03:02:29.630439 8923 consensus_queue.cc:260] T 89ae9cb00ef14b5d9d88dfb94a55e5d5 P 70e7666c46844503beb466fdc054a6fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.630439 8921 consensus_queue.cc:260] T 4718c06ec4ed4452b91483eb6e1ae067 P 4532b54a008a4a39b663112e6d0aacc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.630716 8923 ts_tablet_manager.cc:1434] T 89ae9cb00ef14b5d9d88dfb94a55e5d5 P 70e7666c46844503beb466fdc054a6fc: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260321 03:02:29.630719 8921 ts_tablet_manager.cc:1434] T 4718c06ec4ed4452b91483eb6e1ae067 P 4532b54a008a4a39b663112e6d0aacc0: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260321 03:02:29.630935 8923 tablet_bootstrap.cc:492] T 4718c06ec4ed4452b91483eb6e1ae067 P 70e7666c46844503beb466fdc054a6fc: Bootstrap starting.
I20260321 03:02:29.631439 8921 tablet_bootstrap.cc:492] T 27330be65bac450a8ead355d41fe780e P 4532b54a008a4a39b663112e6d0aacc0: Bootstrap starting.
I20260321 03:02:29.632032 8922 tablet_bootstrap.cc:492] T 27330be65bac450a8ead355d41fe780e P a97f7dd77cf2444f8fdb441019081f79: No bootstrap required, opened a new log
I20260321 03:02:29.632151 8922 ts_tablet_manager.cc:1403] T 27330be65bac450a8ead355d41fe780e P a97f7dd77cf2444f8fdb441019081f79: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.000s
I20260321 03:02:29.632352 8923 tablet_bootstrap.cc:654] T 4718c06ec4ed4452b91483eb6e1ae067 P 70e7666c46844503beb466fdc054a6fc: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:29.632496 8921 tablet_bootstrap.cc:654] T 27330be65bac450a8ead355d41fe780e P 4532b54a008a4a39b663112e6d0aacc0: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:29.632665 8922 raft_consensus.cc:359] T 27330be65bac450a8ead355d41fe780e P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.632781 8922 raft_consensus.cc:385] T 27330be65bac450a8ead355d41fe780e P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:29.632824 8922 raft_consensus.cc:740] T 27330be65bac450a8ead355d41fe780e P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a97f7dd77cf2444f8fdb441019081f79, State: Initialized, Role: FOLLOWER
I20260321 03:02:29.632963 8922 consensus_queue.cc:260] T 27330be65bac450a8ead355d41fe780e P a97f7dd77cf2444f8fdb441019081f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.633282 8922 ts_tablet_manager.cc:1434] T 27330be65bac450a8ead355d41fe780e P a97f7dd77cf2444f8fdb441019081f79: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260321 03:02:29.635713 8922 tablet_bootstrap.cc:492] T ffa603a7e8404c968e09e26e5b277911 P a97f7dd77cf2444f8fdb441019081f79: Bootstrap starting.
I20260321 03:02:29.638281 8922 tablet_bootstrap.cc:654] T ffa603a7e8404c968e09e26e5b277911 P a97f7dd77cf2444f8fdb441019081f79: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:29.641187 9034 raft_consensus.cc:493] T 4718c06ec4ed4452b91483eb6e1ae067 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260321 03:02:29.641366 9034 raft_consensus.cc:515] T 4718c06ec4ed4452b91483eb6e1ae067 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.641794 9034 leader_election.cc:290] T 4718c06ec4ed4452b91483eb6e1ae067 P a97f7dd77cf2444f8fdb441019081f79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171), 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713)
I20260321 03:02:29.642480 8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4718c06ec4ed4452b91483eb6e1ae067" candidate_uuid: "a97f7dd77cf2444f8fdb441019081f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4532b54a008a4a39b663112e6d0aacc0" is_pre_election: true
I20260321 03:02:29.642491 8258 catalog_manager.cc:5002] TS 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171): tablet 47e6f8a096804dc7900db99f931d14fc (table default.table_a658f97fed3c4b3eabbfcbb9018b388f [id=9bc91b7f6cb8477ab6ed1ee5ed74f608]) successfully deleted
I20260321 03:02:29.642635 8531 raft_consensus.cc:2468] T 4718c06ec4ed4452b91483eb6e1ae067 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a97f7dd77cf2444f8fdb441019081f79 in term 0.
I20260321 03:02:29.643105 8923 tablet_bootstrap.cc:492] T 4718c06ec4ed4452b91483eb6e1ae067 P 70e7666c46844503beb466fdc054a6fc: No bootstrap required, opened a new log
I20260321 03:02:29.643204 8667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4718c06ec4ed4452b91483eb6e1ae067" candidate_uuid: "a97f7dd77cf2444f8fdb441019081f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70e7666c46844503beb466fdc054a6fc" is_pre_election: true
W20260321 03:02:29.643877 8737 leader_election.cc:343] T 4718c06ec4ed4452b91483eb6e1ae067 P a97f7dd77cf2444f8fdb441019081f79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Illegal state: must be running to vote when last-logged opid is not known
I20260321 03:02:29.644040 8738 leader_election.cc:304] T 4718c06ec4ed4452b91483eb6e1ae067 P a97f7dd77cf2444f8fdb441019081f79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0, a97f7dd77cf2444f8fdb441019081f79; no voters: 70e7666c46844503beb466fdc054a6fc
I20260321 03:02:29.644258 9034 raft_consensus.cc:2804] T 4718c06ec4ed4452b91483eb6e1ae067 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260321 03:02:29.644320 9034 raft_consensus.cc:493] T 4718c06ec4ed4452b91483eb6e1ae067 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260321 03:02:29.644366 9034 raft_consensus.cc:3060] T 4718c06ec4ed4452b91483eb6e1ae067 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:29.643216 8923 ts_tablet_manager.cc:1403] T 4718c06ec4ed4452b91483eb6e1ae067 P 70e7666c46844503beb466fdc054a6fc: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.002s
I20260321 03:02:29.645094 8923 raft_consensus.cc:359] T 4718c06ec4ed4452b91483eb6e1ae067 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.645205 8923 raft_consensus.cc:385] T 4718c06ec4ed4452b91483eb6e1ae067 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:29.645239 8923 raft_consensus.cc:740] T 4718c06ec4ed4452b91483eb6e1ae067 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70e7666c46844503beb466fdc054a6fc, State: Initialized, Role: FOLLOWER
I20260321 03:02:29.645429 8923 consensus_queue.cc:260] T 4718c06ec4ed4452b91483eb6e1ae067 P 70e7666c46844503beb466fdc054a6fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.645572 9034 raft_consensus.cc:515] T 4718c06ec4ed4452b91483eb6e1ae067 P a97f7dd77cf2444f8fdb441019081f79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.645735 8923 ts_tablet_manager.cc:1434] T 4718c06ec4ed4452b91483eb6e1ae067 P 70e7666c46844503beb466fdc054a6fc: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260321 03:02:29.645939 8923 tablet_bootstrap.cc:492] T 27330be65bac450a8ead355d41fe780e P 70e7666c46844503beb466fdc054a6fc: Bootstrap starting.
I20260321 03:02:29.645978 9034 leader_election.cc:290] T 4718c06ec4ed4452b91483eb6e1ae067 P a97f7dd77cf2444f8fdb441019081f79 [CANDIDATE]: Term 1 election: Requested vote from peers 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171), 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713)
I20260321 03:02:29.647100 8923 tablet_bootstrap.cc:654] T 27330be65bac450a8ead355d41fe780e P 70e7666c46844503beb466fdc054a6fc: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:29.648391 8932 raft_consensus.cc:493] T 89ae9cb00ef14b5d9d88dfb94a55e5d5 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260321 03:02:29.648491 8932 raft_consensus.cc:515] T 89ae9cb00ef14b5d9d88dfb94a55e5d5 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.642480 8921 tablet_bootstrap.cc:492] T 27330be65bac450a8ead355d41fe780e P 4532b54a008a4a39b663112e6d0aacc0: No bootstrap required, opened a new log
I20260321 03:02:29.648753 8921 ts_tablet_manager.cc:1403] T 27330be65bac450a8ead355d41fe780e P 4532b54a008a4a39b663112e6d0aacc0: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.001s
I20260321 03:02:29.648887 8932 leader_election.cc:290] T 89ae9cb00ef14b5d9d88dfb94a55e5d5 P 70e7666c46844503beb466fdc054a6fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
I20260321 03:02:29.649466 8921 raft_consensus.cc:359] T 27330be65bac450a8ead355d41fe780e P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.649660 8921 raft_consensus.cc:385] T 27330be65bac450a8ead355d41fe780e P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:29.649756 8921 raft_consensus.cc:740] T 27330be65bac450a8ead355d41fe780e P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4532b54a008a4a39b663112e6d0aacc0, State: Initialized, Role: FOLLOWER
I20260321 03:02:29.649978 8922 tablet_bootstrap.cc:492] T ffa603a7e8404c968e09e26e5b277911 P a97f7dd77cf2444f8fdb441019081f79: No bootstrap required, opened a new log
I20260321 03:02:29.649976 8921 consensus_queue.cc:260] T 27330be65bac450a8ead355d41fe780e P 4532b54a008a4a39b663112e6d0aacc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.650086 8922 ts_tablet_manager.cc:1403] T ffa603a7e8404c968e09e26e5b277911 P a97f7dd77cf2444f8fdb441019081f79: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.000s
I20260321 03:02:29.650188 8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ae9cb00ef14b5d9d88dfb94a55e5d5" candidate_uuid: "70e7666c46844503beb466fdc054a6fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4532b54a008a4a39b663112e6d0aacc0" is_pre_election: true
I20260321 03:02:29.650334 8531 raft_consensus.cc:2468] T 89ae9cb00ef14b5d9d88dfb94a55e5d5 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70e7666c46844503beb466fdc054a6fc in term 0.
I20260321 03:02:29.650408 8921 ts_tablet_manager.cc:1434] T 27330be65bac450a8ead355d41fe780e P 4532b54a008a4a39b663112e6d0aacc0: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260321 03:02:29.650753 8921 tablet_bootstrap.cc:492] T ffa603a7e8404c968e09e26e5b277911 P 4532b54a008a4a39b663112e6d0aacc0: Bootstrap starting.
I20260321 03:02:29.650750 8922 raft_consensus.cc:359] T ffa603a7e8404c968e09e26e5b277911 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.650856 8922 raft_consensus.cc:385] T ffa603a7e8404c968e09e26e5b277911 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:29.650887 8922 raft_consensus.cc:740] T ffa603a7e8404c968e09e26e5b277911 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a97f7dd77cf2444f8fdb441019081f79, State: Initialized, Role: FOLLOWER
I20260321 03:02:29.651050 8922 consensus_queue.cc:260] T ffa603a7e8404c968e09e26e5b277911 P a97f7dd77cf2444f8fdb441019081f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.651357 8922 ts_tablet_manager.cc:1434] T ffa603a7e8404c968e09e26e5b277911 P a97f7dd77cf2444f8fdb441019081f79: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260321 03:02:29.651916 8921 tablet_bootstrap.cc:654] T ffa603a7e8404c968e09e26e5b277911 P 4532b54a008a4a39b663112e6d0aacc0: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:29.652211 8265 catalog_manager.cc:2174] created HMS catalog entry for table [id=c7602cbc743a43239656449386fbeb83]
I20260321 03:02:29.652297 8602 leader_election.cc:304] T 89ae9cb00ef14b5d9d88dfb94a55e5d5 P 70e7666c46844503beb466fdc054a6fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0, 70e7666c46844503beb466fdc054a6fc; no voters:
I20260321 03:02:29.654325 8923 tablet_bootstrap.cc:492] T 27330be65bac450a8ead355d41fe780e P 70e7666c46844503beb466fdc054a6fc: No bootstrap required, opened a new log
I20260321 03:02:29.654419 8923 ts_tablet_manager.cc:1403] T 27330be65bac450a8ead355d41fe780e P 70e7666c46844503beb466fdc054a6fc: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.002s
I20260321 03:02:29.654979 8923 raft_consensus.cc:359] T 27330be65bac450a8ead355d41fe780e P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.655094 8923 raft_consensus.cc:385] T 27330be65bac450a8ead355d41fe780e P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:29.655128 8923 raft_consensus.cc:740] T 27330be65bac450a8ead355d41fe780e P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70e7666c46844503beb466fdc054a6fc, State: Initialized, Role: FOLLOWER
I20260321 03:02:29.655294 8923 consensus_queue.cc:260] T 27330be65bac450a8ead355d41fe780e P 70e7666c46844503beb466fdc054a6fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.655455 8940 raft_consensus.cc:2804] T 89ae9cb00ef14b5d9d88dfb94a55e5d5 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260321 03:02:29.655498 8940 raft_consensus.cc:493] T 89ae9cb00ef14b5d9d88dfb94a55e5d5 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260321 03:02:29.655532 8940 raft_consensus.cc:3060] T 89ae9cb00ef14b5d9d88dfb94a55e5d5 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:29.656824 8940 raft_consensus.cc:515] T 89ae9cb00ef14b5d9d88dfb94a55e5d5 P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.657326 8940 leader_election.cc:290] T 89ae9cb00ef14b5d9d88dfb94a55e5d5 P 70e7666c46844503beb466fdc054a6fc [CANDIDATE]: Term 1 election: Requested vote from peers 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
I20260321 03:02:29.657819 8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ae9cb00ef14b5d9d88dfb94a55e5d5" candidate_uuid: "70e7666c46844503beb466fdc054a6fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a97f7dd77cf2444f8fdb441019081f79" is_pre_election: true
I20260321 03:02:29.657956 8803 raft_consensus.cc:2468] T 89ae9cb00ef14b5d9d88dfb94a55e5d5 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70e7666c46844503beb466fdc054a6fc in term 0.
I20260321 03:02:29.658229 8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ae9cb00ef14b5d9d88dfb94a55e5d5" candidate_uuid: "70e7666c46844503beb466fdc054a6fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a97f7dd77cf2444f8fdb441019081f79"
I20260321 03:02:29.658344 8804 raft_consensus.cc:3060] T 89ae9cb00ef14b5d9d88dfb94a55e5d5 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:29.658833 8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4718c06ec4ed4452b91483eb6e1ae067" candidate_uuid: "a97f7dd77cf2444f8fdb441019081f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4532b54a008a4a39b663112e6d0aacc0"
I20260321 03:02:29.658954 8532 raft_consensus.cc:3060] T 4718c06ec4ed4452b91483eb6e1ae067 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:29.659478 8804 raft_consensus.cc:2468] T 89ae9cb00ef14b5d9d88dfb94a55e5d5 P a97f7dd77cf2444f8fdb441019081f79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70e7666c46844503beb466fdc054a6fc in term 1.
I20260321 03:02:29.659739 8667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4718c06ec4ed4452b91483eb6e1ae067" candidate_uuid: "a97f7dd77cf2444f8fdb441019081f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70e7666c46844503beb466fdc054a6fc"
I20260321 03:02:29.659844 8667 raft_consensus.cc:3060] T 4718c06ec4ed4452b91483eb6e1ae067 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:29.659893 8532 raft_consensus.cc:2468] T 4718c06ec4ed4452b91483eb6e1ae067 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a97f7dd77cf2444f8fdb441019081f79 in term 1.
I20260321 03:02:29.660755 8667 raft_consensus.cc:2468] T 4718c06ec4ed4452b91483eb6e1ae067 P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a97f7dd77cf2444f8fdb441019081f79 in term 1.
I20260321 03:02:29.662236 8923 ts_tablet_manager.cc:1434] T 27330be65bac450a8ead355d41fe780e P 70e7666c46844503beb466fdc054a6fc: Time spent starting tablet: real 0.008s user 0.000s sys 0.001s
I20260321 03:02:29.662470 8923 tablet_bootstrap.cc:492] T ffa603a7e8404c968e09e26e5b277911 P 70e7666c46844503beb466fdc054a6fc: Bootstrap starting.
I20260321 03:02:29.663739 8738 leader_election.cc:304] T 4718c06ec4ed4452b91483eb6e1ae067 P a97f7dd77cf2444f8fdb441019081f79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0, a97f7dd77cf2444f8fdb441019081f79; no voters:
I20260321 03:02:29.663782 8923 tablet_bootstrap.cc:654] T ffa603a7e8404c968e09e26e5b277911 P 70e7666c46844503beb466fdc054a6fc: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:29.664043 8931 raft_consensus.cc:2804] T 4718c06ec4ed4452b91483eb6e1ae067 P a97f7dd77cf2444f8fdb441019081f79 [term 1 FOLLOWER]: Leader election won for term 1
I20260321 03:02:29.664124 8931 raft_consensus.cc:697] T 4718c06ec4ed4452b91483eb6e1ae067 P a97f7dd77cf2444f8fdb441019081f79 [term 1 LEADER]: Becoming Leader. State: Replica: a97f7dd77cf2444f8fdb441019081f79, State: Running, Role: LEADER
I20260321 03:02:29.664093 8265 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:39954 (request call id 9) took 1247 ms. Trace:
I20260321 03:02:29.664300 8931 consensus_queue.cc:237] T 4718c06ec4ed4452b91483eb6e1ae067 P a97f7dd77cf2444f8fdb441019081f79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.664165 8265 rpcz_store.cc:276] 0321 03:02:28.416110 (+ 0us) service_pool.cc:168] Inserting onto call queue
0321 03:02:28.416154 (+ 44us) service_pool.cc:225] Handling call
0321 03:02:28.939475 (+523321us) catalog_manager.cc:2101] Acquired catalog manager lock
0321 03:02:28.939901 (+ 426us) catalog_manager.cc:2147] Created new table and tablet info
0321 03:02:29.652203 (+712302us) catalog_manager.cc:2173] Created new table in HMS catalog
0321 03:02:29.663848 (+ 11645us) catalog_manager.cc:2207] Wrote table and tablets to system table
0321 03:02:29.663958 (+ 110us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0321 03:02:29.664064 (+ 106us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0321 03:02:29.653138 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0321 03:02:29.653302 (+ 164us) write_op.cc:432] Acquiring schema lock in shared mode
0321 03:02:29.653307 (+ 5us) write_op.cc:435] Acquired schema lock
0321 03:02:29.653309 (+ 2us) tablet.cc:661] Decoding operations
0321 03:02:29.653385 (+ 76us) write_op.cc:620] Acquiring the partition lock for write op
0321 03:02:29.653396 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0321 03:02:29.653399 (+ 3us) tablet.cc:684] Acquiring locks for 2 operations
0321 03:02:29.653458 (+ 59us) tablet.cc:700] Row locks acquired
0321 03:02:29.653460 (+ 2us) write_op.cc:260] PREPARE: finished
0321 03:02:29.653496 (+ 36us) write_op.cc:270] Start()
0321 03:02:29.653529 (+ 33us) write_op.cc:276] Timestamp: P: 1774062149653433 usec, L: 0
0321 03:02:29.653531 (+ 2us) op_driver.cc:348] REPLICATION: starting
0321 03:02:29.653686 (+ 155us) log.cc:844] Serialized 432 byte log entry
0321 03:02:29.662616 (+ 8930us) op_driver.cc:464] REPLICATION: finished
0321 03:02:29.662732 (+ 116us) write_op.cc:301] APPLY: starting
0321 03:02:29.662751 (+ 19us) tablet.cc:1366] starting BulkCheckPresence
0321 03:02:29.662786 (+ 35us) tablet.cc:1369] finished BulkCheckPresence
0321 03:02:29.662807 (+ 21us) tablet.cc:1371] starting ApplyRowOperation cycle
0321 03:02:29.662896 (+ 89us) tablet.cc:1382] finished ApplyRowOperation cycle
0321 03:02:29.662927 (+ 31us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0321 03:02:29.662932 (+ 5us) write_op.cc:312] APPLY: finished
0321 03:02:29.663008 (+ 76us) log.cc:844] Serialized 28 byte log entry
0321 03:02:29.663066 (+ 58us) write_op.cc:489] Releasing partition, row and schema locks
0321 03:02:29.663087 (+ 21us) write_op.cc:454] Released schema lock
0321 03:02:29.663092 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0321 03:02:29.663164 (+ 72us) write_op.cc:489] Releasing partition, row and schema locks
0321 03:02:29.663167 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":561198,"Hive Metastore.run_cpu_time_us":269,"Hive Metastore.run_wall_time_us":150789,"child_traces":[["op",{"apply.queue_time_us":74,"apply.run_cpu_time_us":418,"apply.run_wall_time_us":417,"num_ops":2,"prepare.queue_time_us":417,"prepare.run_cpu_time_us":639,"prepare.run_wall_time_us":640,"raft.queue_time_us":679,"raft.run_cpu_time_us":257,"raft.run_wall_time_us":258,"replication_time_us":9047}]]}
I20260321 03:02:29.667124 8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ae9cb00ef14b5d9d88dfb94a55e5d5" candidate_uuid: "70e7666c46844503beb466fdc054a6fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4532b54a008a4a39b663112e6d0aacc0"
I20260321 03:02:29.667299 8531 raft_consensus.cc:3060] T 89ae9cb00ef14b5d9d88dfb94a55e5d5 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:29.668505 8531 raft_consensus.cc:2468] T 89ae9cb00ef14b5d9d88dfb94a55e5d5 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70e7666c46844503beb466fdc054a6fc in term 1.
I20260321 03:02:29.668996 8602 leader_election.cc:304] T 89ae9cb00ef14b5d9d88dfb94a55e5d5 P 70e7666c46844503beb466fdc054a6fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0, 70e7666c46844503beb466fdc054a6fc; no voters:
I20260321 03:02:29.669243 8932 raft_consensus.cc:2804] T 89ae9cb00ef14b5d9d88dfb94a55e5d5 P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Leader election won for term 1
I20260321 03:02:29.669356 8932 raft_consensus.cc:697] T 89ae9cb00ef14b5d9d88dfb94a55e5d5 P 70e7666c46844503beb466fdc054a6fc [term 1 LEADER]: Becoming Leader. State: Replica: 70e7666c46844503beb466fdc054a6fc, State: Running, Role: LEADER
I20260321 03:02:29.669495 8932 consensus_queue.cc:237] T 89ae9cb00ef14b5d9d88dfb94a55e5d5 P 70e7666c46844503beb466fdc054a6fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.677155 8923 tablet_bootstrap.cc:492] T ffa603a7e8404c968e09e26e5b277911 P 70e7666c46844503beb466fdc054a6fc: No bootstrap required, opened a new log
I20260321 03:02:29.677312 8923 ts_tablet_manager.cc:1403] T ffa603a7e8404c968e09e26e5b277911 P 70e7666c46844503beb466fdc054a6fc: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.002s
I20260321 03:02:29.678205 8923 raft_consensus.cc:359] T ffa603a7e8404c968e09e26e5b277911 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.678337 8923 raft_consensus.cc:385] T ffa603a7e8404c968e09e26e5b277911 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:29.678370 8923 raft_consensus.cc:740] T ffa603a7e8404c968e09e26e5b277911 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70e7666c46844503beb466fdc054a6fc, State: Initialized, Role: FOLLOWER
I20260321 03:02:29.678532 8923 consensus_queue.cc:260] T ffa603a7e8404c968e09e26e5b277911 P 70e7666c46844503beb466fdc054a6fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.678911 8923 ts_tablet_manager.cc:1434] T ffa603a7e8404c968e09e26e5b277911 P 70e7666c46844503beb466fdc054a6fc: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260321 03:02:29.679765 8921 tablet_bootstrap.cc:492] T ffa603a7e8404c968e09e26e5b277911 P 4532b54a008a4a39b663112e6d0aacc0: No bootstrap required, opened a new log
I20260321 03:02:29.679868 8921 ts_tablet_manager.cc:1403] T ffa603a7e8404c968e09e26e5b277911 P 4532b54a008a4a39b663112e6d0aacc0: Time spent bootstrapping tablet: real 0.029s user 0.002s sys 0.000s
I20260321 03:02:29.680368 8921 raft_consensus.cc:359] T ffa603a7e8404c968e09e26e5b277911 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.680490 8921 raft_consensus.cc:385] T ffa603a7e8404c968e09e26e5b277911 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:29.680523 8921 raft_consensus.cc:740] T ffa603a7e8404c968e09e26e5b277911 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4532b54a008a4a39b663112e6d0aacc0, State: Initialized, Role: FOLLOWER
I20260321 03:02:29.680644 8921 consensus_queue.cc:260] T ffa603a7e8404c968e09e26e5b277911 P 4532b54a008a4a39b663112e6d0aacc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.680909 8921 ts_tablet_manager.cc:1434] T ffa603a7e8404c968e09e26e5b277911 P 4532b54a008a4a39b663112e6d0aacc0: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260321 03:02:29.687600 8648 tablet_service.cc:1511] Processing CreateTablet for tablet d4496a81bf2f40cdb82cc4cbdd24dd20 (DEFAULT_TABLE table=default.table_06e0fbe90fe0411d95d76f56b53fb175 [id=c7602cbc743a43239656449386fbeb83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:29.687942 8648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4496a81bf2f40cdb82cc4cbdd24dd20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:29.690445 8923 tablet_bootstrap.cc:492] T d4496a81bf2f40cdb82cc4cbdd24dd20 P 70e7666c46844503beb466fdc054a6fc: Bootstrap starting.
I20260321 03:02:29.691642 8923 tablet_bootstrap.cc:654] T d4496a81bf2f40cdb82cc4cbdd24dd20 P 70e7666c46844503beb466fdc054a6fc: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:29.693369 8783 tablet_service.cc:1511] Processing CreateTablet for tablet d4496a81bf2f40cdb82cc4cbdd24dd20 (DEFAULT_TABLE table=default.table_06e0fbe90fe0411d95d76f56b53fb175 [id=c7602cbc743a43239656449386fbeb83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:29.693497 8513 tablet_service.cc:1511] Processing CreateTablet for tablet d4496a81bf2f40cdb82cc4cbdd24dd20 (DEFAULT_TABLE table=default.table_06e0fbe90fe0411d95d76f56b53fb175 [id=c7602cbc743a43239656449386fbeb83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:29.693709 8783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4496a81bf2f40cdb82cc4cbdd24dd20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:29.693791 8513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4496a81bf2f40cdb82cc4cbdd24dd20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:29.696139 8922 tablet_bootstrap.cc:492] T d4496a81bf2f40cdb82cc4cbdd24dd20 P a97f7dd77cf2444f8fdb441019081f79: Bootstrap starting.
I20260321 03:02:29.696278 8921 tablet_bootstrap.cc:492] T d4496a81bf2f40cdb82cc4cbdd24dd20 P 4532b54a008a4a39b663112e6d0aacc0: Bootstrap starting.
I20260321 03:02:29.697271 8922 tablet_bootstrap.cc:654] T d4496a81bf2f40cdb82cc4cbdd24dd20 P a97f7dd77cf2444f8fdb441019081f79: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:29.697244 8921 tablet_bootstrap.cc:654] T d4496a81bf2f40cdb82cc4cbdd24dd20 P 4532b54a008a4a39b663112e6d0aacc0: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:29.699919 8923 tablet_bootstrap.cc:492] T d4496a81bf2f40cdb82cc4cbdd24dd20 P 70e7666c46844503beb466fdc054a6fc: No bootstrap required, opened a new log
I20260321 03:02:29.700044 8923 ts_tablet_manager.cc:1403] T d4496a81bf2f40cdb82cc4cbdd24dd20 P 70e7666c46844503beb466fdc054a6fc: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.001s
I20260321 03:02:29.700588 8923 raft_consensus.cc:359] T d4496a81bf2f40cdb82cc4cbdd24dd20 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.700731 8923 raft_consensus.cc:385] T d4496a81bf2f40cdb82cc4cbdd24dd20 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:29.700773 8923 raft_consensus.cc:740] T d4496a81bf2f40cdb82cc4cbdd24dd20 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70e7666c46844503beb466fdc054a6fc, State: Initialized, Role: FOLLOWER
I20260321 03:02:29.700960 8923 consensus_queue.cc:260] T d4496a81bf2f40cdb82cc4cbdd24dd20 P 70e7666c46844503beb466fdc054a6fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.701349 8923 ts_tablet_manager.cc:1434] T d4496a81bf2f40cdb82cc4cbdd24dd20 P 70e7666c46844503beb466fdc054a6fc: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20260321 03:02:29.701500 8265 catalog_manager.cc:5671] T 4718c06ec4ed4452b91483eb6e1ae067 P a97f7dd77cf2444f8fdb441019081f79 reported cstate change: term changed from 0 to 1, leader changed from <none> to a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195). New cstate: current_term: 1 leader_uuid: "a97f7dd77cf2444f8fdb441019081f79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } health_report { overall_health: HEALTHY } } }
I20260321 03:02:29.708746 8265 catalog_manager.cc:5671] T 89ae9cb00ef14b5d9d88dfb94a55e5d5 P 70e7666c46844503beb466fdc054a6fc reported cstate change: term changed from 0 to 1, leader changed from <none> to 70e7666c46844503beb466fdc054a6fc (127.7.178.194). New cstate: current_term: 1 leader_uuid: "70e7666c46844503beb466fdc054a6fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } health_report { overall_health: UNKNOWN } } }
I20260321 03:02:29.711246 8922 tablet_bootstrap.cc:492] T d4496a81bf2f40cdb82cc4cbdd24dd20 P a97f7dd77cf2444f8fdb441019081f79: No bootstrap required, opened a new log
I20260321 03:02:29.711273 8921 tablet_bootstrap.cc:492] T d4496a81bf2f40cdb82cc4cbdd24dd20 P 4532b54a008a4a39b663112e6d0aacc0: No bootstrap required, opened a new log
I20260321 03:02:29.711366 8921 ts_tablet_manager.cc:1403] T d4496a81bf2f40cdb82cc4cbdd24dd20 P 4532b54a008a4a39b663112e6d0aacc0: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.000s
I20260321 03:02:29.711366 8922 ts_tablet_manager.cc:1403] T d4496a81bf2f40cdb82cc4cbdd24dd20 P a97f7dd77cf2444f8fdb441019081f79: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.000s
I20260321 03:02:29.711870 8921 raft_consensus.cc:359] T d4496a81bf2f40cdb82cc4cbdd24dd20 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.711871 8922 raft_consensus.cc:359] T d4496a81bf2f40cdb82cc4cbdd24dd20 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.711985 8921 raft_consensus.cc:385] T d4496a81bf2f40cdb82cc4cbdd24dd20 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:29.711985 8922 raft_consensus.cc:385] T d4496a81bf2f40cdb82cc4cbdd24dd20 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:29.712020 8922 raft_consensus.cc:740] T d4496a81bf2f40cdb82cc4cbdd24dd20 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a97f7dd77cf2444f8fdb441019081f79, State: Initialized, Role: FOLLOWER
I20260321 03:02:29.712020 8921 raft_consensus.cc:740] T d4496a81bf2f40cdb82cc4cbdd24dd20 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4532b54a008a4a39b663112e6d0aacc0, State: Initialized, Role: FOLLOWER
I20260321 03:02:29.712157 8921 consensus_queue.cc:260] T d4496a81bf2f40cdb82cc4cbdd24dd20 P 4532b54a008a4a39b663112e6d0aacc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.712419 8922 consensus_queue.cc:260] T d4496a81bf2f40cdb82cc4cbdd24dd20 P a97f7dd77cf2444f8fdb441019081f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.712478 8921 ts_tablet_manager.cc:1434] T d4496a81bf2f40cdb82cc4cbdd24dd20 P 4532b54a008a4a39b663112e6d0aacc0: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260321 03:02:29.712725 8922 ts_tablet_manager.cc:1434] T d4496a81bf2f40cdb82cc4cbdd24dd20 P a97f7dd77cf2444f8fdb441019081f79: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260321 03:02:29.719012 8265 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39954:
name: "default.Table_492554e7d97c4920bdf854ca950c0179"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260321 03:02:29.732684 9034 raft_consensus.cc:493] T c8b7587407f64cbd8f6cbe2dd048547e P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260321 03:02:29.732838 9034 raft_consensus.cc:515] T c8b7587407f64cbd8f6cbe2dd048547e P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.733580 9034 leader_election.cc:290] T c8b7587407f64cbd8f6cbe2dd048547e P a97f7dd77cf2444f8fdb441019081f79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171), 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713)
I20260321 03:02:29.734166 8667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8b7587407f64cbd8f6cbe2dd048547e" candidate_uuid: "a97f7dd77cf2444f8fdb441019081f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70e7666c46844503beb466fdc054a6fc" is_pre_election: true
I20260321 03:02:29.734334 8667 raft_consensus.cc:2468] T c8b7587407f64cbd8f6cbe2dd048547e P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a97f7dd77cf2444f8fdb441019081f79 in term 0.
I20260321 03:02:29.734961 8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8b7587407f64cbd8f6cbe2dd048547e" candidate_uuid: "a97f7dd77cf2444f8fdb441019081f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4532b54a008a4a39b663112e6d0aacc0" is_pre_election: true
I20260321 03:02:29.735136 8531 raft_consensus.cc:2468] T c8b7587407f64cbd8f6cbe2dd048547e P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a97f7dd77cf2444f8fdb441019081f79 in term 0.
I20260321 03:02:29.735502 8738 leader_election.cc:304] T c8b7587407f64cbd8f6cbe2dd048547e P a97f7dd77cf2444f8fdb441019081f79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0, a97f7dd77cf2444f8fdb441019081f79; no voters:
I20260321 03:02:29.735970 9034 raft_consensus.cc:2804] T c8b7587407f64cbd8f6cbe2dd048547e P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260321 03:02:29.736042 9034 raft_consensus.cc:493] T c8b7587407f64cbd8f6cbe2dd048547e P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260321 03:02:29.736086 9034 raft_consensus.cc:3060] T c8b7587407f64cbd8f6cbe2dd048547e P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:29.737229 9034 raft_consensus.cc:515] T c8b7587407f64cbd8f6cbe2dd048547e P a97f7dd77cf2444f8fdb441019081f79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.737671 9034 leader_election.cc:290] T c8b7587407f64cbd8f6cbe2dd048547e P a97f7dd77cf2444f8fdb441019081f79 [CANDIDATE]: Term 1 election: Requested vote from peers 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171), 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713)
I20260321 03:02:29.738152 8667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8b7587407f64cbd8f6cbe2dd048547e" candidate_uuid: "a97f7dd77cf2444f8fdb441019081f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70e7666c46844503beb466fdc054a6fc"
I20260321 03:02:29.738291 8667 raft_consensus.cc:3060] T c8b7587407f64cbd8f6cbe2dd048547e P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:29.739349 8667 raft_consensus.cc:2468] T c8b7587407f64cbd8f6cbe2dd048547e P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a97f7dd77cf2444f8fdb441019081f79 in term 1.
I20260321 03:02:29.740217 8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8b7587407f64cbd8f6cbe2dd048547e" candidate_uuid: "a97f7dd77cf2444f8fdb441019081f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4532b54a008a4a39b663112e6d0aacc0"
I20260321 03:02:29.740371 8531 raft_consensus.cc:3060] T c8b7587407f64cbd8f6cbe2dd048547e P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:29.744639 8737 leader_election.cc:304] T c8b7587407f64cbd8f6cbe2dd048547e P a97f7dd77cf2444f8fdb441019081f79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79; no voters:
I20260321 03:02:29.745236 8531 raft_consensus.cc:2468] T c8b7587407f64cbd8f6cbe2dd048547e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a97f7dd77cf2444f8fdb441019081f79 in term 1.
I20260321 03:02:29.748376 9034 raft_consensus.cc:2804] T c8b7587407f64cbd8f6cbe2dd048547e P a97f7dd77cf2444f8fdb441019081f79 [term 1 FOLLOWER]: Leader election won for term 1
I20260321 03:02:29.748521 9034 raft_consensus.cc:697] T c8b7587407f64cbd8f6cbe2dd048547e P a97f7dd77cf2444f8fdb441019081f79 [term 1 LEADER]: Becoming Leader. State: Replica: a97f7dd77cf2444f8fdb441019081f79, State: Running, Role: LEADER
I20260321 03:02:29.748679 9034 consensus_queue.cc:237] T c8b7587407f64cbd8f6cbe2dd048547e P a97f7dd77cf2444f8fdb441019081f79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.751940 8940 raft_consensus.cc:493] T ffa603a7e8404c968e09e26e5b277911 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260321 03:02:29.752081 8940 raft_consensus.cc:515] T ffa603a7e8404c968e09e26e5b277911 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.752511 8940 leader_election.cc:290] T ffa603a7e8404c968e09e26e5b277911 P 70e7666c46844503beb466fdc054a6fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
I20260321 03:02:29.753852 8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffa603a7e8404c968e09e26e5b277911" candidate_uuid: "70e7666c46844503beb466fdc054a6fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a97f7dd77cf2444f8fdb441019081f79" is_pre_election: true
I20260321 03:02:29.753995 8804 raft_consensus.cc:2468] T ffa603a7e8404c968e09e26e5b277911 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70e7666c46844503beb466fdc054a6fc in term 0.
I20260321 03:02:29.754504 8604 leader_election.cc:304] T ffa603a7e8404c968e09e26e5b277911 P 70e7666c46844503beb466fdc054a6fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79; no voters:
I20260321 03:02:29.754860 8940 raft_consensus.cc:2804] T ffa603a7e8404c968e09e26e5b277911 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260321 03:02:29.754922 8940 raft_consensus.cc:493] T ffa603a7e8404c968e09e26e5b277911 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260321 03:02:29.754963 8940 raft_consensus.cc:3060] T ffa603a7e8404c968e09e26e5b277911 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:29.756111 8940 raft_consensus.cc:515] T ffa603a7e8404c968e09e26e5b277911 P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.756546 8940 leader_election.cc:290] T ffa603a7e8404c968e09e26e5b277911 P 70e7666c46844503beb466fdc054a6fc [CANDIDATE]: Term 1 election: Requested vote from peers 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
I20260321 03:02:29.758339 8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffa603a7e8404c968e09e26e5b277911" candidate_uuid: "70e7666c46844503beb466fdc054a6fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4532b54a008a4a39b663112e6d0aacc0"
I20260321 03:02:29.758509 8532 raft_consensus.cc:3060] T ffa603a7e8404c968e09e26e5b277911 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:29.759171 8267 catalog_manager.cc:2174] created HMS catalog entry for table [id=9f5de6240b844d57991fc673d061fbf4]
I20260321 03:02:29.759611 8532 raft_consensus.cc:2468] T ffa603a7e8404c968e09e26e5b277911 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70e7666c46844503beb466fdc054a6fc in term 1.
I20260321 03:02:29.760181 8602 leader_election.cc:304] T ffa603a7e8404c968e09e26e5b277911 P 70e7666c46844503beb466fdc054a6fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0, 70e7666c46844503beb466fdc054a6fc; no voters:
I20260321 03:02:29.761312 8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffa603a7e8404c968e09e26e5b277911" candidate_uuid: "70e7666c46844503beb466fdc054a6fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a97f7dd77cf2444f8fdb441019081f79"
I20260321 03:02:29.761490 8804 raft_consensus.cc:3060] T ffa603a7e8404c968e09e26e5b277911 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:29.762586 8804 raft_consensus.cc:2468] T ffa603a7e8404c968e09e26e5b277911 P a97f7dd77cf2444f8fdb441019081f79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70e7666c46844503beb466fdc054a6fc in term 1.
I20260321 03:02:29.763391 8267 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:39954 (request call id 7) took 1347 ms. Trace:
I20260321 03:02:29.763486 8267 rpcz_store.cc:276] 0321 03:02:28.415963 (+ 0us) service_pool.cc:168] Inserting onto call queue
0321 03:02:28.417419 (+ 1456us) service_pool.cc:225] Handling call
0321 03:02:28.940281 (+522862us) catalog_manager.cc:2101] Acquired catalog manager lock
0321 03:02:28.940605 (+ 324us) catalog_manager.cc:2147] Created new table and tablet info
0321 03:02:29.759163 (+818558us) catalog_manager.cc:2173] Created new table in HMS catalog
0321 03:02:29.763176 (+ 4013us) catalog_manager.cc:2207] Wrote table and tablets to system table
0321 03:02:29.763282 (+ 106us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0321 03:02:29.763374 (+ 92us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0321 03:02:29.759722 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0321 03:02:29.759856 (+ 134us) write_op.cc:432] Acquiring schema lock in shared mode
0321 03:02:29.759860 (+ 4us) write_op.cc:435] Acquired schema lock
0321 03:02:29.759862 (+ 2us) tablet.cc:661] Decoding operations
0321 03:02:29.759941 (+ 79us) write_op.cc:620] Acquiring the partition lock for write op
0321 03:02:29.759952 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0321 03:02:29.759955 (+ 3us) tablet.cc:684] Acquiring locks for 2 operations
0321 03:02:29.760031 (+ 76us) tablet.cc:700] Row locks acquired
0321 03:02:29.760032 (+ 1us) write_op.cc:260] PREPARE: finished
0321 03:02:29.760069 (+ 37us) write_op.cc:270] Start()
0321 03:02:29.760102 (+ 33us) write_op.cc:276] Timestamp: P: 1774062149759998 usec, L: 0
0321 03:02:29.760104 (+ 2us) op_driver.cc:348] REPLICATION: starting
0321 03:02:29.760297 (+ 193us) log.cc:844] Serialized 432 byte log entry
0321 03:02:29.762635 (+ 2338us) op_driver.cc:464] REPLICATION: finished
0321 03:02:29.762754 (+ 119us) write_op.cc:301] APPLY: starting
0321 03:02:29.762775 (+ 21us) tablet.cc:1366] starting BulkCheckPresence
0321 03:02:29.762811 (+ 36us) tablet.cc:1369] finished BulkCheckPresence
0321 03:02:29.762826 (+ 15us) tablet.cc:1371] starting ApplyRowOperation cycle
0321 03:02:29.762911 (+ 85us) tablet.cc:1382] finished ApplyRowOperation cycle
0321 03:02:29.762942 (+ 31us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0321 03:02:29.762948 (+ 6us) write_op.cc:312] APPLY: finished
0321 03:02:29.763010 (+ 62us) log.cc:844] Serialized 28 byte log entry
0321 03:02:29.763063 (+ 53us) write_op.cc:489] Releasing partition, row and schema locks
0321 03:02:29.763081 (+ 18us) write_op.cc:454] Released schema lock
0321 03:02:29.763086 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0321 03:02:29.763173 (+ 87us) write_op.cc:489] Releasing partition, row and schema locks
0321 03:02:29.763177 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":711326,"Hive Metastore.run_cpu_time_us":248,"Hive Metastore.run_wall_time_us":106951,"child_traces":[["op",{"apply.queue_time_us":72,"apply.run_cpu_time_us":399,"apply.run_wall_time_us":398,"num_ops":2,"prepare.queue_time_us":46,"prepare.run_cpu_time_us":679,"prepare.run_wall_time_us":679,"raft.queue_time_us":139,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":211,"replication_time_us":2496}]]}
I20260321 03:02:29.774031 8513 tablet_service.cc:1511] Processing CreateTablet for tablet ed96f3685d004f6f94f50db2651acc1f (DEFAULT_TABLE table=default.table_f8b27d78677b44468e403c75afa5245a [id=9f5de6240b844d57991fc673d061fbf4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:29.774117 8783 tablet_service.cc:1511] Processing CreateTablet for tablet ed96f3685d004f6f94f50db2651acc1f (DEFAULT_TABLE table=default.table_f8b27d78677b44468e403c75afa5245a [id=9f5de6240b844d57991fc673d061fbf4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:29.774144 8267 catalog_manager.cc:5671] T c8b7587407f64cbd8f6cbe2dd048547e P a97f7dd77cf2444f8fdb441019081f79 reported cstate change: term changed from 0 to 1, leader changed from <none> to a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195). New cstate: current_term: 1 leader_uuid: "a97f7dd77cf2444f8fdb441019081f79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } health_report { overall_health: HEALTHY } } }
I20260321 03:02:29.774425 8513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed96f3685d004f6f94f50db2651acc1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:29.774444 8783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed96f3685d004f6f94f50db2651acc1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:29.777033 8921 tablet_bootstrap.cc:492] T ed96f3685d004f6f94f50db2651acc1f P 4532b54a008a4a39b663112e6d0aacc0: Bootstrap starting.
I20260321 03:02:29.778580 8921 tablet_bootstrap.cc:654] T ed96f3685d004f6f94f50db2651acc1f P 4532b54a008a4a39b663112e6d0aacc0: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:29.780009 8922 tablet_bootstrap.cc:492] T ed96f3685d004f6f94f50db2651acc1f P a97f7dd77cf2444f8fdb441019081f79: Bootstrap starting.
I20260321 03:02:29.780326 8648 tablet_service.cc:1511] Processing CreateTablet for tablet ed96f3685d004f6f94f50db2651acc1f (DEFAULT_TABLE table=default.table_f8b27d78677b44468e403c75afa5245a [id=9f5de6240b844d57991fc673d061fbf4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:29.780666 8648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed96f3685d004f6f94f50db2651acc1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:29.781524 8922 tablet_bootstrap.cc:654] T ed96f3685d004f6f94f50db2651acc1f P a97f7dd77cf2444f8fdb441019081f79: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:29.785853 8267 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39954:
name: "default.Table_9b16e83d2d334faaa3ccd9aaae03ccf7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260321 03:02:29.788246 8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffa603a7e8404c968e09e26e5b277911" candidate_uuid: "70e7666c46844503beb466fdc054a6fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4532b54a008a4a39b663112e6d0aacc0" is_pre_election: true
I20260321 03:02:29.788460 8531 raft_consensus.cc:2376] T ffa603a7e8404c968e09e26e5b277911 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 70e7666c46844503beb466fdc054a6fc in term 1. Re-sending same reply.
I20260321 03:02:29.790135 8923 tablet_bootstrap.cc:492] T ed96f3685d004f6f94f50db2651acc1f P 70e7666c46844503beb466fdc054a6fc: Bootstrap starting.
I20260321 03:02:29.790558 8940 raft_consensus.cc:2804] T ffa603a7e8404c968e09e26e5b277911 P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Leader election won for term 1
I20260321 03:02:29.790648 8940 raft_consensus.cc:697] T ffa603a7e8404c968e09e26e5b277911 P 70e7666c46844503beb466fdc054a6fc [term 1 LEADER]: Becoming Leader. State: Replica: 70e7666c46844503beb466fdc054a6fc, State: Running, Role: LEADER
I20260321 03:02:29.790802 8940 consensus_queue.cc:237] T ffa603a7e8404c968e09e26e5b277911 P 70e7666c46844503beb466fdc054a6fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.791368 8923 tablet_bootstrap.cc:654] T ed96f3685d004f6f94f50db2651acc1f P 70e7666c46844503beb466fdc054a6fc: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:29.802383 9034 raft_consensus.cc:493] T d4496a81bf2f40cdb82cc4cbdd24dd20 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260321 03:02:29.802511 9035 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7451d7c0a71f4620a6607f74b5a22f2e. Latest consensus state: current_term: 1 leader_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } } }
I20260321 03:02:29.802587 9034 raft_consensus.cc:515] T d4496a81bf2f40cdb82cc4cbdd24dd20 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.802675 9035 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [sys.catalog]: This master's current role is: FOLLOWER
I20260321 03:02:29.803126 9034 leader_election.cc:290] T d4496a81bf2f40cdb82cc4cbdd24dd20 P a97f7dd77cf2444f8fdb441019081f79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171), 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713)
I20260321 03:02:29.804461 8940 raft_consensus.cc:493] T 27330be65bac450a8ead355d41fe780e P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260321 03:02:29.804934 8667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4496a81bf2f40cdb82cc4cbdd24dd20" candidate_uuid: "a97f7dd77cf2444f8fdb441019081f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70e7666c46844503beb466fdc054a6fc" is_pre_election: true
I20260321 03:02:29.804876 8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4496a81bf2f40cdb82cc4cbdd24dd20" candidate_uuid: "a97f7dd77cf2444f8fdb441019081f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4532b54a008a4a39b663112e6d0aacc0" is_pre_election: true
I20260321 03:02:29.805209 8940 raft_consensus.cc:515] T 27330be65bac450a8ead355d41fe780e P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.805581 8667 raft_consensus.cc:2468] T d4496a81bf2f40cdb82cc4cbdd24dd20 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a97f7dd77cf2444f8fdb441019081f79 in term 0.
I20260321 03:02:29.805768 8531 raft_consensus.cc:2468] T d4496a81bf2f40cdb82cc4cbdd24dd20 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a97f7dd77cf2444f8fdb441019081f79 in term 0.
I20260321 03:02:29.806725 8737 leader_election.cc:304] T d4496a81bf2f40cdb82cc4cbdd24dd20 P a97f7dd77cf2444f8fdb441019081f79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79; no voters:
I20260321 03:02:29.807787 8940 leader_election.cc:290] T 27330be65bac450a8ead355d41fe780e P 70e7666c46844503beb466fdc054a6fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
I20260321 03:02:29.808627 8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27330be65bac450a8ead355d41fe780e" candidate_uuid: "70e7666c46844503beb466fdc054a6fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a97f7dd77cf2444f8fdb441019081f79" is_pre_election: true
I20260321 03:02:29.808795 8804 raft_consensus.cc:2468] T 27330be65bac450a8ead355d41fe780e P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70e7666c46844503beb466fdc054a6fc in term 0.
I20260321 03:02:29.809114 8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27330be65bac450a8ead355d41fe780e" candidate_uuid: "70e7666c46844503beb466fdc054a6fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4532b54a008a4a39b663112e6d0aacc0" is_pre_election: true
I20260321 03:02:29.809289 8531 raft_consensus.cc:2468] T 27330be65bac450a8ead355d41fe780e P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70e7666c46844503beb466fdc054a6fc in term 0.
I20260321 03:02:29.809674 8602 leader_election.cc:304] T 27330be65bac450a8ead355d41fe780e P 70e7666c46844503beb466fdc054a6fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0, 70e7666c46844503beb466fdc054a6fc; no voters:
I20260321 03:02:29.810307 9034 raft_consensus.cc:2804] T d4496a81bf2f40cdb82cc4cbdd24dd20 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260321 03:02:29.810384 9034 raft_consensus.cc:493] T d4496a81bf2f40cdb82cc4cbdd24dd20 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260321 03:02:29.810444 9034 raft_consensus.cc:3060] T d4496a81bf2f40cdb82cc4cbdd24dd20 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:29.811885 9034 raft_consensus.cc:515] T d4496a81bf2f40cdb82cc4cbdd24dd20 P a97f7dd77cf2444f8fdb441019081f79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.812407 9034 leader_election.cc:290] T d4496a81bf2f40cdb82cc4cbdd24dd20 P a97f7dd77cf2444f8fdb441019081f79 [CANDIDATE]: Term 1 election: Requested vote from peers 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171), 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713)
I20260321 03:02:29.813520 8667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4496a81bf2f40cdb82cc4cbdd24dd20" candidate_uuid: "a97f7dd77cf2444f8fdb441019081f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70e7666c46844503beb466fdc054a6fc"
I20260321 03:02:29.813661 8667 raft_consensus.cc:3060] T d4496a81bf2f40cdb82cc4cbdd24dd20 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:29.814431 8922 tablet_bootstrap.cc:492] T ed96f3685d004f6f94f50db2651acc1f P a97f7dd77cf2444f8fdb441019081f79: No bootstrap required, opened a new log
I20260321 03:02:29.814520 8921 tablet_bootstrap.cc:492] T ed96f3685d004f6f94f50db2651acc1f P 4532b54a008a4a39b663112e6d0aacc0: No bootstrap required, opened a new log
I20260321 03:02:29.814532 8922 ts_tablet_manager.cc:1403] T ed96f3685d004f6f94f50db2651acc1f P a97f7dd77cf2444f8fdb441019081f79: Time spent bootstrapping tablet: real 0.035s user 0.002s sys 0.000s
I20260321 03:02:29.814657 8921 ts_tablet_manager.cc:1403] T ed96f3685d004f6f94f50db2651acc1f P 4532b54a008a4a39b663112e6d0aacc0: Time spent bootstrapping tablet: real 0.038s user 0.003s sys 0.000s
I20260321 03:02:29.814764 8667 raft_consensus.cc:2468] T d4496a81bf2f40cdb82cc4cbdd24dd20 P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a97f7dd77cf2444f8fdb441019081f79 in term 1.
I20260321 03:02:29.815083 8922 raft_consensus.cc:359] T ed96f3685d004f6f94f50db2651acc1f P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.815210 8922 raft_consensus.cc:385] T ed96f3685d004f6f94f50db2651acc1f P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:29.815251 8922 raft_consensus.cc:740] T ed96f3685d004f6f94f50db2651acc1f P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a97f7dd77cf2444f8fdb441019081f79, State: Initialized, Role: FOLLOWER
I20260321 03:02:29.815380 8940 raft_consensus.cc:2804] T 27330be65bac450a8ead355d41fe780e P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260321 03:02:29.815399 8922 consensus_queue.cc:260] T ed96f3685d004f6f94f50db2651acc1f P a97f7dd77cf2444f8fdb441019081f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.815449 8940 raft_consensus.cc:493] T 27330be65bac450a8ead355d41fe780e P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260321 03:02:29.815490 8940 raft_consensus.cc:3060] T 27330be65bac450a8ead355d41fe780e P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:29.815704 8922 ts_tablet_manager.cc:1434] T ed96f3685d004f6f94f50db2651acc1f P a97f7dd77cf2444f8fdb441019081f79: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260321 03:02:29.816393 8940 raft_consensus.cc:515] T 27330be65bac450a8ead355d41fe780e P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.816803 8940 leader_election.cc:290] T 27330be65bac450a8ead355d41fe780e P 70e7666c46844503beb466fdc054a6fc [CANDIDATE]: Term 1 election: Requested vote from peers 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
I20260321 03:02:29.817370 8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27330be65bac450a8ead355d41fe780e" candidate_uuid: "70e7666c46844503beb466fdc054a6fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4532b54a008a4a39b663112e6d0aacc0"
I20260321 03:02:29.817485 8923 tablet_bootstrap.cc:492] T ed96f3685d004f6f94f50db2651acc1f P 70e7666c46844503beb466fdc054a6fc: No bootstrap required, opened a new log
I20260321 03:02:29.817497 8532 raft_consensus.cc:3060] T 27330be65bac450a8ead355d41fe780e P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:29.817576 8923 ts_tablet_manager.cc:1403] T ed96f3685d004f6f94f50db2651acc1f P 70e7666c46844503beb466fdc054a6fc: Time spent bootstrapping tablet: real 0.028s user 0.002s sys 0.000s
I20260321 03:02:29.818019 8923 raft_consensus.cc:359] T ed96f3685d004f6f94f50db2651acc1f P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.818105 8923 raft_consensus.cc:385] T ed96f3685d004f6f94f50db2651acc1f P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:29.818136 8923 raft_consensus.cc:740] T ed96f3685d004f6f94f50db2651acc1f P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70e7666c46844503beb466fdc054a6fc, State: Initialized, Role: FOLLOWER
I20260321 03:02:29.818275 8923 consensus_queue.cc:260] T ed96f3685d004f6f94f50db2651acc1f P 70e7666c46844503beb466fdc054a6fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.818487 8532 raft_consensus.cc:2468] T 27330be65bac450a8ead355d41fe780e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70e7666c46844503beb466fdc054a6fc in term 1.
I20260321 03:02:29.818603 8923 ts_tablet_manager.cc:1434] T ed96f3685d004f6f94f50db2651acc1f P 70e7666c46844503beb466fdc054a6fc: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260321 03:02:29.820200 8602 leader_election.cc:304] T 27330be65bac450a8ead355d41fe780e P 70e7666c46844503beb466fdc054a6fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0, 70e7666c46844503beb466fdc054a6fc; no voters:
I20260321 03:02:29.820427 8932 raft_consensus.cc:2804] T 27330be65bac450a8ead355d41fe780e P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Leader election won for term 1
I20260321 03:02:29.820489 8932 raft_consensus.cc:697] T 27330be65bac450a8ead355d41fe780e P 70e7666c46844503beb466fdc054a6fc [term 1 LEADER]: Becoming Leader. State: Replica: 70e7666c46844503beb466fdc054a6fc, State: Running, Role: LEADER
I20260321 03:02:29.820601 8932 consensus_queue.cc:237] T 27330be65bac450a8ead355d41fe780e P 70e7666c46844503beb466fdc054a6fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.815150 8921 raft_consensus.cc:359] T ed96f3685d004f6f94f50db2651acc1f P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.820840 8921 raft_consensus.cc:385] T ed96f3685d004f6f94f50db2651acc1f P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:29.820892 8921 raft_consensus.cc:740] T ed96f3685d004f6f94f50db2651acc1f P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4532b54a008a4a39b663112e6d0aacc0, State: Initialized, Role: FOLLOWER
I20260321 03:02:29.821033 8921 consensus_queue.cc:260] T ed96f3685d004f6f94f50db2651acc1f P 4532b54a008a4a39b663112e6d0aacc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.821359 8921 ts_tablet_manager.cc:1434] T ed96f3685d004f6f94f50db2651acc1f P 4532b54a008a4a39b663112e6d0aacc0: Time spent starting tablet: real 0.007s user 0.001s sys 0.000s
I20260321 03:02:29.823607 8737 leader_election.cc:304] T d4496a81bf2f40cdb82cc4cbdd24dd20 P a97f7dd77cf2444f8fdb441019081f79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79; no voters:
I20260321 03:02:29.823953 9034 raft_consensus.cc:2804] T d4496a81bf2f40cdb82cc4cbdd24dd20 P a97f7dd77cf2444f8fdb441019081f79 [term 1 FOLLOWER]: Leader election won for term 1
I20260321 03:02:29.824033 9034 raft_consensus.cc:697] T d4496a81bf2f40cdb82cc4cbdd24dd20 P a97f7dd77cf2444f8fdb441019081f79 [term 1 LEADER]: Becoming Leader. State: Replica: a97f7dd77cf2444f8fdb441019081f79, State: Running, Role: LEADER
I20260321 03:02:29.824156 9034 consensus_queue.cc:237] T d4496a81bf2f40cdb82cc4cbdd24dd20 P a97f7dd77cf2444f8fdb441019081f79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.824990 8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27330be65bac450a8ead355d41fe780e" candidate_uuid: "70e7666c46844503beb466fdc054a6fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a97f7dd77cf2444f8fdb441019081f79"
I20260321 03:02:29.825093 8804 raft_consensus.cc:3060] T 27330be65bac450a8ead355d41fe780e P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:29.826349 8804 raft_consensus.cc:2468] T 27330be65bac450a8ead355d41fe780e P a97f7dd77cf2444f8fdb441019081f79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70e7666c46844503beb466fdc054a6fc in term 1.
I20260321 03:02:29.830622 8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4496a81bf2f40cdb82cc4cbdd24dd20" candidate_uuid: "a97f7dd77cf2444f8fdb441019081f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4532b54a008a4a39b663112e6d0aacc0"
I20260321 03:02:29.830794 8531 raft_consensus.cc:3060] T d4496a81bf2f40cdb82cc4cbdd24dd20 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:29.832091 8531 raft_consensus.cc:2468] T d4496a81bf2f40cdb82cc4cbdd24dd20 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a97f7dd77cf2444f8fdb441019081f79 in term 1.
I20260321 03:02:29.860268 8264 catalog_manager.cc:2174] created HMS catalog entry for table [id=c6b5b0c7a19649c2b502921f472fc1dc]
I20260321 03:02:29.862458 8912 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } } }
I20260321 03:02:29.862638 8912 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [sys.catalog]: This master's current role is: LEADER
I20260321 03:02:29.869001 8940 consensus_queue.cc:1048] T cc5de6cf47b84822810e38f094ff99ea P 70e7666c46844503beb466fdc054a6fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260321 03:02:29.874336 8264 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:39954 (request call id 10) took 1450 ms. Trace:
I20260321 03:02:29.874445 8264 rpcz_store.cc:276] 0321 03:02:28.423535 (+ 0us) service_pool.cc:168] Inserting onto call queue
0321 03:02:28.423587 (+ 52us) service_pool.cc:225] Handling call
0321 03:02:28.941056 (+517469us) catalog_manager.cc:2101] Acquired catalog manager lock
0321 03:02:28.941661 (+ 605us) catalog_manager.cc:2147] Created new table and tablet info
0321 03:02:29.860251 (+918590us) catalog_manager.cc:2173] Created new table in HMS catalog
0321 03:02:29.874069 (+ 13818us) catalog_manager.cc:2207] Wrote table and tablets to system table
0321 03:02:29.874201 (+ 132us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0321 03:02:29.874313 (+ 112us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0321 03:02:29.860982 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0321 03:02:29.861124 (+ 142us) write_op.cc:432] Acquiring schema lock in shared mode
0321 03:02:29.861128 (+ 4us) write_op.cc:435] Acquired schema lock
0321 03:02:29.861130 (+ 2us) tablet.cc:661] Decoding operations
0321 03:02:29.861214 (+ 84us) write_op.cc:620] Acquiring the partition lock for write op
0321 03:02:29.861225 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0321 03:02:29.861229 (+ 4us) tablet.cc:684] Acquiring locks for 2 operations
0321 03:02:29.861357 (+ 128us) tablet.cc:700] Row locks acquired
0321 03:02:29.861359 (+ 2us) write_op.cc:260] PREPARE: finished
0321 03:02:29.861396 (+ 37us) write_op.cc:270] Start()
0321 03:02:29.861439 (+ 43us) write_op.cc:276] Timestamp: P: 1774062149861374 usec, L: 0
0321 03:02:29.861441 (+ 2us) op_driver.cc:348] REPLICATION: starting
0321 03:02:29.861612 (+ 171us) log.cc:844] Serialized 432 byte log entry
0321 03:02:29.867447 (+ 5835us) op_driver.cc:464] REPLICATION: finished
0321 03:02:29.867539 (+ 92us) write_op.cc:301] APPLY: starting
0321 03:02:29.867556 (+ 17us) tablet.cc:1366] starting BulkCheckPresence
0321 03:02:29.867589 (+ 33us) tablet.cc:1369] finished BulkCheckPresence
0321 03:02:29.867610 (+ 21us) tablet.cc:1371] starting ApplyRowOperation cycle
0321 03:02:29.867703 (+ 93us) tablet.cc:1382] finished ApplyRowOperation cycle
0321 03:02:29.867734 (+ 31us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0321 03:02:29.867738 (+ 4us) write_op.cc:312] APPLY: finished
0321 03:02:29.867805 (+ 67us) log.cc:844] Serialized 28 byte log entry
0321 03:02:29.867862 (+ 57us) write_op.cc:489] Releasing partition, row and schema locks
0321 03:02:29.867880 (+ 18us) write_op.cc:454] Released schema lock
0321 03:02:29.867886 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0321 03:02:29.867951 (+ 65us) write_op.cc:489] Releasing partition, row and schema locks
0321 03:02:29.867953 (+ 2us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":817265,"Hive Metastore.run_cpu_time_us":260,"Hive Metastore.run_wall_time_us":101131,"child_traces":[["op",{"apply.queue_time_us":50,"apply.run_cpu_time_us":400,"apply.run_wall_time_us":398,"leader-initialization.queue_time_us":1799,"leader-initialization.run_cpu_time_us":13,"leader-initialization.run_wall_time_us":15,"num_ops":2,"prepare.queue_time_us":114,"prepare.run_cpu_time_us":746,"prepare.run_wall_time_us":746,"raft.queue_time_us":1175,"raft.run_cpu_time_us":799,"raft.run_wall_time_us":798,"replication_time_us":5972,"thread_start_us":119,"threads_started":1}]]}
I20260321 03:02:29.886968 8940 consensus_queue.cc:1048] T 1806a588d8d24b18a405e1a545d9cdda P 70e7666c46844503beb466fdc054a6fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260321 03:02:29.887322 8940 consensus_queue.cc:1048] T cc5de6cf47b84822810e38f094ff99ea P 70e7666c46844503beb466fdc054a6fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260321 03:02:29.898622 8783 tablet_service.cc:1511] Processing CreateTablet for tablet 90980515c2f14e4abfff2f3e2edf2f16 (DEFAULT_TABLE table=default.table_0e444e840fa14c16a1a1f2e750c73045 [id=c6b5b0c7a19649c2b502921f472fc1dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:29.898944 8783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90980515c2f14e4abfff2f3e2edf2f16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:29.901386 8922 tablet_bootstrap.cc:492] T 90980515c2f14e4abfff2f3e2edf2f16 P a97f7dd77cf2444f8fdb441019081f79: Bootstrap starting.
I20260321 03:02:29.902509 8922 tablet_bootstrap.cc:654] T 90980515c2f14e4abfff2f3e2edf2f16 P a97f7dd77cf2444f8fdb441019081f79: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:29.904026 8513 tablet_service.cc:1511] Processing CreateTablet for tablet 90980515c2f14e4abfff2f3e2edf2f16 (DEFAULT_TABLE table=default.table_0e444e840fa14c16a1a1f2e750c73045 [id=c6b5b0c7a19649c2b502921f472fc1dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:29.904335 8513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90980515c2f14e4abfff2f3e2edf2f16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:29.905716 8264 catalog_manager.cc:5671] T ffa603a7e8404c968e09e26e5b277911 P 70e7666c46844503beb466fdc054a6fc reported cstate change: term changed from 0 to 1, leader changed from <none> to 70e7666c46844503beb466fdc054a6fc (127.7.178.194). New cstate: current_term: 1 leader_uuid: "70e7666c46844503beb466fdc054a6fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } health_report { overall_health: UNKNOWN } } }
I20260321 03:02:29.907270 8940 consensus_queue.cc:1048] T 1806a588d8d24b18a405e1a545d9cdda P 70e7666c46844503beb466fdc054a6fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260321 03:02:29.907821 8648 tablet_service.cc:1511] Processing CreateTablet for tablet 90980515c2f14e4abfff2f3e2edf2f16 (DEFAULT_TABLE table=default.table_0e444e840fa14c16a1a1f2e750c73045 [id=c6b5b0c7a19649c2b502921f472fc1dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:29.908124 8648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90980515c2f14e4abfff2f3e2edf2f16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:29.910614 8921 tablet_bootstrap.cc:492] T 90980515c2f14e4abfff2f3e2edf2f16 P 4532b54a008a4a39b663112e6d0aacc0: Bootstrap starting.
I20260321 03:02:29.911746 8921 tablet_bootstrap.cc:654] T 90980515c2f14e4abfff2f3e2edf2f16 P 4532b54a008a4a39b663112e6d0aacc0: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:29.913414 8923 tablet_bootstrap.cc:492] T 90980515c2f14e4abfff2f3e2edf2f16 P 70e7666c46844503beb466fdc054a6fc: Bootstrap starting.
I20260321 03:02:29.914489 8923 tablet_bootstrap.cc:654] T 90980515c2f14e4abfff2f3e2edf2f16 P 70e7666c46844503beb466fdc054a6fc: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:29.916496 8264 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39954:
table { table_name: "default.Table_ec53d9a55a4c47b8a9b0fa3916c9c561" } modify_external_catalogs: true
I20260321 03:02:29.920147 8264 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39954:
table { table_name: "default.Table_ec53d9a55a4c47b8a9b0fa3916c9c561" } modify_external_catalogs: true
I20260321 03:02:29.927315 8931 raft_consensus.cc:493] T ed96f3685d004f6f94f50db2651acc1f P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260321 03:02:29.927459 8931 raft_consensus.cc:515] T ed96f3685d004f6f94f50db2651acc1f P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.927939 8931 leader_election.cc:290] T ed96f3685d004f6f94f50db2651acc1f P a97f7dd77cf2444f8fdb441019081f79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171), 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713)
I20260321 03:02:29.928481 8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed96f3685d004f6f94f50db2651acc1f" candidate_uuid: "a97f7dd77cf2444f8fdb441019081f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4532b54a008a4a39b663112e6d0aacc0" is_pre_election: true
I20260321 03:02:29.928638 8531 raft_consensus.cc:2468] T ed96f3685d004f6f94f50db2651acc1f P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a97f7dd77cf2444f8fdb441019081f79 in term 0.
I20260321 03:02:29.929013 8738 leader_election.cc:304] T ed96f3685d004f6f94f50db2651acc1f P a97f7dd77cf2444f8fdb441019081f79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0, a97f7dd77cf2444f8fdb441019081f79; no voters:
I20260321 03:02:29.929206 8931 raft_consensus.cc:2804] T ed96f3685d004f6f94f50db2651acc1f P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260321 03:02:29.929281 8931 raft_consensus.cc:493] T ed96f3685d004f6f94f50db2651acc1f P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260321 03:02:29.929333 8931 raft_consensus.cc:3060] T ed96f3685d004f6f94f50db2651acc1f P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:29.930480 8931 raft_consensus.cc:515] T ed96f3685d004f6f94f50db2651acc1f P a97f7dd77cf2444f8fdb441019081f79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.930887 8931 leader_election.cc:290] T ed96f3685d004f6f94f50db2651acc1f P a97f7dd77cf2444f8fdb441019081f79 [CANDIDATE]: Term 1 election: Requested vote from peers 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171), 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713)
I20260321 03:02:29.931465 8922 tablet_bootstrap.cc:492] T 90980515c2f14e4abfff2f3e2edf2f16 P a97f7dd77cf2444f8fdb441019081f79: No bootstrap required, opened a new log
I20260321 03:02:29.931568 8922 ts_tablet_manager.cc:1403] T 90980515c2f14e4abfff2f3e2edf2f16 P a97f7dd77cf2444f8fdb441019081f79: Time spent bootstrapping tablet: real 0.030s user 0.002s sys 0.000s
I20260321 03:02:29.932150 8922 raft_consensus.cc:359] T 90980515c2f14e4abfff2f3e2edf2f16 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.932293 8922 raft_consensus.cc:385] T 90980515c2f14e4abfff2f3e2edf2f16 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:29.932340 8922 raft_consensus.cc:740] T 90980515c2f14e4abfff2f3e2edf2f16 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a97f7dd77cf2444f8fdb441019081f79, State: Initialized, Role: FOLLOWER
I20260321 03:02:29.932463 8922 consensus_queue.cc:260] T 90980515c2f14e4abfff2f3e2edf2f16 P a97f7dd77cf2444f8fdb441019081f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.932798 8922 ts_tablet_manager.cc:1434] T 90980515c2f14e4abfff2f3e2edf2f16 P a97f7dd77cf2444f8fdb441019081f79: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260321 03:02:29.933516 8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed96f3685d004f6f94f50db2651acc1f" candidate_uuid: "a97f7dd77cf2444f8fdb441019081f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4532b54a008a4a39b663112e6d0aacc0"
I20260321 03:02:29.933656 8531 raft_consensus.cc:3060] T ed96f3685d004f6f94f50db2651acc1f P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:29.934681 8531 raft_consensus.cc:2468] T ed96f3685d004f6f94f50db2651acc1f P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a97f7dd77cf2444f8fdb441019081f79 in term 1.
I20260321 03:02:29.935904 8738 leader_election.cc:304] T ed96f3685d004f6f94f50db2651acc1f P a97f7dd77cf2444f8fdb441019081f79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0, a97f7dd77cf2444f8fdb441019081f79; no voters:
I20260321 03:02:29.936196 9034 raft_consensus.cc:2804] T ed96f3685d004f6f94f50db2651acc1f P a97f7dd77cf2444f8fdb441019081f79 [term 1 FOLLOWER]: Leader election won for term 1
I20260321 03:02:29.936269 9034 raft_consensus.cc:697] T ed96f3685d004f6f94f50db2651acc1f P a97f7dd77cf2444f8fdb441019081f79 [term 1 LEADER]: Becoming Leader. State: Replica: a97f7dd77cf2444f8fdb441019081f79, State: Running, Role: LEADER
I20260321 03:02:29.936398 9034 consensus_queue.cc:237] T ed96f3685d004f6f94f50db2651acc1f P a97f7dd77cf2444f8fdb441019081f79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.937954 8667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed96f3685d004f6f94f50db2651acc1f" candidate_uuid: "a97f7dd77cf2444f8fdb441019081f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70e7666c46844503beb466fdc054a6fc" is_pre_election: true
I20260321 03:02:29.938107 8667 raft_consensus.cc:2468] T ed96f3685d004f6f94f50db2651acc1f P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a97f7dd77cf2444f8fdb441019081f79 in term 0.
I20260321 03:02:29.938341 8668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed96f3685d004f6f94f50db2651acc1f" candidate_uuid: "a97f7dd77cf2444f8fdb441019081f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70e7666c46844503beb466fdc054a6fc"
I20260321 03:02:29.938439 8668 raft_consensus.cc:3060] T ed96f3685d004f6f94f50db2651acc1f P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:29.939576 8668 raft_consensus.cc:2468] T ed96f3685d004f6f94f50db2651acc1f P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a97f7dd77cf2444f8fdb441019081f79 in term 1.
I20260321 03:02:29.946873 8921 tablet_bootstrap.cc:492] T 90980515c2f14e4abfff2f3e2edf2f16 P 4532b54a008a4a39b663112e6d0aacc0: No bootstrap required, opened a new log
I20260321 03:02:29.946993 8921 ts_tablet_manager.cc:1403] T 90980515c2f14e4abfff2f3e2edf2f16 P 4532b54a008a4a39b663112e6d0aacc0: Time spent bootstrapping tablet: real 0.036s user 0.002s sys 0.000s
I20260321 03:02:29.947561 8921 raft_consensus.cc:359] T 90980515c2f14e4abfff2f3e2edf2f16 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.947674 8921 raft_consensus.cc:385] T 90980515c2f14e4abfff2f3e2edf2f16 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:29.947702 8921 raft_consensus.cc:740] T 90980515c2f14e4abfff2f3e2edf2f16 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4532b54a008a4a39b663112e6d0aacc0, State: Initialized, Role: FOLLOWER
I20260321 03:02:29.947818 8921 consensus_queue.cc:260] T 90980515c2f14e4abfff2f3e2edf2f16 P 4532b54a008a4a39b663112e6d0aacc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.948432 8921 ts_tablet_manager.cc:1434] T 90980515c2f14e4abfff2f3e2edf2f16 P 4532b54a008a4a39b663112e6d0aacc0: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260321 03:02:29.955232 8923 tablet_bootstrap.cc:492] T 90980515c2f14e4abfff2f3e2edf2f16 P 70e7666c46844503beb466fdc054a6fc: No bootstrap required, opened a new log
I20260321 03:02:29.955364 8923 ts_tablet_manager.cc:1403] T 90980515c2f14e4abfff2f3e2edf2f16 P 70e7666c46844503beb466fdc054a6fc: Time spent bootstrapping tablet: real 0.042s user 0.003s sys 0.000s
I20260321 03:02:29.955931 8923 raft_consensus.cc:359] T 90980515c2f14e4abfff2f3e2edf2f16 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.956048 8923 raft_consensus.cc:385] T 90980515c2f14e4abfff2f3e2edf2f16 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:29.956080 8923 raft_consensus.cc:740] T 90980515c2f14e4abfff2f3e2edf2f16 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70e7666c46844503beb466fdc054a6fc, State: Initialized, Role: FOLLOWER
I20260321 03:02:29.956224 8923 consensus_queue.cc:260] T 90980515c2f14e4abfff2f3e2edf2f16 P 70e7666c46844503beb466fdc054a6fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.956502 8923 ts_tablet_manager.cc:1434] T 90980515c2f14e4abfff2f3e2edf2f16 P 70e7666c46844503beb466fdc054a6fc: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260321 03:02:29.984930 9101 raft_consensus.cc:493] T 90980515c2f14e4abfff2f3e2edf2f16 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260321 03:02:29.985101 9101 raft_consensus.cc:515] T 90980515c2f14e4abfff2f3e2edf2f16 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.985682 9101 leader_election.cc:290] T 90980515c2f14e4abfff2f3e2edf2f16 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
I20260321 03:02:29.986451 8668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90980515c2f14e4abfff2f3e2edf2f16" candidate_uuid: "4532b54a008a4a39b663112e6d0aacc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70e7666c46844503beb466fdc054a6fc" is_pre_election: true
I20260321 03:02:29.986622 8668 raft_consensus.cc:2468] T 90980515c2f14e4abfff2f3e2edf2f16 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4532b54a008a4a39b663112e6d0aacc0 in term 0.
I20260321 03:02:29.986610 8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90980515c2f14e4abfff2f3e2edf2f16" candidate_uuid: "4532b54a008a4a39b663112e6d0aacc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a97f7dd77cf2444f8fdb441019081f79" is_pre_election: true
I20260321 03:02:29.986756 8804 raft_consensus.cc:2468] T 90980515c2f14e4abfff2f3e2edf2f16 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4532b54a008a4a39b663112e6d0aacc0 in term 0.
I20260321 03:02:29.987118 8469 leader_election.cc:304] T 90980515c2f14e4abfff2f3e2edf2f16 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0, a97f7dd77cf2444f8fdb441019081f79; no voters:
I20260321 03:02:29.987677 9101 raft_consensus.cc:2804] T 90980515c2f14e4abfff2f3e2edf2f16 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260321 03:02:29.987747 9101 raft_consensus.cc:493] T 90980515c2f14e4abfff2f3e2edf2f16 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260321 03:02:29.987787 9101 raft_consensus.cc:3060] T 90980515c2f14e4abfff2f3e2edf2f16 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:29.988938 9101 raft_consensus.cc:515] T 90980515c2f14e4abfff2f3e2edf2f16 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:29.989415 9101 leader_election.cc:290] T 90980515c2f14e4abfff2f3e2edf2f16 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 1 election: Requested vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
I20260321 03:02:29.990342 8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90980515c2f14e4abfff2f3e2edf2f16" candidate_uuid: "4532b54a008a4a39b663112e6d0aacc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a97f7dd77cf2444f8fdb441019081f79"
I20260321 03:02:29.990343 8668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90980515c2f14e4abfff2f3e2edf2f16" candidate_uuid: "4532b54a008a4a39b663112e6d0aacc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70e7666c46844503beb466fdc054a6fc"
I20260321 03:02:29.990485 8668 raft_consensus.cc:3060] T 90980515c2f14e4abfff2f3e2edf2f16 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:29.990556 8804 raft_consensus.cc:3060] T 90980515c2f14e4abfff2f3e2edf2f16 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:29.991575 8668 raft_consensus.cc:2468] T 90980515c2f14e4abfff2f3e2edf2f16 P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4532b54a008a4a39b663112e6d0aacc0 in term 1.
I20260321 03:02:29.991598 8804 raft_consensus.cc:2468] T 90980515c2f14e4abfff2f3e2edf2f16 P a97f7dd77cf2444f8fdb441019081f79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4532b54a008a4a39b663112e6d0aacc0 in term 1.
I20260321 03:02:29.992136 8469 leader_election.cc:304] T 90980515c2f14e4abfff2f3e2edf2f16 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0, a97f7dd77cf2444f8fdb441019081f79; no voters:
I20260321 03:02:29.992406 9101 raft_consensus.cc:2804] T 90980515c2f14e4abfff2f3e2edf2f16 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader election won for term 1
I20260321 03:02:29.993010 9101 raft_consensus.cc:697] T 90980515c2f14e4abfff2f3e2edf2f16 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 LEADER]: Becoming Leader. State: Replica: 4532b54a008a4a39b663112e6d0aacc0, State: Running, Role: LEADER
I20260321 03:02:29.993197 9101 consensus_queue.cc:237] T 90980515c2f14e4abfff2f3e2edf2f16 P 4532b54a008a4a39b663112e6d0aacc0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:30.042790 8931 consensus_queue.cc:1048] T 4718c06ec4ed4452b91483eb6e1ae067 P a97f7dd77cf2444f8fdb441019081f79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260321 03:02:30.049422 9034 consensus_queue.cc:1048] T 4718c06ec4ed4452b91483eb6e1ae067 P a97f7dd77cf2444f8fdb441019081f79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260321 03:02:30.112116 9090 consensus_queue.cc:1048] T 89ae9cb00ef14b5d9d88dfb94a55e5d5 P 70e7666c46844503beb466fdc054a6fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260321 03:02:30.119714 9090 consensus_queue.cc:1048] T 89ae9cb00ef14b5d9d88dfb94a55e5d5 P 70e7666c46844503beb466fdc054a6fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260321 03:02:30.212657 9034 consensus_queue.cc:1048] T c8b7587407f64cbd8f6cbe2dd048547e P a97f7dd77cf2444f8fdb441019081f79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260321 03:02:30.221226 8931 consensus_queue.cc:1048] T c8b7587407f64cbd8f6cbe2dd048547e P a97f7dd77cf2444f8fdb441019081f79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260321 03:02:30.225472 9090 consensus_queue.cc:1048] T ffa603a7e8404c968e09e26e5b277911 P 70e7666c46844503beb466fdc054a6fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260321 03:02:30.236313 8273 catalog_manager.cc:3502] renamed table default.table_628c329100ff4b269d91d561af863424 [id=94ef39d020ab428b9e0392bedab9483d] in HMS: new name default.table_10dd23c6f33c4aa0bad0a534fb770d4a
W20260321 03:02:30.239907 8267 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_9b16e83d2d334faaa3ccd9aaae03ccf7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260321 03:02:30.239959 8269 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_01a908196f6d4a1ba499b382b6932d90 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260321 03:02:30.240294 8272 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_79533ce61645417d9d18b6b2820ee1af in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260321 03:02:30.241009 8265 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_492554e7d97c4920bdf854ca950c0179 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260321 03:02:30.242753 8932 consensus_queue.cc:1048] T ffa603a7e8404c968e09e26e5b277911 P 70e7666c46844503beb466fdc054a6fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260321 03:02:30.257215 8273 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:39954 (request call id 11) took 1308 ms. Trace:
I20260321 03:02:30.257336 8273 rpcz_store.cc:276] 0321 03:02:28.948729 (+ 0us) service_pool.cc:168] Inserting onto call queue
0321 03:02:28.948772 (+ 43us) service_pool.cc:225] Handling call
0321 03:02:29.897743 (+948971us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0321 03:02:30.256694 (+358951us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0321 03:02:30.256966 (+ 272us) catalog_manager.cc:3725] Apply alter schema
0321 03:02:30.257190 (+ 224us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":4101,"Hive Metastore.run_cpu_time_us":879,"Hive Metastore.run_wall_time_us":334233}
I20260321 03:02:30.258383 8273 catalog_manager.cc:5671] T d4496a81bf2f40cdb82cc4cbdd24dd20 P a97f7dd77cf2444f8fdb441019081f79 reported cstate change: term changed from 0 to 1, leader changed from <none> to a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195). New cstate: current_term: 1 leader_uuid: "a97f7dd77cf2444f8fdb441019081f79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } health_report { overall_health: HEALTHY } } }
I20260321 03:02:30.266855 8273 catalog_manager.cc:5671] T 27330be65bac450a8ead355d41fe780e P 70e7666c46844503beb466fdc054a6fc reported cstate change: term changed from 0 to 1, leader changed from <none> to 70e7666c46844503beb466fdc054a6fc (127.7.178.194). New cstate: current_term: 1 leader_uuid: "70e7666c46844503beb466fdc054a6fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } health_report { overall_health: UNKNOWN } } }
I20260321 03:02:30.272714 9113 tablet.cc:1723] T 4718c06ec4ed4452b91483eb6e1ae067 P 70e7666c46844503beb466fdc054a6fc: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260321 03:02:30.276559 9114 tablet.cc:1723] T 4718c06ec4ed4452b91483eb6e1ae067 P 4532b54a008a4a39b663112e6d0aacc0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260321 03:02:30.277644 8273 catalog_manager.cc:5763] TS a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091) does not have the latest schema for tablet 4718c06ec4ed4452b91483eb6e1ae067 (table default.table_10dd23c6f33c4aa0bad0a534fb770d4a [id=94ef39d020ab428b9e0392bedab9483d]). Expected version 1 got 0
I20260321 03:02:30.277833 8273 catalog_manager.cc:5671] T ed96f3685d004f6f94f50db2651acc1f P a97f7dd77cf2444f8fdb441019081f79 reported cstate change: term changed from 0 to 1, leader changed from <none> to a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195). New cstate: current_term: 1 leader_uuid: "a97f7dd77cf2444f8fdb441019081f79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } health_report { overall_health: HEALTHY } } }
I20260321 03:02:30.285143 8273 catalog_manager.cc:5671] T 90980515c2f14e4abfff2f3e2edf2f16 P 4532b54a008a4a39b663112e6d0aacc0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193). New cstate: current_term: 1 leader_uuid: "4532b54a008a4a39b663112e6d0aacc0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } health_report { overall_health: UNKNOWN } } }
I20260321 03:02:30.288465 9112 tablet.cc:1723] T 4718c06ec4ed4452b91483eb6e1ae067 P a97f7dd77cf2444f8fdb441019081f79: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260321 03:02:30.292371 8940 consensus_queue.cc:1048] T 27330be65bac450a8ead355d41fe780e P 70e7666c46844503beb466fdc054a6fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260321 03:02:30.297375 8273 catalog_manager.cc:6216] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e: default.table_10dd23c6f33c4aa0bad0a534fb770d4a [id=94ef39d020ab428b9e0392bedab9483d] alter complete (version 1)
I20260321 03:02:30.302517 8273 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39954:
name: "default.Table_d52655a709224a7d999af3a2f1f2a678"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260321 03:02:30.315883 8932 consensus_queue.cc:1048] T 27330be65bac450a8ead355d41fe780e P 70e7666c46844503beb466fdc054a6fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260321 03:02:30.330896 9034 consensus_queue.cc:1048] T ed96f3685d004f6f94f50db2651acc1f P a97f7dd77cf2444f8fdb441019081f79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260321 03:02:30.344233 8931 consensus_queue.cc:1048] T ed96f3685d004f6f94f50db2651acc1f P a97f7dd77cf2444f8fdb441019081f79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260321 03:02:30.418304 9111 consensus_queue.cc:1048] T d4496a81bf2f40cdb82cc4cbdd24dd20 P a97f7dd77cf2444f8fdb441019081f79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260321 03:02:30.441373 8931 consensus_queue.cc:1048] T d4496a81bf2f40cdb82cc4cbdd24dd20 P a97f7dd77cf2444f8fdb441019081f79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260321 03:02:30.460255 8935 consensus_queue.cc:1048] T 90980515c2f14e4abfff2f3e2edf2f16 P 4532b54a008a4a39b663112e6d0aacc0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260321 03:02:30.479614 9101 consensus_queue.cc:1048] T 90980515c2f14e4abfff2f3e2edf2f16 P 4532b54a008a4a39b663112e6d0aacc0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260321 03:02:30.688097 8266 catalog_manager.cc:2731] deleted HMS catalog entry for table default.table_9731292f060b48d7a3b304a142988570 [id=3fbb48538eb34ee9ae7b462f2af6d628]
I20260321 03:02:30.786513 8268 catalog_manager.cc:3502] renamed table default.table_a658f97fed3c4b3eabbfcbb9018b388f [id=9bc91b7f6cb8477ab6ed1ee5ed74f608] in HMS: new name default.table_60888690371e4e1d8d9e6a31f44b55a5
I20260321 03:02:30.798120 9124 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7451d7c0a71f4620a6607f74b5a22f2e)
I20260321 03:02:30.798488 9124 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:02:30.800529 8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3df5e4492f3049c1b09fea013b92f863" candidate_term: 2 candidate_status { last_received { term: 1 index: 47 } } ignore_live_leader: false dest_uuid: "4a187d1fb5804686b4aff01e47fd0284" is_pre_election: true
I20260321 03:02:30.800705 8212 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3df5e4492f3049c1b09fea013b92f863 in term 1.
I20260321 03:02:30.800989 8283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3df5e4492f3049c1b09fea013b92f863" candidate_term: 2 candidate_status { last_received { term: 1 index: 47 } } ignore_live_leader: false dest_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" is_pre_election: true
I20260321 03:02:30.801468 8973 leader_election.cc:304] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3df5e4492f3049c1b09fea013b92f863, 4a187d1fb5804686b4aff01e47fd0284; no voters:
I20260321 03:02:30.802070 9124 leader_election.cc:290] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651), 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595)
I20260321 03:02:30.802484 9124 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260321 03:02:30.802573 9124 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7451d7c0a71f4620a6607f74b5a22f2e)
I20260321 03:02:30.802627 9124 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 1 FOLLOWER]: Advancing to term 2
I20260321 03:02:30.804533 9124 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:02:30.805469 8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3df5e4492f3049c1b09fea013b92f863" candidate_term: 2 candidate_status { last_received { term: 1 index: 47 } } ignore_live_leader: false dest_uuid: "4a187d1fb5804686b4aff01e47fd0284"
I20260321 03:02:30.805629 8212 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 1 FOLLOWER]: Advancing to term 2
I20260321 03:02:30.805806 9124 leader_election.cc:290] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 2 election: Requested vote from peers 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651), 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595)
I20260321 03:02:30.805857 8283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3df5e4492f3049c1b09fea013b92f863" candidate_term: 2 candidate_status { last_received { term: 1 index: 47 } } ignore_live_leader: false dest_uuid: "7451d7c0a71f4620a6607f74b5a22f2e"
I20260321 03:02:30.806880 8212 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3df5e4492f3049c1b09fea013b92f863 in term 2.
I20260321 03:02:30.807343 8973 leader_election.cc:304] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3df5e4492f3049c1b09fea013b92f863, 4a187d1fb5804686b4aff01e47fd0284; no voters: 7451d7c0a71f4620a6607f74b5a22f2e
I20260321 03:02:30.807698 9125 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 2 FOLLOWER]: Leader election won for term 2
I20260321 03:02:30.807835 9125 raft_consensus.cc:697] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 2 LEADER]: Becoming Leader. State: Replica: 3df5e4492f3049c1b09fea013b92f863, State: Running, Role: LEADER
I20260321 03:02:30.808384 9125 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 47, Committed index: 47, Last appended: 1.47, Last appended by leader: 47, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:02:30.810099 9124 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3df5e4492f3049c1b09fea013b92f863. Latest consensus state: current_term: 2 leader_uuid: "3df5e4492f3049c1b09fea013b92f863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } } }
I20260321 03:02:30.810240 9124 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [sys.catalog]: This master's current role is: LEADER
I20260321 03:02:30.813488 9123 raft_consensus.cc:493] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260321 03:02:30.813642 9123 raft_consensus.cc:515] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:02:30.814628 8283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4a187d1fb5804686b4aff01e47fd0284" candidate_term: 3 candidate_status { last_received { term: 1 index: 47 } } ignore_live_leader: false dest_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" is_pre_election: true
I20260321 03:02:30.815400 9123 leader_election.cc:290] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595), 3df5e4492f3049c1b09fea013b92f863 (127.7.178.252:45145)
I20260321 03:02:30.822197 9126 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260321 03:02:30.824508 9126 catalog_manager.cc:679] Loaded metadata for table default.table_337c18c13bb24e78bad2738358717d2d [id=06718ed7d99744ff818ac2fc5bdbf11c]
I20260321 03:02:30.824918 9126 catalog_manager.cc:679] Loaded metadata for table default.table_9731292f060b48d7a3b304a142988570 [id=3fbb48538eb34ee9ae7b462f2af6d628]
I20260321 03:02:30.825305 9126 catalog_manager.cc:679] Loaded metadata for table default.table_9bbd1f43ebe347ed99a9be3a6ffb3d86 [id=4ac1925a391a48ea86c63da0c1d8c442]
I20260321 03:02:30.831916 9126 catalog_manager.cc:679] Loaded metadata for table default.table_0e0c55f293274457aed5e8d315334903 [id=850c888ac63d4c048f27ceeb1ddd4f83]
I20260321 03:02:30.832659 9126 catalog_manager.cc:679] Loaded metadata for table default.table_10dd23c6f33c4aa0bad0a534fb770d4a [id=94ef39d020ab428b9e0392bedab9483d]
I20260321 03:02:30.833115 9126 catalog_manager.cc:679] Loaded metadata for table default.table_a658f97fed3c4b3eabbfcbb9018b388f [id=9bc91b7f6cb8477ab6ed1ee5ed74f608]
I20260321 03:02:30.834126 8212 raft_consensus.cc:1240] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 2 FOLLOWER]: Rejecting Update request from peer 7451d7c0a71f4620a6607f74b5a22f2e for earlier term 1. Current term is 2. Ops: []
I20260321 03:02:30.835047 9129 consensus_queue.cc:1059] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 }, Status: INVALID_TERM, Last received: 1.47, Next index: 48, Last known committed idx: 47, Time since last communication: 0.000s
I20260321 03:02:30.835632 9126 catalog_manager.cc:679] Loaded metadata for table default.table_f8b27d78677b44468e403c75afa5245a [id=9f5de6240b844d57991fc673d061fbf4]
I20260321 03:02:30.835994 9129 raft_consensus.cc:3055] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [term 1 LEADER]: Stepping down as leader of term 1
I20260321 03:02:30.836125 9129 raft_consensus.cc:740] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7451d7c0a71f4620a6607f74b5a22f2e, State: Running, Role: LEADER
I20260321 03:02:30.836144 9126 catalog_manager.cc:679] Loaded metadata for table default.table_ec53d9a55a4c47b8a9b0fa3916c9c561 [id=b792550a4b344d24a9d33f468884c107]
I20260321 03:02:30.836481 9129 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 47, Committed index: 47, Last appended: 1.47, Last appended by leader: 47, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:02:30.836637 9126 catalog_manager.cc:679] Loaded metadata for table default.table_0e444e840fa14c16a1a1f2e750c73045 [id=c6b5b0c7a19649c2b502921f472fc1dc]
I20260321 03:02:30.837037 9126 catalog_manager.cc:679] Loaded metadata for table default.table_06e0fbe90fe0411d95d76f56b53fb175 [id=c7602cbc743a43239656449386fbeb83]
I20260321 03:02:30.837302 9129 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [term 1 FOLLOWER]: Advancing to term 2
I20260321 03:02:30.839344 9126 tablet_loader.cc:96] loaded metadata for tablet 1806a588d8d24b18a405e1a545d9cdda (table default.table_9731292f060b48d7a3b304a142988570 [id=3fbb48538eb34ee9ae7b462f2af6d628])
I20260321 03:02:30.839982 9126 tablet_loader.cc:96] loaded metadata for tablet 27330be65bac450a8ead355d41fe780e (table default.table_9bbd1f43ebe347ed99a9be3a6ffb3d86 [id=4ac1925a391a48ea86c63da0c1d8c442])
I20260321 03:02:30.840306 9126 tablet_loader.cc:96] loaded metadata for tablet 4718c06ec4ed4452b91483eb6e1ae067 (table default.table_10dd23c6f33c4aa0bad0a534fb770d4a [id=94ef39d020ab428b9e0392bedab9483d])
I20260321 03:02:30.840801 9126 tablet_loader.cc:96] loaded metadata for tablet 89ae9cb00ef14b5d9d88dfb94a55e5d5 (table default.table_0e0c55f293274457aed5e8d315334903 [id=850c888ac63d4c048f27ceeb1ddd4f83])
I20260321 03:02:30.841122 9126 tablet_loader.cc:96] loaded metadata for tablet 90980515c2f14e4abfff2f3e2edf2f16 (table default.table_0e444e840fa14c16a1a1f2e750c73045 [id=c6b5b0c7a19649c2b502921f472fc1dc])
I20260321 03:02:30.841671 9126 tablet_loader.cc:96] loaded metadata for tablet c8b7587407f64cbd8f6cbe2dd048547e (table default.table_ec53d9a55a4c47b8a9b0fa3916c9c561 [id=b792550a4b344d24a9d33f468884c107])
I20260321 03:02:30.842002 9126 tablet_loader.cc:96] loaded metadata for tablet cc5de6cf47b84822810e38f094ff99ea (table default.table_337c18c13bb24e78bad2738358717d2d [id=06718ed7d99744ff818ac2fc5bdbf11c])
I20260321 03:02:30.842520 9126 tablet_loader.cc:96] loaded metadata for tablet d4496a81bf2f40cdb82cc4cbdd24dd20 (table default.table_06e0fbe90fe0411d95d76f56b53fb175 [id=c7602cbc743a43239656449386fbeb83])
I20260321 03:02:30.842850 9126 tablet_loader.cc:96] loaded metadata for tablet ed96f3685d004f6f94f50db2651acc1f (table default.table_f8b27d78677b44468e403c75afa5245a [id=9f5de6240b844d57991fc673d061fbf4])
I20260321 03:02:30.843209 9126 tablet_loader.cc:96] loaded metadata for tablet ffa603a7e8404c968e09e26e5b277911 (table default.table_a658f97fed3c4b3eabbfcbb9018b388f [id=9bc91b7f6cb8477ab6ed1ee5ed74f608])
I20260321 03:02:30.843644 8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4a187d1fb5804686b4aff01e47fd0284" candidate_term: 3 candidate_status { last_received { term: 1 index: 47 } } ignore_live_leader: false dest_uuid: "3df5e4492f3049c1b09fea013b92f863" is_pre_election: true
I20260321 03:02:30.844427 8186 leader_election.cc:304] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a187d1fb5804686b4aff01e47fd0284; no voters: 3df5e4492f3049c1b09fea013b92f863, 7451d7c0a71f4620a6607f74b5a22f2e
I20260321 03:02:30.844749 9123 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260321 03:02:30.845006 9126 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260321 03:02:30.846122 9126 catalog_manager.cc:1269] Loaded cluster ID: 30588dbe2d29416e8c640adf9bfaba1f
I20260321 03:02:30.846249 9126 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260321 03:02:30.847447 9126 catalog_manager.cc:1514] Loading token signing keys...
I20260321 03:02:30.848271 9126 catalog_manager.cc:6055] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863: Loaded TSK: 0
I20260321 03:02:30.849483 9126 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260321 03:02:30.850242 9126 catalog_manager.cc:1537] Loading latest processed Hive Metastore notification log event ID...
I20260321 03:02:30.850908 9126 catalog_manager.cc:5893] Last processed Hive Metastore notification event ID: 11
I20260321 03:02:30.851920 8270 catalog_manager.cc:2731] deleted HMS catalog entry for table default.table_337c18c13bb24e78bad2738358717d2d [id=06718ed7d99744ff818ac2fc5bdbf11c]
I20260321 03:02:30.926913 8271 catalog_manager.cc:3502] renamed table default.table_9bbd1f43ebe347ed99a9be3a6ffb3d86 [id=4ac1925a391a48ea86c63da0c1d8c442] in HMS: new name default.table_c8e5202d265f463bbcf568d34a1e64a2
I20260321 03:02:30.970672 8267 catalog_manager.cc:2174] created HMS catalog entry for table [id=ac7f63999ecc43328aa76b55c07ab529]
W20260321 03:02:30.971388 8267 catalog_manager.cc:2202] Illegal state: an error occurred while writing to the sys-catalog: replica 7451d7c0a71f4620a6607f74b5a22f2e is not leader of this config: current role FOLLOWER
I20260321 03:02:31.010396 8850 heartbeater.cc:499] Master 127.7.178.252:45145 was elected leader, sending a full tablet report...
I20260321 03:02:31.013635 8272 catalog_manager.cc:2174] created HMS catalog entry for table [id=435759bdc4464e5f859546dfc760d6ad]
W20260321 03:02:31.014272 8272 catalog_manager.cc:2202] Illegal state: an error occurred while writing to the sys-catalog: replica 7451d7c0a71f4620a6607f74b5a22f2e is not leader of this config: current role FOLLOWER
I20260321 03:02:31.045174 8265 catalog_manager.cc:2174] created HMS catalog entry for table [id=1eabb731ef9a41249c3e08ccf80157e4]
W20260321 03:02:31.045933 8265 catalog_manager.cc:2202] Illegal state: an error occurred while writing to the sys-catalog: replica 7451d7c0a71f4620a6607f74b5a22f2e is not leader of this config: current role FOLLOWER
I20260321 03:02:31.054963 8579 heartbeater.cc:499] Master 127.7.178.252:45145 was elected leader, sending a full tablet report...
I20260321 03:02:31.076921 8269 catalog_manager.cc:2174] created HMS catalog entry for table [id=b20ef8da20fe487e9f99a91c820ad06f]
W20260321 03:02:31.077649 8269 catalog_manager.cc:2202] Illegal state: an error occurred while writing to the sys-catalog: replica 7451d7c0a71f4620a6607f74b5a22f2e is not leader of this config: current role FOLLOWER
I20260321 03:02:31.127074 8264 catalog_manager.cc:2731] deleted HMS catalog entry for table default.table_ec53d9a55a4c47b8a9b0fa3916c9c561 [id=b792550a4b344d24a9d33f468884c107]
I20260321 03:02:31.132874 8417 catalog_manager.cc:2772] Deleting table default.table_9731292f060b48d7a3b304a142988570 [id=3fbb48538eb34ee9ae7b462f2af6d628] in response to Hive Metastore notification log event 12
W20260321 03:02:31.134131 8417 catalog_manager.cc:2848] Illegal state: an error occurred while updating the sys-catalog: replica 7451d7c0a71f4620a6607f74b5a22f2e is not leader of this config: current role FOLLOWER
W20260321 03:02:31.134285 8417 hms_notification_log_listener.cc:329] Failed to handle Hive Metastore notification: 12 DROP_TABLE default.table_9731292f060b48d7a3b304a142988570: Illegal state: an error occurred while updating the sys-catalog: replica 7451d7c0a71f4620a6607f74b5a22f2e is not leader of this config: current role FOLLOWER
W20260321 03:02:31.134369 8417 hms_notification_log_listener.cc:143] Hive Metastore notification log listener poll failed: Service unavailable: lost leadership while handling Hive Metastore notification log events: an error occurred while updating the sys-catalog: replica 7451d7c0a71f4620a6607f74b5a22f2e is not leader of this config: current role FOLLOWER
I20260321 03:02:31.134824 8273 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:39954 (request call id 31) took 1661 ms. Trace:
I20260321 03:02:31.134889 8273 rpcz_store.cc:276] 0321 03:02:29.473179 (+ 0us) service_pool.cc:168] Inserting onto call queue
0321 03:02:30.302401 (+829222us) service_pool.cc:225] Handling call
0321 03:02:31.134802 (+832401us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260321 03:02:31.135524 8273 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.7.178.194:60557 (request call id 15) took 829 ms (client timeout 1000 ms). Trace:
W20260321 03:02:31.135581 8273 rpcz_store.cc:269] 0321 03:02:30.306325 (+ 0us) service_pool.cc:168] Inserting onto call queue
0321 03:02:31.135069 (+828744us) service_pool.cc:225] Handling call
0321 03:02:31.135498 (+ 429us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260321 03:02:31.136026 8273 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.7.178.195:39935 (request call id 18) took 823 ms (client timeout 1000 ms). Trace:
W20260321 03:02:31.136073 8273 rpcz_store.cc:269] 0321 03:02:30.312085 (+ 0us) service_pool.cc:168] Inserting onto call queue
0321 03:02:31.135696 (+823611us) service_pool.cc:225] Handling call
0321 03:02:31.136015 (+ 319us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260321 03:02:31.136483 8273 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.7.178.193:47073 (request call id 17) took 812 ms (client timeout 1000 ms). Trace:
W20260321 03:02:31.136534 8273 rpcz_store.cc:269] 0321 03:02:30.323718 (+ 0us) service_pool.cc:168] Inserting onto call queue
0321 03:02:31.136160 (+812442us) service_pool.cc:225] Handling call
0321 03:02:31.136470 (+ 310us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260321 03:02:31.136783 8273 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:39954 (request call id 32) took 1625 ms. Trace:
I20260321 03:02:31.136830 8273 rpcz_store.cc:276] 0321 03:02:29.511718 (+ 0us) service_pool.cc:168] Inserting onto call queue
0321 03:02:31.136624 (+1624906us) service_pool.cc:225] Handling call
0321 03:02:31.136772 (+ 148us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260321 03:02:31.137109 8273 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:39954 (request call id 33) took 1537 ms. Trace:
I20260321 03:02:31.137157 8273 rpcz_store.cc:276] 0321 03:02:29.599959 (+ 0us) service_pool.cc:168] Inserting onto call queue
0321 03:02:31.136943 (+1536984us) service_pool.cc:225] Handling call
0321 03:02:31.137097 (+ 154us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260321 03:02:31.137327 8266 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:39954 (request call id 27) took 1864 ms. Trace:
I20260321 03:02:31.137370 8266 rpcz_store.cc:276] 0321 03:02:29.272857 (+ 0us) service_pool.cc:168] Inserting onto call queue
0321 03:02:29.598048 (+325191us) service_pool.cc:225] Handling call
0321 03:02:30.239724 (+641676us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0321 03:02:31.137319 (+897595us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":5533,"Hive Metastore.run_cpu_time_us":219,"Hive Metastore.run_wall_time_us":442582}
I20260321 03:02:31.137720 8266 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:39954 (request call id 35) took 1425 ms. Trace:
I20260321 03:02:31.137768 8266 rpcz_store.cc:276] 0321 03:02:29.712601 (+ 0us) service_pool.cc:168] Inserting onto call queue
0321 03:02:31.137518 (+1424917us) service_pool.cc:225] Handling call
0321 03:02:31.137708 (+ 190us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260321 03:02:31.137871 8266 master_service.cc:954] ReplaceTablet: received request to replace tablet 27330be65bac450a8ead355d41fe780e from {username='slave'} at 127.0.0.1:39954
I20260321 03:02:31.138005 8266 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:39954 (request call id 36) took 1380 ms. Trace:
I20260321 03:02:31.138044 8266 rpcz_store.cc:276] 0321 03:02:29.757584 (+ 0us) service_pool.cc:168] Inserting onto call queue
0321 03:02:31.137853 (+1380269us) service_pool.cc:225] Handling call
0321 03:02:31.137997 (+ 144us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260321 03:02:31.138146 8266 master_service.cc:954] ReplaceTablet: received request to replace tablet cc5de6cf47b84822810e38f094ff99ea from {username='slave'} at 127.0.0.1:39954
I20260321 03:02:31.138295 8266 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:39954 (request call id 37) took 1377 ms. Trace:
I20260321 03:02:31.138340 8266 rpcz_store.cc:276] 0321 03:02:29.760855 (+ 0us) service_pool.cc:168] Inserting onto call queue
0321 03:02:31.138130 (+1377275us) service_pool.cc:225] Handling call
0321 03:02:31.138285 (+ 155us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260321 03:02:31.138581 8266 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:39954 (request call id 38) took 1372 ms. Trace:
I20260321 03:02:31.138625 8266 rpcz_store.cc:276] 0321 03:02:29.766121 (+ 0us) service_pool.cc:168] Inserting onto call queue
0321 03:02:31.138438 (+1372317us) service_pool.cc:225] Handling call
0321 03:02:31.138571 (+ 133us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260321 03:02:31.138729 8266 master_service.cc:954] ReplaceTablet: received request to replace tablet 4718c06ec4ed4452b91483eb6e1ae067 from {username='slave'} at 127.0.0.1:39954
I20260321 03:02:31.138873 8266 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:39954 (request call id 39) took 1363 ms. Trace:
I20260321 03:02:31.138911 8266 rpcz_store.cc:276] 0321 03:02:29.775305 (+ 0us) service_pool.cc:168] Inserting onto call queue
0321 03:02:31.138713 (+1363408us) service_pool.cc:225] Handling call
0321 03:02:31.138864 (+ 151us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260321 03:02:31.139009 8266 master_service.cc:954] ReplaceTablet: received request to replace tablet c8b7587407f64cbd8f6cbe2dd048547e from {username='slave'} at 127.0.0.1:39954
I20260321 03:02:31.139139 8266 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:39954 (request call id 40) took 1363 ms. Trace:
I20260321 03:02:31.139175 8266 rpcz_store.cc:276] 0321 03:02:29.775379 (+ 0us) service_pool.cc:168] Inserting onto call queue
0321 03:02:31.138996 (+1363617us) service_pool.cc:225] Handling call
0321 03:02:31.139131 (+ 135us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260321 03:02:31.139274 8266 master_service.cc:954] ReplaceTablet: received request to replace tablet c8b7587407f64cbd8f6cbe2dd048547e from {username='slave'} at 127.0.0.1:39954
I20260321 03:02:31.139421 8266 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:39954 (request call id 41) took 1341 ms. Trace:
I20260321 03:02:31.139464 8266 rpcz_store.cc:276] 0321 03:02:29.797871 (+ 0us) service_pool.cc:168] Inserting onto call queue
0321 03:02:31.139258 (+1341387us) service_pool.cc:225] Handling call
0321 03:02:31.139400 (+ 142us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260321 03:02:31.139698 8266 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:39954 (request call id 42) took 1273 ms. Trace:
I20260321 03:02:31.139743 8266 rpcz_store.cc:276] 0321 03:02:29.865796 (+ 0us) service_pool.cc:168] Inserting onto call queue
0321 03:02:31.139548 (+1273752us) service_pool.cc:225] Handling call
0321 03:02:31.139687 (+ 139us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260321 03:02:31.139962 8266 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:39954 (request call id 43) took 1264 ms. Trace:
I20260321 03:02:31.140007 8266 rpcz_store.cc:276] 0321 03:02:29.875706 (+ 0us) service_pool.cc:168] Inserting onto call queue
0321 03:02:31.139832 (+1264126us) service_pool.cc:225] Handling call
0321 03:02:31.139952 (+ 120us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260321 03:02:31.140244 8266 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:39954 (request call id 44) took 1173 ms. Trace:
I20260321 03:02:31.140291 8266 rpcz_store.cc:276] 0321 03:02:29.966588 (+ 0us) service_pool.cc:168] Inserting onto call queue
0321 03:02:31.140103 (+1173515us) service_pool.cc:225] Handling call
0321 03:02:31.140234 (+ 131us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260321 03:02:31.140998 8268 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:39954 (request call id 20) took 1970 ms. Trace:
I20260321 03:02:31.141053 8268 rpcz_store.cc:276] 0321 03:02:29.170295 (+ 0us) service_pool.cc:168] Inserting onto call queue
0321 03:02:29.270439 (+100144us) service_pool.cc:225] Handling call
0321 03:02:30.239727 (+969288us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0321 03:02:31.140543 (+900816us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0321 03:02:31.140742 (+ 199us) catalog_manager.cc:3725] Apply alter schema
0321 03:02:31.140984 (+ 242us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":448162,"Hive Metastore.run_cpu_time_us":681,"Hive Metastore.run_wall_time_us":98438}
I20260321 03:02:31.141605 8268 rpcz_store.cc:275] Call kudu.master.MasterService.GetMasterRegistration from 127.0.0.1:39962 (request call id 0) took 1515 ms. Trace:
I20260321 03:02:31.141657 8268 rpcz_store.cc:276] 0321 03:02:29.625822 (+ 0us) service_pool.cc:168] Inserting onto call queue
0321 03:02:31.141436 (+1515614us) service_pool.cc:225] Handling call
0321 03:02:31.141592 (+ 156us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260321 03:02:31.141826 8270 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:39954 (request call id 18) took 2056 ms. Trace:
I20260321 03:02:31.141873 8270 rpcz_store.cc:276] 0321 03:02:29.085375 (+ 0us) service_pool.cc:168] Inserting onto call queue
0321 03:02:29.085514 (+ 139us) service_pool.cc:225] Handling call
0321 03:02:30.239549 (+1154035us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0321 03:02:31.141815 (+902266us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":546800,"Hive Metastore.run_cpu_time_us":191,"Hive Metastore.run_wall_time_us":65381,"mutex_wait_us":151}
I20260321 03:02:31.142459 8271 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:39954 (request call id 17) took 2138 ms. Trace:
I20260321 03:02:31.142513 8271 rpcz_store.cc:276] 0321 03:02:29.003867 (+ 0us) service_pool.cc:168] Inserting onto call queue
0321 03:02:29.026069 (+ 22202us) service_pool.cc:225] Handling call
0321 03:02:30.239553 (+1213484us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0321 03:02:31.142050 (+902497us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0321 03:02:31.142234 (+ 184us) catalog_manager.cc:3725] Apply alter schema
0321 03:02:31.142445 (+ 211us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":612236,"Hive Metastore.run_cpu_time_us":679,"Hive Metastore.run_wall_time_us":74890,"mutex_wait_us":204}
I20260321 03:02:31.142695 8264 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:39954 (request call id 30) took 1743 ms. Trace:
I20260321 03:02:31.142740 8264 rpcz_store.cc:276] 0321 03:02:29.398764 (+ 0us) service_pool.cc:168] Inserting onto call queue
0321 03:02:29.916415 (+517651us) service_pool.cc:225] Handling call
0321 03:02:30.256451 (+340036us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0321 03:02:31.142685 (+886234us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":820295,"Hive Metastore.run_cpu_time_us":206,"Hive Metastore.run_wall_time_us":50126}
W20260321 03:02:31.144645 8859 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.7.178.253:46595)
W20260321 03:02:31.144899 8859 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.7.178.253:46595)
W20260321 03:02:31.145285 8859 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.7.178.253:46595)
W20260321 03:02:31.145541 8859 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.7.178.253:46595)
I20260321 03:02:31.153468 8924 master_runner.cc:232] Existing masters have differing terms: 1 vs 2
I20260321 03:02:31.153692 8924 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260321 03:02:31.155827 8273 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:39954 (request call id 34) took 1490 ms. Trace:
I20260321 03:02:31.155937 8273 rpcz_store.cc:276] 0321 03:02:29.665346 (+ 0us) service_pool.cc:168] Inserting onto call queue
0321 03:02:31.137245 (+1471899us) service_pool.cc:225] Handling call
0321 03:02:31.155807 (+ 18562us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260321 03:02:31.157387 8266 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:39954 (request call id 45) took 1081 ms. Trace:
I20260321 03:02:31.157481 8266 rpcz_store.cc:276] 0321 03:02:30.076274 (+ 0us) service_pool.cc:168] Inserting onto call queue
0321 03:02:31.140378 (+1064104us) service_pool.cc:225] Handling call
0321 03:02:31.157367 (+ 16989us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260321 03:02:31.175050 8985 master_service.cc:954] ReplaceTablet: received request to replace tablet 27330be65bac450a8ead355d41fe780e from {username='slave'} at 127.0.0.1:51854
I20260321 03:02:31.176067 8984 master_service.cc:954] ReplaceTablet: received request to replace tablet cc5de6cf47b84822810e38f094ff99ea from {username='slave'} at 127.0.0.1:51854
I20260321 03:02:31.174357 8987 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51854:
table { table_name: "default.Table_0e0c55f293274457aed5e8d315334903" } modify_external_catalogs: true
I20260321 03:02:31.174367 8989 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51854:
name: "default.Table_d2585fcc892d4f4882c0a068ce656fee"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260321 03:02:31.176617 8987 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51854:
table { table_name: "default.Table_0e0c55f293274457aed5e8d315334903" } modify_external_catalogs: true
I20260321 03:02:31.177290 8988 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51854:
name: "default.Table_d52655a709224a7d999af3a2f1f2a678"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260321 03:02:31.177439 8983 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51854:
table { table_name: "default.Table_f8b27d78677b44468e403c75afa5245a" } new_table_name: "default.Table_a144cb0fc86946c095774662670afa8a" modify_external_catalogs: true
I20260321 03:02:31.177662 8982 master_service.cc:954] ReplaceTablet: received request to replace tablet 4718c06ec4ed4452b91483eb6e1ae067 from {username='slave'} at 127.0.0.1:51854
I20260321 03:02:31.178323 8981 master_service.cc:954] ReplaceTablet: received request to replace tablet c8b7587407f64cbd8f6cbe2dd048547e from {username='slave'} at 127.0.0.1:51854
I20260321 03:02:31.178956 8980 master_service.cc:954] ReplaceTablet: received request to replace tablet c8b7587407f64cbd8f6cbe2dd048547e from {username='slave'} at 127.0.0.1:51854
I20260321 03:02:31.174911 8986 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51854:
name: "default.Table_9017f1e107c846008985a821415447b8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260321 03:02:31.183955 9048 catalog_manager.cc:2772] Deleting table default.table_9731292f060b48d7a3b304a142988570 [id=3fbb48538eb34ee9ae7b462f2af6d628] in response to Hive Metastore notification log event 12
I20260321 03:02:31.186579 8212 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 2 FOLLOWER]: Refusing update from remote peer 3df5e4492f3049c1b09fea013b92f863: Log matching property violated. Preceding OpId in replica: term: 1 index: 47. Preceding OpId from leader: term: 2 index: 50. (index mismatch)
I20260321 03:02:31.186579 8283 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [term 2 FOLLOWER]: Refusing update from remote peer 3df5e4492f3049c1b09fea013b92f863: Log matching property violated. Preceding OpId in replica: term: 1 index: 47. Preceding OpId from leader: term: 2 index: 49. (index mismatch)
I20260321 03:02:31.187110 9125 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 48, Last known committed idx: 47, Time since last communication: 0.000s
I20260321 03:02:31.189613 9123 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3df5e4492f3049c1b09fea013b92f863. Latest consensus state: current_term: 2 leader_uuid: "3df5e4492f3049c1b09fea013b92f863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } } }
I20260321 03:02:31.189760 9123 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [sys.catalog]: This master's current role is: FOLLOWER
I20260321 03:02:31.191504 9125 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 48, Last known committed idx: 47, Time since last communication: 0.000s
I20260321 03:02:31.194819 9130 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3df5e4492f3049c1b09fea013b92f863. Latest consensus state: current_term: 2 leader_uuid: "3df5e4492f3049c1b09fea013b92f863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } } }
I20260321 03:02:31.194985 9130 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [sys.catalog]: This master's current role is: FOLLOWER
I20260321 03:02:31.197077 9125 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "3df5e4492f3049c1b09fea013b92f863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } } }
I20260321 03:02:31.197361 9125 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [sys.catalog]: This master's current role is: LEADER
I20260321 03:02:31.197602 8984 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863: Sending DeleteTablet for 3 replicas of tablet cc5de6cf47b84822810e38f094ff99ea
I20260321 03:02:31.198426 9124 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "3df5e4492f3049c1b09fea013b92f863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } } }
I20260321 03:02:31.198542 9124 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [sys.catalog]: This master's current role is: LEADER
I20260321 03:02:31.198907 8984 catalog_manager.cc:6741] ReplaceTablet: tablet cc5de6cf47b84822810e38f094ff99ea deleted and replaced by tablet 34cc41d9b1f24aaaa3b7140dc7a7e280
I20260321 03:02:31.199342 8984 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51854:
name: "default.Table_a6ce605126a947cfa6a44f2124f15087"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260321 03:02:31.199817 9133 mvcc.cc:204] Tried to move back new op lower bound from 7266558571265114112 to 7266558569714847744. Current Snapshot: MvccSnapshot[applied={T|T < 7266558571255070720}]
I20260321 03:02:31.201542 9123 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "3df5e4492f3049c1b09fea013b92f863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } } }
I20260321 03:02:31.201678 9123 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [sys.catalog]: This master's current role is: FOLLOWER
I20260321 03:02:31.202093 9130 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "3df5e4492f3049c1b09fea013b92f863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } } }
I20260321 03:02:31.202313 9130 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [sys.catalog]: This master's current role is: FOLLOWER
I20260321 03:02:31.203029 8982 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863: Sending DeleteTablet for 3 replicas of tablet 4718c06ec4ed4452b91483eb6e1ae067
I20260321 03:02:31.203344 8982 catalog_manager.cc:6741] ReplaceTablet: tablet 4718c06ec4ed4452b91483eb6e1ae067 deleted and replaced by tablet a062f5d0fc344fb9a1e8169401451bad
I20260321 03:02:31.203547 8982 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51854:
table { table_name: "default.Table_0e444e840fa14c16a1a1f2e750c73045" } new_table_name: "default.Table_eb81105465414fdd9c4d66d6aefc3120" modify_external_catalogs: true
I20260321 03:02:31.206277 8981 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863: Sending DeleteTablet for 3 replicas of tablet c8b7587407f64cbd8f6cbe2dd048547e
I20260321 03:02:31.206593 8981 catalog_manager.cc:6741] ReplaceTablet: tablet c8b7587407f64cbd8f6cbe2dd048547e deleted and replaced by tablet 481a544d7e4a461396b26b89dfc058ac
I20260321 03:02:31.206645 8267 catalog_manager.cc:2184] deleted orphaned HMS catalog entry for table [id=ac7f63999ecc43328aa76b55c07ab529]
I20260321 03:02:31.206840 8981 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51854:
name: "default.Table_a8ad6a72849a42ab9d21634ee3041396"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260321 03:02:31.206977 8267 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:39954 (request call id 29) took 1837 ms. Trace:
I20260321 03:02:31.207037 8267 rpcz_store.cc:276] 0321 03:02:29.369715 (+ 0us) service_pool.cc:168] Inserting onto call queue
0321 03:02:29.785725 (+416010us) service_pool.cc:225] Handling call
0321 03:02:30.240031 (+454306us) catalog_manager.cc:2101] Acquired catalog manager lock
0321 03:02:30.240412 (+ 381us) catalog_manager.cc:2147] Created new table and tablet info
0321 03:02:30.970658 (+730246us) catalog_manager.cc:2173] Created new table in HMS catalog
0321 03:02:30.971325 (+ 667us) write_op.cc:489] Releasing partition, row and schema locks
0321 03:02:30.971327 (+ 2us) write_op.cc:454] Released schema lock
0321 03:02:30.971464 (+ 137us) catalog_manager.cc:2181] Rolling back HMS table creation
0321 03:02:31.206962 (+235498us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0321 03:02:30.971235 (+ 0us) op_driver.cc:389] HandleFailure(Illegal state: replica 7451d7c0a71f4620a6607f74b5a22f2e is not leader of this config: current role FOLLOWER)
0321 03:02:30.971247 (+ 12us) write_op.cc:489] Releasing partition, row and schema locks
0321 03:02:30.971251 (+ 4us) write_op.cc:454] Released schema lock
0321 03:02:30.971254 (+ 3us) write_op.cc:335] FINISH: Op aborted
Metrics: {"Hive Metastore.queue_time_us":847337,"Hive Metastore.run_cpu_time_us":463,"Hive Metastore.run_wall_time_us":117783,"child_traces":[["op",{}]]}
I20260321 03:02:31.207350 8980 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51854:
table { table_name: "default.Table_10dd23c6f33c4aa0bad0a534fb770d4a" } new_table_name: "default.Table_91567c8331f247aebc889906e9067634" modify_external_catalogs: true
I20260321 03:02:31.209952 8985 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863: Sending DeleteTablet for 3 replicas of tablet 27330be65bac450a8ead355d41fe780e
I20260321 03:02:31.210296 8985 catalog_manager.cc:6741] ReplaceTablet: tablet 27330be65bac450a8ead355d41fe780e deleted and replaced by tablet 7c4e86aafdb24f71a59e3142235441c6
I20260321 03:02:31.210494 8985 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51854:
table { table_name: "default.Table_06e0fbe90fe0411d95d76f56b53fb175" } modify_external_catalogs: true
I20260321 03:02:31.210624 8985 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51854:
table { table_name: "default.Table_06e0fbe90fe0411d95d76f56b53fb175" } modify_external_catalogs: true
I20260321 03:02:31.212033 9048 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863: Sending DeleteTablet for 3 replicas of tablet 1806a588d8d24b18a405e1a545d9cdda
I20260321 03:02:31.221227 9136 mvcc.cc:204] Tried to move back new op lower bound from 7266558571265114112 to 7266558569714847744. Current Snapshot: MvccSnapshot[applied={T|T < 7266558571252338688}]
I20260321 03:02:31.224510 9048 catalog_manager.cc:2772] Deleting table default.table_337c18c13bb24e78bad2738358717d2d [id=06718ed7d99744ff818ac2fc5bdbf11c] in response to Hive Metastore notification log event 14
I20260321 03:02:31.234582 9048 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863: Sending DeleteTablet for 3 replicas of tablet 34cc41d9b1f24aaaa3b7140dc7a7e280
W20260321 03:02:31.245911 9048 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7c4e86aafdb24f71a59e3142235441c6 consensus state has no leader
I20260321 03:02:31.246845 9048 catalog_manager.cc:2772] Deleting table default.table_ec53d9a55a4c47b8a9b0fa3916c9c561 [id=b792550a4b344d24a9d33f468884c107] in response to Hive Metastore notification log event 20
I20260321 03:02:31.252651 8513 tablet_service.cc:1558] Processing DeleteTablet for tablet cc5de6cf47b84822810e38f094ff99ea with delete_type TABLET_DATA_DELETED (replaced by tablet 34cc41d9b1f24aaaa3b7140dc7a7e280) from {username='slave'} at 127.0.0.1:51700
I20260321 03:02:31.252995 8512 tablet_service.cc:1558] Processing DeleteTablet for tablet 4718c06ec4ed4452b91483eb6e1ae067 with delete_type TABLET_DATA_DELETED (replaced by tablet a062f5d0fc344fb9a1e8169401451bad) from {username='slave'} at 127.0.0.1:51700
I20260321 03:02:31.253171 8511 tablet_service.cc:1558] Processing DeleteTablet for tablet c8b7587407f64cbd8f6cbe2dd048547e with delete_type TABLET_DATA_DELETED (replaced by tablet 481a544d7e4a461396b26b89dfc058ac) from {username='slave'} at 127.0.0.1:51700
I20260321 03:02:31.253341 8510 tablet_service.cc:1558] Processing DeleteTablet for tablet 27330be65bac450a8ead355d41fe780e with delete_type TABLET_DATA_DELETED (replaced by tablet 7c4e86aafdb24f71a59e3142235441c6) from {username='slave'} at 127.0.0.1:51700
I20260321 03:02:31.253480 8509 tablet_service.cc:1558] Processing DeleteTablet for tablet 1806a588d8d24b18a405e1a545d9cdda with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-21 03:02:31 UTC) from {username='slave'} at 127.0.0.1:51700
I20260321 03:02:31.253638 8648 tablet_service.cc:1558] Processing DeleteTablet for tablet cc5de6cf47b84822810e38f094ff99ea with delete_type TABLET_DATA_DELETED (replaced by tablet 34cc41d9b1f24aaaa3b7140dc7a7e280) from {username='slave'} at 127.0.0.1:35526
I20260321 03:02:31.253818 8508 tablet_service.cc:1511] Processing CreateTablet for tablet 34cc41d9b1f24aaaa3b7140dc7a7e280 (DEFAULT_TABLE table=default.table_337c18c13bb24e78bad2738358717d2d [id=06718ed7d99744ff818ac2fc5bdbf11c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:31.253897 8647 tablet_service.cc:1558] Processing DeleteTablet for tablet 4718c06ec4ed4452b91483eb6e1ae067 with delete_type TABLET_DATA_DELETED (replaced by tablet a062f5d0fc344fb9a1e8169401451bad) from {username='slave'} at 127.0.0.1:35526
I20260321 03:02:31.254196 8508 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34cc41d9b1f24aaaa3b7140dc7a7e280. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:31.254220 8643 tablet_service.cc:1511] Processing CreateTablet for tablet 34cc41d9b1f24aaaa3b7140dc7a7e280 (DEFAULT_TABLE table=default.table_337c18c13bb24e78bad2738358717d2d [id=06718ed7d99744ff818ac2fc5bdbf11c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:31.254503 8643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34cc41d9b1f24aaaa3b7140dc7a7e280. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:31.256712 9048 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863: Sending DeleteTablet for 3 replicas of tablet 481a544d7e4a461396b26b89dfc058ac
I20260321 03:02:31.257304 8507 tablet_service.cc:1511] Processing CreateTablet for tablet 481a544d7e4a461396b26b89dfc058ac (DEFAULT_TABLE table=default.table_ec53d9a55a4c47b8a9b0fa3916c9c561 [id=b792550a4b344d24a9d33f468884c107]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:31.257491 8639 tablet_service.cc:1511] Processing CreateTablet for tablet a062f5d0fc344fb9a1e8169401451bad (DEFAULT_TABLE table=default.table_10dd23c6f33c4aa0bad0a534fb770d4a [id=94ef39d020ab428b9e0392bedab9483d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:31.257619 8507 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 481a544d7e4a461396b26b89dfc058ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:31.257740 8639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a062f5d0fc344fb9a1e8169401451bad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:31.260380 8506 tablet_service.cc:1511] Processing CreateTablet for tablet 7c4e86aafdb24f71a59e3142235441c6 (DEFAULT_TABLE table=default.table_9bbd1f43ebe347ed99a9be3a6ffb3d86 [id=4ac1925a391a48ea86c63da0c1d8c442]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:31.257280 8641 tablet_service.cc:1511] Processing CreateTablet for tablet 481a544d7e4a461396b26b89dfc058ac (DEFAULT_TABLE table=default.table_ec53d9a55a4c47b8a9b0fa3916c9c561 [id=b792550a4b344d24a9d33f468884c107]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:31.260684 8506 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c4e86aafdb24f71a59e3142235441c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:31.260710 8641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 481a544d7e4a461396b26b89dfc058ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:31.261152 9048 catalog_manager.cc:2772] Deleting table default.table_9b16e83d2d334faaa3ccd9aaae03ccf7 [id=ac7f63999ecc43328aa76b55c07ab529] in response to Hive Metastore notification log event 21
I20260321 03:02:31.261282 8505 tablet_service.cc:1511] Processing CreateTablet for tablet a062f5d0fc344fb9a1e8169401451bad (DEFAULT_TABLE table=default.table_10dd23c6f33c4aa0bad0a534fb770d4a [id=94ef39d020ab428b9e0392bedab9483d]), partition=RANGE (key) PARTITION UNBOUNDED
W20260321 03:02:31.261410 9048 hms_notification_log_listener.cc:329] Failed to handle Hive Metastore notification: 21 DROP_TABLE default.table_9b16e83d2d334faaa3ccd9aaae03ccf7: Not found: the table does not exist: table_id: "ac7f63999ecc43328aa76b55c07ab529" table_name: "default.table_9b16e83d2d334faaa3ccd9aaae03ccf7"
I20260321 03:02:31.261534 8504 tablet_service.cc:1558] Processing DeleteTablet for tablet 34cc41d9b1f24aaaa3b7140dc7a7e280 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-21 03:02:31 UTC) from {username='slave'} at 127.0.0.1:51700
I20260321 03:02:31.261847 8646 tablet_service.cc:1558] Processing DeleteTablet for tablet c8b7587407f64cbd8f6cbe2dd048547e with delete_type TABLET_DATA_DELETED (replaced by tablet 481a544d7e4a461396b26b89dfc058ac) from {username='slave'} at 127.0.0.1:35526
I20260321 03:02:31.262025 8645 tablet_service.cc:1558] Processing DeleteTablet for tablet 27330be65bac450a8ead355d41fe780e with delete_type TABLET_DATA_DELETED (replaced by tablet 7c4e86aafdb24f71a59e3142235441c6) from {username='slave'} at 127.0.0.1:35526
I20260321 03:02:31.262188 8644 tablet_service.cc:1558] Processing DeleteTablet for tablet 1806a588d8d24b18a405e1a545d9cdda with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-21 03:02:31 UTC) from {username='slave'} at 127.0.0.1:35526
I20260321 03:02:31.262709 8505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a062f5d0fc344fb9a1e8169401451bad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:31.263262 8640 tablet_service.cc:1511] Processing CreateTablet for tablet 7c4e86aafdb24f71a59e3142235441c6 (DEFAULT_TABLE table=default.table_9bbd1f43ebe347ed99a9be3a6ffb3d86 [id=4ac1925a391a48ea86c63da0c1d8c442]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:31.263517 8638 tablet_service.cc:1558] Processing DeleteTablet for tablet 34cc41d9b1f24aaaa3b7140dc7a7e280 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-21 03:02:31 UTC) from {username='slave'} at 127.0.0.1:35526
I20260321 03:02:31.265407 8640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c4e86aafdb24f71a59e3142235441c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:31.266687 8418 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260321 03:02:31.271054 8988 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_d52655a709224a7d999af3a2f1f2a678 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260321 03:02:31.272436 8989 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_d2585fcc892d4f4882c0a068ce656fee in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260321 03:02:31.273432 8505 tablet_service.cc:1558] Processing DeleteTablet for tablet 481a544d7e4a461396b26b89dfc058ac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-21 03:02:31 UTC) from {username='slave'} at 127.0.0.1:51700
W20260321 03:02:31.274065 8981 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_a8ad6a72849a42ab9d21634ee3041396 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260321 03:02:31.275033 8984 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_a6ce605126a947cfa6a44f2124f15087 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260321 03:02:31.275746 8986 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_9017f1e107c846008985a821415447b8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260321 03:02:31.277462 8639 tablet_service.cc:1558] Processing DeleteTablet for tablet 481a544d7e4a461396b26b89dfc058ac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-21 03:02:31 UTC) from {username='slave'} at 127.0.0.1:35526
W20260321 03:02:31.277676 8972 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet 7c4e86aafdb24f71a59e3142235441c6 (table default.table_c8e5202d265f463bbcf568d34a1e64a2 [id=4ac1925a391a48ea86c63da0c1d8c442], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 7c4e86aafdb24f71a59e3142235441c6 consensus state has no leader
I20260321 03:02:31.281561 9157 tablet_bootstrap.cc:492] T 34cc41d9b1f24aaaa3b7140dc7a7e280 P 4532b54a008a4a39b663112e6d0aacc0: Bootstrap starting.
I20260321 03:02:31.281816 8781 tablet_service.cc:1558] Processing DeleteTablet for tablet 1806a588d8d24b18a405e1a545d9cdda with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-21 03:02:31 UTC) from {username='slave'} at 127.0.0.1:58818
I20260321 03:02:31.282078 8783 tablet_service.cc:1558] Processing DeleteTablet for tablet cc5de6cf47b84822810e38f094ff99ea with delete_type TABLET_DATA_DELETED (replaced by tablet 34cc41d9b1f24aaaa3b7140dc7a7e280) from {username='slave'} at 127.0.0.1:58818
I20260321 03:02:31.282197 8784 tablet_service.cc:1558] Processing DeleteTablet for tablet 4718c06ec4ed4452b91483eb6e1ae067 with delete_type TABLET_DATA_DELETED (replaced by tablet a062f5d0fc344fb9a1e8169401451bad) from {username='slave'} at 127.0.0.1:58818
I20260321 03:02:31.282295 8782 tablet_service.cc:1558] Processing DeleteTablet for tablet c8b7587407f64cbd8f6cbe2dd048547e with delete_type TABLET_DATA_DELETED (replaced by tablet 481a544d7e4a461396b26b89dfc058ac) from {username='slave'} at 127.0.0.1:58818
I20260321 03:02:31.282323 8779 tablet_service.cc:1511] Processing CreateTablet for tablet 481a544d7e4a461396b26b89dfc058ac (DEFAULT_TABLE table=default.table_ec53d9a55a4c47b8a9b0fa3916c9c561 [id=b792550a4b344d24a9d33f468884c107]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:31.282409 8780 tablet_service.cc:1558] Processing DeleteTablet for tablet 27330be65bac450a8ead355d41fe780e with delete_type TABLET_DATA_DELETED (replaced by tablet 7c4e86aafdb24f71a59e3142235441c6) from {username='slave'} at 127.0.0.1:58818
I20260321 03:02:31.282629 8779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 481a544d7e4a461396b26b89dfc058ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:31.282670 8777 tablet_service.cc:1511] Processing CreateTablet for tablet 34cc41d9b1f24aaaa3b7140dc7a7e280 (DEFAULT_TABLE table=default.table_337c18c13bb24e78bad2738358717d2d [id=06718ed7d99744ff818ac2fc5bdbf11c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:31.282874 8777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34cc41d9b1f24aaaa3b7140dc7a7e280. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:31.283053 8776 tablet_service.cc:1511] Processing CreateTablet for tablet a062f5d0fc344fb9a1e8169401451bad (DEFAULT_TABLE table=default.table_10dd23c6f33c4aa0bad0a534fb770d4a [id=94ef39d020ab428b9e0392bedab9483d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:31.283288 8776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a062f5d0fc344fb9a1e8169401451bad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:31.285300 8778 tablet_service.cc:1511] Processing CreateTablet for tablet 7c4e86aafdb24f71a59e3142235441c6 (DEFAULT_TABLE table=default.table_9bbd1f43ebe347ed99a9be3a6ffb3d86 [id=4ac1925a391a48ea86c63da0c1d8c442]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:31.285604 8778 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c4e86aafdb24f71a59e3142235441c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:31.285332 8775 tablet_service.cc:1558] Processing DeleteTablet for tablet 34cc41d9b1f24aaaa3b7140dc7a7e280 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-21 03:02:31 UTC) from {username='slave'} at 127.0.0.1:58818
I20260321 03:02:31.285382 8774 tablet_service.cc:1558] Processing DeleteTablet for tablet 481a544d7e4a461396b26b89dfc058ac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-21 03:02:31 UTC) from {username='slave'} at 127.0.0.1:58818
I20260321 03:02:31.290848 9157 tablet_bootstrap.cc:654] T 34cc41d9b1f24aaaa3b7140dc7a7e280 P 4532b54a008a4a39b663112e6d0aacc0: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:31.291975 8272 catalog_manager.cc:2184] deleted orphaned HMS catalog entry for table [id=435759bdc4464e5f859546dfc760d6ad]
I20260321 03:02:31.292217 8272 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:39954 (request call id 21) took 2086 ms. Trace:
I20260321 03:02:31.292275 8272 rpcz_store.cc:276] 0321 03:02:29.205523 (+ 0us) service_pool.cc:168] Inserting onto call queue
0321 03:02:29.489681 (+284158us) service_pool.cc:225] Handling call
0321 03:02:30.240380 (+750699us) catalog_manager.cc:2101] Acquired catalog manager lock
0321 03:02:30.240720 (+ 340us) catalog_manager.cc:2147] Created new table and tablet info
0321 03:02:31.013621 (+772901us) catalog_manager.cc:2173] Created new table in HMS catalog
0321 03:02:31.014214 (+ 593us) write_op.cc:489] Releasing partition, row and schema locks
0321 03:02:31.014216 (+ 2us) write_op.cc:454] Released schema lock
0321 03:02:31.014354 (+ 138us) catalog_manager.cc:2181] Rolling back HMS table creation
0321 03:02:31.292199 (+277845us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0321 03:02:31.014159 (+ 0us) op_driver.cc:389] HandleFailure(Illegal state: replica 7451d7c0a71f4620a6607f74b5a22f2e is not leader of this config: current role FOLLOWER)
0321 03:02:31.014169 (+ 10us) write_op.cc:489] Releasing partition, row and schema locks
0321 03:02:31.014174 (+ 5us) write_op.cc:454] Released schema lock
0321 03:02:31.014177 (+ 3us) write_op.cc:335] FINISH: Op aborted
Metrics: {"Hive Metastore.queue_time_us":922082,"Hive Metastore.run_cpu_time_us":406,"Hive Metastore.run_wall_time_us":128043,"child_traces":[["op",{}]]}
I20260321 03:02:31.294602 9156 tablet_replica.cc:333] T cc5de6cf47b84822810e38f094ff99ea P 70e7666c46844503beb466fdc054a6fc: stopping tablet replica
I20260321 03:02:31.294979 9156 raft_consensus.cc:2243] T cc5de6cf47b84822810e38f094ff99ea P 70e7666c46844503beb466fdc054a6fc [term 1 LEADER]: Raft consensus shutting down.
I20260321 03:02:31.295527 9156 raft_consensus.cc:2272] T cc5de6cf47b84822810e38f094ff99ea P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260321 03:02:31.297724 9156 ts_tablet_manager.cc:1916] T cc5de6cf47b84822810e38f094ff99ea P 70e7666c46844503beb466fdc054a6fc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260321 03:02:31.301386 9158 tablet_bootstrap.cc:492] T 34cc41d9b1f24aaaa3b7140dc7a7e280 P 70e7666c46844503beb466fdc054a6fc: Bootstrap starting.
I20260321 03:02:31.303045 9158 tablet_bootstrap.cc:654] T 34cc41d9b1f24aaaa3b7140dc7a7e280 P 70e7666c46844503beb466fdc054a6fc: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:31.304085 9155 tablet_replica.cc:333] T cc5de6cf47b84822810e38f094ff99ea P 4532b54a008a4a39b663112e6d0aacc0: stopping tablet replica
I20260321 03:02:31.304353 9155 raft_consensus.cc:2243] T cc5de6cf47b84822810e38f094ff99ea P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260321 03:02:31.304584 9155 raft_consensus.cc:2272] T cc5de6cf47b84822810e38f094ff99ea P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260321 03:02:31.305133 9155 ts_tablet_manager.cc:1916] T cc5de6cf47b84822810e38f094ff99ea P 4532b54a008a4a39b663112e6d0aacc0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260321 03:02:31.308591 9155 ts_tablet_manager.cc:1929] T cc5de6cf47b84822810e38f094ff99ea P 4532b54a008a4a39b663112e6d0aacc0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260321 03:02:31.309298 9155 log.cc:1199] T cc5de6cf47b84822810e38f094ff99ea P 4532b54a008a4a39b663112e6d0aacc0: Deleting WAL directory at /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-0/wal/wals/cc5de6cf47b84822810e38f094ff99ea
I20260321 03:02:31.316290 9161 tablet_bootstrap.cc:492] T a062f5d0fc344fb9a1e8169401451bad P a97f7dd77cf2444f8fdb441019081f79: Bootstrap starting.
I20260321 03:02:31.317824 9161 tablet_bootstrap.cc:654] T a062f5d0fc344fb9a1e8169401451bad P a97f7dd77cf2444f8fdb441019081f79: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:31.318831 9160 tablet_replica.cc:333] T 1806a588d8d24b18a405e1a545d9cdda P a97f7dd77cf2444f8fdb441019081f79: stopping tablet replica
I20260321 03:02:31.319087 9160 raft_consensus.cc:2243] T 1806a588d8d24b18a405e1a545d9cdda P a97f7dd77cf2444f8fdb441019081f79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260321 03:02:31.319324 9160 raft_consensus.cc:2272] T 1806a588d8d24b18a405e1a545d9cdda P a97f7dd77cf2444f8fdb441019081f79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260321 03:02:31.319936 9160 ts_tablet_manager.cc:1916] T 1806a588d8d24b18a405e1a545d9cdda P a97f7dd77cf2444f8fdb441019081f79: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260321 03:02:31.324662 9158 tablet_bootstrap.cc:492] T 34cc41d9b1f24aaaa3b7140dc7a7e280 P 70e7666c46844503beb466fdc054a6fc: No bootstrap required, opened a new log
I20260321 03:02:31.323391 9157 tablet_bootstrap.cc:492] T 34cc41d9b1f24aaaa3b7140dc7a7e280 P 4532b54a008a4a39b663112e6d0aacc0: No bootstrap required, opened a new log
I20260321 03:02:31.324841 9158 ts_tablet_manager.cc:1403] T 34cc41d9b1f24aaaa3b7140dc7a7e280 P 70e7666c46844503beb466fdc054a6fc: Time spent bootstrapping tablet: real 0.024s user 0.003s sys 0.000s
I20260321 03:02:31.324952 9157 ts_tablet_manager.cc:1403] T 34cc41d9b1f24aaaa3b7140dc7a7e280 P 4532b54a008a4a39b663112e6d0aacc0: Time spent bootstrapping tablet: real 0.044s user 0.003s sys 0.000s
I20260321 03:02:31.325174 9170 tablet.cc:1723] T ffa603a7e8404c968e09e26e5b277911 P 70e7666c46844503beb466fdc054a6fc: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260321 03:02:31.324690 9156 ts_tablet_manager.cc:1929] T cc5de6cf47b84822810e38f094ff99ea P 70e7666c46844503beb466fdc054a6fc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260321 03:02:31.325559 9156 log.cc:1199] T cc5de6cf47b84822810e38f094ff99ea P 70e7666c46844503beb466fdc054a6fc: Deleting WAL directory at /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-1/wal/wals/cc5de6cf47b84822810e38f094ff99ea
I20260321 03:02:31.325699 9157 raft_consensus.cc:359] T 34cc41d9b1f24aaaa3b7140dc7a7e280 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } }
I20260321 03:02:31.325836 9157 raft_consensus.cc:385] T 34cc41d9b1f24aaaa3b7140dc7a7e280 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:31.325876 9157 raft_consensus.cc:740] T 34cc41d9b1f24aaaa3b7140dc7a7e280 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4532b54a008a4a39b663112e6d0aacc0, State: Initialized, Role: FOLLOWER
I20260321 03:02:31.326021 9157 consensus_queue.cc:260] T 34cc41d9b1f24aaaa3b7140dc7a7e280 P 4532b54a008a4a39b663112e6d0aacc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } }
I20260321 03:02:31.326807 9157 ts_tablet_manager.cc:1434] T 34cc41d9b1f24aaaa3b7140dc7a7e280 P 4532b54a008a4a39b663112e6d0aacc0: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260321 03:02:31.327041 9157 tablet_bootstrap.cc:492] T 481a544d7e4a461396b26b89dfc058ac P 4532b54a008a4a39b663112e6d0aacc0: Bootstrap starting.
I20260321 03:02:31.325004 9155 ts_tablet_manager.cc:1950] T cc5de6cf47b84822810e38f094ff99ea P 4532b54a008a4a39b663112e6d0aacc0: Deleting consensus metadata
I20260321 03:02:31.328290 9155 tablet_replica.cc:333] T 4718c06ec4ed4452b91483eb6e1ae067 P 4532b54a008a4a39b663112e6d0aacc0: stopping tablet replica
I20260321 03:02:31.328406 9155 raft_consensus.cc:2243] T 4718c06ec4ed4452b91483eb6e1ae067 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260321 03:02:31.328552 9155 raft_consensus.cc:2272] T 4718c06ec4ed4452b91483eb6e1ae067 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260321 03:02:31.328897 9155 ts_tablet_manager.cc:1916] T 4718c06ec4ed4452b91483eb6e1ae067 P 4532b54a008a4a39b663112e6d0aacc0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260321 03:02:31.330068 9157 tablet_bootstrap.cc:654] T 481a544d7e4a461396b26b89dfc058ac P 4532b54a008a4a39b663112e6d0aacc0: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:31.332701 8714 heartbeater.cc:499] Master 127.7.178.252:45145 was elected leader, sending a full tablet report...
I20260321 03:02:31.332837 9155 ts_tablet_manager.cc:1929] T 4718c06ec4ed4452b91483eb6e1ae067 P 4532b54a008a4a39b663112e6d0aacc0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260321 03:02:31.332902 9155 log.cc:1199] T 4718c06ec4ed4452b91483eb6e1ae067 P 4532b54a008a4a39b663112e6d0aacc0: Deleting WAL directory at /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-0/wal/wals/4718c06ec4ed4452b91483eb6e1ae067
I20260321 03:02:31.333150 9155 ts_tablet_manager.cc:1950] T 4718c06ec4ed4452b91483eb6e1ae067 P 4532b54a008a4a39b663112e6d0aacc0: Deleting consensus metadata
I20260321 03:02:31.334789 8972 catalog_manager.cc:5002] TS 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171): tablet 4718c06ec4ed4452b91483eb6e1ae067 (table default.table_10dd23c6f33c4aa0bad0a534fb770d4a [id=94ef39d020ab428b9e0392bedab9483d]) successfully deleted
I20260321 03:02:31.335364 9155 tablet_replica.cc:333] T c8b7587407f64cbd8f6cbe2dd048547e P 4532b54a008a4a39b663112e6d0aacc0: stopping tablet replica
I20260321 03:02:31.335551 9155 raft_consensus.cc:2243] T c8b7587407f64cbd8f6cbe2dd048547e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260321 03:02:31.335700 9155 raft_consensus.cc:2272] T c8b7587407f64cbd8f6cbe2dd048547e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260321 03:02:31.336131 9155 ts_tablet_manager.cc:1916] T c8b7587407f64cbd8f6cbe2dd048547e P 4532b54a008a4a39b663112e6d0aacc0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260321 03:02:31.336779 9160 ts_tablet_manager.cc:1929] T 1806a588d8d24b18a405e1a545d9cdda P a97f7dd77cf2444f8fdb441019081f79: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260321 03:02:31.336895 9160 log.cc:1199] T 1806a588d8d24b18a405e1a545d9cdda P a97f7dd77cf2444f8fdb441019081f79: Deleting WAL directory at /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-2/wal/wals/1806a588d8d24b18a405e1a545d9cdda
I20260321 03:02:31.337183 9160 ts_tablet_manager.cc:1950] T 1806a588d8d24b18a405e1a545d9cdda P a97f7dd77cf2444f8fdb441019081f79: Deleting consensus metadata
I20260321 03:02:31.338025 9160 tablet_replica.cc:333] T cc5de6cf47b84822810e38f094ff99ea P a97f7dd77cf2444f8fdb441019081f79: stopping tablet replica
I20260321 03:02:31.338037 8974 catalog_manager.cc:5002] TS a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): tablet 1806a588d8d24b18a405e1a545d9cdda (table default.table_9731292f060b48d7a3b304a142988570 [id=3fbb48538eb34ee9ae7b462f2af6d628]) successfully deleted
I20260321 03:02:31.338162 9160 raft_consensus.cc:2243] T cc5de6cf47b84822810e38f094ff99ea P a97f7dd77cf2444f8fdb441019081f79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260321 03:02:31.338254 9160 raft_consensus.cc:2272] T cc5de6cf47b84822810e38f094ff99ea P a97f7dd77cf2444f8fdb441019081f79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260321 03:02:31.338626 9155 ts_tablet_manager.cc:1929] T c8b7587407f64cbd8f6cbe2dd048547e P 4532b54a008a4a39b663112e6d0aacc0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260321 03:02:31.338701 9155 log.cc:1199] T c8b7587407f64cbd8f6cbe2dd048547e P 4532b54a008a4a39b663112e6d0aacc0: Deleting WAL directory at /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-0/wal/wals/c8b7587407f64cbd8f6cbe2dd048547e
I20260321 03:02:31.339182 9160 ts_tablet_manager.cc:1916] T cc5de6cf47b84822810e38f094ff99ea P a97f7dd77cf2444f8fdb441019081f79: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260321 03:02:31.339365 9155 ts_tablet_manager.cc:1950] T c8b7587407f64cbd8f6cbe2dd048547e P 4532b54a008a4a39b663112e6d0aacc0: Deleting consensus metadata
I20260321 03:02:31.340250 9155 tablet_replica.cc:333] T 27330be65bac450a8ead355d41fe780e P 4532b54a008a4a39b663112e6d0aacc0: stopping tablet replica
I20260321 03:02:31.340389 9155 raft_consensus.cc:2243] T 27330be65bac450a8ead355d41fe780e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260321 03:02:31.340519 9155 raft_consensus.cc:2272] T 27330be65bac450a8ead355d41fe780e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260321 03:02:31.340903 9155 ts_tablet_manager.cc:1916] T 27330be65bac450a8ead355d41fe780e P 4532b54a008a4a39b663112e6d0aacc0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260321 03:02:31.341377 9160 ts_tablet_manager.cc:1929] T cc5de6cf47b84822810e38f094ff99ea P a97f7dd77cf2444f8fdb441019081f79: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260321 03:02:31.341514 9160 log.cc:1199] T cc5de6cf47b84822810e38f094ff99ea P a97f7dd77cf2444f8fdb441019081f79: Deleting WAL directory at /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-2/wal/wals/cc5de6cf47b84822810e38f094ff99ea
I20260321 03:02:31.341774 9156 ts_tablet_manager.cc:1950] T cc5de6cf47b84822810e38f094ff99ea P 70e7666c46844503beb466fdc054a6fc: Deleting consensus metadata
I20260321 03:02:31.341856 9160 ts_tablet_manager.cc:1950] T cc5de6cf47b84822810e38f094ff99ea P a97f7dd77cf2444f8fdb441019081f79: Deleting consensus metadata
I20260321 03:02:31.342561 9160 tablet_replica.cc:333] T 4718c06ec4ed4452b91483eb6e1ae067 P a97f7dd77cf2444f8fdb441019081f79: stopping tablet replica
I20260321 03:02:31.342689 9160 raft_consensus.cc:2243] T 4718c06ec4ed4452b91483eb6e1ae067 P a97f7dd77cf2444f8fdb441019081f79 [term 1 LEADER]: Raft consensus shutting down.
I20260321 03:02:31.342911 9160 raft_consensus.cc:2272] T 4718c06ec4ed4452b91483eb6e1ae067 P a97f7dd77cf2444f8fdb441019081f79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260321 03:02:31.343257 9160 ts_tablet_manager.cc:1916] T 4718c06ec4ed4452b91483eb6e1ae067 P a97f7dd77cf2444f8fdb441019081f79: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260321 03:02:31.343894 9155 ts_tablet_manager.cc:1929] T 27330be65bac450a8ead355d41fe780e P 4532b54a008a4a39b663112e6d0aacc0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260321 03:02:31.344018 9155 log.cc:1199] T 27330be65bac450a8ead355d41fe780e P 4532b54a008a4a39b663112e6d0aacc0: Deleting WAL directory at /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-0/wal/wals/27330be65bac450a8ead355d41fe780e
I20260321 03:02:31.344301 9155 ts_tablet_manager.cc:1950] T 27330be65bac450a8ead355d41fe780e P 4532b54a008a4a39b663112e6d0aacc0: Deleting consensus metadata
I20260321 03:02:31.345118 9160 ts_tablet_manager.cc:1929] T 4718c06ec4ed4452b91483eb6e1ae067 P a97f7dd77cf2444f8fdb441019081f79: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260321 03:02:31.345216 9160 log.cc:1199] T 4718c06ec4ed4452b91483eb6e1ae067 P a97f7dd77cf2444f8fdb441019081f79: Deleting WAL directory at /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-2/wal/wals/4718c06ec4ed4452b91483eb6e1ae067
I20260321 03:02:31.345527 9160 ts_tablet_manager.cc:1950] T 4718c06ec4ed4452b91483eb6e1ae067 P a97f7dd77cf2444f8fdb441019081f79: Deleting consensus metadata
I20260321 03:02:31.345692 8972 catalog_manager.cc:5002] TS 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171): tablet 27330be65bac450a8ead355d41fe780e (table default.table_c8e5202d265f463bbcf568d34a1e64a2 [id=4ac1925a391a48ea86c63da0c1d8c442]) successfully deleted
I20260321 03:02:31.346091 9155 tablet_replica.cc:333] T 1806a588d8d24b18a405e1a545d9cdda P 4532b54a008a4a39b663112e6d0aacc0: stopping tablet replica
I20260321 03:02:31.346259 9155 raft_consensus.cc:2243] T 1806a588d8d24b18a405e1a545d9cdda P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260321 03:02:31.346393 9160 tablet_replica.cc:333] T c8b7587407f64cbd8f6cbe2dd048547e P a97f7dd77cf2444f8fdb441019081f79: stopping tablet replica
I20260321 03:02:31.346416 9155 raft_consensus.cc:2272] T 1806a588d8d24b18a405e1a545d9cdda P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260321 03:02:31.346549 9160 raft_consensus.cc:2243] T c8b7587407f64cbd8f6cbe2dd048547e P a97f7dd77cf2444f8fdb441019081f79 [term 1 LEADER]: Raft consensus shutting down.
I20260321 03:02:31.346721 9160 raft_consensus.cc:2272] T c8b7587407f64cbd8f6cbe2dd048547e P a97f7dd77cf2444f8fdb441019081f79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260321 03:02:31.346984 9155 ts_tablet_manager.cc:1916] T 1806a588d8d24b18a405e1a545d9cdda P 4532b54a008a4a39b663112e6d0aacc0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260321 03:02:31.347021 8974 catalog_manager.cc:5002] TS a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): tablet 4718c06ec4ed4452b91483eb6e1ae067 (table default.table_10dd23c6f33c4aa0bad0a534fb770d4a [id=94ef39d020ab428b9e0392bedab9483d]) successfully deleted
I20260321 03:02:31.347093 9160 ts_tablet_manager.cc:1916] T c8b7587407f64cbd8f6cbe2dd048547e P a97f7dd77cf2444f8fdb441019081f79: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260321 03:02:31.349013 9160 ts_tablet_manager.cc:1929] T c8b7587407f64cbd8f6cbe2dd048547e P a97f7dd77cf2444f8fdb441019081f79: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260321 03:02:31.349131 9160 log.cc:1199] T c8b7587407f64cbd8f6cbe2dd048547e P a97f7dd77cf2444f8fdb441019081f79: Deleting WAL directory at /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-2/wal/wals/c8b7587407f64cbd8f6cbe2dd048547e
I20260321 03:02:31.349463 9160 ts_tablet_manager.cc:1950] T c8b7587407f64cbd8f6cbe2dd048547e P a97f7dd77cf2444f8fdb441019081f79: Deleting consensus metadata
I20260321 03:02:31.349707 9155 ts_tablet_manager.cc:1929] T 1806a588d8d24b18a405e1a545d9cdda P 4532b54a008a4a39b663112e6d0aacc0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260321 03:02:31.350893 9156 tablet_replica.cc:333] T 4718c06ec4ed4452b91483eb6e1ae067 P 70e7666c46844503beb466fdc054a6fc: stopping tablet replica
I20260321 03:02:31.351111 9156 raft_consensus.cc:2243] T 4718c06ec4ed4452b91483eb6e1ae067 P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260321 03:02:31.351377 9156 raft_consensus.cc:2272] T 4718c06ec4ed4452b91483eb6e1ae067 P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260321 03:02:31.351913 9156 ts_tablet_manager.cc:1916] T 4718c06ec4ed4452b91483eb6e1ae067 P 70e7666c46844503beb466fdc054a6fc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260321 03:02:31.354650 9156 ts_tablet_manager.cc:1929] T 4718c06ec4ed4452b91483eb6e1ae067 P 70e7666c46844503beb466fdc054a6fc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260321 03:02:31.355216 9156 log.cc:1199] T 4718c06ec4ed4452b91483eb6e1ae067 P 70e7666c46844503beb466fdc054a6fc: Deleting WAL directory at /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-1/wal/wals/4718c06ec4ed4452b91483eb6e1ae067
I20260321 03:02:31.355626 9156 ts_tablet_manager.cc:1950] T 4718c06ec4ed4452b91483eb6e1ae067 P 70e7666c46844503beb466fdc054a6fc: Deleting consensus metadata
I20260321 03:02:31.356711 8971 catalog_manager.cc:5002] TS 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): tablet 4718c06ec4ed4452b91483eb6e1ae067 (table default.table_10dd23c6f33c4aa0bad0a534fb770d4a [id=94ef39d020ab428b9e0392bedab9483d]) successfully deleted
I20260321 03:02:31.357088 9156 tablet_replica.cc:333] T c8b7587407f64cbd8f6cbe2dd048547e P 70e7666c46844503beb466fdc054a6fc: stopping tablet replica
I20260321 03:02:31.357323 9156 raft_consensus.cc:2243] T c8b7587407f64cbd8f6cbe2dd048547e P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260321 03:02:31.357537 9156 raft_consensus.cc:2272] T c8b7587407f64cbd8f6cbe2dd048547e P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260321 03:02:31.358033 9156 ts_tablet_manager.cc:1916] T c8b7587407f64cbd8f6cbe2dd048547e P 70e7666c46844503beb466fdc054a6fc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260321 03:02:31.358382 9158 raft_consensus.cc:359] T 34cc41d9b1f24aaaa3b7140dc7a7e280 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } }
I20260321 03:02:31.358549 9158 raft_consensus.cc:385] T 34cc41d9b1f24aaaa3b7140dc7a7e280 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:31.358589 9158 raft_consensus.cc:740] T 34cc41d9b1f24aaaa3b7140dc7a7e280 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70e7666c46844503beb466fdc054a6fc, State: Initialized, Role: FOLLOWER
I20260321 03:02:31.358738 9158 consensus_queue.cc:260] T 34cc41d9b1f24aaaa3b7140dc7a7e280 P 70e7666c46844503beb466fdc054a6fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } }
I20260321 03:02:31.359046 9158 ts_tablet_manager.cc:1434] T 34cc41d9b1f24aaaa3b7140dc7a7e280 P 70e7666c46844503beb466fdc054a6fc: Time spent starting tablet: real 0.034s user 0.001s sys 0.000s
I20260321 03:02:31.359247 9158 tablet_bootstrap.cc:492] T a062f5d0fc344fb9a1e8169401451bad P 70e7666c46844503beb466fdc054a6fc: Bootstrap starting.
I20260321 03:02:31.360617 9158 tablet_bootstrap.cc:654] T a062f5d0fc344fb9a1e8169401451bad P 70e7666c46844503beb466fdc054a6fc: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:31.361862 9161 tablet_bootstrap.cc:492] T a062f5d0fc344fb9a1e8169401451bad P a97f7dd77cf2444f8fdb441019081f79: No bootstrap required, opened a new log
I20260321 03:02:31.362043 9161 ts_tablet_manager.cc:1403] T a062f5d0fc344fb9a1e8169401451bad P a97f7dd77cf2444f8fdb441019081f79: Time spent bootstrapping tablet: real 0.046s user 0.003s sys 0.000s
I20260321 03:02:31.362658 9161 raft_consensus.cc:359] T a062f5d0fc344fb9a1e8169401451bad P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } }
I20260321 03:02:31.362854 9161 raft_consensus.cc:385] T a062f5d0fc344fb9a1e8169401451bad P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:31.362936 9161 raft_consensus.cc:740] T a062f5d0fc344fb9a1e8169401451bad P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a97f7dd77cf2444f8fdb441019081f79, State: Initialized, Role: FOLLOWER
I20260321 03:02:31.363174 9161 consensus_queue.cc:260] T a062f5d0fc344fb9a1e8169401451bad P a97f7dd77cf2444f8fdb441019081f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } }
I20260321 03:02:31.363580 9161 ts_tablet_manager.cc:1434] T a062f5d0fc344fb9a1e8169401451bad P a97f7dd77cf2444f8fdb441019081f79: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260321 03:02:31.364429 9158 tablet_bootstrap.cc:492] T a062f5d0fc344fb9a1e8169401451bad P 70e7666c46844503beb466fdc054a6fc: No bootstrap required, opened a new log
I20260321 03:02:31.364591 9158 ts_tablet_manager.cc:1403] T a062f5d0fc344fb9a1e8169401451bad P 70e7666c46844503beb466fdc054a6fc: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260321 03:02:31.366842 9158 raft_consensus.cc:359] T a062f5d0fc344fb9a1e8169401451bad P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } }
I20260321 03:02:31.367058 9158 raft_consensus.cc:385] T a062f5d0fc344fb9a1e8169401451bad P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:31.367141 9158 raft_consensus.cc:740] T a062f5d0fc344fb9a1e8169401451bad P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70e7666c46844503beb466fdc054a6fc, State: Initialized, Role: FOLLOWER
I20260321 03:02:31.367307 9161 tablet_bootstrap.cc:492] T 7c4e86aafdb24f71a59e3142235441c6 P a97f7dd77cf2444f8fdb441019081f79: Bootstrap starting.
I20260321 03:02:31.367486 9158 consensus_queue.cc:260] T a062f5d0fc344fb9a1e8169401451bad P 70e7666c46844503beb466fdc054a6fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } }
I20260321 03:02:31.367895 9158 ts_tablet_manager.cc:1434] T a062f5d0fc344fb9a1e8169401451bad P 70e7666c46844503beb466fdc054a6fc: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260321 03:02:31.368173 9158 tablet_bootstrap.cc:492] T 7c4e86aafdb24f71a59e3142235441c6 P 70e7666c46844503beb466fdc054a6fc: Bootstrap starting.
I20260321 03:02:31.368441 9171 tablet.cc:1723] T ffa603a7e8404c968e09e26e5b277911 P 4532b54a008a4a39b663112e6d0aacc0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260321 03:02:31.374902 9161 tablet_bootstrap.cc:654] T 7c4e86aafdb24f71a59e3142235441c6 P a97f7dd77cf2444f8fdb441019081f79: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:31.375782 9158 tablet_bootstrap.cc:654] T 7c4e86aafdb24f71a59e3142235441c6 P 70e7666c46844503beb466fdc054a6fc: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:31.373719 9160 tablet_replica.cc:333] T 27330be65bac450a8ead355d41fe780e P a97f7dd77cf2444f8fdb441019081f79: stopping tablet replica
I20260321 03:02:31.376220 9157 tablet_bootstrap.cc:492] T 481a544d7e4a461396b26b89dfc058ac P 4532b54a008a4a39b663112e6d0aacc0: No bootstrap required, opened a new log
I20260321 03:02:31.376329 9157 ts_tablet_manager.cc:1403] T 481a544d7e4a461396b26b89dfc058ac P 4532b54a008a4a39b663112e6d0aacc0: Time spent bootstrapping tablet: real 0.049s user 0.002s sys 0.000s
I20260321 03:02:31.376493 9160 raft_consensus.cc:2243] T 27330be65bac450a8ead355d41fe780e P a97f7dd77cf2444f8fdb441019081f79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260321 03:02:31.376883 9172 tablet.cc:1723] T ffa603a7e8404c968e09e26e5b277911 P a97f7dd77cf2444f8fdb441019081f79: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260321 03:02:31.376912 9157 raft_consensus.cc:359] T 481a544d7e4a461396b26b89dfc058ac P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } }
I20260321 03:02:31.377023 9157 raft_consensus.cc:385] T 481a544d7e4a461396b26b89dfc058ac P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:31.377064 9157 raft_consensus.cc:740] T 481a544d7e4a461396b26b89dfc058ac P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4532b54a008a4a39b663112e6d0aacc0, State: Initialized, Role: FOLLOWER
I20260321 03:02:31.377216 9157 consensus_queue.cc:260] T 481a544d7e4a461396b26b89dfc058ac P 4532b54a008a4a39b663112e6d0aacc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } }
I20260321 03:02:31.377550 9157 ts_tablet_manager.cc:1434] T 481a544d7e4a461396b26b89dfc058ac P 4532b54a008a4a39b663112e6d0aacc0: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260321 03:02:31.377740 9157 tablet_bootstrap.cc:492] T a062f5d0fc344fb9a1e8169401451bad P 4532b54a008a4a39b663112e6d0aacc0: Bootstrap starting.
I20260321 03:02:31.377839 9158 tablet_bootstrap.cc:492] T 7c4e86aafdb24f71a59e3142235441c6 P 70e7666c46844503beb466fdc054a6fc: No bootstrap required, opened a new log
I20260321 03:02:31.377931 9158 ts_tablet_manager.cc:1403] T 7c4e86aafdb24f71a59e3142235441c6 P 70e7666c46844503beb466fdc054a6fc: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20260321 03:02:31.378811 9157 tablet_bootstrap.cc:654] T a062f5d0fc344fb9a1e8169401451bad P 4532b54a008a4a39b663112e6d0aacc0: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:31.378468 9158 raft_consensus.cc:359] T 7c4e86aafdb24f71a59e3142235441c6 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } }
I20260321 03:02:31.379088 9158 raft_consensus.cc:385] T 7c4e86aafdb24f71a59e3142235441c6 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:31.379139 9158 raft_consensus.cc:740] T 7c4e86aafdb24f71a59e3142235441c6 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70e7666c46844503beb466fdc054a6fc, State: Initialized, Role: FOLLOWER
I20260321 03:02:31.379297 9158 consensus_queue.cc:260] T 7c4e86aafdb24f71a59e3142235441c6 P 70e7666c46844503beb466fdc054a6fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } }
I20260321 03:02:31.379909 9157 tablet_bootstrap.cc:492] T a062f5d0fc344fb9a1e8169401451bad P 4532b54a008a4a39b663112e6d0aacc0: No bootstrap required, opened a new log
I20260321 03:02:31.380000 9157 ts_tablet_manager.cc:1403] T a062f5d0fc344fb9a1e8169401451bad P 4532b54a008a4a39b663112e6d0aacc0: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260321 03:02:31.380506 9157 raft_consensus.cc:359] T a062f5d0fc344fb9a1e8169401451bad P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } }
I20260321 03:02:31.380611 9157 raft_consensus.cc:385] T a062f5d0fc344fb9a1e8169401451bad P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:31.380645 9157 raft_consensus.cc:740] T a062f5d0fc344fb9a1e8169401451bad P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4532b54a008a4a39b663112e6d0aacc0, State: Initialized, Role: FOLLOWER
I20260321 03:02:31.380770 9157 consensus_queue.cc:260] T a062f5d0fc344fb9a1e8169401451bad P 4532b54a008a4a39b663112e6d0aacc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } }
I20260321 03:02:31.380981 9158 ts_tablet_manager.cc:1434] T 7c4e86aafdb24f71a59e3142235441c6 P 70e7666c46844503beb466fdc054a6fc: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260321 03:02:31.381031 9157 ts_tablet_manager.cc:1434] T a062f5d0fc344fb9a1e8169401451bad P 4532b54a008a4a39b663112e6d0aacc0: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260321 03:02:31.381163 9158 tablet_bootstrap.cc:492] T 481a544d7e4a461396b26b89dfc058ac P 70e7666c46844503beb466fdc054a6fc: Bootstrap starting.
I20260321 03:02:31.381240 9157 tablet_bootstrap.cc:492] T 7c4e86aafdb24f71a59e3142235441c6 P 4532b54a008a4a39b663112e6d0aacc0: Bootstrap starting.
I20260321 03:02:31.382337 9157 tablet_bootstrap.cc:654] T 7c4e86aafdb24f71a59e3142235441c6 P 4532b54a008a4a39b663112e6d0aacc0: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:31.387427 9160 raft_consensus.cc:2272] T 27330be65bac450a8ead355d41fe780e P a97f7dd77cf2444f8fdb441019081f79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260321 03:02:31.388182 9160 ts_tablet_manager.cc:1916] T 27330be65bac450a8ead355d41fe780e P a97f7dd77cf2444f8fdb441019081f79: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260321 03:02:31.390268 9158 tablet_bootstrap.cc:654] T 481a544d7e4a461396b26b89dfc058ac P 70e7666c46844503beb466fdc054a6fc: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:31.391036 9155 log.cc:1199] T 1806a588d8d24b18a405e1a545d9cdda P 4532b54a008a4a39b663112e6d0aacc0: Deleting WAL directory at /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-0/wal/wals/1806a588d8d24b18a405e1a545d9cdda
I20260321 03:02:31.391389 9155 ts_tablet_manager.cc:1950] T 1806a588d8d24b18a405e1a545d9cdda P 4532b54a008a4a39b663112e6d0aacc0: Deleting consensus metadata
I20260321 03:02:31.392202 9156 ts_tablet_manager.cc:1929] T c8b7587407f64cbd8f6cbe2dd048547e P 70e7666c46844503beb466fdc054a6fc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260321 03:02:31.392222 8972 catalog_manager.cc:5002] TS 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171): tablet 1806a588d8d24b18a405e1a545d9cdda (table default.table_9731292f060b48d7a3b304a142988570 [id=3fbb48538eb34ee9ae7b462f2af6d628]) successfully deleted
I20260321 03:02:31.392417 9156 log.cc:1199] T c8b7587407f64cbd8f6cbe2dd048547e P 70e7666c46844503beb466fdc054a6fc: Deleting WAL directory at /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-1/wal/wals/c8b7587407f64cbd8f6cbe2dd048547e
I20260321 03:02:31.392746 9156 ts_tablet_manager.cc:1950] T c8b7587407f64cbd8f6cbe2dd048547e P 70e7666c46844503beb466fdc054a6fc: Deleting consensus metadata
I20260321 03:02:31.392504 9155 tablet_replica.cc:333] T 34cc41d9b1f24aaaa3b7140dc7a7e280 P 4532b54a008a4a39b663112e6d0aacc0: stopping tablet replica
I20260321 03:02:31.393016 9160 ts_tablet_manager.cc:1929] T 27330be65bac450a8ead355d41fe780e P a97f7dd77cf2444f8fdb441019081f79: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260321 03:02:31.393070 9155 raft_consensus.cc:2243] T 34cc41d9b1f24aaaa3b7140dc7a7e280 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260321 03:02:31.393105 9160 log.cc:1199] T 27330be65bac450a8ead355d41fe780e P a97f7dd77cf2444f8fdb441019081f79: Deleting WAL directory at /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-2/wal/wals/27330be65bac450a8ead355d41fe780e
I20260321 03:02:31.393224 9155 raft_consensus.cc:2272] T 34cc41d9b1f24aaaa3b7140dc7a7e280 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260321 03:02:31.393409 9160 ts_tablet_manager.cc:1950] T 27330be65bac450a8ead355d41fe780e P a97f7dd77cf2444f8fdb441019081f79: Deleting consensus metadata
I20260321 03:02:31.394073 8974 catalog_manager.cc:5002] TS a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): tablet 27330be65bac450a8ead355d41fe780e (table default.table_c8e5202d265f463bbcf568d34a1e64a2 [id=4ac1925a391a48ea86c63da0c1d8c442]) successfully deleted
I20260321 03:02:31.394408 9156 tablet_replica.cc:333] T 27330be65bac450a8ead355d41fe780e P 70e7666c46844503beb466fdc054a6fc: stopping tablet replica
I20260321 03:02:31.394646 9156 raft_consensus.cc:2243] T 27330be65bac450a8ead355d41fe780e P 70e7666c46844503beb466fdc054a6fc [term 1 LEADER]: Raft consensus shutting down.
I20260321 03:02:31.394915 9156 raft_consensus.cc:2272] T 27330be65bac450a8ead355d41fe780e P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260321 03:02:31.395473 9156 ts_tablet_manager.cc:1916] T 27330be65bac450a8ead355d41fe780e P 70e7666c46844503beb466fdc054a6fc: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260321 03:02:31.396312 8974 catalog_manager.cc:4982] TS a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): delete failed for tablet 34cc41d9b1f24aaaa3b7140dc7a7e280 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 34cc41d9b1f24aaaa3b7140dc7a7e280 already in progress: creating tablet
W20260321 03:02:31.396572 8974 catalog_manager.cc:4982] TS a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): delete failed for tablet 481a544d7e4a461396b26b89dfc058ac because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 481a544d7e4a461396b26b89dfc058ac already in progress: creating tablet
I20260321 03:02:31.396865 9157 tablet_bootstrap.cc:492] T 7c4e86aafdb24f71a59e3142235441c6 P 4532b54a008a4a39b663112e6d0aacc0: No bootstrap required, opened a new log
I20260321 03:02:31.396898 9155 ts_tablet_manager.cc:1916] T 34cc41d9b1f24aaaa3b7140dc7a7e280 P 4532b54a008a4a39b663112e6d0aacc0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260321 03:02:31.396976 9157 ts_tablet_manager.cc:1403] T 7c4e86aafdb24f71a59e3142235441c6 P 4532b54a008a4a39b663112e6d0aacc0: Time spent bootstrapping tablet: real 0.016s user 0.000s sys 0.002s
I20260321 03:02:31.397743 9157 raft_consensus.cc:359] T 7c4e86aafdb24f71a59e3142235441c6 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } }
I20260321 03:02:31.397869 9157 raft_consensus.cc:385] T 7c4e86aafdb24f71a59e3142235441c6 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:31.397908 9157 raft_consensus.cc:740] T 7c4e86aafdb24f71a59e3142235441c6 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4532b54a008a4a39b663112e6d0aacc0, State: Initialized, Role: FOLLOWER
I20260321 03:02:31.398054 9157 consensus_queue.cc:260] T 7c4e86aafdb24f71a59e3142235441c6 P 4532b54a008a4a39b663112e6d0aacc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } }
I20260321 03:02:31.398396 9157 ts_tablet_manager.cc:1434] T 7c4e86aafdb24f71a59e3142235441c6 P 4532b54a008a4a39b663112e6d0aacc0: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
I20260321 03:02:31.402690 9161 tablet_bootstrap.cc:492] T 7c4e86aafdb24f71a59e3142235441c6 P a97f7dd77cf2444f8fdb441019081f79: No bootstrap required, opened a new log
I20260321 03:02:31.402748 9158 tablet_bootstrap.cc:492] T 481a544d7e4a461396b26b89dfc058ac P 70e7666c46844503beb466fdc054a6fc: No bootstrap required, opened a new log
I20260321 03:02:31.402842 9158 ts_tablet_manager.cc:1403] T 481a544d7e4a461396b26b89dfc058ac P 70e7666c46844503beb466fdc054a6fc: Time spent bootstrapping tablet: real 0.022s user 0.002s sys 0.000s
I20260321 03:02:31.402949 9161 ts_tablet_manager.cc:1403] T 7c4e86aafdb24f71a59e3142235441c6 P a97f7dd77cf2444f8fdb441019081f79: Time spent bootstrapping tablet: real 0.036s user 0.003s sys 0.000s
I20260321 03:02:31.403434 9158 raft_consensus.cc:359] T 481a544d7e4a461396b26b89dfc058ac P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } }
I20260321 03:02:31.403496 9161 raft_consensus.cc:359] T 7c4e86aafdb24f71a59e3142235441c6 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } }
I20260321 03:02:31.403610 9158 raft_consensus.cc:385] T 481a544d7e4a461396b26b89dfc058ac P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:31.403672 9158 raft_consensus.cc:740] T 481a544d7e4a461396b26b89dfc058ac P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70e7666c46844503beb466fdc054a6fc, State: Initialized, Role: FOLLOWER
I20260321 03:02:31.403654 9161 raft_consensus.cc:385] T 7c4e86aafdb24f71a59e3142235441c6 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:31.403716 9161 raft_consensus.cc:740] T 7c4e86aafdb24f71a59e3142235441c6 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a97f7dd77cf2444f8fdb441019081f79, State: Initialized, Role: FOLLOWER
I20260321 03:02:31.403875 9158 consensus_queue.cc:260] T 481a544d7e4a461396b26b89dfc058ac P 70e7666c46844503beb466fdc054a6fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } }
I20260321 03:02:31.403939 9161 consensus_queue.cc:260] T 7c4e86aafdb24f71a59e3142235441c6 P a97f7dd77cf2444f8fdb441019081f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } }
I20260321 03:02:31.409969 9161 ts_tablet_manager.cc:1434] T 7c4e86aafdb24f71a59e3142235441c6 P a97f7dd77cf2444f8fdb441019081f79: Time spent starting tablet: real 0.007s user 0.001s sys 0.000s
I20260321 03:02:31.413828 9161 tablet_bootstrap.cc:492] T 481a544d7e4a461396b26b89dfc058ac P a97f7dd77cf2444f8fdb441019081f79: Bootstrap starting.
I20260321 03:02:31.414963 9161 tablet_bootstrap.cc:654] T 481a544d7e4a461396b26b89dfc058ac P a97f7dd77cf2444f8fdb441019081f79: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:31.416303 9156 ts_tablet_manager.cc:1929] T 27330be65bac450a8ead355d41fe780e P 70e7666c46844503beb466fdc054a6fc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260321 03:02:31.416507 9156 log.cc:1199] T 27330be65bac450a8ead355d41fe780e P 70e7666c46844503beb466fdc054a6fc: Deleting WAL directory at /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-1/wal/wals/27330be65bac450a8ead355d41fe780e
I20260321 03:02:31.416880 9156 ts_tablet_manager.cc:1950] T 27330be65bac450a8ead355d41fe780e P 70e7666c46844503beb466fdc054a6fc: Deleting consensus metadata
I20260321 03:02:31.417631 9158 ts_tablet_manager.cc:1434] T 481a544d7e4a461396b26b89dfc058ac P 70e7666c46844503beb466fdc054a6fc: Time spent starting tablet: real 0.015s user 0.001s sys 0.000s
I20260321 03:02:31.417905 8971 catalog_manager.cc:5002] TS 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): tablet 27330be65bac450a8ead355d41fe780e (table default.table_c8e5202d265f463bbcf568d34a1e64a2 [id=4ac1925a391a48ea86c63da0c1d8c442]) successfully deleted
I20260321 03:02:31.419147 9161 tablet_bootstrap.cc:492] T 481a544d7e4a461396b26b89dfc058ac P a97f7dd77cf2444f8fdb441019081f79: No bootstrap required, opened a new log
I20260321 03:02:31.419293 9161 ts_tablet_manager.cc:1403] T 481a544d7e4a461396b26b89dfc058ac P a97f7dd77cf2444f8fdb441019081f79: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260321 03:02:31.419493 9156 tablet_replica.cc:333] T 1806a588d8d24b18a405e1a545d9cdda P 70e7666c46844503beb466fdc054a6fc: stopping tablet replica
I20260321 03:02:31.419664 9156 raft_consensus.cc:2243] T 1806a588d8d24b18a405e1a545d9cdda P 70e7666c46844503beb466fdc054a6fc [term 1 LEADER]: Raft consensus shutting down.
I20260321 03:02:31.420377 9161 raft_consensus.cc:359] T 481a544d7e4a461396b26b89dfc058ac P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } }
I20260321 03:02:31.420543 9161 raft_consensus.cc:385] T 481a544d7e4a461396b26b89dfc058ac P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:31.420598 9161 raft_consensus.cc:740] T 481a544d7e4a461396b26b89dfc058ac P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a97f7dd77cf2444f8fdb441019081f79, State: Initialized, Role: FOLLOWER
I20260321 03:02:31.420745 9161 consensus_queue.cc:260] T 481a544d7e4a461396b26b89dfc058ac P a97f7dd77cf2444f8fdb441019081f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } }
I20260321 03:02:31.421057 9161 ts_tablet_manager.cc:1434] T 481a544d7e4a461396b26b89dfc058ac P a97f7dd77cf2444f8fdb441019081f79: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260321 03:02:31.421794 9156 raft_consensus.cc:2272] T 1806a588d8d24b18a405e1a545d9cdda P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260321 03:02:31.422842 9155 ts_tablet_manager.cc:1929] T 34cc41d9b1f24aaaa3b7140dc7a7e280 P 4532b54a008a4a39b663112e6d0aacc0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260321 03:02:31.422945 9155 log.cc:1199] T 34cc41d9b1f24aaaa3b7140dc7a7e280 P 4532b54a008a4a39b663112e6d0aacc0: Deleting WAL directory at /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-0/wal/wals/34cc41d9b1f24aaaa3b7140dc7a7e280
I20260321 03:02:31.423178 9155 ts_tablet_manager.cc:1950] T 34cc41d9b1f24aaaa3b7140dc7a7e280 P 4532b54a008a4a39b663112e6d0aacc0: Deleting consensus metadata
I20260321 03:02:31.424700 8972 catalog_manager.cc:5002] TS 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171): tablet 34cc41d9b1f24aaaa3b7140dc7a7e280 (table default.table_337c18c13bb24e78bad2738358717d2d [id=06718ed7d99744ff818ac2fc5bdbf11c]) successfully deleted
I20260321 03:02:31.425832 9161 tablet_bootstrap.cc:492] T 34cc41d9b1f24aaaa3b7140dc7a7e280 P a97f7dd77cf2444f8fdb441019081f79: Bootstrap starting.
I20260321 03:02:31.427618 9155 tablet_replica.cc:333] T 481a544d7e4a461396b26b89dfc058ac P 4532b54a008a4a39b663112e6d0aacc0: stopping tablet replica
I20260321 03:02:31.428200 9155 raft_consensus.cc:2243] T 481a544d7e4a461396b26b89dfc058ac P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260321 03:02:31.428673 9161 tablet_bootstrap.cc:654] T 34cc41d9b1f24aaaa3b7140dc7a7e280 P a97f7dd77cf2444f8fdb441019081f79: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:31.429862 9155 raft_consensus.cc:2272] T 481a544d7e4a461396b26b89dfc058ac P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260321 03:02:31.430023 9161 tablet_bootstrap.cc:492] T 34cc41d9b1f24aaaa3b7140dc7a7e280 P a97f7dd77cf2444f8fdb441019081f79: No bootstrap required, opened a new log
I20260321 03:02:31.430133 9161 ts_tablet_manager.cc:1403] T 34cc41d9b1f24aaaa3b7140dc7a7e280 P a97f7dd77cf2444f8fdb441019081f79: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.001s
I20260321 03:02:31.430583 9155 ts_tablet_manager.cc:1916] T 481a544d7e4a461396b26b89dfc058ac P 4532b54a008a4a39b663112e6d0aacc0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260321 03:02:31.430683 9161 raft_consensus.cc:359] T 34cc41d9b1f24aaaa3b7140dc7a7e280 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } }
I20260321 03:02:31.430821 9161 raft_consensus.cc:385] T 34cc41d9b1f24aaaa3b7140dc7a7e280 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:31.430871 9161 raft_consensus.cc:740] T 34cc41d9b1f24aaaa3b7140dc7a7e280 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a97f7dd77cf2444f8fdb441019081f79, State: Initialized, Role: FOLLOWER
I20260321 03:02:31.431016 9161 consensus_queue.cc:260] T 34cc41d9b1f24aaaa3b7140dc7a7e280 P a97f7dd77cf2444f8fdb441019081f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } }
I20260321 03:02:31.431334 9161 ts_tablet_manager.cc:1434] T 34cc41d9b1f24aaaa3b7140dc7a7e280 P a97f7dd77cf2444f8fdb441019081f79: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
I20260321 03:02:31.432240 9156 ts_tablet_manager.cc:1916] T 1806a588d8d24b18a405e1a545d9cdda P 70e7666c46844503beb466fdc054a6fc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260321 03:02:31.434450 9155 ts_tablet_manager.cc:1929] T 481a544d7e4a461396b26b89dfc058ac P 4532b54a008a4a39b663112e6d0aacc0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260321 03:02:31.434617 9155 log.cc:1199] T 481a544d7e4a461396b26b89dfc058ac P 4532b54a008a4a39b663112e6d0aacc0: Deleting WAL directory at /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-0/wal/wals/481a544d7e4a461396b26b89dfc058ac
I20260321 03:02:31.434949 9155 ts_tablet_manager.cc:1950] T 481a544d7e4a461396b26b89dfc058ac P 4532b54a008a4a39b663112e6d0aacc0: Deleting consensus metadata
I20260321 03:02:31.435441 9156 ts_tablet_manager.cc:1929] T 1806a588d8d24b18a405e1a545d9cdda P 70e7666c46844503beb466fdc054a6fc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260321 03:02:31.435529 9156 log.cc:1199] T 1806a588d8d24b18a405e1a545d9cdda P 70e7666c46844503beb466fdc054a6fc: Deleting WAL directory at /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-1/wal/wals/1806a588d8d24b18a405e1a545d9cdda
I20260321 03:02:31.435905 9156 ts_tablet_manager.cc:1950] T 1806a588d8d24b18a405e1a545d9cdda P 70e7666c46844503beb466fdc054a6fc: Deleting consensus metadata
I20260321 03:02:31.435896 8972 catalog_manager.cc:5002] TS 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171): tablet 481a544d7e4a461396b26b89dfc058ac (table default.table_ec53d9a55a4c47b8a9b0fa3916c9c561 [id=b792550a4b344d24a9d33f468884c107]) successfully deleted
I20260321 03:02:31.436829 9156 tablet_replica.cc:333] T 34cc41d9b1f24aaaa3b7140dc7a7e280 P 70e7666c46844503beb466fdc054a6fc: stopping tablet replica
I20260321 03:02:31.436949 8971 catalog_manager.cc:5002] TS 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): tablet 1806a588d8d24b18a405e1a545d9cdda (table default.table_9731292f060b48d7a3b304a142988570 [id=3fbb48538eb34ee9ae7b462f2af6d628]) successfully deleted
I20260321 03:02:31.436985 9156 raft_consensus.cc:2243] T 34cc41d9b1f24aaaa3b7140dc7a7e280 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Raft consensus shutting down.
I20260321 03:02:31.437093 9156 raft_consensus.cc:2272] T 34cc41d9b1f24aaaa3b7140dc7a7e280 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Raft consensus is shut down!
I20260321 03:02:31.437783 9156 ts_tablet_manager.cc:1916] T 34cc41d9b1f24aaaa3b7140dc7a7e280 P 70e7666c46844503beb466fdc054a6fc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260321 03:02:31.440356 9156 ts_tablet_manager.cc:1929] T 34cc41d9b1f24aaaa3b7140dc7a7e280 P 70e7666c46844503beb466fdc054a6fc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260321 03:02:31.440502 9156 log.cc:1199] T 34cc41d9b1f24aaaa3b7140dc7a7e280 P 70e7666c46844503beb466fdc054a6fc: Deleting WAL directory at /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-1/wal/wals/34cc41d9b1f24aaaa3b7140dc7a7e280
I20260321 03:02:31.440774 9156 ts_tablet_manager.cc:1950] T 34cc41d9b1f24aaaa3b7140dc7a7e280 P 70e7666c46844503beb466fdc054a6fc: Deleting consensus metadata
I20260321 03:02:31.441695 8971 catalog_manager.cc:5002] TS 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): tablet 34cc41d9b1f24aaaa3b7140dc7a7e280 (table default.table_337c18c13bb24e78bad2738358717d2d [id=06718ed7d99744ff818ac2fc5bdbf11c]) successfully deleted
I20260321 03:02:31.441988 9156 tablet_replica.cc:333] T 481a544d7e4a461396b26b89dfc058ac P 70e7666c46844503beb466fdc054a6fc: stopping tablet replica
I20260321 03:02:31.442116 9156 raft_consensus.cc:2243] T 481a544d7e4a461396b26b89dfc058ac P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Raft consensus shutting down.
I20260321 03:02:31.442232 9156 raft_consensus.cc:2272] T 481a544d7e4a461396b26b89dfc058ac P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Raft consensus is shut down!
I20260321 03:02:31.442800 9156 ts_tablet_manager.cc:1916] T 481a544d7e4a461396b26b89dfc058ac P 70e7666c46844503beb466fdc054a6fc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260321 03:02:31.445087 9156 ts_tablet_manager.cc:1929] T 481a544d7e4a461396b26b89dfc058ac P 70e7666c46844503beb466fdc054a6fc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260321 03:02:31.445171 9156 log.cc:1199] T 481a544d7e4a461396b26b89dfc058ac P 70e7666c46844503beb466fdc054a6fc: Deleting WAL directory at /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-1/wal/wals/481a544d7e4a461396b26b89dfc058ac
I20260321 03:02:31.445423 9156 ts_tablet_manager.cc:1950] T 481a544d7e4a461396b26b89dfc058ac P 70e7666c46844503beb466fdc054a6fc: Deleting consensus metadata
I20260321 03:02:31.446342 8971 catalog_manager.cc:5002] TS 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): tablet 481a544d7e4a461396b26b89dfc058ac (table default.table_ec53d9a55a4c47b8a9b0fa3916c9c561 [id=b792550a4b344d24a9d33f468884c107]) successfully deleted
I20260321 03:02:31.452649 8265 catalog_manager.cc:2184] deleted orphaned HMS catalog entry for table [id=1eabb731ef9a41249c3e08ccf80157e4]
I20260321 03:02:31.452911 8265 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:39954 (request call id 28) took 2161 ms. Trace:
I20260321 03:02:31.452970 8265 rpcz_store.cc:276] 0321 03:02:29.291701 (+ 0us) service_pool.cc:168] Inserting onto call queue
0321 03:02:29.718913 (+427212us) service_pool.cc:225] Handling call
0321 03:02:30.241087 (+522174us) catalog_manager.cc:2101] Acquired catalog manager lock
0321 03:02:30.241424 (+ 337us) catalog_manager.cc:2147] Created new table and tablet info
0321 03:02:31.045160 (+803736us) catalog_manager.cc:2173] Created new table in HMS catalog
0321 03:02:31.045875 (+ 715us) write_op.cc:489] Releasing partition, row and schema locks
0321 03:02:31.045877 (+ 2us) write_op.cc:454] Released schema lock
0321 03:02:31.046020 (+ 143us) catalog_manager.cc:2181] Rolling back HMS table creation
0321 03:02:31.452894 (+406874us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0321 03:02:31.045823 (+ 0us) op_driver.cc:389] HandleFailure(Illegal state: replica 7451d7c0a71f4620a6607f74b5a22f2e is not leader of this config: current role FOLLOWER)
0321 03:02:31.045832 (+ 9us) write_op.cc:489] Releasing partition, row and schema locks
0321 03:02:31.045837 (+ 5us) write_op.cc:454] Released schema lock
0321 03:02:31.045840 (+ 3us) write_op.cc:335] FINISH: Op aborted
Metrics: {"Hive Metastore.queue_time_us":1017834,"Hive Metastore.run_cpu_time_us":443,"Hive Metastore.run_wall_time_us":192249,"child_traces":[["op",{}]]}
I20260321 03:02:31.456197 9101 raft_consensus.cc:493] T 7c4e86aafdb24f71a59e3142235441c6 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260321 03:02:31.456352 9101 raft_consensus.cc:515] T 7c4e86aafdb24f71a59e3142235441c6 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } }
I20260321 03:02:31.456898 9101 leader_election.cc:290] T 7c4e86aafdb24f71a59e3142235441c6 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091), 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713)
I20260321 03:02:31.457023 9090 raft_consensus.cc:493] T 7c4e86aafdb24f71a59e3142235441c6 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260321 03:02:31.457139 9090 raft_consensus.cc:515] T 7c4e86aafdb24f71a59e3142235441c6 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } }
I20260321 03:02:31.457589 9090 leader_election.cc:290] T 7c4e86aafdb24f71a59e3142235441c6 P 70e7666c46844503beb466fdc054a6fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091), 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171)
I20260321 03:02:31.457602 8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e86aafdb24f71a59e3142235441c6" candidate_uuid: "4532b54a008a4a39b663112e6d0aacc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a97f7dd77cf2444f8fdb441019081f79" is_pre_election: true
I20260321 03:02:31.457756 8804 raft_consensus.cc:2468] T 7c4e86aafdb24f71a59e3142235441c6 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4532b54a008a4a39b663112e6d0aacc0 in term 0.
I20260321 03:02:31.458036 8667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e86aafdb24f71a59e3142235441c6" candidate_uuid: "4532b54a008a4a39b663112e6d0aacc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70e7666c46844503beb466fdc054a6fc" is_pre_election: true
I20260321 03:02:31.458168 8667 raft_consensus.cc:2468] T 7c4e86aafdb24f71a59e3142235441c6 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4532b54a008a4a39b663112e6d0aacc0 in term 0.
I20260321 03:02:31.458585 8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e86aafdb24f71a59e3142235441c6" candidate_uuid: "70e7666c46844503beb466fdc054a6fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4532b54a008a4a39b663112e6d0aacc0" is_pre_election: true
I20260321 03:02:31.458719 8531 raft_consensus.cc:2468] T 7c4e86aafdb24f71a59e3142235441c6 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70e7666c46844503beb466fdc054a6fc in term 0.
I20260321 03:02:31.459501 8987 catalog_manager.cc:2731] deleted HMS catalog entry for table default.table_0e0c55f293274457aed5e8d315334903 [id=850c888ac63d4c048f27ceeb1ddd4f83]
I20260321 03:02:31.460083 8469 leader_election.cc:304] T 7c4e86aafdb24f71a59e3142235441c6 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0, a97f7dd77cf2444f8fdb441019081f79; no voters:
I20260321 03:02:31.460561 8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e86aafdb24f71a59e3142235441c6" candidate_uuid: "70e7666c46844503beb466fdc054a6fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a97f7dd77cf2444f8fdb441019081f79" is_pre_election: true
I20260321 03:02:31.460708 8804 raft_consensus.cc:2468] T 7c4e86aafdb24f71a59e3142235441c6 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70e7666c46844503beb466fdc054a6fc in term 0.
I20260321 03:02:31.461021 8604 leader_election.cc:304] T 7c4e86aafdb24f71a59e3142235441c6 P 70e7666c46844503beb466fdc054a6fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79; no voters:
I20260321 03:02:31.461400 9090 raft_consensus.cc:2804] T 7c4e86aafdb24f71a59e3142235441c6 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260321 03:02:31.461441 9101 raft_consensus.cc:2804] T 7c4e86aafdb24f71a59e3142235441c6 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260321 03:02:31.461464 9090 raft_consensus.cc:493] T 7c4e86aafdb24f71a59e3142235441c6 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260321 03:02:31.461496 9101 raft_consensus.cc:493] T 7c4e86aafdb24f71a59e3142235441c6 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260321 03:02:31.461508 9090 raft_consensus.cc:3060] T 7c4e86aafdb24f71a59e3142235441c6 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:31.461540 9101 raft_consensus.cc:3060] T 7c4e86aafdb24f71a59e3142235441c6 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:31.462528 9090 raft_consensus.cc:515] T 7c4e86aafdb24f71a59e3142235441c6 P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } }
I20260321 03:02:31.462527 9101 raft_consensus.cc:515] T 7c4e86aafdb24f71a59e3142235441c6 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } }
I20260321 03:02:31.462908 9090 leader_election.cc:290] T 7c4e86aafdb24f71a59e3142235441c6 P 70e7666c46844503beb466fdc054a6fc [CANDIDATE]: Term 1 election: Requested vote from peers a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091), 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171)
I20260321 03:02:31.462914 9101 leader_election.cc:290] T 7c4e86aafdb24f71a59e3142235441c6 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 1 election: Requested vote from peers a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091), 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713)
I20260321 03:02:31.463400 8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e86aafdb24f71a59e3142235441c6" candidate_uuid: "4532b54a008a4a39b663112e6d0aacc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a97f7dd77cf2444f8fdb441019081f79"
I20260321 03:02:31.463517 8803 raft_consensus.cc:3060] T 7c4e86aafdb24f71a59e3142235441c6 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:31.464650 8803 raft_consensus.cc:2468] T 7c4e86aafdb24f71a59e3142235441c6 P a97f7dd77cf2444f8fdb441019081f79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4532b54a008a4a39b663112e6d0aacc0 in term 1.
I20260321 03:02:31.465117 8469 leader_election.cc:304] T 7c4e86aafdb24f71a59e3142235441c6 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0, a97f7dd77cf2444f8fdb441019081f79; no voters:
I20260321 03:02:31.465922 8667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e86aafdb24f71a59e3142235441c6" candidate_uuid: "4532b54a008a4a39b663112e6d0aacc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70e7666c46844503beb466fdc054a6fc"
I20260321 03:02:31.466161 8667 raft_consensus.cc:2393] T 7c4e86aafdb24f71a59e3142235441c6 P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4532b54a008a4a39b663112e6d0aacc0 in current term 1: Already voted for candidate 70e7666c46844503beb466fdc054a6fc in this term.
I20260321 03:02:31.466430 8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e86aafdb24f71a59e3142235441c6" candidate_uuid: "70e7666c46844503beb466fdc054a6fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4532b54a008a4a39b663112e6d0aacc0"
I20260321 03:02:31.466595 8531 raft_consensus.cc:2393] T 7c4e86aafdb24f71a59e3142235441c6 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 70e7666c46844503beb466fdc054a6fc in current term 1: Already voted for candidate 4532b54a008a4a39b663112e6d0aacc0 in this term.
I20260321 03:02:31.463522 8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e86aafdb24f71a59e3142235441c6" candidate_uuid: "70e7666c46844503beb466fdc054a6fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a97f7dd77cf2444f8fdb441019081f79"
I20260321 03:02:31.467367 8804 raft_consensus.cc:2393] T 7c4e86aafdb24f71a59e3142235441c6 P a97f7dd77cf2444f8fdb441019081f79 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 70e7666c46844503beb466fdc054a6fc in current term 1: Already voted for candidate 4532b54a008a4a39b663112e6d0aacc0 in this term.
I20260321 03:02:31.467891 8602 leader_election.cc:304] T 7c4e86aafdb24f71a59e3142235441c6 P 70e7666c46844503beb466fdc054a6fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70e7666c46844503beb466fdc054a6fc; no voters: 4532b54a008a4a39b663112e6d0aacc0, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:02:31.468082 9101 raft_consensus.cc:2804] T 7c4e86aafdb24f71a59e3142235441c6 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader election won for term 1
I20260321 03:02:31.468140 9090 raft_consensus.cc:2749] T 7c4e86aafdb24f71a59e3142235441c6 P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260321 03:02:31.468194 9101 raft_consensus.cc:697] T 7c4e86aafdb24f71a59e3142235441c6 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 LEADER]: Becoming Leader. State: Replica: 4532b54a008a4a39b663112e6d0aacc0, State: Running, Role: LEADER
I20260321 03:02:31.468351 9101 consensus_queue.cc:237] T 7c4e86aafdb24f71a59e3142235441c6 P 4532b54a008a4a39b663112e6d0aacc0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } }
I20260321 03:02:31.506517 8269 catalog_manager.cc:2184] deleted orphaned HMS catalog entry for table [id=b20ef8da20fe487e9f99a91c820ad06f]
I20260321 03:02:31.506867 8269 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:39954 (request call id 19) took 2357 ms. Trace:
I20260321 03:02:31.506932 8269 rpcz_store.cc:276] 0321 03:02:29.149313 (+ 0us) service_pool.cc:168] Inserting onto call queue
0321 03:02:29.183835 (+ 34522us) service_pool.cc:225] Handling call
0321 03:02:30.241530 (+1057695us) catalog_manager.cc:2101] Acquired catalog manager lock
0321 03:02:30.241819 (+ 289us) catalog_manager.cc:2147] Created new table and tablet info
0321 03:02:31.076906 (+835087us) catalog_manager.cc:2173] Created new table in HMS catalog
0321 03:02:31.077593 (+ 687us) write_op.cc:489] Releasing partition, row and schema locks
0321 03:02:31.077595 (+ 2us) write_op.cc:454] Released schema lock
0321 03:02:31.077747 (+ 152us) catalog_manager.cc:2181] Rolling back HMS table creation
0321 03:02:31.506842 (+429095us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0321 03:02:31.077540 (+ 0us) op_driver.cc:389] HandleFailure(Illegal state: replica 7451d7c0a71f4620a6607f74b5a22f2e is not leader of this config: current role FOLLOWER)
0321 03:02:31.077550 (+ 10us) write_op.cc:489] Releasing partition, row and schema locks
0321 03:02:31.077555 (+ 5us) write_op.cc:454] Released schema lock
0321 03:02:31.077558 (+ 3us) write_op.cc:335] FINISH: Op aborted
Metrics: {"Hive Metastore.queue_time_us":1178069,"Hive Metastore.run_cpu_time_us":445,"Hive Metastore.run_wall_time_us":85455,"child_traces":[["op",{}]]}
I20260321 03:02:31.522231 8988 catalog_manager.cc:2174] created HMS catalog entry for table [id=a69b5fce47c341fe9f48dd5e36364533]
I20260321 03:02:31.535446 8506 tablet_service.cc:1558] Processing DeleteTablet for tablet 34cc41d9b1f24aaaa3b7140dc7a7e280 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-21 03:02:31 UTC) from {username='slave'} at 127.0.0.1:51700
W20260321 03:02:31.536827 8972 catalog_manager.cc:4969] TS 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171): delete failed for tablet 34cc41d9b1f24aaaa3b7140dc7a7e280 because the tablet was not found. No further retry: Not found: Tablet not found: 34cc41d9b1f24aaaa3b7140dc7a7e280
I20260321 03:02:31.541960 8777 tablet_service.cc:1511] Processing CreateTablet for tablet 68e8b3d268124c709b5797c168590ceb (DEFAULT_TABLE table=default.table_d52655a709224a7d999af3a2f1f2a678 [id=a69b5fce47c341fe9f48dd5e36364533]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:31.542172 8639 tablet_service.cc:1511] Processing CreateTablet for tablet 68e8b3d268124c709b5797c168590ceb (DEFAULT_TABLE table=default.table_d52655a709224a7d999af3a2f1f2a678 [id=a69b5fce47c341fe9f48dd5e36364533]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:31.542409 8777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68e8b3d268124c709b5797c168590ceb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:31.542496 8639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68e8b3d268124c709b5797c168590ceb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:31.542650 8988 catalog_manager.cc:5763] TS 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713) does not have the latest schema for tablet a062f5d0fc344fb9a1e8169401451bad (table default.table_10dd23c6f33c4aa0bad0a534fb770d4a [id=94ef39d020ab428b9e0392bedab9483d]). Expected version 1 got 0
I20260321 03:02:31.542778 8988 catalog_manager.cc:5763] TS 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713) does not have the latest schema for tablet 7c4e86aafdb24f71a59e3142235441c6 (table default.table_c8e5202d265f463bbcf568d34a1e64a2 [id=4ac1925a391a48ea86c63da0c1d8c442]). Expected version 1 got 0
I20260321 03:02:31.545503 9161 tablet_bootstrap.cc:492] T 68e8b3d268124c709b5797c168590ceb P a97f7dd77cf2444f8fdb441019081f79: Bootstrap starting.
I20260321 03:02:31.546707 9161 tablet_bootstrap.cc:654] T 68e8b3d268124c709b5797c168590ceb P a97f7dd77cf2444f8fdb441019081f79: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:31.548384 8506 tablet_service.cc:1511] Processing CreateTablet for tablet 68e8b3d268124c709b5797c168590ceb (DEFAULT_TABLE table=default.table_d52655a709224a7d999af3a2f1f2a678 [id=a69b5fce47c341fe9f48dd5e36364533]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:31.548708 8506 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68e8b3d268124c709b5797c168590ceb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:31.551211 8931 raft_consensus.cc:493] T 34cc41d9b1f24aaaa3b7140dc7a7e280 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260321 03:02:31.551327 8931 raft_consensus.cc:515] T 34cc41d9b1f24aaaa3b7140dc7a7e280 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } }
I20260321 03:02:31.551743 8931 leader_election.cc:290] T 34cc41d9b1f24aaaa3b7140dc7a7e280 P a97f7dd77cf2444f8fdb441019081f79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171)
I20260321 03:02:31.552037 8988 catalog_manager.cc:6216] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863: default.table_60888690371e4e1d8d9e6a31f44b55a5 [id=9bc91b7f6cb8477ab6ed1ee5ed74f608] alter complete (version 1)
W20260321 03:02:31.552678 8738 leader_election.cc:343] T 34cc41d9b1f24aaaa3b7140dc7a7e280 P a97f7dd77cf2444f8fdb441019081f79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171): Not found: Tablet not found: 34cc41d9b1f24aaaa3b7140dc7a7e280
W20260321 03:02:31.552961 8988 catalog_manager.cc:5863] Failed to send AlterTable RPC for tablet a062f5d0fc344fb9a1e8169401451bad (table default.table_10dd23c6f33c4aa0bad0a534fb770d4a [id=94ef39d020ab428b9e0392bedab9483d], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet a062f5d0fc344fb9a1e8169401451bad consensus state has no leader
W20260321 03:02:31.553026 8737 leader_election.cc:343] T 34cc41d9b1f24aaaa3b7140dc7a7e280 P a97f7dd77cf2444f8fdb441019081f79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: 34cc41d9b1f24aaaa3b7140dc7a7e280
I20260321 03:02:31.553095 8737 leader_election.cc:304] T 34cc41d9b1f24aaaa3b7140dc7a7e280 P a97f7dd77cf2444f8fdb441019081f79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a97f7dd77cf2444f8fdb441019081f79; no voters: 4532b54a008a4a39b663112e6d0aacc0, 70e7666c46844503beb466fdc054a6fc
I20260321 03:02:31.553426 8931 raft_consensus.cc:2749] T 34cc41d9b1f24aaaa3b7140dc7a7e280 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260321 03:02:31.553717 9157 tablet_bootstrap.cc:492] T 68e8b3d268124c709b5797c168590ceb P 4532b54a008a4a39b663112e6d0aacc0: Bootstrap starting.
I20260321 03:02:31.554034 8988 catalog_manager.cc:5763] TS a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091) does not have the latest schema for tablet a062f5d0fc344fb9a1e8169401451bad (table default.table_10dd23c6f33c4aa0bad0a534fb770d4a [id=94ef39d020ab428b9e0392bedab9483d]). Expected version 1 got 0
I20260321 03:02:31.555298 8988 catalog_manager.cc:5671] T 7c4e86aafdb24f71a59e3142235441c6 P 4532b54a008a4a39b663112e6d0aacc0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193). New cstate: current_term: 1 leader_uuid: "4532b54a008a4a39b663112e6d0aacc0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } health_report { overall_health: UNKNOWN } } }
I20260321 03:02:31.555697 9157 tablet_bootstrap.cc:654] T 68e8b3d268124c709b5797c168590ceb P 4532b54a008a4a39b663112e6d0aacc0: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:31.555738 8988 catalog_manager.cc:5763] TS 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171) does not have the latest schema for tablet 7c4e86aafdb24f71a59e3142235441c6 (table default.table_c8e5202d265f463bbcf568d34a1e64a2 [id=4ac1925a391a48ea86c63da0c1d8c442]). Expected version 1 got 0
I20260321 03:02:31.555888 8988 catalog_manager.cc:5763] TS 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171) does not have the latest schema for tablet a062f5d0fc344fb9a1e8169401451bad (table default.table_10dd23c6f33c4aa0bad0a534fb770d4a [id=94ef39d020ab428b9e0392bedab9483d]). Expected version 1 got 0
I20260321 03:02:31.556396 8641 tablet_service.cc:1558] Processing DeleteTablet for tablet c8b7587407f64cbd8f6cbe2dd048547e with delete_type TABLET_DATA_DELETED (replaced by tablet 481a544d7e4a461396b26b89dfc058ac) from {username='slave'} at 127.0.0.1:35526
I20260321 03:02:31.556478 8638 tablet_service.cc:1558] Processing DeleteTablet for tablet cc5de6cf47b84822810e38f094ff99ea with delete_type TABLET_DATA_DELETED (replaced by tablet 34cc41d9b1f24aaaa3b7140dc7a7e280) from {username='slave'} at 127.0.0.1:35526
I20260321 03:02:31.556610 8640 tablet_service.cc:1558] Processing DeleteTablet for tablet 1806a588d8d24b18a405e1a545d9cdda with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-21 03:02:31 UTC) from {username='slave'} at 127.0.0.1:35526
I20260321 03:02:31.556646 8642 tablet_service.cc:1558] Processing DeleteTablet for tablet 481a544d7e4a461396b26b89dfc058ac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-21 03:02:31 UTC) from {username='slave'} at 127.0.0.1:35526
I20260321 03:02:31.556754 8644 tablet_service.cc:1558] Processing DeleteTablet for tablet 4718c06ec4ed4452b91483eb6e1ae067 with delete_type TABLET_DATA_DELETED (replaced by tablet a062f5d0fc344fb9a1e8169401451bad) from {username='slave'} at 127.0.0.1:35526
I20260321 03:02:31.556844 8645 tablet_service.cc:1558] Processing DeleteTablet for tablet 34cc41d9b1f24aaaa3b7140dc7a7e280 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-21 03:02:31 UTC) from {username='slave'} at 127.0.0.1:35526
I20260321 03:02:31.556950 8646 tablet_service.cc:1558] Processing DeleteTablet for tablet 27330be65bac450a8ead355d41fe780e with delete_type TABLET_DATA_DELETED (replaced by tablet 7c4e86aafdb24f71a59e3142235441c6) from {username='slave'} at 127.0.0.1:35526
I20260321 03:02:31.557060 9101 raft_consensus.cc:493] T a062f5d0fc344fb9a1e8169401451bad P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260321 03:02:31.557143 9101 raft_consensus.cc:515] T a062f5d0fc344fb9a1e8169401451bad P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } }
I20260321 03:02:31.557613 9101 leader_election.cc:290] T a062f5d0fc344fb9a1e8169401451bad P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091), 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713)
W20260321 03:02:31.558048 8971 catalog_manager.cc:4969] TS 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): delete failed for tablet c8b7587407f64cbd8f6cbe2dd048547e because the tablet was not found. No further retry: Not found: Tablet not found: c8b7587407f64cbd8f6cbe2dd048547e
I20260321 03:02:31.558159 8667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a062f5d0fc344fb9a1e8169401451bad" candidate_uuid: "4532b54a008a4a39b663112e6d0aacc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70e7666c46844503beb466fdc054a6fc" is_pre_election: true
W20260321 03:02:31.558221 8971 catalog_manager.cc:4969] TS 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): delete failed for tablet cc5de6cf47b84822810e38f094ff99ea because the tablet was not found. No further retry: Not found: Tablet not found: cc5de6cf47b84822810e38f094ff99ea
I20260321 03:02:31.558189 8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a062f5d0fc344fb9a1e8169401451bad" candidate_uuid: "4532b54a008a4a39b663112e6d0aacc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a97f7dd77cf2444f8fdb441019081f79" is_pre_election: true
I20260321 03:02:31.558290 8667 raft_consensus.cc:2468] T a062f5d0fc344fb9a1e8169401451bad P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4532b54a008a4a39b663112e6d0aacc0 in term 0.
W20260321 03:02:31.558327 8971 catalog_manager.cc:4969] TS 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): delete failed for tablet 1806a588d8d24b18a405e1a545d9cdda because the tablet was not found. No further retry: Not found: Tablet not found: 1806a588d8d24b18a405e1a545d9cdda
I20260321 03:02:31.558331 8804 raft_consensus.cc:2468] T a062f5d0fc344fb9a1e8169401451bad P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4532b54a008a4a39b663112e6d0aacc0 in term 0.
W20260321 03:02:31.558439 8971 catalog_manager.cc:4969] TS 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): delete failed for tablet 481a544d7e4a461396b26b89dfc058ac because the tablet was not found. No further retry: Not found: Tablet not found: 481a544d7e4a461396b26b89dfc058ac
W20260321 03:02:31.558547 8971 catalog_manager.cc:4969] TS 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): delete failed for tablet 4718c06ec4ed4452b91483eb6e1ae067 because the tablet was not found. No further retry: Not found: Tablet not found: 4718c06ec4ed4452b91483eb6e1ae067
W20260321 03:02:31.558641 8971 catalog_manager.cc:4969] TS 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): delete failed for tablet 34cc41d9b1f24aaaa3b7140dc7a7e280 because the tablet was not found. No further retry: Not found: Tablet not found: 34cc41d9b1f24aaaa3b7140dc7a7e280
W20260321 03:02:31.558751 8971 catalog_manager.cc:4969] TS 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): delete failed for tablet 27330be65bac450a8ead355d41fe780e because the tablet was not found. No further retry: Not found: Tablet not found: 27330be65bac450a8ead355d41fe780e
I20260321 03:02:31.558880 8469 leader_election.cc:304] T a062f5d0fc344fb9a1e8169401451bad P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0, a97f7dd77cf2444f8fdb441019081f79; no voters:
I20260321 03:02:31.559103 9101 raft_consensus.cc:2804] T a062f5d0fc344fb9a1e8169401451bad P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260321 03:02:31.559190 9101 raft_consensus.cc:493] T a062f5d0fc344fb9a1e8169401451bad P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260321 03:02:31.559231 9101 raft_consensus.cc:3060] T a062f5d0fc344fb9a1e8169401451bad P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:31.560364 9101 raft_consensus.cc:515] T a062f5d0fc344fb9a1e8169401451bad P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } }
I20260321 03:02:31.560793 9101 leader_election.cc:290] T a062f5d0fc344fb9a1e8169401451bad P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 1 election: Requested vote from peers a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091), 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713)
I20260321 03:02:31.561146 9158 tablet_bootstrap.cc:492] T 68e8b3d268124c709b5797c168590ceb P 70e7666c46844503beb466fdc054a6fc: Bootstrap starting.
I20260321 03:02:31.561398 8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a062f5d0fc344fb9a1e8169401451bad" candidate_uuid: "4532b54a008a4a39b663112e6d0aacc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a97f7dd77cf2444f8fdb441019081f79"
I20260321 03:02:31.561532 8804 raft_consensus.cc:3060] T a062f5d0fc344fb9a1e8169401451bad P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:31.562490 9158 tablet_bootstrap.cc:654] T 68e8b3d268124c709b5797c168590ceb P 70e7666c46844503beb466fdc054a6fc: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:31.562546 8804 raft_consensus.cc:2468] T a062f5d0fc344fb9a1e8169401451bad P a97f7dd77cf2444f8fdb441019081f79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4532b54a008a4a39b663112e6d0aacc0 in term 1.
I20260321 03:02:31.563071 8469 leader_election.cc:304] T a062f5d0fc344fb9a1e8169401451bad P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0, a97f7dd77cf2444f8fdb441019081f79; no voters:
I20260321 03:02:31.563680 8667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a062f5d0fc344fb9a1e8169401451bad" candidate_uuid: "4532b54a008a4a39b663112e6d0aacc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70e7666c46844503beb466fdc054a6fc"
I20260321 03:02:31.563819 8667 raft_consensus.cc:3060] T a062f5d0fc344fb9a1e8169401451bad P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:31.564736 8667 raft_consensus.cc:2468] T a062f5d0fc344fb9a1e8169401451bad P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4532b54a008a4a39b663112e6d0aacc0 in term 1.
I20260321 03:02:31.565819 9161 tablet_bootstrap.cc:492] T 68e8b3d268124c709b5797c168590ceb P a97f7dd77cf2444f8fdb441019081f79: No bootstrap required, opened a new log
I20260321 03:02:31.565944 9161 ts_tablet_manager.cc:1403] T 68e8b3d268124c709b5797c168590ceb P a97f7dd77cf2444f8fdb441019081f79: Time spent bootstrapping tablet: real 0.021s user 0.000s sys 0.002s
I20260321 03:02:31.566584 9161 raft_consensus.cc:359] T 68e8b3d268124c709b5797c168590ceb P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } }
I20260321 03:02:31.566708 9161 raft_consensus.cc:385] T 68e8b3d268124c709b5797c168590ceb P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:31.566740 9161 raft_consensus.cc:740] T 68e8b3d268124c709b5797c168590ceb P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a97f7dd77cf2444f8fdb441019081f79, State: Initialized, Role: FOLLOWER
I20260321 03:02:31.566967 9101 raft_consensus.cc:2804] T a062f5d0fc344fb9a1e8169401451bad P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader election won for term 1
I20260321 03:02:31.567075 9101 raft_consensus.cc:697] T a062f5d0fc344fb9a1e8169401451bad P 4532b54a008a4a39b663112e6d0aacc0 [term 1 LEADER]: Becoming Leader. State: Replica: 4532b54a008a4a39b663112e6d0aacc0, State: Running, Role: LEADER
I20260321 03:02:31.567241 9101 consensus_queue.cc:237] T a062f5d0fc344fb9a1e8169401451bad P 4532b54a008a4a39b663112e6d0aacc0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } }
I20260321 03:02:31.568378 9157 tablet_bootstrap.cc:492] T 68e8b3d268124c709b5797c168590ceb P 4532b54a008a4a39b663112e6d0aacc0: No bootstrap required, opened a new log
I20260321 03:02:31.568518 9157 ts_tablet_manager.cc:1403] T 68e8b3d268124c709b5797c168590ceb P 4532b54a008a4a39b663112e6d0aacc0: Time spent bootstrapping tablet: real 0.015s user 0.000s sys 0.003s
I20260321 03:02:31.569041 9157 raft_consensus.cc:359] T 68e8b3d268124c709b5797c168590ceb P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } }
I20260321 03:02:31.569176 9157 raft_consensus.cc:385] T 68e8b3d268124c709b5797c168590ceb P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:31.569224 9157 raft_consensus.cc:740] T 68e8b3d268124c709b5797c168590ceb P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4532b54a008a4a39b663112e6d0aacc0, State: Initialized, Role: FOLLOWER
I20260321 03:02:31.569203 8988 catalog_manager.cc:5763] TS 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713) does not have the latest schema for tablet a062f5d0fc344fb9a1e8169401451bad (table default.table_10dd23c6f33c4aa0bad0a534fb770d4a [id=94ef39d020ab428b9e0392bedab9483d]). Expected version 1 got 0
I20260321 03:02:31.569440 8988 catalog_manager.cc:5763] TS 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713) does not have the latest schema for tablet 7c4e86aafdb24f71a59e3142235441c6 (table default.table_c8e5202d265f463bbcf568d34a1e64a2 [id=4ac1925a391a48ea86c63da0c1d8c442]). Expected version 1 got 0
I20260321 03:02:31.570089 9158 tablet_bootstrap.cc:492] T 68e8b3d268124c709b5797c168590ceb P 70e7666c46844503beb466fdc054a6fc: No bootstrap required, opened a new log
I20260321 03:02:31.570221 9158 ts_tablet_manager.cc:1403] T 68e8b3d268124c709b5797c168590ceb P 70e7666c46844503beb466fdc054a6fc: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.000s
I20260321 03:02:31.570736 9158 raft_consensus.cc:359] T 68e8b3d268124c709b5797c168590ceb P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } }
I20260321 03:02:31.570884 9158 raft_consensus.cc:385] T 68e8b3d268124c709b5797c168590ceb P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:31.570923 9158 raft_consensus.cc:740] T 68e8b3d268124c709b5797c168590ceb P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70e7666c46844503beb466fdc054a6fc, State: Initialized, Role: FOLLOWER
I20260321 03:02:31.571065 9158 consensus_queue.cc:260] T 68e8b3d268124c709b5797c168590ceb P 70e7666c46844503beb466fdc054a6fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } }
I20260321 03:02:31.571434 9158 ts_tablet_manager.cc:1434] T 68e8b3d268124c709b5797c168590ceb P 70e7666c46844503beb466fdc054a6fc: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260321 03:02:31.572389 8988 catalog_manager.cc:5763] TS a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091) does not have the latest schema for tablet a062f5d0fc344fb9a1e8169401451bad (table default.table_10dd23c6f33c4aa0bad0a534fb770d4a [id=94ef39d020ab428b9e0392bedab9483d]). Expected version 1 got 0
I20260321 03:02:31.572618 8988 catalog_manager.cc:5763] TS a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091) does not have the latest schema for tablet 7c4e86aafdb24f71a59e3142235441c6 (table default.table_c8e5202d265f463bbcf568d34a1e64a2 [id=4ac1925a391a48ea86c63da0c1d8c442]). Expected version 1 got 0
I20260321 03:02:31.573992 8776 tablet_service.cc:1558] Processing DeleteTablet for tablet 481a544d7e4a461396b26b89dfc058ac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-21 03:02:31 UTC) from {username='slave'} at 127.0.0.1:58818
I20260321 03:02:31.574208 9160 tablet_replica.cc:333] T 481a544d7e4a461396b26b89dfc058ac P a97f7dd77cf2444f8fdb441019081f79: stopping tablet replica
I20260321 03:02:31.574334 9160 raft_consensus.cc:2243] T 481a544d7e4a461396b26b89dfc058ac P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260321 03:02:31.574460 9160 raft_consensus.cc:2272] T 481a544d7e4a461396b26b89dfc058ac P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260321 03:02:31.574800 8988 catalog_manager.cc:5671] T a062f5d0fc344fb9a1e8169401451bad P 4532b54a008a4a39b663112e6d0aacc0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193). New cstate: current_term: 1 leader_uuid: "4532b54a008a4a39b663112e6d0aacc0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } health_report { overall_health: UNKNOWN } } }
I20260321 03:02:31.574980 8988 catalog_manager.cc:5763] TS 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171) does not have the latest schema for tablet a062f5d0fc344fb9a1e8169401451bad (table default.table_10dd23c6f33c4aa0bad0a534fb770d4a [id=94ef39d020ab428b9e0392bedab9483d]). Expected version 1 got 0
I20260321 03:02:31.575263 9160 ts_tablet_manager.cc:1916] T 481a544d7e4a461396b26b89dfc058ac P a97f7dd77cf2444f8fdb441019081f79: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260321 03:02:31.579253 9160 ts_tablet_manager.cc:1929] T 481a544d7e4a461396b26b89dfc058ac P a97f7dd77cf2444f8fdb441019081f79: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260321 03:02:31.579381 9160 log.cc:1199] T 481a544d7e4a461396b26b89dfc058ac P a97f7dd77cf2444f8fdb441019081f79: Deleting WAL directory at /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-2/wal/wals/481a544d7e4a461396b26b89dfc058ac
I20260321 03:02:31.579595 9160 ts_tablet_manager.cc:1950] T 481a544d7e4a461396b26b89dfc058ac P a97f7dd77cf2444f8fdb441019081f79: Deleting consensus metadata
I20260321 03:02:31.579864 9161 consensus_queue.cc:260] T 68e8b3d268124c709b5797c168590ceb P a97f7dd77cf2444f8fdb441019081f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } }
I20260321 03:02:31.580247 9161 ts_tablet_manager.cc:1434] T 68e8b3d268124c709b5797c168590ceb P a97f7dd77cf2444f8fdb441019081f79: Time spent starting tablet: real 0.014s user 0.000s sys 0.002s
I20260321 03:02:31.580591 8777 tablet_service.cc:1558] Processing DeleteTablet for tablet 34cc41d9b1f24aaaa3b7140dc7a7e280 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-21 03:02:31 UTC) from {username='slave'} at 127.0.0.1:58818
I20260321 03:02:31.581705 9160 tablet_replica.cc:333] T 34cc41d9b1f24aaaa3b7140dc7a7e280 P a97f7dd77cf2444f8fdb441019081f79: stopping tablet replica
I20260321 03:02:31.581847 9160 raft_consensus.cc:2243] T 34cc41d9b1f24aaaa3b7140dc7a7e280 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260321 03:02:31.581956 9160 raft_consensus.cc:2272] T 34cc41d9b1f24aaaa3b7140dc7a7e280 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260321 03:02:31.581982 8974 catalog_manager.cc:5002] TS a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): tablet 481a544d7e4a461396b26b89dfc058ac (table default.table_ec53d9a55a4c47b8a9b0fa3916c9c561 [id=b792550a4b344d24a9d33f468884c107]) successfully deleted
I20260321 03:02:31.582336 9157 consensus_queue.cc:260] T 68e8b3d268124c709b5797c168590ceb P 4532b54a008a4a39b663112e6d0aacc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } }
I20260321 03:02:31.582690 9157 ts_tablet_manager.cc:1434] T 68e8b3d268124c709b5797c168590ceb P 4532b54a008a4a39b663112e6d0aacc0: Time spent starting tablet: real 0.014s user 0.000s sys 0.001s
I20260321 03:02:31.588263 9160 ts_tablet_manager.cc:1916] T 34cc41d9b1f24aaaa3b7140dc7a7e280 P a97f7dd77cf2444f8fdb441019081f79: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260321 03:02:31.589383 8988 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51854:
name: "default.Table_ba8bb11787c9433093d74640a71395f2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260321 03:02:31.590583 7883 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskZ5BwAx/build/debug/bin/kudu with pid 8924
I20260321 03:02:31.592013 9160 ts_tablet_manager.cc:1929] T 34cc41d9b1f24aaaa3b7140dc7a7e280 P a97f7dd77cf2444f8fdb441019081f79: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260321 03:02:31.592226 9160 log.cc:1199] T 34cc41d9b1f24aaaa3b7140dc7a7e280 P a97f7dd77cf2444f8fdb441019081f79: Deleting WAL directory at /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-2/wal/wals/34cc41d9b1f24aaaa3b7140dc7a7e280
I20260321 03:02:31.592469 9160 ts_tablet_manager.cc:1950] T 34cc41d9b1f24aaaa3b7140dc7a7e280 P a97f7dd77cf2444f8fdb441019081f79: Deleting consensus metadata
W20260321 03:02:31.603183 8739 connection.cc:537] server connection from 127.0.0.1:58818 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260321 03:02:31.606091 8931 raft_consensus.cc:493] T 68e8b3d268124c709b5797c168590ceb P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260321 03:02:31.606251 8931 raft_consensus.cc:515] T 68e8b3d268124c709b5797c168590ceb P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } }
I20260321 03:02:31.606698 8931 leader_election.cc:290] T 68e8b3d268124c709b5797c168590ceb P a97f7dd77cf2444f8fdb441019081f79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171)
I20260321 03:02:31.607066 8667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8b3d268124c709b5797c168590ceb" candidate_uuid: "a97f7dd77cf2444f8fdb441019081f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70e7666c46844503beb466fdc054a6fc" is_pre_election: true
I20260321 03:02:31.607213 8667 raft_consensus.cc:2468] T 68e8b3d268124c709b5797c168590ceb P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a97f7dd77cf2444f8fdb441019081f79 in term 0.
I20260321 03:02:31.607180 8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8b3d268124c709b5797c168590ceb" candidate_uuid: "a97f7dd77cf2444f8fdb441019081f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4532b54a008a4a39b663112e6d0aacc0" is_pre_election: true
I20260321 03:02:31.607316 8531 raft_consensus.cc:2468] T 68e8b3d268124c709b5797c168590ceb P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a97f7dd77cf2444f8fdb441019081f79 in term 0.
I20260321 03:02:31.607642 8738 leader_election.cc:304] T 68e8b3d268124c709b5797c168590ceb P a97f7dd77cf2444f8fdb441019081f79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0, a97f7dd77cf2444f8fdb441019081f79; no voters:
I20260321 03:02:31.607916 8931 raft_consensus.cc:2804] T 68e8b3d268124c709b5797c168590ceb P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260321 03:02:31.607980 8931 raft_consensus.cc:493] T 68e8b3d268124c709b5797c168590ceb P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260321 03:02:31.608016 8931 raft_consensus.cc:3060] T 68e8b3d268124c709b5797c168590ceb P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:31.609073 8931 raft_consensus.cc:515] T 68e8b3d268124c709b5797c168590ceb P a97f7dd77cf2444f8fdb441019081f79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } }
I20260321 03:02:31.609522 8931 leader_election.cc:290] T 68e8b3d268124c709b5797c168590ceb P a97f7dd77cf2444f8fdb441019081f79 [CANDIDATE]: Term 1 election: Requested vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171)
I20260321 03:02:31.610195 8667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8b3d268124c709b5797c168590ceb" candidate_uuid: "a97f7dd77cf2444f8fdb441019081f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70e7666c46844503beb466fdc054a6fc"
I20260321 03:02:31.610338 8667 raft_consensus.cc:3060] T 68e8b3d268124c709b5797c168590ceb P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:31.611431 8667 raft_consensus.cc:2468] T 68e8b3d268124c709b5797c168590ceb P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a97f7dd77cf2444f8fdb441019081f79 in term 1.
I20260321 03:02:31.611809 8737 leader_election.cc:304] T 68e8b3d268124c709b5797c168590ceb P a97f7dd77cf2444f8fdb441019081f79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79; no voters:
I20260321 03:02:31.612100 8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8b3d268124c709b5797c168590ceb" candidate_uuid: "a97f7dd77cf2444f8fdb441019081f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4532b54a008a4a39b663112e6d0aacc0"
I20260321 03:02:31.612233 8531 raft_consensus.cc:3060] T 68e8b3d268124c709b5797c168590ceb P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:31.613297 8531 raft_consensus.cc:2468] T 68e8b3d268124c709b5797c168590ceb P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a97f7dd77cf2444f8fdb441019081f79 in term 1.
I20260321 03:02:31.613811 8931 raft_consensus.cc:2804] T 68e8b3d268124c709b5797c168590ceb P a97f7dd77cf2444f8fdb441019081f79 [term 1 FOLLOWER]: Leader election won for term 1
I20260321 03:02:31.613981 8931 raft_consensus.cc:697] T 68e8b3d268124c709b5797c168590ceb P a97f7dd77cf2444f8fdb441019081f79 [term 1 LEADER]: Becoming Leader. State: Replica: a97f7dd77cf2444f8fdb441019081f79, State: Running, Role: LEADER
I20260321 03:02:31.614133 8931 consensus_queue.cc:237] T 68e8b3d268124c709b5797c168590ceb P a97f7dd77cf2444f8fdb441019081f79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } }
I20260321 03:02:31.888375 9101 consensus_queue.cc:1048] T 7c4e86aafdb24f71a59e3142235441c6 P 4532b54a008a4a39b663112e6d0aacc0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260321 03:02:31.892326 9101 consensus_queue.cc:1048] T 7c4e86aafdb24f71a59e3142235441c6 P 4532b54a008a4a39b663112e6d0aacc0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260321 03:02:31.956475 9101 consensus_queue.cc:1048] T a062f5d0fc344fb9a1e8169401451bad P 4532b54a008a4a39b663112e6d0aacc0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260321 03:02:31.961484 9131 consensus_queue.cc:1048] T a062f5d0fc344fb9a1e8169401451bad P 4532b54a008a4a39b663112e6d0aacc0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260321 03:02:32.084237 9201 raft_consensus.cc:493] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3df5e4492f3049c1b09fea013b92f863)
I20260321 03:02:32.084486 9201 raft_consensus.cc:515] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:02:32.085050 9201 leader_election.cc:290] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595), 3df5e4492f3049c1b09fea013b92f863 (127.7.178.252:45145)
I20260321 03:02:32.085290 9202 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3df5e4492f3049c1b09fea013b92f863)
I20260321 03:02:32.085417 9202 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:02:32.085937 8283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4a187d1fb5804686b4aff01e47fd0284" candidate_term: 3 candidate_status { last_received { term: 2 index: 65 } } ignore_live_leader: false dest_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" is_pre_election: true
I20260321 03:02:32.086133 8283 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a187d1fb5804686b4aff01e47fd0284 in term 2.
I20260321 03:02:32.086318 8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" candidate_term: 3 candidate_status { last_received { term: 2 index: 65 } } ignore_live_leader: false dest_uuid: "4a187d1fb5804686b4aff01e47fd0284" is_pre_election: true
I20260321 03:02:32.086439 8212 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7451d7c0a71f4620a6607f74b5a22f2e in term 2.
I20260321 03:02:32.086143 9202 leader_election.cc:290] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651), 3df5e4492f3049c1b09fea013b92f863 (127.7.178.252:45145)
I20260321 03:02:32.086805 8188 leader_election.cc:304] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a187d1fb5804686b4aff01e47fd0284, 7451d7c0a71f4620a6607f74b5a22f2e; no voters:
I20260321 03:02:32.086983 9201 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260321 03:02:32.087033 9201 raft_consensus.cc:493] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3df5e4492f3049c1b09fea013b92f863)
W20260321 03:02:32.087031 8257 leader_election.cc:336] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 3df5e4492f3049c1b09fea013b92f863 (127.7.178.252:45145): Network error: Client connection negotiation failed: client connection to 127.7.178.252:45145: connect: Connection refused (error 111)
I20260321 03:02:32.087080 9201 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 2 FOLLOWER]: Advancing to term 3
W20260321 03:02:32.087394 8186 leader_election.cc:336] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 3df5e4492f3049c1b09fea013b92f863 (127.7.178.252:45145): Network error: Client connection negotiation failed: client connection to 127.7.178.252:45145: connect: Connection refused (error 111)
I20260321 03:02:32.087405 8259 leader_election.cc:304] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a187d1fb5804686b4aff01e47fd0284, 7451d7c0a71f4620a6607f74b5a22f2e; no voters: 3df5e4492f3049c1b09fea013b92f863
I20260321 03:02:32.087621 9202 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260321 03:02:32.087677 9202 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3df5e4492f3049c1b09fea013b92f863)
I20260321 03:02:32.087714 9202 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [term 2 FOLLOWER]: Advancing to term 3
I20260321 03:02:32.088316 9201 raft_consensus.cc:515] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:02:32.088733 9201 leader_election.cc:290] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [CANDIDATE]: Term 3 election: Requested vote from peers 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595), 3df5e4492f3049c1b09fea013b92f863 (127.7.178.252:45145)
I20260321 03:02:32.088797 9202 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:02:32.089044 8283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4a187d1fb5804686b4aff01e47fd0284" candidate_term: 3 candidate_status { last_received { term: 2 index: 65 } } ignore_live_leader: false dest_uuid: "7451d7c0a71f4620a6607f74b5a22f2e"
I20260321 03:02:32.089169 9202 leader_election.cc:290] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [CANDIDATE]: Term 3 election: Requested vote from peers 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651), 3df5e4492f3049c1b09fea013b92f863 (127.7.178.252:45145)
I20260321 03:02:32.089241 8283 raft_consensus.cc:2393] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a187d1fb5804686b4aff01e47fd0284 in current term 3: Already voted for candidate 7451d7c0a71f4620a6607f74b5a22f2e in this term.
I20260321 03:02:32.089959 8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" candidate_term: 3 candidate_status { last_received { term: 2 index: 65 } } ignore_live_leader: false dest_uuid: "4a187d1fb5804686b4aff01e47fd0284"
W20260321 03:02:32.090024 8186 leader_election.cc:336] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 3df5e4492f3049c1b09fea013b92f863 (127.7.178.252:45145): Network error: Client connection negotiation failed: client connection to 127.7.178.252:45145: connect: Connection refused (error 111)
I20260321 03:02:32.090088 8186 leader_election.cc:304] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a187d1fb5804686b4aff01e47fd0284; no voters: 3df5e4492f3049c1b09fea013b92f863, 7451d7c0a71f4620a6607f74b5a22f2e
I20260321 03:02:32.090091 8212 raft_consensus.cc:2393] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7451d7c0a71f4620a6607f74b5a22f2e in current term 3: Already voted for candidate 4a187d1fb5804686b4aff01e47fd0284 in this term.
I20260321 03:02:32.090368 9201 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260321 03:02:32.090736 8257 leader_election.cc:336] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 3df5e4492f3049c1b09fea013b92f863 (127.7.178.252:45145): Network error: Client connection negotiation failed: client connection to 127.7.178.252:45145: connect: Connection refused (error 111)
I20260321 03:02:32.090799 8257 leader_election.cc:304] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7451d7c0a71f4620a6607f74b5a22f2e; no voters: 3df5e4492f3049c1b09fea013b92f863, 4a187d1fb5804686b4aff01e47fd0284
I20260321 03:02:32.090940 9202 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260321 03:02:32.170578 8931 consensus_queue.cc:1048] T 68e8b3d268124c709b5797c168590ceb P a97f7dd77cf2444f8fdb441019081f79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260321 03:02:32.174888 8931 consensus_queue.cc:1048] T 68e8b3d268124c709b5797c168590ceb P a97f7dd77cf2444f8fdb441019081f79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260321 03:02:32.554448 8239 master_runner.cc:186] Error getting master registration for 127.7.178.252:45145: Network error: Client connection negotiation failed: client connection to 127.7.178.252:45145: connect: Connection refused (error 111),
I20260321 03:02:32.554601 8239 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260321 03:02:32.569111 7883 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskZ5BwAx/build/debug/bin/kudu
/tmp/dist-test-taskZ5BwAx/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.178.252:45145
--webserver_interface=127.7.178.252
--webserver_port=36797
--builtin_ntp_servers=127.7.178.212:39683
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145
--hive_metastore_uris=thrift://127.0.0.1:35641
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260321 03:02:32.611987 9211 raft_consensus.cc:493] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260321 03:02:32.612131 9211 raft_consensus.cc:515] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:02:32.612689 9211 leader_election.cc:290] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595), 3df5e4492f3049c1b09fea013b92f863 (127.7.178.252:45145)
I20260321 03:02:32.613152 8283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4a187d1fb5804686b4aff01e47fd0284" candidate_term: 4 candidate_status { last_received { term: 2 index: 65 } } ignore_live_leader: false dest_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" is_pre_election: true
I20260321 03:02:32.613336 8283 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a187d1fb5804686b4aff01e47fd0284 in term 3.
W20260321 03:02:32.613695 8186 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.178.252:45145: connect: Connection refused (error 111) [suppressed 8 similar messages]
I20260321 03:02:32.613709 8188 leader_election.cc:304] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a187d1fb5804686b4aff01e47fd0284, 7451d7c0a71f4620a6607f74b5a22f2e; no voters:
I20260321 03:02:32.613942 9211 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260321 03:02:32.614002 9211 raft_consensus.cc:493] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260321 03:02:32.614048 9211 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 3 FOLLOWER]: Advancing to term 4
W20260321 03:02:32.614625 8186 leader_election.cc:336] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 3df5e4492f3049c1b09fea013b92f863 (127.7.178.252:45145): Network error: Client connection negotiation failed: client connection to 127.7.178.252:45145: connect: Connection refused (error 111)
I20260321 03:02:32.615196 9211 raft_consensus.cc:515] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:02:32.615597 9211 leader_election.cc:290] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [CANDIDATE]: Term 4 election: Requested vote from peers 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595), 3df5e4492f3049c1b09fea013b92f863 (127.7.178.252:45145)
I20260321 03:02:32.615955 8283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4a187d1fb5804686b4aff01e47fd0284" candidate_term: 4 candidate_status { last_received { term: 2 index: 65 } } ignore_live_leader: false dest_uuid: "7451d7c0a71f4620a6607f74b5a22f2e"
I20260321 03:02:32.616110 8283 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [term 3 FOLLOWER]: Advancing to term 4
W20260321 03:02:32.616750 8186 leader_election.cc:336] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 3df5e4492f3049c1b09fea013b92f863 (127.7.178.252:45145): Network error: Client connection negotiation failed: client connection to 127.7.178.252:45145: connect: Connection refused (error 111)
I20260321 03:02:32.617376 8283 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a187d1fb5804686b4aff01e47fd0284 in term 4.
I20260321 03:02:32.617681 8188 leader_election.cc:304] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a187d1fb5804686b4aff01e47fd0284, 7451d7c0a71f4620a6607f74b5a22f2e; no voters: 3df5e4492f3049c1b09fea013b92f863
I20260321 03:02:32.617940 9211 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 4 FOLLOWER]: Leader election won for term 4
I20260321 03:02:32.618166 9211 raft_consensus.cc:697] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 4 LEADER]: Becoming Leader. State: Replica: 4a187d1fb5804686b4aff01e47fd0284, State: Running, Role: LEADER
I20260321 03:02:32.618481 9211 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 65, Committed index: 65, Last appended: 2.65, Last appended by leader: 65, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:02:32.619809 9214 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4a187d1fb5804686b4aff01e47fd0284. Latest consensus state: current_term: 4 leader_uuid: "4a187d1fb5804686b4aff01e47fd0284" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } } }
I20260321 03:02:32.619937 9214 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [sys.catalog]: This master's current role is: LEADER
I20260321 03:02:32.620277 9216 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260321 03:02:32.622395 9216 catalog_manager.cc:679] Loaded metadata for table default.table_c8e5202d265f463bbcf568d34a1e64a2 [id=4ac1925a391a48ea86c63da0c1d8c442]
I20260321 03:02:32.622700 9216 catalog_manager.cc:679] Loaded metadata for table default.table_0e0c55f293274457aed5e8d315334903 [id=850c888ac63d4c048f27ceeb1ddd4f83]
I20260321 03:02:32.622962 9216 catalog_manager.cc:679] Loaded metadata for table default.table_10dd23c6f33c4aa0bad0a534fb770d4a [id=94ef39d020ab428b9e0392bedab9483d]
I20260321 03:02:32.623373 9216 catalog_manager.cc:679] Loaded metadata for table default.table_60888690371e4e1d8d9e6a31f44b55a5 [id=9bc91b7f6cb8477ab6ed1ee5ed74f608]
I20260321 03:02:32.623675 9216 catalog_manager.cc:679] Loaded metadata for table default.table_f8b27d78677b44468e403c75afa5245a [id=9f5de6240b844d57991fc673d061fbf4]
I20260321 03:02:32.623937 9216 catalog_manager.cc:679] Loaded metadata for table default.table_d52655a709224a7d999af3a2f1f2a678 [id=a69b5fce47c341fe9f48dd5e36364533]
I20260321 03:02:32.624269 9216 catalog_manager.cc:679] Loaded metadata for table default.table_0e444e840fa14c16a1a1f2e750c73045 [id=c6b5b0c7a19649c2b502921f472fc1dc]
I20260321 03:02:32.624497 9216 catalog_manager.cc:679] Loaded metadata for table default.table_06e0fbe90fe0411d95d76f56b53fb175 [id=c7602cbc743a43239656449386fbeb83]
I20260321 03:02:32.626407 9216 tablet_loader.cc:96] loaded metadata for tablet 68e8b3d268124c709b5797c168590ceb (table default.table_d52655a709224a7d999af3a2f1f2a678 [id=a69b5fce47c341fe9f48dd5e36364533])
I20260321 03:02:32.626647 9216 tablet_loader.cc:96] loaded metadata for tablet 7c4e86aafdb24f71a59e3142235441c6 (table default.table_c8e5202d265f463bbcf568d34a1e64a2 [id=4ac1925a391a48ea86c63da0c1d8c442])
I20260321 03:02:32.626843 9216 tablet_loader.cc:96] loaded metadata for tablet 89ae9cb00ef14b5d9d88dfb94a55e5d5 (table default.table_0e0c55f293274457aed5e8d315334903 [id=850c888ac63d4c048f27ceeb1ddd4f83])
I20260321 03:02:32.627030 9216 tablet_loader.cc:96] loaded metadata for tablet 90980515c2f14e4abfff2f3e2edf2f16 (table default.table_0e444e840fa14c16a1a1f2e750c73045 [id=c6b5b0c7a19649c2b502921f472fc1dc])
I20260321 03:02:32.627223 9216 tablet_loader.cc:96] loaded metadata for tablet a062f5d0fc344fb9a1e8169401451bad (table default.table_10dd23c6f33c4aa0bad0a534fb770d4a [id=94ef39d020ab428b9e0392bedab9483d])
I20260321 03:02:32.627902 9216 tablet_loader.cc:96] loaded metadata for tablet d4496a81bf2f40cdb82cc4cbdd24dd20 (table default.table_06e0fbe90fe0411d95d76f56b53fb175 [id=c7602cbc743a43239656449386fbeb83])
I20260321 03:02:32.628137 9216 tablet_loader.cc:96] loaded metadata for tablet ed96f3685d004f6f94f50db2651acc1f (table default.table_f8b27d78677b44468e403c75afa5245a [id=9f5de6240b844d57991fc673d061fbf4])
I20260321 03:02:32.628351 9216 tablet_loader.cc:96] loaded metadata for tablet ffa603a7e8404c968e09e26e5b277911 (table default.table_60888690371e4e1d8d9e6a31f44b55a5 [id=9bc91b7f6cb8477ab6ed1ee5ed74f608])
I20260321 03:02:32.628505 9216 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260321 03:02:32.629191 9216 catalog_manager.cc:1269] Loaded cluster ID: 30588dbe2d29416e8c640adf9bfaba1f
I20260321 03:02:32.629293 9216 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260321 03:02:32.630731 9216 catalog_manager.cc:1514] Loading token signing keys...
I20260321 03:02:32.631369 9216 catalog_manager.cc:6055] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284: Loaded TSK: 0
I20260321 03:02:32.632097 9216 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260321 03:02:32.632737 9216 catalog_manager.cc:1537] Loading latest processed Hive Metastore notification log event ID...
I20260321 03:02:32.633366 9216 catalog_manager.cc:5893] Last processed Hive Metastore notification event ID: 21
I20260321 03:02:32.681169 8196 master_service.cc:954] ReplaceTablet: received request to replace tablet 481a544d7e4a461396b26b89dfc058ac from {username='slave'} at 127.0.0.1:40294
I20260321 03:02:32.681318 8193 master_service.cc:954] ReplaceTablet: received request to replace tablet ffa603a7e8404c968e09e26e5b277911 from {username='slave'} at 127.0.0.1:40294
I20260321 03:02:32.681599 8194 master_service.cc:954] ReplaceTablet: received request to replace tablet 27330be65bac450a8ead355d41fe780e from {username='slave'} at 127.0.0.1:40294
I20260321 03:02:32.682438 8196 master_service.cc:954] ReplaceTablet: received request to replace tablet d4496a81bf2f40cdb82cc4cbdd24dd20 from {username='slave'} at 127.0.0.1:40294
I20260321 03:02:32.680984 8195 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40294:
name: "default.Table_01a908196f6d4a1ba499b382b6932d90"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260321 03:02:32.681280 8197 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40294:
name: "default.Table_492554e7d97c4920bdf854ca950c0179"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260321 03:02:32.681068 8199 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40294:
name: "default.Table_79533ce61645417d9d18b6b2820ee1af"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260321 03:02:32.683477 8202 master_service.cc:954] ReplaceTablet: received request to replace tablet 27330be65bac450a8ead355d41fe780e from {username='slave'} at 127.0.0.1:40294
I20260321 03:02:32.681104 8200 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40294:
name: "default.Table_9b16e83d2d334faaa3ccd9aaae03ccf7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260321 03:02:32.681522 8198 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40294:
table { table_name: "default.Table_d52655a709224a7d999af3a2f1f2a678" } modify_external_catalogs: true
I20260321 03:02:32.683888 8198 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40294:
table { table_name: "default.Table_d52655a709224a7d999af3a2f1f2a678" } modify_external_catalogs: true
I20260321 03:02:32.682065 8194 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40294:
name: "default.Table_d2585fcc892d4f4882c0a068ce656fee"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260321 03:02:32.684072 8202 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40294:
table { table_name: "default.Table_60888690371e4e1d8d9e6a31f44b55a5" } modify_external_catalogs: true
I20260321 03:02:32.684190 8202 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40294:
table { table_name: "default.Table_60888690371e4e1d8d9e6a31f44b55a5" } modify_external_catalogs: true
I20260321 03:02:32.682533 8201 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40294:
name: "default.Table_9017f1e107c846008985a821415447b8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260321 03:02:32.687477 8283 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [term 4 FOLLOWER]: Refusing update from remote peer 4a187d1fb5804686b4aff01e47fd0284: Log matching property violated. Preceding OpId in replica: term: 2 index: 65. Preceding OpId from leader: term: 4 index: 67. (index mismatch)
W20260321 03:02:32.687779 8186 consensus_peers.cc:597] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 -> Peer 3df5e4492f3049c1b09fea013b92f863 (127.7.178.252:45145): Couldn't send request to peer 3df5e4492f3049c1b09fea013b92f863. Status: Network error: Client connection negotiation failed: client connection to 127.7.178.252:45145: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260321 03:02:32.688333 9211 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 66, Last known committed idx: 65, Time since last communication: 0.000s
I20260321 03:02:32.695176 9214 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 4 leader_uuid: "4a187d1fb5804686b4aff01e47fd0284" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } } }
I20260321 03:02:32.695341 9214 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [sys.catalog]: This master's current role is: LEADER
F20260321 03:02:32.696049 8439 hms_notification_log_listener.cc:287] non-monotonous event IDs from HMS: current 23, previous 23; dumping first 3 out of 6 received events: NotificationEvent(eventId=22, eventTime=1774062151, eventType=DROP_TABLE, dbName=default, tableName=table_79533ce61645417d9d18b6b2820ee1af, message={"server":"","servicePrincipal":"","db":"default","table":"table_79533ce61645417d9d18b6b2820ee1af","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_79533ce61645417d9d18b6b2820ee1af\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1774062150},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/warehouse/table_79533ce61645417d9d18b6b2820ee1af\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_79533ce61645417d9d18b6b2820ee1af\",\"kudu.table_id\":\"435759bdc4464e5f859546dfc760d6ad\",\"transient_lastDdlTime\":\"1774062150\",\"comment\":\"\",\"kudu.master_addresses\":\"127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"30588dbe2d29416e8c640adf9bfaba1f\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1774062151}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=23, eventTime=1774062151, eventType=DROP_TABLE, dbName=default, tableName=table_0e0c55f293274457aed5e8d315334903, message={"server":"","servicePrincipal":"","db":"default","table":"table_0e0c55f293274457aed5e8d315334903","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_0e0c55f293274457aed5e8d315334903\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1774062149},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/warehouse/table_0e0c55f293274457aed5e8d315334903\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_0e0c55f293274457aed5e8d315334903\",\"kudu.table_id\":\"850c888ac63d4c048f27ceeb1ddd4f83\",\"transient_lastDdlTime\":\"1774062149\",\"comment\":\"\",\"kudu.master_addresses\":\"127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"30588dbe2d29416e8c640adf9bfaba1f\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1774062151}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=23, eventTime=1774062151, eventType=DROP_TABLE, dbName=default, tableName=table_492554e7d97c4920bdf854ca950c0179, message={"server":"","servicePrincipal":"","db":"default","table":"table_492554e7d97c4920bdf854ca950c0179","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_492554e7d97c4920bdf854ca950c0179\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1774062151},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/warehouse/table_492554e7d97c4920bdf854ca950c0179\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_492554e7d97c4920bdf854ca950c0179\",\"kudu.table_id\":\"1eabb731ef9a41249c3e08ccf80157e4\",\"transient_lastDdlTime\":\"1774062151\",\"comment\":\"\",\"kudu.master_addresses\":\"127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"30588dbe2d29416e8c640adf9bfaba1f\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1774062151}, messageFormat=json-0.2, catName=hive);
I20260321 03:02:32.695992 9226 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4a187d1fb5804686b4aff01e47fd0284. Latest consensus state: current_term: 4 leader_uuid: "4a187d1fb5804686b4aff01e47fd0284" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } } }
I20260321 03:02:32.696123 9226 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [sys.catalog]: This master's current role is: FOLLOWER
I20260321 03:02:32.696209 9226 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 4 leader_uuid: "4a187d1fb5804686b4aff01e47fd0284" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } } }
I20260321 03:02:32.696288 9226 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [sys.catalog]: This master's current role is: FOLLOWER
*** Check failure stack trace: ***
W20260321 03:02:32.697429 9210 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260321 03:02:32.697744 9210 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260321 03:02:32.697866 9210 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260321 03:02:32.698349 8196 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284: Sending DeleteTablet for 3 replicas of tablet d4496a81bf2f40cdb82cc4cbdd24dd20
I20260321 03:02:32.699908 8196 catalog_manager.cc:6741] ReplaceTablet: tablet d4496a81bf2f40cdb82cc4cbdd24dd20 deleted and replaced by tablet d254157f7738406eb700e7e9af6adab3
I20260321 03:02:32.700145 8196 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40294:
table { table_name: "default.Table_0e0c55f293274457aed5e8d315334903" } modify_external_catalogs: true
I20260321 03:02:32.700282 8196 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40294:
table { table_name: "default.Table_0e0c55f293274457aed5e8d315334903" } modify_external_catalogs: true
@ 0x7ff23e5d5dcd google::LogMessage::Fail() at ??:0
W20260321 03:02:32.703433 9210 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260321 03:02:32.703504 9210 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260321 03:02:32.703532 9210 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260321 03:02:32.703558 9210 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260321 03:02:32.704208 8193 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284: Sending DeleteTablet for 3 replicas of tablet ffa603a7e8404c968e09e26e5b277911
@ 0x7ff23e5d9b93 google::LogMessage::SendToLog() at ??:0
I20260321 03:02:32.704618 8193 catalog_manager.cc:6741] ReplaceTablet: tablet ffa603a7e8404c968e09e26e5b277911 deleted and replaced by tablet 8535a1895af2482f90cfd53a79de88d5
I20260321 03:02:32.704926 8193 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40294:
table { table_name: "default.Table_c8e5202d265f463bbcf568d34a1e64a2" } new_table_name: "default.Table_75e35409dad54304bbd621a1202abbec" modify_external_catalogs: true
I20260321 03:02:32.707993 8506 tablet_service.cc:1558] Processing DeleteTablet for tablet d4496a81bf2f40cdb82cc4cbdd24dd20 with delete_type TABLET_DATA_DELETED (replaced by tablet d254157f7738406eb700e7e9af6adab3) from {username='slave'} at 127.0.0.1:60600
I20260321 03:02:32.708299 8505 tablet_service.cc:1558] Processing DeleteTablet for tablet ffa603a7e8404c968e09e26e5b277911 with delete_type TABLET_DATA_DELETED (replaced by tablet 8535a1895af2482f90cfd53a79de88d5) from {username='slave'} at 127.0.0.1:60600
I20260321 03:02:32.710543 9210 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.178.212:39683
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-2/wal
--hive_metastore_uris=thrift://127.0.0.1:35641
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.178.252:45145
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.7.178.252
--webserver_port=36797
--never_fsync=true
--heap_profile_path=/tmp/kudu.9210
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 68f10dd41067059260a5fb5c725b178b69c38aed
build type DEBUG
built by None at 21 Mar 2026 02:43:15 UTC on bdcb31816ec0
build id 11028
I20260321 03:02:32.711283 8639 tablet_service.cc:1558] Processing DeleteTablet for tablet d4496a81bf2f40cdb82cc4cbdd24dd20 with delete_type TABLET_DATA_DELETED (replaced by tablet d254157f7738406eb700e7e9af6adab3) from {username='slave'} at 127.0.0.1:43442
I20260321 03:02:32.711767 8646 tablet_service.cc:1558] Processing DeleteTablet for tablet ffa603a7e8404c968e09e26e5b277911 with delete_type TABLET_DATA_DELETED (replaced by tablet 8535a1895af2482f90cfd53a79de88d5) from {username='slave'} at 127.0.0.1:43442
I20260321 03:02:32.712414 9210 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260321 03:02:32.712427 8505 tablet_service.cc:1511] Processing CreateTablet for tablet d254157f7738406eb700e7e9af6adab3 (DEFAULT_TABLE table=default.table_06e0fbe90fe0411d95d76f56b53fb175 [id=c7602cbc743a43239656449386fbeb83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:32.712559 8777 tablet_service.cc:1558] Processing DeleteTablet for tablet d4496a81bf2f40cdb82cc4cbdd24dd20 with delete_type TABLET_DATA_DELETED (replaced by tablet d254157f7738406eb700e7e9af6adab3) from {username='slave'} at 127.0.0.1:44954
I20260321 03:02:32.712775 8505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d254157f7738406eb700e7e9af6adab3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:32.712913 9238 tablet_replica.cc:333] T d4496a81bf2f40cdb82cc4cbdd24dd20 P a97f7dd77cf2444f8fdb441019081f79: stopping tablet replica
I20260321 03:02:32.712935 8779 tablet_service.cc:1511] Processing CreateTablet for tablet d254157f7738406eb700e7e9af6adab3 (DEFAULT_TABLE table=default.table_06e0fbe90fe0411d95d76f56b53fb175 [id=c7602cbc743a43239656449386fbeb83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:32.713049 9238 raft_consensus.cc:2243] T d4496a81bf2f40cdb82cc4cbdd24dd20 P a97f7dd77cf2444f8fdb441019081f79 [term 1 LEADER]: Raft consensus shutting down.
I20260321 03:02:32.713198 8779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d254157f7738406eb700e7e9af6adab3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:32.713328 9238 raft_consensus.cc:2272] T d4496a81bf2f40cdb82cc4cbdd24dd20 P a97f7dd77cf2444f8fdb441019081f79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260321 03:02:32.713752 9238 ts_tablet_manager.cc:1916] T d4496a81bf2f40cdb82cc4cbdd24dd20 P a97f7dd77cf2444f8fdb441019081f79: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260321 03:02:32.714061 9210 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260321 03:02:32.715601 8776 tablet_service.cc:1558] Processing DeleteTablet for tablet ffa603a7e8404c968e09e26e5b277911 with delete_type TABLET_DATA_DELETED (replaced by tablet 8535a1895af2482f90cfd53a79de88d5) from {username='slave'} at 127.0.0.1:44954
I20260321 03:02:32.717471 8646 tablet_service.cc:1511] Processing CreateTablet for tablet d254157f7738406eb700e7e9af6adab3 (DEFAULT_TABLE table=default.table_06e0fbe90fe0411d95d76f56b53fb175 [id=c7602cbc743a43239656449386fbeb83]), partition=RANGE (key) PARTITION UNBOUNDED
@ 0x7ff23e5d57cc google::LogMessage::Flush() at ??:0
I20260321 03:02:32.717836 8646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d254157f7738406eb700e7e9af6adab3. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7ff23e5d5a11 google::LogMessage::~LogMessage() at ??:0
I20260321 03:02:32.721107 9237 tablet_replica.cc:333] T d4496a81bf2f40cdb82cc4cbdd24dd20 P 70e7666c46844503beb466fdc054a6fc: stopping tablet replica
I20260321 03:02:32.721530 9236 tablet_replica.cc:333] T d4496a81bf2f40cdb82cc4cbdd24dd20 P 4532b54a008a4a39b663112e6d0aacc0: stopping tablet replica
I20260321 03:02:32.721693 9236 raft_consensus.cc:2243] T d4496a81bf2f40cdb82cc4cbdd24dd20 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260321 03:02:32.721832 9236 raft_consensus.cc:2272] T d4496a81bf2f40cdb82cc4cbdd24dd20 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260321 03:02:32.722184 8505 tablet_service.cc:1511] Processing CreateTablet for tablet 8535a1895af2482f90cfd53a79de88d5 (DEFAULT_TABLE table=default.table_60888690371e4e1d8d9e6a31f44b55a5 [id=9bc91b7f6cb8477ab6ed1ee5ed74f608]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:32.722282 9236 ts_tablet_manager.cc:1916] T d4496a81bf2f40cdb82cc4cbdd24dd20 P 4532b54a008a4a39b663112e6d0aacc0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260321 03:02:32.722338 8776 tablet_service.cc:1511] Processing CreateTablet for tablet 8535a1895af2482f90cfd53a79de88d5 (DEFAULT_TABLE table=default.table_60888690371e4e1d8d9e6a31f44b55a5 [id=9bc91b7f6cb8477ab6ed1ee5ed74f608]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:32.722484 8505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8535a1895af2482f90cfd53a79de88d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:32.723824 8776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8535a1895af2482f90cfd53a79de88d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:32.725921 8646 tablet_service.cc:1511] Processing CreateTablet for tablet 8535a1895af2482f90cfd53a79de88d5 (DEFAULT_TABLE table=default.table_60888690371e4e1d8d9e6a31f44b55a5 [id=9bc91b7f6cb8477ab6ed1ee5ed74f608]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:32.726255 8646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8535a1895af2482f90cfd53a79de88d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:32.726351 9238 ts_tablet_manager.cc:1929] T d4496a81bf2f40cdb82cc4cbdd24dd20 P a97f7dd77cf2444f8fdb441019081f79: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260321 03:02:32.726418 9238 log.cc:1199] T d4496a81bf2f40cdb82cc4cbdd24dd20 P a97f7dd77cf2444f8fdb441019081f79: Deleting WAL directory at /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-2/wal/wals/d4496a81bf2f40cdb82cc4cbdd24dd20
I20260321 03:02:32.726691 9238 ts_tablet_manager.cc:1950] T d4496a81bf2f40cdb82cc4cbdd24dd20 P a97f7dd77cf2444f8fdb441019081f79: Deleting consensus metadata
I20260321 03:02:32.727521 9238 tablet_replica.cc:333] T ffa603a7e8404c968e09e26e5b277911 P a97f7dd77cf2444f8fdb441019081f79: stopping tablet replica
I20260321 03:02:32.727663 9238 raft_consensus.cc:2243] T ffa603a7e8404c968e09e26e5b277911 P a97f7dd77cf2444f8fdb441019081f79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260321 03:02:32.727658 8189 catalog_manager.cc:5002] TS a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): tablet d4496a81bf2f40cdb82cc4cbdd24dd20 (table default.table_06e0fbe90fe0411d95d76f56b53fb175 [id=c7602cbc743a43239656449386fbeb83]) successfully deleted
I20260321 03:02:32.727792 9238 raft_consensus.cc:2272] T ffa603a7e8404c968e09e26e5b277911 P a97f7dd77cf2444f8fdb441019081f79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260321 03:02:32.728235 9238 ts_tablet_manager.cc:1916] T ffa603a7e8404c968e09e26e5b277911 P a97f7dd77cf2444f8fdb441019081f79: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260321 03:02:32.721278 9237 raft_consensus.cc:2243] T d4496a81bf2f40cdb82cc4cbdd24dd20 P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260321 03:02:32.728921 9237 raft_consensus.cc:2272] T d4496a81bf2f40cdb82cc4cbdd24dd20 P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260321 03:02:32.729374 9237 ts_tablet_manager.cc:1916] T d4496a81bf2f40cdb82cc4cbdd24dd20 P 70e7666c46844503beb466fdc054a6fc: Deleting tablet data with delete state TABLET_DATA_DELETED
@ 0x7ff2437ae44d kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
I20260321 03:02:32.730437 9238 ts_tablet_manager.cc:1929] T ffa603a7e8404c968e09e26e5b277911 P a97f7dd77cf2444f8fdb441019081f79: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260321 03:02:32.730509 9238 log.cc:1199] T ffa603a7e8404c968e09e26e5b277911 P a97f7dd77cf2444f8fdb441019081f79: Deleting WAL directory at /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-2/wal/wals/ffa603a7e8404c968e09e26e5b277911
I20260321 03:02:32.730764 9238 ts_tablet_manager.cc:1950] T ffa603a7e8404c968e09e26e5b277911 P a97f7dd77cf2444f8fdb441019081f79: Deleting consensus metadata
I20260321 03:02:32.731077 9240 tablet_bootstrap.cc:492] T d254157f7738406eb700e7e9af6adab3 P a97f7dd77cf2444f8fdb441019081f79: Bootstrap starting.
I20260321 03:02:32.731573 9237 ts_tablet_manager.cc:1929] T d4496a81bf2f40cdb82cc4cbdd24dd20 P 70e7666c46844503beb466fdc054a6fc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260321 03:02:32.731655 9237 log.cc:1199] T d4496a81bf2f40cdb82cc4cbdd24dd20 P 70e7666c46844503beb466fdc054a6fc: Deleting WAL directory at /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-1/wal/wals/d4496a81bf2f40cdb82cc4cbdd24dd20
I20260321 03:02:32.731946 9237 ts_tablet_manager.cc:1950] T d4496a81bf2f40cdb82cc4cbdd24dd20 P 70e7666c46844503beb466fdc054a6fc: Deleting consensus metadata
I20260321 03:02:32.732251 9241 tablet_bootstrap.cc:492] T d254157f7738406eb700e7e9af6adab3 P 70e7666c46844503beb466fdc054a6fc: Bootstrap starting.
I20260321 03:02:32.727924 9236 ts_tablet_manager.cc:1929] T d4496a81bf2f40cdb82cc4cbdd24dd20 P 4532b54a008a4a39b663112e6d0aacc0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260321 03:02:32.732322 9236 log.cc:1199] T d4496a81bf2f40cdb82cc4cbdd24dd20 P 4532b54a008a4a39b663112e6d0aacc0: Deleting WAL directory at /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-0/wal/wals/d4496a81bf2f40cdb82cc4cbdd24dd20
I20260321 03:02:32.732399 9240 tablet_bootstrap.cc:654] T d254157f7738406eb700e7e9af6adab3 P a97f7dd77cf2444f8fdb441019081f79: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:32.732717 9236 ts_tablet_manager.cc:1950] T d4496a81bf2f40cdb82cc4cbdd24dd20 P 4532b54a008a4a39b663112e6d0aacc0: Deleting consensus metadata
I20260321 03:02:32.732858 9239 tablet_bootstrap.cc:492] T d254157f7738406eb700e7e9af6adab3 P 4532b54a008a4a39b663112e6d0aacc0: Bootstrap starting.
I20260321 03:02:32.733606 9236 tablet_replica.cc:333] T ffa603a7e8404c968e09e26e5b277911 P 4532b54a008a4a39b663112e6d0aacc0: stopping tablet replica
I20260321 03:02:32.733731 9236 raft_consensus.cc:2243] T ffa603a7e8404c968e09e26e5b277911 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260321 03:02:32.733772 8187 catalog_manager.cc:5002] TS 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171): tablet d4496a81bf2f40cdb82cc4cbdd24dd20 (table default.table_06e0fbe90fe0411d95d76f56b53fb175 [id=c7602cbc743a43239656449386fbeb83]) successfully deleted
I20260321 03:02:32.733855 9236 raft_consensus.cc:2272] T ffa603a7e8404c968e09e26e5b277911 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260321 03:02:32.733497 9241 tablet_bootstrap.cc:654] T d254157f7738406eb700e7e9af6adab3 P 70e7666c46844503beb466fdc054a6fc: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:32.734050 9239 tablet_bootstrap.cc:654] T d254157f7738406eb700e7e9af6adab3 P 4532b54a008a4a39b663112e6d0aacc0: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:32.734297 9236 ts_tablet_manager.cc:1916] T ffa603a7e8404c968e09e26e5b277911 P 4532b54a008a4a39b663112e6d0aacc0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260321 03:02:32.735495 8186 catalog_manager.cc:5002] TS 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): tablet d4496a81bf2f40cdb82cc4cbdd24dd20 (table default.table_06e0fbe90fe0411d95d76f56b53fb175 [id=c7602cbc743a43239656449386fbeb83]) successfully deleted
I20260321 03:02:32.735762 9237 tablet_replica.cc:333] T ffa603a7e8404c968e09e26e5b277911 P 70e7666c46844503beb466fdc054a6fc: stopping tablet replica
I20260321 03:02:32.735898 9237 raft_consensus.cc:2243] T ffa603a7e8404c968e09e26e5b277911 P 70e7666c46844503beb466fdc054a6fc [term 1 LEADER]: Raft consensus shutting down.
I20260321 03:02:32.736117 9237 raft_consensus.cc:2272] T ffa603a7e8404c968e09e26e5b277911 P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260321 03:02:32.736541 9237 ts_tablet_manager.cc:1916] T ffa603a7e8404c968e09e26e5b277911 P 70e7666c46844503beb466fdc054a6fc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260321 03:02:32.736909 8189 catalog_manager.cc:5002] TS a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): tablet ffa603a7e8404c968e09e26e5b277911 (table default.table_60888690371e4e1d8d9e6a31f44b55a5 [id=9bc91b7f6cb8477ab6ed1ee5ed74f608]) successfully deleted
I20260321 03:02:32.737344 9239 tablet_bootstrap.cc:492] T d254157f7738406eb700e7e9af6adab3 P 4532b54a008a4a39b663112e6d0aacc0: No bootstrap required, opened a new log
I20260321 03:02:32.737440 9239 ts_tablet_manager.cc:1403] T d254157f7738406eb700e7e9af6adab3 P 4532b54a008a4a39b663112e6d0aacc0: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260321 03:02:32.737700 9236 ts_tablet_manager.cc:1929] T ffa603a7e8404c968e09e26e5b277911 P 4532b54a008a4a39b663112e6d0aacc0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260321 03:02:32.737778 9236 log.cc:1199] T ffa603a7e8404c968e09e26e5b277911 P 4532b54a008a4a39b663112e6d0aacc0: Deleting WAL directory at /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-0/wal/wals/ffa603a7e8404c968e09e26e5b277911
I20260321 03:02:32.738062 9236 ts_tablet_manager.cc:1950] T ffa603a7e8404c968e09e26e5b277911 P 4532b54a008a4a39b663112e6d0aacc0: Deleting consensus metadata
I20260321 03:02:32.738018 9239 raft_consensus.cc:359] T d254157f7738406eb700e7e9af6adab3 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } }
I20260321 03:02:32.738128 9239 raft_consensus.cc:385] T d254157f7738406eb700e7e9af6adab3 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:32.738158 9239 raft_consensus.cc:740] T d254157f7738406eb700e7e9af6adab3 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4532b54a008a4a39b663112e6d0aacc0, State: Initialized, Role: FOLLOWER
I20260321 03:02:32.736133 9241 tablet_bootstrap.cc:492] T d254157f7738406eb700e7e9af6adab3 P 70e7666c46844503beb466fdc054a6fc: No bootstrap required, opened a new log
I20260321 03:02:32.738308 9239 consensus_queue.cc:260] T d254157f7738406eb700e7e9af6adab3 P 4532b54a008a4a39b663112e6d0aacc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } }
I20260321 03:02:32.738374 9241 ts_tablet_manager.cc:1403] T d254157f7738406eb700e7e9af6adab3 P 70e7666c46844503beb466fdc054a6fc: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260321 03:02:32.738981 9241 raft_consensus.cc:359] T d254157f7738406eb700e7e9af6adab3 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } }
I20260321 03:02:32.739095 9241 raft_consensus.cc:385] T d254157f7738406eb700e7e9af6adab3 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:32.739178 9239 ts_tablet_manager.cc:1434] T d254157f7738406eb700e7e9af6adab3 P 4532b54a008a4a39b663112e6d0aacc0: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260321 03:02:32.739382 9239 tablet_bootstrap.cc:492] T 8535a1895af2482f90cfd53a79de88d5 P 4532b54a008a4a39b663112e6d0aacc0: Bootstrap starting.
I20260321 03:02:32.739924 9237 ts_tablet_manager.cc:1929] T ffa603a7e8404c968e09e26e5b277911 P 70e7666c46844503beb466fdc054a6fc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260321 03:02:32.739998 9237 log.cc:1199] T ffa603a7e8404c968e09e26e5b277911 P 70e7666c46844503beb466fdc054a6fc: Deleting WAL directory at /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-1/wal/wals/ffa603a7e8404c968e09e26e5b277911
I20260321 03:02:32.739135 9241 raft_consensus.cc:740] T d254157f7738406eb700e7e9af6adab3 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70e7666c46844503beb466fdc054a6fc, State: Initialized, Role: FOLLOWER
I20260321 03:02:32.740338 9241 consensus_queue.cc:260] T d254157f7738406eb700e7e9af6adab3 P 70e7666c46844503beb466fdc054a6fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } }
I20260321 03:02:32.740635 9239 tablet_bootstrap.cc:654] T 8535a1895af2482f90cfd53a79de88d5 P 4532b54a008a4a39b663112e6d0aacc0: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:32.740854 8715 heartbeater.cc:499] Master 127.7.178.254:38651 was elected leader, sending a full tablet report...
I20260321 03:02:32.740952 9237 ts_tablet_manager.cc:1950] T ffa603a7e8404c968e09e26e5b277911 P 70e7666c46844503beb466fdc054a6fc: Deleting consensus metadata
@ 0x7ff2437ad364 kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
I20260321 03:02:32.743216 9241 ts_tablet_manager.cc:1434] T d254157f7738406eb700e7e9af6adab3 P 70e7666c46844503beb466fdc054a6fc: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20260321 03:02:32.744036 8186 catalog_manager.cc:5002] TS 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): tablet ffa603a7e8404c968e09e26e5b277911 (table default.table_60888690371e4e1d8d9e6a31f44b55a5 [id=9bc91b7f6cb8477ab6ed1ee5ed74f608]) successfully deleted
I20260321 03:02:32.744313 9239 tablet_bootstrap.cc:492] T 8535a1895af2482f90cfd53a79de88d5 P 4532b54a008a4a39b663112e6d0aacc0: No bootstrap required, opened a new log
I20260321 03:02:32.744436 9239 ts_tablet_manager.cc:1403] T 8535a1895af2482f90cfd53a79de88d5 P 4532b54a008a4a39b663112e6d0aacc0: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
W20260321 03:02:32.744658 9246 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260321 03:02:32.744933 9244 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260321 03:02:32.745011 9239 raft_consensus.cc:359] T 8535a1895af2482f90cfd53a79de88d5 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
W20260321 03:02:32.745123 9243 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260321 03:02:32.745148 9239 raft_consensus.cc:385] T 8535a1895af2482f90cfd53a79de88d5 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:32.745201 9239 raft_consensus.cc:740] T 8535a1895af2482f90cfd53a79de88d5 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4532b54a008a4a39b663112e6d0aacc0, State: Initialized, Role: FOLLOWER
I20260321 03:02:32.745397 9239 consensus_queue.cc:260] T 8535a1895af2482f90cfd53a79de88d5 P 4532b54a008a4a39b663112e6d0aacc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:32.745530 9241 tablet_bootstrap.cc:492] T 8535a1895af2482f90cfd53a79de88d5 P 70e7666c46844503beb466fdc054a6fc: Bootstrap starting.
I20260321 03:02:32.745775 9239 ts_tablet_manager.cc:1434] T 8535a1895af2482f90cfd53a79de88d5 P 4532b54a008a4a39b663112e6d0aacc0: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
@ 0x7ff2437acac7 _ZZN4kudu6master30HmsNotificationLogListenerTask4InitEvENKUlvE_clEv at ??:0
I20260321 03:02:32.747015 9241 tablet_bootstrap.cc:654] T 8535a1895af2482f90cfd53a79de88d5 P 70e7666c46844503beb466fdc054a6fc: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:32.748735 8187 catalog_manager.cc:5002] TS 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171): tablet ffa603a7e8404c968e09e26e5b277911 (table default.table_60888690371e4e1d8d9e6a31f44b55a5 [id=9bc91b7f6cb8477ab6ed1ee5ed74f608]) successfully deleted
I20260321 03:02:32.749223 9240 tablet_bootstrap.cc:492] T d254157f7738406eb700e7e9af6adab3 P a97f7dd77cf2444f8fdb441019081f79: No bootstrap required, opened a new log
I20260321 03:02:32.749362 9240 ts_tablet_manager.cc:1403] T d254157f7738406eb700e7e9af6adab3 P a97f7dd77cf2444f8fdb441019081f79: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.001s
I20260321 03:02:32.749933 9210 server_base.cc:1061] running on GCE node
I20260321 03:02:32.749948 9240 raft_consensus.cc:359] T d254157f7738406eb700e7e9af6adab3 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } }
I20260321 03:02:32.750051 9240 raft_consensus.cc:385] T d254157f7738406eb700e7e9af6adab3 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:32.750082 9240 raft_consensus.cc:740] T d254157f7738406eb700e7e9af6adab3 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a97f7dd77cf2444f8fdb441019081f79, State: Initialized, Role: FOLLOWER
I20260321 03:02:32.750240 9240 consensus_queue.cc:260] T d254157f7738406eb700e7e9af6adab3 P a97f7dd77cf2444f8fdb441019081f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } }
I20260321 03:02:32.750528 9240 ts_tablet_manager.cc:1434] T d254157f7738406eb700e7e9af6adab3 P a97f7dd77cf2444f8fdb441019081f79: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260321 03:02:32.750731 9210 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260321 03:02:32.750737 8851 heartbeater.cc:499] Master 127.7.178.254:38651 was elected leader, sending a full tablet report...
I20260321 03:02:32.750751 9240 tablet_bootstrap.cc:492] T 8535a1895af2482f90cfd53a79de88d5 P a97f7dd77cf2444f8fdb441019081f79: Bootstrap starting.
I20260321 03:02:32.751979 9210 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
@ 0x7ff2437b21ce _ZNSt17_Function_handlerIFvvEZN4kudu6master30HmsNotificationLogListenerTask4InitEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
I20260321 03:02:32.753227 9240 tablet_bootstrap.cc:654] T 8535a1895af2482f90cfd53a79de88d5 P a97f7dd77cf2444f8fdb441019081f79: Neither blocks nor log segments found. Creating new log.
@ 0x5604f4b2118a std::function<>::operator()() at ??:0
I20260321 03:02:32.754026 9241 tablet_bootstrap.cc:492] T 8535a1895af2482f90cfd53a79de88d5 P 70e7666c46844503beb466fdc054a6fc: No bootstrap required, opened a new log
I20260321 03:02:32.754125 9241 ts_tablet_manager.cc:1403] T 8535a1895af2482f90cfd53a79de88d5 P 70e7666c46844503beb466fdc054a6fc: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20260321 03:02:32.754865 9241 raft_consensus.cc:359] T 8535a1895af2482f90cfd53a79de88d5 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:32.754997 9241 raft_consensus.cc:385] T 8535a1895af2482f90cfd53a79de88d5 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:32.755038 9241 raft_consensus.cc:740] T 8535a1895af2482f90cfd53a79de88d5 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70e7666c46844503beb466fdc054a6fc, State: Initialized, Role: FOLLOWER
I20260321 03:02:32.755213 9241 consensus_queue.cc:260] T 8535a1895af2482f90cfd53a79de88d5 P 70e7666c46844503beb466fdc054a6fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:32.755247 9210 hybrid_clock.cc:648] HybridClock initialized: now 1774062152754711 us; error 543 us; skew 500 ppm
I20260321 03:02:32.755443 9240 tablet_bootstrap.cc:492] T 8535a1895af2482f90cfd53a79de88d5 P a97f7dd77cf2444f8fdb441019081f79: No bootstrap required, opened a new log
I20260321 03:02:32.755522 9240 ts_tablet_manager.cc:1403] T 8535a1895af2482f90cfd53a79de88d5 P a97f7dd77cf2444f8fdb441019081f79: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.002s
I20260321 03:02:32.755788 9241 ts_tablet_manager.cc:1434] T 8535a1895af2482f90cfd53a79de88d5 P 70e7666c46844503beb466fdc054a6fc: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260321 03:02:32.756038 9240 raft_consensus.cc:359] T 8535a1895af2482f90cfd53a79de88d5 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:32.756153 9240 raft_consensus.cc:385] T 8535a1895af2482f90cfd53a79de88d5 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:32.756186 9240 raft_consensus.cc:740] T 8535a1895af2482f90cfd53a79de88d5 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a97f7dd77cf2444f8fdb441019081f79, State: Initialized, Role: FOLLOWER
I20260321 03:02:32.756341 9240 consensus_queue.cc:260] T 8535a1895af2482f90cfd53a79de88d5 P a97f7dd77cf2444f8fdb441019081f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:32.757124 9240 ts_tablet_manager.cc:1434] T 8535a1895af2482f90cfd53a79de88d5 P a97f7dd77cf2444f8fdb441019081f79: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260321 03:02:32.758010 9210 webserver.cc:492] Webserver started at http://127.7.178.252:36797/ using document root <none> and password file <none>
I20260321 03:02:32.758823 9210 fs_manager.cc:362] Metadata directory not provided
I20260321 03:02:32.758934 9210 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
@ 0x7ff23fada028 kudu::Thread::SuperviseThread() at ??:0
@ 0x7ff2402c16db start_thread at ??:0
I20260321 03:02:32.763872 9090 raft_consensus.cc:493] T d254157f7738406eb700e7e9af6adab3 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260321 03:02:32.763999 9090 raft_consensus.cc:515] T d254157f7738406eb700e7e9af6adab3 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } }
I20260321 03:02:32.764276 9210 fs_manager.cc:714] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260321 03:02:32.764516 9090 leader_election.cc:290] T d254157f7738406eb700e7e9af6adab3 P 70e7666c46844503beb466fdc054a6fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091), 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171)
@ 0x7ff23d78c61f clone at ??:0
I20260321 03:02:32.764894 8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d254157f7738406eb700e7e9af6adab3" candidate_uuid: "70e7666c46844503beb466fdc054a6fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a97f7dd77cf2444f8fdb441019081f79" is_pre_election: true
I20260321 03:02:32.765021 8803 raft_consensus.cc:2468] T d254157f7738406eb700e7e9af6adab3 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70e7666c46844503beb466fdc054a6fc in term 0.
I20260321 03:02:32.765400 8604 leader_election.cc:304] T d254157f7738406eb700e7e9af6adab3 P 70e7666c46844503beb466fdc054a6fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79; no voters:
I20260321 03:02:32.765398 8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d254157f7738406eb700e7e9af6adab3" candidate_uuid: "70e7666c46844503beb466fdc054a6fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4532b54a008a4a39b663112e6d0aacc0" is_pre_election: true
I20260321 03:02:32.765542 8531 raft_consensus.cc:2468] T d254157f7738406eb700e7e9af6adab3 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70e7666c46844503beb466fdc054a6fc in term 0.
I20260321 03:02:32.765795 9090 raft_consensus.cc:2804] T d254157f7738406eb700e7e9af6adab3 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260321 03:02:32.765852 9090 raft_consensus.cc:493] T d254157f7738406eb700e7e9af6adab3 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260321 03:02:32.765889 9090 raft_consensus.cc:3060] T d254157f7738406eb700e7e9af6adab3 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:32.766932 9090 raft_consensus.cc:515] T d254157f7738406eb700e7e9af6adab3 P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } }
I20260321 03:02:32.767021 9265 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260321 03:02:32.767338 9090 leader_election.cc:290] T d254157f7738406eb700e7e9af6adab3 P 70e7666c46844503beb466fdc054a6fc [CANDIDATE]: Term 1 election: Requested vote from peers a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091), 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171)
I20260321 03:02:32.767763 8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d254157f7738406eb700e7e9af6adab3" candidate_uuid: "70e7666c46844503beb466fdc054a6fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4532b54a008a4a39b663112e6d0aacc0"
I20260321 03:02:32.767889 8531 raft_consensus.cc:3060] T d254157f7738406eb700e7e9af6adab3 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:32.768131 8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d254157f7738406eb700e7e9af6adab3" candidate_uuid: "70e7666c46844503beb466fdc054a6fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a97f7dd77cf2444f8fdb441019081f79"
I20260321 03:02:32.768265 8803 raft_consensus.cc:3060] T d254157f7738406eb700e7e9af6adab3 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:32.769034 8531 raft_consensus.cc:2468] T d254157f7738406eb700e7e9af6adab3 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70e7666c46844503beb466fdc054a6fc in term 1.
I20260321 03:02:32.769399 8803 raft_consensus.cc:2468] T d254157f7738406eb700e7e9af6adab3 P a97f7dd77cf2444f8fdb441019081f79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70e7666c46844503beb466fdc054a6fc in term 1.
I20260321 03:02:32.769506 8602 leader_election.cc:304] T d254157f7738406eb700e7e9af6adab3 P 70e7666c46844503beb466fdc054a6fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0, 70e7666c46844503beb466fdc054a6fc; no voters:
I20260321 03:02:32.769773 9090 raft_consensus.cc:2804] T d254157f7738406eb700e7e9af6adab3 P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Leader election won for term 1
I20260321 03:02:32.769970 9090 raft_consensus.cc:697] T d254157f7738406eb700e7e9af6adab3 P 70e7666c46844503beb466fdc054a6fc [term 1 LEADER]: Becoming Leader. State: Replica: 70e7666c46844503beb466fdc054a6fc, State: Running, Role: LEADER
I20260321 03:02:32.770150 9090 consensus_queue.cc:237] T d254157f7738406eb700e7e9af6adab3 P 70e7666c46844503beb466fdc054a6fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } }
I20260321 03:02:32.771126 9210 fs_manager.cc:730] Time spent opening block manager: real 0.006s user 0.001s sys 0.000s
I20260321 03:02:32.771276 9210 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-2/data,/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-2/wal
uuid: "3df5e4492f3049c1b09fea013b92f863"
format_stamp: "Formatted at 2026-03-21 03:02:27 on dist-test-slave-bwf0"
I20260321 03:02:32.771880 9210 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260321 03:02:32.781663 9101 raft_consensus.cc:493] T 8535a1895af2482f90cfd53a79de88d5 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260321 03:02:32.781811 9101 raft_consensus.cc:515] T 8535a1895af2482f90cfd53a79de88d5 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:32.782428 9101 leader_election.cc:290] T 8535a1895af2482f90cfd53a79de88d5 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
I20260321 03:02:32.782673 9090 raft_consensus.cc:493] T 8535a1895af2482f90cfd53a79de88d5 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260321 03:02:32.782783 9090 raft_consensus.cc:515] T 8535a1895af2482f90cfd53a79de88d5 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:32.782938 8667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8535a1895af2482f90cfd53a79de88d5" candidate_uuid: "4532b54a008a4a39b663112e6d0aacc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70e7666c46844503beb466fdc054a6fc" is_pre_election: true
I20260321 03:02:32.783034 8667 raft_consensus.cc:2468] T 8535a1895af2482f90cfd53a79de88d5 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4532b54a008a4a39b663112e6d0aacc0 in term 0.
I20260321 03:02:32.783320 8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8535a1895af2482f90cfd53a79de88d5" candidate_uuid: "4532b54a008a4a39b663112e6d0aacc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a97f7dd77cf2444f8fdb441019081f79" is_pre_election: true
I20260321 03:02:32.783365 9090 leader_election.cc:290] T 8535a1895af2482f90cfd53a79de88d5 P 70e7666c46844503beb466fdc054a6fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
I20260321 03:02:32.783385 8466 leader_election.cc:304] T 8535a1895af2482f90cfd53a79de88d5 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0, 70e7666c46844503beb466fdc054a6fc; no voters:
I20260321 03:02:32.783741 8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8535a1895af2482f90cfd53a79de88d5" candidate_uuid: "70e7666c46844503beb466fdc054a6fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4532b54a008a4a39b663112e6d0aacc0" is_pre_election: true
I20260321 03:02:32.783860 8531 raft_consensus.cc:2468] T 8535a1895af2482f90cfd53a79de88d5 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70e7666c46844503beb466fdc054a6fc in term 0.
I20260321 03:02:32.783479 8803 raft_consensus.cc:2468] T 8535a1895af2482f90cfd53a79de88d5 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4532b54a008a4a39b663112e6d0aacc0 in term 0.
I20260321 03:02:32.783991 8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8535a1895af2482f90cfd53a79de88d5" candidate_uuid: "70e7666c46844503beb466fdc054a6fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a97f7dd77cf2444f8fdb441019081f79" is_pre_election: true
I20260321 03:02:32.784124 8804 raft_consensus.cc:2468] T 8535a1895af2482f90cfd53a79de88d5 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70e7666c46844503beb466fdc054a6fc in term 0.
I20260321 03:02:32.784170 8602 leader_election.cc:304] T 8535a1895af2482f90cfd53a79de88d5 P 70e7666c46844503beb466fdc054a6fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0, 70e7666c46844503beb466fdc054a6fc; no voters:
I20260321 03:02:32.784332 9090 raft_consensus.cc:2804] T 8535a1895af2482f90cfd53a79de88d5 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260321 03:02:32.784363 9101 raft_consensus.cc:2804] T 8535a1895af2482f90cfd53a79de88d5 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260321 03:02:32.784384 9090 raft_consensus.cc:493] T 8535a1895af2482f90cfd53a79de88d5 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260321 03:02:32.784411 9101 raft_consensus.cc:493] T 8535a1895af2482f90cfd53a79de88d5 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260321 03:02:32.784441 9090 raft_consensus.cc:3060] T 8535a1895af2482f90cfd53a79de88d5 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:32.784456 9101 raft_consensus.cc:3060] T 8535a1895af2482f90cfd53a79de88d5 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:32.785529 9101 raft_consensus.cc:515] T 8535a1895af2482f90cfd53a79de88d5 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:32.785555 9090 raft_consensus.cc:515] T 8535a1895af2482f90cfd53a79de88d5 P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:32.785913 9090 leader_election.cc:290] T 8535a1895af2482f90cfd53a79de88d5 P 70e7666c46844503beb466fdc054a6fc [CANDIDATE]: Term 1 election: Requested vote from peers 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
I20260321 03:02:32.785913 9101 leader_election.cc:290] T 8535a1895af2482f90cfd53a79de88d5 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 1 election: Requested vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
I20260321 03:02:32.786413 8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8535a1895af2482f90cfd53a79de88d5" candidate_uuid: "4532b54a008a4a39b663112e6d0aacc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a97f7dd77cf2444f8fdb441019081f79"
I20260321 03:02:32.786448 8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8535a1895af2482f90cfd53a79de88d5" candidate_uuid: "70e7666c46844503beb466fdc054a6fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a97f7dd77cf2444f8fdb441019081f79"
I20260321 03:02:32.786514 8804 raft_consensus.cc:3060] T 8535a1895af2482f90cfd53a79de88d5 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:32.787431 8804 raft_consensus.cc:2468] T 8535a1895af2482f90cfd53a79de88d5 P a97f7dd77cf2444f8fdb441019081f79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4532b54a008a4a39b663112e6d0aacc0 in term 1.
I20260321 03:02:32.787662 8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8535a1895af2482f90cfd53a79de88d5" candidate_uuid: "70e7666c46844503beb466fdc054a6fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4532b54a008a4a39b663112e6d0aacc0"
I20260321 03:02:32.787783 8531 raft_consensus.cc:2393] T 8535a1895af2482f90cfd53a79de88d5 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 70e7666c46844503beb466fdc054a6fc in current term 1: Already voted for candidate 4532b54a008a4a39b663112e6d0aacc0 in this term.
I20260321 03:02:32.787796 8469 leader_election.cc:304] T 8535a1895af2482f90cfd53a79de88d5 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0, a97f7dd77cf2444f8fdb441019081f79; no voters:
I20260321 03:02:32.787989 8667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8535a1895af2482f90cfd53a79de88d5" candidate_uuid: "4532b54a008a4a39b663112e6d0aacc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70e7666c46844503beb466fdc054a6fc"
I20260321 03:02:32.788111 8667 raft_consensus.cc:2393] T 8535a1895af2482f90cfd53a79de88d5 P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4532b54a008a4a39b663112e6d0aacc0 in current term 1: Already voted for candidate 70e7666c46844503beb466fdc054a6fc in this term.
I20260321 03:02:32.788517 8602 leader_election.cc:304] T 8535a1895af2482f90cfd53a79de88d5 P 70e7666c46844503beb466fdc054a6fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70e7666c46844503beb466fdc054a6fc; no voters: 4532b54a008a4a39b663112e6d0aacc0, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:02:32.788698 9090 raft_consensus.cc:2749] T 8535a1895af2482f90cfd53a79de88d5 P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260321 03:02:32.788725 9101 raft_consensus.cc:2804] T 8535a1895af2482f90cfd53a79de88d5 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader election won for term 1
I20260321 03:02:32.788801 9101 raft_consensus.cc:697] T 8535a1895af2482f90cfd53a79de88d5 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 LEADER]: Becoming Leader. State: Replica: 4532b54a008a4a39b663112e6d0aacc0, State: Running, Role: LEADER
I20260321 03:02:32.788924 9101 consensus_queue.cc:237] T 8535a1895af2482f90cfd53a79de88d5 P 4532b54a008a4a39b663112e6d0aacc0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:32.802211 9210 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260321 03:02:32.802964 9210 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260321 03:02:32.803180 9210 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260321 03:02:32.811147 9210 rpc_server.cc:307] RPC server started. Bound to: 127.7.178.252:45145
I20260321 03:02:32.811232 9325 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.178.252:45145 every 8 connection(s)
I20260321 03:02:32.812322 9210 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-2/data/info.pb
I20260321 03:02:32.817938 9326 sys_catalog.cc:263] Verifying existing consensus state
I20260321 03:02:32.820477 9326 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863: Bootstrap starting.
I20260321 03:02:32.820958 7883 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskZ5BwAx/build/debug/bin/kudu as pid 9210
I20260321 03:02:32.832636 9326 log.cc:826] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863: Log is configured to *not* fsync() on all Append() calls
I20260321 03:02:32.871037 9326 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863: Bootstrap replayed 1/1 log segments. Stats: ops{read=65 overwritten=0 applied=65 ignored=0} inserts{seen=41 ignored=0} mutations{seen=53 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260321 03:02:32.871568 9326 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863: Bootstrap complete.
I20260321 03:02:32.874523 9326 raft_consensus.cc:359] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:02:32.874902 9326 raft_consensus.cc:740] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3df5e4492f3049c1b09fea013b92f863, State: Initialized, Role: FOLLOWER
I20260321 03:02:32.875399 9326 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 65, Last appended: 2.65, Last appended by leader: 65, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:02:32.875998 9330 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } } }
I20260321 03:02:32.876160 9330 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [sys.catalog]: This master's current role is: FOLLOWER
I20260321 03:02:32.876699 9326 sys_catalog.cc:565] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [sys.catalog]: configured and running, proceeding with master startup.
I20260321 03:02:32.886391 9344 catalog_manager.cc:1269] Loaded cluster ID: 30588dbe2d29416e8c640adf9bfaba1f
I20260321 03:02:32.886484 9344 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863: loading cluster ID for follower catalog manager: success
I20260321 03:02:32.890592 9344 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863: acquiring CA information for follower catalog manager: success
I20260321 03:02:32.895617 9344 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260321 03:02:33.000051 8859 connection.cc:537] client connection to 127.7.178.254:38651 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260321 03:02:33.000525 8859 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.7.178.254:38651)
W20260321 03:02:33.000896 8859 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.7.178.254:38651)
W20260321 03:02:33.001048 8859 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.7.178.254:38651)
W20260321 03:02:33.001288 8859 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.7.178.254:38651)
W20260321 03:02:33.005139 9217 negotiation.cc:337] Failed RPC negotiation. Trace:
0321 03:02:33.002138 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.178.254:38651 (local address 127.7.178.194:51453)
0321 03:02:33.002352 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0321 03:02:33.002368 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0321 03:02:33.002476 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0321 03:02:33.004581 (+ 2105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":131}
W20260321 03:02:33.005417 9347 negotiation.cc:337] Failed RPC negotiation. Trace:
0321 03:02:32.881489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.178.254:38651 (local address 127.0.0.1:38280)
0321 03:02:32.882264 (+ 775us) negotiation.cc:107] Waiting for socket to connect
0321 03:02:32.882301 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0321 03:02:32.882450 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0321 03:02:33.004818 (+122368us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":590,"thread_start_us":88,"threads_started":1}
W20260321 03:02:33.006134 9194 negotiation.cc:337] Failed RPC negotiation. Trace:
0321 03:02:33.001868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.178.254:38651 (local address 127.7.178.193:35275)
0321 03:02:33.002078 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0321 03:02:33.002092 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0321 03:02:33.002189 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0321 03:02:33.005661 (+ 3472us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":126}
W20260321 03:02:33.006953 9348 negotiation.cc:337] Failed RPC negotiation. Trace:
0321 03:02:33.002131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.178.254:38651 (local address 127.0.0.1:38290)
0321 03:02:33.003503 (+ 1372us) negotiation.cc:107] Waiting for socket to connect
0321 03:02:33.003517 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0321 03:02:33.003601 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0321 03:02:33.005965 (+ 2364us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":1254,"thread_start_us":84,"threads_started":1}
W20260321 03:02:33.006980 9218 negotiation.cc:337] Failed RPC negotiation. Trace:
0321 03:02:33.000469 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.178.254:38651 (local address 127.7.178.195:43969)
0321 03:02:33.000701 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0321 03:02:33.000718 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0321 03:02:33.000830 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0321 03:02:33.006557 (+ 5727us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":130}
I20260321 03:02:33.006801 9210 master_runner.cc:186] Error getting master registration for 127.7.178.254:38651: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107),
I20260321 03:02:33.009295 9210 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260321 03:02:33.011950 8579 heartbeater.cc:344] Connected to a master server at 127.7.178.252:45145
I20260321 03:02:33.014282 9290 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" instance_seqno: 1774062147955760) as {username='slave'} at 127.7.178.193:54331; Asking this server to re-register.
I20260321 03:02:33.014958 8579 heartbeater.cc:461] Registering TS with master...
I20260321 03:02:33.017043 9290 ts_manager.cc:194] Registered new tserver with Master: 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171)
I20260321 03:02:33.223436 9351 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4a187d1fb5804686b4aff01e47fd0284)
I20260321 03:02:33.223575 9351 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:02:33.224169 9351 leader_election.cc:290] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651), 3df5e4492f3049c1b09fea013b92f863 (127.7.178.252:45145)
W20260321 03:02:33.225029 8259 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111) [suppressed 7 similar messages]
W20260321 03:02:33.226034 8259 leader_election.cc:336] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651): Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111)
I20260321 03:02:33.229035 9300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" candidate_term: 5 candidate_status { last_received { term: 4 index: 70 } } ignore_live_leader: false dest_uuid: "3df5e4492f3049c1b09fea013b92f863" is_pre_election: true
I20260321 03:02:33.229488 9300 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7451d7c0a71f4620a6607f74b5a22f2e in term 2.
I20260321 03:02:33.229885 8257 leader_election.cc:304] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3df5e4492f3049c1b09fea013b92f863, 7451d7c0a71f4620a6607f74b5a22f2e; no voters: 4a187d1fb5804686b4aff01e47fd0284
I20260321 03:02:33.230075 9351 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260321 03:02:33.230137 9351 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4a187d1fb5804686b4aff01e47fd0284)
I20260321 03:02:33.230190 9351 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [term 4 FOLLOWER]: Advancing to term 5
I20260321 03:02:33.231101 9351 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:02:33.231493 9351 leader_election.cc:290] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [CANDIDATE]: Term 5 election: Requested vote from peers 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651), 3df5e4492f3049c1b09fea013b92f863 (127.7.178.252:45145)
I20260321 03:02:33.231917 9300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" candidate_term: 5 candidate_status { last_received { term: 4 index: 70 } } ignore_live_leader: false dest_uuid: "3df5e4492f3049c1b09fea013b92f863"
I20260321 03:02:33.232061 9300 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 2 FOLLOWER]: Advancing to term 5
W20260321 03:02:33.232941 8259 leader_election.cc:336] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651): Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111)
I20260321 03:02:33.234350 9300 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7451d7c0a71f4620a6607f74b5a22f2e in term 5.
I20260321 03:02:33.234766 8257 leader_election.cc:304] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3df5e4492f3049c1b09fea013b92f863, 7451d7c0a71f4620a6607f74b5a22f2e; no voters: 4a187d1fb5804686b4aff01e47fd0284
I20260321 03:02:33.235005 9351 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [term 5 FOLLOWER]: Leader election won for term 5
I20260321 03:02:33.235567 9351 raft_consensus.cc:697] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [term 5 LEADER]: Becoming Leader. State: Replica: 7451d7c0a71f4620a6607f74b5a22f2e, State: Running, Role: LEADER
I20260321 03:02:33.235786 9351 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 70, Committed index: 70, Last appended: 4.70, Last appended by leader: 70, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:02:33.236476 9355 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7451d7c0a71f4620a6607f74b5a22f2e. Latest consensus state: current_term: 5 leader_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } } }
I20260321 03:02:33.236608 9355 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [sys.catalog]: This master's current role is: LEADER
I20260321 03:02:33.237102 9356 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260321 03:02:33.238443 9101 consensus_queue.cc:1048] T 8535a1895af2482f90cfd53a79de88d5 P 4532b54a008a4a39b663112e6d0aacc0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260321 03:02:33.239281 9356 catalog_manager.cc:679] Loaded metadata for table default.table_c8e5202d265f463bbcf568d34a1e64a2 [id=4ac1925a391a48ea86c63da0c1d8c442]
I20260321 03:02:33.239532 9356 catalog_manager.cc:679] Loaded metadata for table default.table_0e0c55f293274457aed5e8d315334903 [id=850c888ac63d4c048f27ceeb1ddd4f83]
I20260321 03:02:33.240531 9356 catalog_manager.cc:679] Loaded metadata for table default.table_10dd23c6f33c4aa0bad0a534fb770d4a [id=94ef39d020ab428b9e0392bedab9483d]
I20260321 03:02:33.241299 9356 catalog_manager.cc:679] Loaded metadata for table default.table_60888690371e4e1d8d9e6a31f44b55a5 [id=9bc91b7f6cb8477ab6ed1ee5ed74f608]
I20260321 03:02:33.241598 9356 catalog_manager.cc:679] Loaded metadata for table default.table_f8b27d78677b44468e403c75afa5245a [id=9f5de6240b844d57991fc673d061fbf4]
I20260321 03:02:33.241881 9356 catalog_manager.cc:679] Loaded metadata for table default.table_d52655a709224a7d999af3a2f1f2a678 [id=a69b5fce47c341fe9f48dd5e36364533]
I20260321 03:02:33.243172 9356 catalog_manager.cc:679] Loaded metadata for table default.table_0e444e840fa14c16a1a1f2e750c73045 [id=c6b5b0c7a19649c2b502921f472fc1dc]
I20260321 03:02:33.243571 9192 consensus_queue.cc:1048] T 8535a1895af2482f90cfd53a79de88d5 P 4532b54a008a4a39b663112e6d0aacc0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260321 03:02:33.244730 9356 catalog_manager.cc:679] Loaded metadata for table default.table_06e0fbe90fe0411d95d76f56b53fb175 [id=c7602cbc743a43239656449386fbeb83]
I20260321 03:02:33.247469 9356 tablet_loader.cc:96] loaded metadata for tablet 68e8b3d268124c709b5797c168590ceb (table default.table_d52655a709224a7d999af3a2f1f2a678 [id=a69b5fce47c341fe9f48dd5e36364533])
I20260321 03:02:33.248132 8714 heartbeater.cc:344] Connected to a master server at 127.7.178.252:45145
I20260321 03:02:33.248313 9356 tablet_loader.cc:96] loaded metadata for tablet 7c4e86aafdb24f71a59e3142235441c6 (table default.table_c8e5202d265f463bbcf568d34a1e64a2 [id=4ac1925a391a48ea86c63da0c1d8c442])
I20260321 03:02:33.248535 9356 tablet_loader.cc:96] loaded metadata for tablet 8535a1895af2482f90cfd53a79de88d5 (table default.table_60888690371e4e1d8d9e6a31f44b55a5 [id=9bc91b7f6cb8477ab6ed1ee5ed74f608])
I20260321 03:02:33.248701 9356 tablet_loader.cc:96] loaded metadata for tablet 89ae9cb00ef14b5d9d88dfb94a55e5d5 (table default.table_0e0c55f293274457aed5e8d315334903 [id=850c888ac63d4c048f27ceeb1ddd4f83])
I20260321 03:02:33.250574 9289 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "70e7666c46844503beb466fdc054a6fc" instance_seqno: 1774062148158895) as {username='slave'} at 127.7.178.194:51415; Asking this server to re-register.
I20260321 03:02:33.251075 8714 heartbeater.cc:461] Registering TS with master...
I20260321 03:02:33.251077 9356 tablet_loader.cc:96] loaded metadata for tablet 90980515c2f14e4abfff2f3e2edf2f16 (table default.table_0e444e840fa14c16a1a1f2e750c73045 [id=c6b5b0c7a19649c2b502921f472fc1dc])
I20260321 03:02:33.251564 9356 tablet_loader.cc:96] loaded metadata for tablet a062f5d0fc344fb9a1e8169401451bad (table default.table_10dd23c6f33c4aa0bad0a534fb770d4a [id=94ef39d020ab428b9e0392bedab9483d])
I20260321 03:02:33.252210 8850 heartbeater.cc:344] Connected to a master server at 127.7.178.252:45145
I20260321 03:02:33.252265 9289 ts_manager.cc:194] Registered new tserver with Master: 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713)
I20260321 03:02:33.252386 9356 tablet_loader.cc:96] loaded metadata for tablet d254157f7738406eb700e7e9af6adab3 (table default.table_06e0fbe90fe0411d95d76f56b53fb175 [id=c7602cbc743a43239656449386fbeb83])
I20260321 03:02:33.252712 9356 tablet_loader.cc:96] loaded metadata for tablet ed96f3685d004f6f94f50db2651acc1f (table default.table_f8b27d78677b44468e403c75afa5245a [id=9f5de6240b844d57991fc673d061fbf4])
I20260321 03:02:33.253401 9356 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260321 03:02:33.253589 9289 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" instance_seqno: 1774062148360782) as {username='slave'} at 127.7.178.195:58645; Asking this server to re-register.
I20260321 03:02:33.254087 8850 heartbeater.cc:461] Registering TS with master...
I20260321 03:02:33.254503 9356 catalog_manager.cc:1269] Loaded cluster ID: 30588dbe2d29416e8c640adf9bfaba1f
I20260321 03:02:33.254577 9356 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260321 03:02:33.255096 9289 ts_manager.cc:194] Registered new tserver with Master: a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
I20260321 03:02:33.255797 9356 catalog_manager.cc:1514] Loading token signing keys...
I20260321 03:02:33.256438 9356 catalog_manager.cc:6055] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e: Loaded TSK: 0
I20260321 03:02:33.256942 9356 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260321 03:02:33.257541 9356 catalog_manager.cc:1537] Loading latest processed Hive Metastore notification log event ID...
I20260321 03:02:33.258066 9356 catalog_manager.cc:5893] Last processed Hive Metastore notification event ID: 21
I20260321 03:02:33.276753 8269 master_service.cc:954] ReplaceTablet: received request to replace tablet 68e8b3d268124c709b5797c168590ceb from {username='slave'} at 127.0.0.1:39954
I20260321 03:02:33.277420 8265 master_service.cc:954] ReplaceTablet: received request to replace tablet 7c4e86aafdb24f71a59e3142235441c6 from {username='slave'} at 127.0.0.1:39954
I20260321 03:02:33.277951 8271 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39954:
table { table_name: "default.Table_06e0fbe90fe0411d95d76f56b53fb175" } modify_external_catalogs: true
I20260321 03:02:33.278087 8271 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39954:
table { table_name: "default.Table_06e0fbe90fe0411d95d76f56b53fb175" } modify_external_catalogs: true
I20260321 03:02:33.278110 8272 master_service.cc:954] ReplaceTablet: received request to replace tablet a062f5d0fc344fb9a1e8169401451bad from {username='slave'} at 127.0.0.1:39954
I20260321 03:02:33.278218 8267 master_service.cc:954] ReplaceTablet: received request to replace tablet ed96f3685d004f6f94f50db2651acc1f from {username='slave'} at 127.0.0.1:39954
I20260321 03:02:33.278785 8266 master_service.cc:954] ReplaceTablet: received request to replace tablet 90980515c2f14e4abfff2f3e2edf2f16 from {username='slave'} at 127.0.0.1:39954
I20260321 03:02:33.278867 8264 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39954:
name: "default.Table_ba8bb11787c9433093d74640a71395f2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260321 03:02:33.279155 8270 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39954:
table { table_name: "default.Table_10dd23c6f33c4aa0bad0a534fb770d4a" } new_table_name: "default.Table_91567c8331f247aebc889906e9067634" modify_external_catalogs: true
I20260321 03:02:33.279397 8268 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39954:
name: "default.Table_a8ad6a72849a42ab9d21634ee3041396"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260321 03:02:33.279803 8273 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39954:
name: "default.Table_bda6f16160c04b1190bb1866f63d3af2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260321 03:02:33.281802 9300 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 5 FOLLOWER]: Refusing update from remote peer 7451d7c0a71f4620a6607f74b5a22f2e: Log matching property violated. Preceding OpId in replica: term: 2 index: 65. Preceding OpId from leader: term: 5 index: 72. (index mismatch)
I20260321 03:02:33.282508 9355 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 71, Last known committed idx: 65, Time since last communication: 0.000s
W20260321 03:02:33.283278 8259 consensus_peers.cc:597] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e -> Peer 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651): Couldn't send request to peer 4a187d1fb5804686b4aff01e47fd0284. Status: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
F20260321 03:02:33.285275 8417 hms_notification_log_listener.cc:287] non-monotonous event IDs from HMS: current 23, previous 23; dumping first 3 out of 6 received events: NotificationEvent(eventId=22, eventTime=1774062151, eventType=DROP_TABLE, dbName=default, tableName=table_79533ce61645417d9d18b6b2820ee1af, message={"server":"","servicePrincipal":"","db":"default","table":"table_79533ce61645417d9d18b6b2820ee1af","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_79533ce61645417d9d18b6b2820ee1af\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1774062150},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/warehouse/table_79533ce61645417d9d18b6b2820ee1af\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_79533ce61645417d9d18b6b2820ee1af\",\"kudu.table_id\":\"435759bdc4464e5f859546dfc760d6ad\",\"transient_lastDdlTime\":\"1774062150\",\"comment\":\"\",\"kudu.master_addresses\":\"127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"30588dbe2d29416e8c640adf9bfaba1f\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1774062151}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=23, eventTime=1774062151, eventType=DROP_TABLE, dbName=default, tableName=table_0e0c55f293274457aed5e8d315334903, message={"server":"","servicePrincipal":"","db":"default","table":"table_0e0c55f293274457aed5e8d315334903","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_0e0c55f293274457aed5e8d315334903\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1774062149},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/warehouse/table_0e0c55f293274457aed5e8d315334903\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_0e0c55f293274457aed5e8d315334903\",\"kudu.table_id\":\"850c888ac63d4c048f27ceeb1ddd4f83\",\"transient_lastDdlTime\":\"1774062149\",\"comment\":\"\",\"kudu.master_addresses\":\"127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"30588dbe2d29416e8c640adf9bfaba1f\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1774062151}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=23, eventTime=1774062151, eventType=DROP_TABLE, dbName=default, tableName=table_492554e7d97c4920bdf854ca950c0179, message={"server":"","servicePrincipal":"","db":"default","table":"table_492554e7d97c4920bdf854ca950c0179","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_492554e7d97c4920bdf854ca950c0179\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1774062151},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/warehouse/table_492554e7d97c4920bdf854ca950c0179\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_492554e7d97c4920bdf854ca950c0179\",\"kudu.table_id\":\"1eabb731ef9a41249c3e08ccf80157e4\",\"transient_lastDdlTime\":\"1774062151\",\"comment\":\"\",\"kudu.master_addresses\":\"127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"30588dbe2d29416e8c640adf9bfaba1f\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1774062151}, messageFormat=json-0.2, catName=hive);
*** Check failure stack trace: ***
I20260321 03:02:33.288272 9330 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7451d7c0a71f4620a6607f74b5a22f2e. Latest consensus state: current_term: 5 leader_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } } }
I20260321 03:02:33.288415 9330 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [sys.catalog]: This master's current role is: FOLLOWER
I20260321 03:02:33.288512 9330 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 5 leader_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } } }
I20260321 03:02:33.288573 9330 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [sys.catalog]: This master's current role is: FOLLOWER
I20260321 03:02:33.289733 8269 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e: Sending DeleteTablet for 3 replicas of tablet 68e8b3d268124c709b5797c168590ceb
I20260321 03:02:33.289942 9355 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 5 leader_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } } }
I20260321 03:02:33.290064 9355 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [sys.catalog]: This master's current role is: LEADER
@ 0x7fda8fc48dcd google::LogMessage::Fail() at ??:0
I20260321 03:02:33.290792 8776 tablet_service.cc:1558] Processing DeleteTablet for tablet 68e8b3d268124c709b5797c168590ceb with delete_type TABLET_DATA_DELETED (replaced by tablet ba92d73996f84bbfbab47006dc934c8e) from {username='slave'} at 127.0.0.1:58810
I20260321 03:02:33.290810 8505 tablet_service.cc:1558] Processing DeleteTablet for tablet 68e8b3d268124c709b5797c168590ceb with delete_type TABLET_DATA_DELETED (replaced by tablet ba92d73996f84bbfbab47006dc934c8e) from {username='slave'} at 127.0.0.1:51684
I20260321 03:02:33.291501 8646 tablet_service.cc:1558] Processing DeleteTablet for tablet 68e8b3d268124c709b5797c168590ceb with delete_type TABLET_DATA_DELETED (replaced by tablet ba92d73996f84bbfbab47006dc934c8e) from {username='slave'} at 127.0.0.1:35520
I20260321 03:02:33.291621 8265 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e: Sending DeleteTablet for 3 replicas of tablet 7c4e86aafdb24f71a59e3142235441c6
I20260321 03:02:33.291688 8269 catalog_manager.cc:6741] ReplaceTablet: tablet 68e8b3d268124c709b5797c168590ceb deleted and replaced by tablet ba92d73996f84bbfbab47006dc934c8e
I20260321 03:02:33.291733 9330 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 5 leader_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } } }
I20260321 03:02:33.291841 9330 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [sys.catalog]: This master's current role is: FOLLOWER
I20260321 03:02:33.291949 8269 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39954:
table { table_name: "default.Table_0e444e840fa14c16a1a1f2e750c73045" } new_table_name: "default.Table_eb81105465414fdd9c4d66d6aefc3120" modify_external_catalogs: true
I20260321 03:02:33.292001 8265 catalog_manager.cc:6741] ReplaceTablet: tablet 7c4e86aafdb24f71a59e3142235441c6 deleted and replaced by tablet 60c70af8c0e94b30801ae2437a7f8529
I20260321 03:02:33.292299 8265 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39954:
name: "default.Table_a6ce605126a947cfa6a44f2124f15087"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
@ 0x7fda8fc4cb93 google::LogMessage::SendToLog() at ??:0
I20260321 03:02:33.292582 8505 tablet_service.cc:1558] Processing DeleteTablet for tablet 7c4e86aafdb24f71a59e3142235441c6 with delete_type TABLET_DATA_DELETED (replaced by tablet 60c70af8c0e94b30801ae2437a7f8529) from {username='slave'} at 127.0.0.1:51684
I20260321 03:02:33.293102 8646 tablet_service.cc:1558] Processing DeleteTablet for tablet 7c4e86aafdb24f71a59e3142235441c6 with delete_type TABLET_DATA_DELETED (replaced by tablet 60c70af8c0e94b30801ae2437a7f8529) from {username='slave'} at 127.0.0.1:35520
I20260321 03:02:33.293243 9375 tablet_replica.cc:333] T 68e8b3d268124c709b5797c168590ceb P 70e7666c46844503beb466fdc054a6fc: stopping tablet replica
I20260321 03:02:33.293426 9375 raft_consensus.cc:2243] T 68e8b3d268124c709b5797c168590ceb P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260321 03:02:33.293624 9375 raft_consensus.cc:2272] T 68e8b3d268124c709b5797c168590ceb P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260321 03:02:33.293810 8776 tablet_service.cc:1558] Processing DeleteTablet for tablet 7c4e86aafdb24f71a59e3142235441c6 with delete_type TABLET_DATA_DELETED (replaced by tablet 60c70af8c0e94b30801ae2437a7f8529) from {username='slave'} at 127.0.0.1:58810
I20260321 03:02:33.294030 8267 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e: Sending DeleteTablet for 3 replicas of tablet ed96f3685d004f6f94f50db2651acc1f
I20260321 03:02:33.294061 9375 ts_tablet_manager.cc:1916] T 68e8b3d268124c709b5797c168590ceb P 70e7666c46844503beb466fdc054a6fc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260321 03:02:33.294320 8267 catalog_manager.cc:6741] ReplaceTablet: tablet ed96f3685d004f6f94f50db2651acc1f deleted and replaced by tablet c1e54bc634ac44199436f2c538e6d63f
I20260321 03:02:33.294544 8267 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39954:
table { table_name: "default.Table_d52655a709224a7d999af3a2f1f2a678" } modify_external_catalogs: true
I20260321 03:02:33.294663 8267 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39954:
table { table_name: "default.Table_d52655a709224a7d999af3a2f1f2a678" } modify_external_catalogs: true
I20260321 03:02:33.295120 8776 tablet_service.cc:1558] Processing DeleteTablet for tablet ed96f3685d004f6f94f50db2651acc1f with delete_type TABLET_DATA_DELETED (replaced by tablet c1e54bc634ac44199436f2c538e6d63f) from {username='slave'} at 127.0.0.1:58810
I20260321 03:02:33.295152 8505 tablet_service.cc:1558] Processing DeleteTablet for tablet ed96f3685d004f6f94f50db2651acc1f with delete_type TABLET_DATA_DELETED (replaced by tablet c1e54bc634ac44199436f2c538e6d63f) from {username='slave'} at 127.0.0.1:51684
I20260321 03:02:33.295331 8646 tablet_service.cc:1558] Processing DeleteTablet for tablet ed96f3685d004f6f94f50db2651acc1f with delete_type TABLET_DATA_DELETED (replaced by tablet c1e54bc634ac44199436f2c538e6d63f) from {username='slave'} at 127.0.0.1:35520
@ 0x7fda8fc487cc google::LogMessage::Flush() at ??:0
I20260321 03:02:33.296941 8266 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e: Sending DeleteTablet for 3 replicas of tablet 90980515c2f14e4abfff2f3e2edf2f16
I20260321 03:02:33.297026 8272 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e: Sending DeleteTablet for 3 replicas of tablet a062f5d0fc344fb9a1e8169401451bad
I20260321 03:02:33.297052 9375 ts_tablet_manager.cc:1929] T 68e8b3d268124c709b5797c168590ceb P 70e7666c46844503beb466fdc054a6fc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260321 03:02:33.297144 9375 log.cc:1199] T 68e8b3d268124c709b5797c168590ceb P 70e7666c46844503beb466fdc054a6fc: Deleting WAL directory at /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-1/wal/wals/68e8b3d268124c709b5797c168590ceb
I20260321 03:02:33.297222 8266 catalog_manager.cc:6741] ReplaceTablet: tablet 90980515c2f14e4abfff2f3e2edf2f16 deleted and replaced by tablet a4a81619964144e9aae068ed1e9eeaff
I20260321 03:02:33.297480 9375 ts_tablet_manager.cc:1950] T 68e8b3d268124c709b5797c168590ceb P 70e7666c46844503beb466fdc054a6fc: Deleting consensus metadata
I20260321 03:02:33.297498 8266 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39954:
name: "default.Table_01a908196f6d4a1ba499b382b6932d90"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260321 03:02:33.297221 8272 catalog_manager.cc:6741] ReplaceTablet: tablet a062f5d0fc344fb9a1e8169401451bad deleted and replaced by tablet 5e67b5247f19477c9091bd936639f40e
I20260321 03:02:33.297856 8272 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39954:
name: "default.Table_492554e7d97c4920bdf854ca950c0179"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260321 03:02:33.298239 9375 tablet_replica.cc:333] T 7c4e86aafdb24f71a59e3142235441c6 P 70e7666c46844503beb466fdc054a6fc: stopping tablet replica
I20260321 03:02:33.298399 9375 raft_consensus.cc:2243] T 7c4e86aafdb24f71a59e3142235441c6 P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Raft consensus shutting down.
@ 0x7fda8fc48a11 google::LogMessage::~LogMessage() at ??:0
I20260321 03:02:33.298512 9375 raft_consensus.cc:2272] T 7c4e86aafdb24f71a59e3142235441c6 P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260321 03:02:33.298816 8257 catalog_manager.cc:5002] TS 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): tablet 68e8b3d268124c709b5797c168590ceb (table default.table_d52655a709224a7d999af3a2f1f2a678 [id=a69b5fce47c341fe9f48dd5e36364533]) successfully deleted
I20260321 03:02:33.298844 8779 tablet_service.cc:1558] Processing DeleteTablet for tablet 90980515c2f14e4abfff2f3e2edf2f16 with delete_type TABLET_DATA_DELETED (replaced by tablet a4a81619964144e9aae068ed1e9eeaff) from {username='slave'} at 127.0.0.1:58810
I20260321 03:02:33.299014 8776 tablet_service.cc:1558] Processing DeleteTablet for tablet a062f5d0fc344fb9a1e8169401451bad with delete_type TABLET_DATA_DELETED (replaced by tablet 5e67b5247f19477c9091bd936639f40e) from {username='slave'} at 127.0.0.1:58810
I20260321 03:02:33.299065 8506 tablet_service.cc:1558] Processing DeleteTablet for tablet a062f5d0fc344fb9a1e8169401451bad with delete_type TABLET_DATA_DELETED (replaced by tablet 5e67b5247f19477c9091bd936639f40e) from {username='slave'} at 127.0.0.1:51684
I20260321 03:02:33.299217 8505 tablet_service.cc:1558] Processing DeleteTablet for tablet 90980515c2f14e4abfff2f3e2edf2f16 with delete_type TABLET_DATA_DELETED (replaced by tablet a4a81619964144e9aae068ed1e9eeaff) from {username='slave'} at 127.0.0.1:51684
I20260321 03:02:33.299223 9375 ts_tablet_manager.cc:1916] T 7c4e86aafdb24f71a59e3142235441c6 P 70e7666c46844503beb466fdc054a6fc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260321 03:02:33.299597 8639 tablet_service.cc:1558] Processing DeleteTablet for tablet a062f5d0fc344fb9a1e8169401451bad with delete_type TABLET_DATA_DELETED (replaced by tablet 5e67b5247f19477c9091bd936639f40e) from {username='slave'} at 127.0.0.1:35520
I20260321 03:02:33.299726 8646 tablet_service.cc:1558] Processing DeleteTablet for tablet 90980515c2f14e4abfff2f3e2edf2f16 with delete_type TABLET_DATA_DELETED (replaced by tablet a4a81619964144e9aae068ed1e9eeaff) from {username='slave'} at 127.0.0.1:35520
I20260321 03:02:33.301147 8505 tablet_service.cc:1511] Processing CreateTablet for tablet ba92d73996f84bbfbab47006dc934c8e (DEFAULT_TABLE table=default.table_d52655a709224a7d999af3a2f1f2a678 [id=a69b5fce47c341fe9f48dd5e36364533]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:33.301659 9375 ts_tablet_manager.cc:1929] T 7c4e86aafdb24f71a59e3142235441c6 P 70e7666c46844503beb466fdc054a6fc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260321 03:02:33.301734 9375 log.cc:1199] T 7c4e86aafdb24f71a59e3142235441c6 P 70e7666c46844503beb466fdc054a6fc: Deleting WAL directory at /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-1/wal/wals/7c4e86aafdb24f71a59e3142235441c6
I20260321 03:02:33.301867 8506 tablet_service.cc:1511] Processing CreateTablet for tablet 60c70af8c0e94b30801ae2437a7f8529 (DEFAULT_TABLE table=default.table_c8e5202d265f463bbcf568d34a1e64a2 [id=4ac1925a391a48ea86c63da0c1d8c442]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:33.302016 9375 ts_tablet_manager.cc:1950] T 7c4e86aafdb24f71a59e3142235441c6 P 70e7666c46844503beb466fdc054a6fc: Deleting consensus metadata
I20260321 03:02:33.302152 8506 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60c70af8c0e94b30801ae2437a7f8529. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:33.302848 9375 tablet_replica.cc:333] T ed96f3685d004f6f94f50db2651acc1f P 70e7666c46844503beb466fdc054a6fc: stopping tablet replica
I20260321 03:02:33.302994 9375 raft_consensus.cc:2243] T ed96f3685d004f6f94f50db2651acc1f P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260321 03:02:33.303126 9375 raft_consensus.cc:2272] T ed96f3685d004f6f94f50db2651acc1f P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260321 03:02:33.303534 9375 ts_tablet_manager.cc:1916] T ed96f3685d004f6f94f50db2651acc1f P 70e7666c46844503beb466fdc054a6fc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260321 03:02:33.303727 8257 catalog_manager.cc:5002] TS 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): tablet 7c4e86aafdb24f71a59e3142235441c6 (table default.table_c8e5202d265f463bbcf568d34a1e64a2 [id=4ac1925a391a48ea86c63da0c1d8c442]) successfully deleted
I20260321 03:02:33.303848 9373 tablet_replica.cc:333] T 68e8b3d268124c709b5797c168590ceb P 4532b54a008a4a39b663112e6d0aacc0: stopping tablet replica
I20260321 03:02:33.303973 9373 raft_consensus.cc:2243] T 68e8b3d268124c709b5797c168590ceb P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260321 03:02:33.304088 9373 raft_consensus.cc:2272] T 68e8b3d268124c709b5797c168590ceb P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260321 03:02:33.304391 8639 tablet_service.cc:1511] Processing CreateTablet for tablet 60c70af8c0e94b30801ae2437a7f8529 (DEFAULT_TABLE table=default.table_c8e5202d265f463bbcf568d34a1e64a2 [id=4ac1925a391a48ea86c63da0c1d8c442]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:33.304443 9373 ts_tablet_manager.cc:1916] T 68e8b3d268124c709b5797c168590ceb P 4532b54a008a4a39b663112e6d0aacc0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260321 03:02:33.304646 8639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60c70af8c0e94b30801ae2437a7f8529. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:33.305868 9375 ts_tablet_manager.cc:1929] T ed96f3685d004f6f94f50db2651acc1f P 70e7666c46844503beb466fdc054a6fc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260321 03:02:33.305828 8646 tablet_service.cc:1511] Processing CreateTablet for tablet ba92d73996f84bbfbab47006dc934c8e (DEFAULT_TABLE table=default.table_d52655a709224a7d999af3a2f1f2a678 [id=a69b5fce47c341fe9f48dd5e36364533]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:33.305928 9375 log.cc:1199] T ed96f3685d004f6f94f50db2651acc1f P 70e7666c46844503beb466fdc054a6fc: Deleting WAL directory at /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-1/wal/wals/ed96f3685d004f6f94f50db2651acc1f
I20260321 03:02:33.306098 8646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba92d73996f84bbfbab47006dc934c8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:33.306211 9375 ts_tablet_manager.cc:1950] T ed96f3685d004f6f94f50db2651acc1f P 70e7666c46844503beb466fdc054a6fc: Deleting consensus metadata
I20260321 03:02:33.306731 9373 ts_tablet_manager.cc:1929] T 68e8b3d268124c709b5797c168590ceb P 4532b54a008a4a39b663112e6d0aacc0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260321 03:02:33.306798 9373 log.cc:1199] T 68e8b3d268124c709b5797c168590ceb P 4532b54a008a4a39b663112e6d0aacc0: Deleting WAL directory at /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-0/wal/wals/68e8b3d268124c709b5797c168590ceb
I20260321 03:02:33.307315 8779 tablet_service.cc:1511] Processing CreateTablet for tablet 60c70af8c0e94b30801ae2437a7f8529 (DEFAULT_TABLE table=default.table_c8e5202d265f463bbcf568d34a1e64a2 [id=4ac1925a391a48ea86c63da0c1d8c442]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:33.307595 8779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60c70af8c0e94b30801ae2437a7f8529. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:33.308189 8505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba92d73996f84bbfbab47006dc934c8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:33.307906 9373 ts_tablet_manager.cc:1950] T 68e8b3d268124c709b5797c168590ceb P 4532b54a008a4a39b663112e6d0aacc0: Deleting consensus metadata
I20260321 03:02:33.308833 9373 tablet_replica.cc:333] T 7c4e86aafdb24f71a59e3142235441c6 P 4532b54a008a4a39b663112e6d0aacc0: stopping tablet replica
I20260321 03:02:33.308974 9373 raft_consensus.cc:2243] T 7c4e86aafdb24f71a59e3142235441c6 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 LEADER]: Raft consensus shutting down.
I20260321 03:02:33.309173 9373 raft_consensus.cc:2272] T 7c4e86aafdb24f71a59e3142235441c6 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260321 03:02:33.309587 9373 ts_tablet_manager.cc:1916] T 7c4e86aafdb24f71a59e3142235441c6 P 4532b54a008a4a39b663112e6d0aacc0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260321 03:02:33.309583 8258 catalog_manager.cc:5002] TS 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171): tablet 68e8b3d268124c709b5797c168590ceb (table default.table_d52655a709224a7d999af3a2f1f2a678 [id=a69b5fce47c341fe9f48dd5e36364533]) successfully deleted
I20260321 03:02:33.307309 8776 tablet_service.cc:1511] Processing CreateTablet for tablet ba92d73996f84bbfbab47006dc934c8e (DEFAULT_TABLE table=default.table_d52655a709224a7d999af3a2f1f2a678 [id=a69b5fce47c341fe9f48dd5e36364533]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:33.310286 8776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba92d73996f84bbfbab47006dc934c8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:33.312019 8505 tablet_service.cc:1511] Processing CreateTablet for tablet a4a81619964144e9aae068ed1e9eeaff (DEFAULT_TABLE table=default.table_0e444e840fa14c16a1a1f2e750c73045 [id=c6b5b0c7a19649c2b502921f472fc1dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:33.312213 8779 tablet_service.cc:1511] Processing CreateTablet for tablet a4a81619964144e9aae068ed1e9eeaff (DEFAULT_TABLE table=default.table_0e444e840fa14c16a1a1f2e750c73045 [id=c6b5b0c7a19649c2b502921f472fc1dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:33.312288 8505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4a81619964144e9aae068ed1e9eeaff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:33.312461 8779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4a81619964144e9aae068ed1e9eeaff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:33.313182 8777 tablet_service.cc:1511] Processing CreateTablet for tablet c1e54bc634ac44199436f2c538e6d63f (DEFAULT_TABLE table=default.table_f8b27d78677b44468e403c75afa5245a [id=9f5de6240b844d57991fc673d061fbf4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:33.313182 8776 tablet_service.cc:1511] Processing CreateTablet for tablet 5e67b5247f19477c9091bd936639f40e (DEFAULT_TABLE table=default.table_10dd23c6f33c4aa0bad0a534fb770d4a [id=94ef39d020ab428b9e0392bedab9483d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:33.313516 8777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1e54bc634ac44199436f2c538e6d63f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:33.313611 8776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e67b5247f19477c9091bd936639f40e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:33.313695 8506 tablet_service.cc:1511] Processing CreateTablet for tablet 5e67b5247f19477c9091bd936639f40e (DEFAULT_TABLE table=default.table_10dd23c6f33c4aa0bad0a534fb770d4a [id=94ef39d020ab428b9e0392bedab9483d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:33.313761 8257 catalog_manager.cc:5002] TS 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): tablet ed96f3685d004f6f94f50db2651acc1f (table default.table_f8b27d78677b44468e403c75afa5245a [id=9f5de6240b844d57991fc673d061fbf4]) successfully deleted
I20260321 03:02:33.313928 8506 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e67b5247f19477c9091bd936639f40e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:33.313695 8504 tablet_service.cc:1511] Processing CreateTablet for tablet c1e54bc634ac44199436f2c538e6d63f (DEFAULT_TABLE table=default.table_f8b27d78677b44468e403c75afa5245a [id=9f5de6240b844d57991fc673d061fbf4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:33.314096 8504 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1e54bc634ac44199436f2c538e6d63f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:33.313237 8646 tablet_service.cc:1511] Processing CreateTablet for tablet a4a81619964144e9aae068ed1e9eeaff (DEFAULT_TABLE table=default.table_0e444e840fa14c16a1a1f2e750c73045 [id=c6b5b0c7a19649c2b502921f472fc1dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:33.315632 8646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4a81619964144e9aae068ed1e9eeaff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:33.313411 8639 tablet_service.cc:1511] Processing CreateTablet for tablet 5e67b5247f19477c9091bd936639f40e (DEFAULT_TABLE table=default.table_10dd23c6f33c4aa0bad0a534fb770d4a [id=94ef39d020ab428b9e0392bedab9483d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:33.317787 8639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e67b5247f19477c9091bd936639f40e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:33.318001 9374 tablet_replica.cc:333] T 68e8b3d268124c709b5797c168590ceb P a97f7dd77cf2444f8fdb441019081f79: stopping tablet replica
I20260321 03:02:33.318150 9374 raft_consensus.cc:2243] T 68e8b3d268124c709b5797c168590ceb P a97f7dd77cf2444f8fdb441019081f79 [term 1 LEADER]: Raft consensus shutting down.
I20260321 03:02:33.318401 9374 raft_consensus.cc:2272] T 68e8b3d268124c709b5797c168590ceb P a97f7dd77cf2444f8fdb441019081f79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260321 03:02:33.318883 9374 ts_tablet_manager.cc:1916] T 68e8b3d268124c709b5797c168590ceb P a97f7dd77cf2444f8fdb441019081f79: Deleting tablet data with delete state TABLET_DATA_DELETED
@ 0x7fda94e2144d kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
I20260321 03:02:33.313512 8645 tablet_service.cc:1511] Processing CreateTablet for tablet c1e54bc634ac44199436f2c538e6d63f (DEFAULT_TABLE table=default.table_f8b27d78677b44468e403c75afa5245a [id=9f5de6240b844d57991fc673d061fbf4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:33.320704 8645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1e54bc634ac44199436f2c538e6d63f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:33.323400 9373 ts_tablet_manager.cc:1929] T 7c4e86aafdb24f71a59e3142235441c6 P 4532b54a008a4a39b663112e6d0aacc0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260321 03:02:33.323467 9373 log.cc:1199] T 7c4e86aafdb24f71a59e3142235441c6 P 4532b54a008a4a39b663112e6d0aacc0: Deleting WAL directory at /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-0/wal/wals/7c4e86aafdb24f71a59e3142235441c6
I20260321 03:02:33.323663 9373 ts_tablet_manager.cc:1950] T 7c4e86aafdb24f71a59e3142235441c6 P 4532b54a008a4a39b663112e6d0aacc0: Deleting consensus metadata
I20260321 03:02:33.323979 9379 tablet_bootstrap.cc:492] T 60c70af8c0e94b30801ae2437a7f8529 P 70e7666c46844503beb466fdc054a6fc: Bootstrap starting.
I20260321 03:02:33.324683 8258 catalog_manager.cc:5002] TS 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171): tablet 7c4e86aafdb24f71a59e3142235441c6 (table default.table_c8e5202d265f463bbcf568d34a1e64a2 [id=4ac1925a391a48ea86c63da0c1d8c442]) successfully deleted
I20260321 03:02:33.324973 9373 tablet_replica.cc:333] T ed96f3685d004f6f94f50db2651acc1f P 4532b54a008a4a39b663112e6d0aacc0: stopping tablet replica
@ 0x7fda94e20364 kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
I20260321 03:02:33.325207 9373 raft_consensus.cc:2243] T ed96f3685d004f6f94f50db2651acc1f P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260321 03:02:33.325311 9379 tablet_bootstrap.cc:654] T 60c70af8c0e94b30801ae2437a7f8529 P 70e7666c46844503beb466fdc054a6fc: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:33.325385 9373 raft_consensus.cc:2272] T ed96f3685d004f6f94f50db2651acc1f P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260321 03:02:33.312987 9375 tablet_replica.cc:333] T a062f5d0fc344fb9a1e8169401451bad P 70e7666c46844503beb466fdc054a6fc: stopping tablet replica
I20260321 03:02:33.325793 9373 ts_tablet_manager.cc:1916] T ed96f3685d004f6f94f50db2651acc1f P 4532b54a008a4a39b663112e6d0aacc0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260321 03:02:33.325961 9375 raft_consensus.cc:2243] T a062f5d0fc344fb9a1e8169401451bad P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260321 03:02:33.326093 9375 raft_consensus.cc:2272] T a062f5d0fc344fb9a1e8169401451bad P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260321 03:02:33.326534 9375 ts_tablet_manager.cc:1916] T a062f5d0fc344fb9a1e8169401451bad P 70e7666c46844503beb466fdc054a6fc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260321 03:02:33.328111 9374 ts_tablet_manager.cc:1929] T 68e8b3d268124c709b5797c168590ceb P a97f7dd77cf2444f8fdb441019081f79: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260321 03:02:33.328187 9374 log.cc:1199] T 68e8b3d268124c709b5797c168590ceb P a97f7dd77cf2444f8fdb441019081f79: Deleting WAL directory at /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-2/wal/wals/68e8b3d268124c709b5797c168590ceb
I20260321 03:02:33.328465 9374 ts_tablet_manager.cc:1950] T 68e8b3d268124c709b5797c168590ceb P a97f7dd77cf2444f8fdb441019081f79: Deleting consensus metadata
@ 0x7fda94e1fac7 _ZZN4kudu6master30HmsNotificationLogListenerTask4InitEvENKUlvE_clEv at ??:0
I20260321 03:02:33.328928 9373 ts_tablet_manager.cc:1929] T ed96f3685d004f6f94f50db2651acc1f P 4532b54a008a4a39b663112e6d0aacc0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260321 03:02:33.328994 9373 log.cc:1199] T ed96f3685d004f6f94f50db2651acc1f P 4532b54a008a4a39b663112e6d0aacc0: Deleting WAL directory at /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-0/wal/wals/ed96f3685d004f6f94f50db2651acc1f
I20260321 03:02:33.329236 9374 tablet_replica.cc:333] T 7c4e86aafdb24f71a59e3142235441c6 P a97f7dd77cf2444f8fdb441019081f79: stopping tablet replica
I20260321 03:02:33.329268 9375 ts_tablet_manager.cc:1929] T a062f5d0fc344fb9a1e8169401451bad P 70e7666c46844503beb466fdc054a6fc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260321 03:02:33.329342 9375 log.cc:1199] T a062f5d0fc344fb9a1e8169401451bad P 70e7666c46844503beb466fdc054a6fc: Deleting WAL directory at /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-1/wal/wals/a062f5d0fc344fb9a1e8169401451bad
I20260321 03:02:33.329406 9373 ts_tablet_manager.cc:1950] T ed96f3685d004f6f94f50db2651acc1f P 4532b54a008a4a39b663112e6d0aacc0: Deleting consensus metadata
I20260321 03:02:33.329396 9374 raft_consensus.cc:2243] T 7c4e86aafdb24f71a59e3142235441c6 P a97f7dd77cf2444f8fdb441019081f79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260321 03:02:33.329447 8260 catalog_manager.cc:5002] TS a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): tablet 68e8b3d268124c709b5797c168590ceb (table default.table_d52655a709224a7d999af3a2f1f2a678 [id=a69b5fce47c341fe9f48dd5e36364533]) successfully deleted
I20260321 03:02:33.329516 9374 raft_consensus.cc:2272] T 7c4e86aafdb24f71a59e3142235441c6 P a97f7dd77cf2444f8fdb441019081f79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260321 03:02:33.329613 9375 ts_tablet_manager.cc:1950] T a062f5d0fc344fb9a1e8169401451bad P 70e7666c46844503beb466fdc054a6fc: Deleting consensus metadata
I20260321 03:02:33.329893 9374 ts_tablet_manager.cc:1916] T 7c4e86aafdb24f71a59e3142235441c6 P a97f7dd77cf2444f8fdb441019081f79: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260321 03:02:33.330134 8258 catalog_manager.cc:5002] TS 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171): tablet ed96f3685d004f6f94f50db2651acc1f (table default.table_f8b27d78677b44468e403c75afa5245a [id=9f5de6240b844d57991fc673d061fbf4]) successfully deleted
I20260321 03:02:33.330377 8257 catalog_manager.cc:5002] TS 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): tablet a062f5d0fc344fb9a1e8169401451bad (table default.table_10dd23c6f33c4aa0bad0a534fb770d4a [id=94ef39d020ab428b9e0392bedab9483d]) successfully deleted
I20260321 03:02:33.330722 9373 tablet_replica.cc:333] T a062f5d0fc344fb9a1e8169401451bad P 4532b54a008a4a39b663112e6d0aacc0: stopping tablet replica
I20260321 03:02:33.330742 9380 tablet_bootstrap.cc:492] T 60c70af8c0e94b30801ae2437a7f8529 P a97f7dd77cf2444f8fdb441019081f79: Bootstrap starting.
I20260321 03:02:33.330868 9373 raft_consensus.cc:2243] T a062f5d0fc344fb9a1e8169401451bad P 4532b54a008a4a39b663112e6d0aacc0 [term 1 LEADER]: Raft consensus shutting down.
I20260321 03:02:33.331081 9373 raft_consensus.cc:2272] T a062f5d0fc344fb9a1e8169401451bad P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260321 03:02:33.331514 9373 ts_tablet_manager.cc:1916] T a062f5d0fc344fb9a1e8169401451bad P 4532b54a008a4a39b663112e6d0aacc0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260321 03:02:33.332152 9380 tablet_bootstrap.cc:654] T 60c70af8c0e94b30801ae2437a7f8529 P a97f7dd77cf2444f8fdb441019081f79: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:33.332798 9375 tablet_replica.cc:333] T 90980515c2f14e4abfff2f3e2edf2f16 P 70e7666c46844503beb466fdc054a6fc: stopping tablet replica
@ 0x7fda94e251ce _ZNSt17_Function_handlerIFvvEZN4kudu6master30HmsNotificationLogListenerTask4InitEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
I20260321 03:02:33.332964 9375 raft_consensus.cc:2243] T 90980515c2f14e4abfff2f3e2edf2f16 P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260321 03:02:33.333114 9375 raft_consensus.cc:2272] T 90980515c2f14e4abfff2f3e2edf2f16 P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260321 03:02:33.333743 9365 mvcc.cc:204] Tried to move back new op lower bound from 7266558579843313664 to 7266558577128095744. Current Snapshot: MvccSnapshot[applied={T|T < 7266558579835920384}]
I20260321 03:02:33.333928 9375 ts_tablet_manager.cc:1916] T 90980515c2f14e4abfff2f3e2edf2f16 P 70e7666c46844503beb466fdc054a6fc: Deleting tablet data with delete state TABLET_DATA_DELETED
@ 0x55994b18118a std::function<>::operator()() at ??:0
I20260321 03:02:33.335405 9374 ts_tablet_manager.cc:1929] T 7c4e86aafdb24f71a59e3142235441c6 P a97f7dd77cf2444f8fdb441019081f79: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260321 03:02:33.335487 9374 log.cc:1199] T 7c4e86aafdb24f71a59e3142235441c6 P a97f7dd77cf2444f8fdb441019081f79: Deleting WAL directory at /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-2/wal/wals/7c4e86aafdb24f71a59e3142235441c6
I20260321 03:02:33.335764 9374 ts_tablet_manager.cc:1950] T 7c4e86aafdb24f71a59e3142235441c6 P a97f7dd77cf2444f8fdb441019081f79: Deleting consensus metadata
I20260321 03:02:33.336517 9374 tablet_replica.cc:333] T ed96f3685d004f6f94f50db2651acc1f P a97f7dd77cf2444f8fdb441019081f79: stopping tablet replica
I20260321 03:02:33.336660 9374 raft_consensus.cc:2243] T ed96f3685d004f6f94f50db2651acc1f P a97f7dd77cf2444f8fdb441019081f79 [term 1 LEADER]: Raft consensus shutting down.
I20260321 03:02:33.336694 9375 ts_tablet_manager.cc:1929] T 90980515c2f14e4abfff2f3e2edf2f16 P 70e7666c46844503beb466fdc054a6fc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260321 03:02:33.336699 8260 catalog_manager.cc:5002] TS a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): tablet 7c4e86aafdb24f71a59e3142235441c6 (table default.table_c8e5202d265f463bbcf568d34a1e64a2 [id=4ac1925a391a48ea86c63da0c1d8c442]) successfully deleted
I20260321 03:02:33.336763 9375 log.cc:1199] T 90980515c2f14e4abfff2f3e2edf2f16 P 70e7666c46844503beb466fdc054a6fc: Deleting WAL directory at /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-1/wal/wals/90980515c2f14e4abfff2f3e2edf2f16
I20260321 03:02:33.336930 9374 raft_consensus.cc:2272] T ed96f3685d004f6f94f50db2651acc1f P a97f7dd77cf2444f8fdb441019081f79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260321 03:02:33.337016 9375 ts_tablet_manager.cc:1950] T 90980515c2f14e4abfff2f3e2edf2f16 P 70e7666c46844503beb466fdc054a6fc: Deleting consensus metadata
I20260321 03:02:33.337404 9374 ts_tablet_manager.cc:1916] T ed96f3685d004f6f94f50db2651acc1f P a97f7dd77cf2444f8fdb441019081f79: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260321 03:02:33.337934 8257 catalog_manager.cc:5002] TS 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): tablet 90980515c2f14e4abfff2f3e2edf2f16 (table default.table_0e444e840fa14c16a1a1f2e750c73045 [id=c6b5b0c7a19649c2b502921f472fc1dc]) successfully deleted
I20260321 03:02:33.338377 9378 tablet_bootstrap.cc:492] T 60c70af8c0e94b30801ae2437a7f8529 P 4532b54a008a4a39b663112e6d0aacc0: Bootstrap starting.
@ 0x7fda9114d028 kudu::Thread::SuperviseThread() at ??:0
I20260321 03:02:33.339830 9378 tablet_bootstrap.cc:654] T 60c70af8c0e94b30801ae2437a7f8529 P 4532b54a008a4a39b663112e6d0aacc0: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:33.340292 9374 ts_tablet_manager.cc:1929] T ed96f3685d004f6f94f50db2651acc1f P a97f7dd77cf2444f8fdb441019081f79: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260321 03:02:33.340380 9374 log.cc:1199] T ed96f3685d004f6f94f50db2651acc1f P a97f7dd77cf2444f8fdb441019081f79: Deleting WAL directory at /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-2/wal/wals/ed96f3685d004f6f94f50db2651acc1f
I20260321 03:02:33.340726 9374 ts_tablet_manager.cc:1950] T ed96f3685d004f6f94f50db2651acc1f P a97f7dd77cf2444f8fdb441019081f79: Deleting consensus metadata
I20260321 03:02:33.341233 9380 tablet_bootstrap.cc:492] T 60c70af8c0e94b30801ae2437a7f8529 P a97f7dd77cf2444f8fdb441019081f79: No bootstrap required, opened a new log
I20260321 03:02:33.341369 9380 ts_tablet_manager.cc:1403] T 60c70af8c0e94b30801ae2437a7f8529 P a97f7dd77cf2444f8fdb441019081f79: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.001s
I20260321 03:02:33.341526 9379 tablet_bootstrap.cc:492] T 60c70af8c0e94b30801ae2437a7f8529 P 70e7666c46844503beb466fdc054a6fc: No bootstrap required, opened a new log
I20260321 03:02:33.341562 9374 tablet_replica.cc:333] T 90980515c2f14e4abfff2f3e2edf2f16 P a97f7dd77cf2444f8fdb441019081f79: stopping tablet replica
I20260321 03:02:33.341624 9379 ts_tablet_manager.cc:1403] T 60c70af8c0e94b30801ae2437a7f8529 P 70e7666c46844503beb466fdc054a6fc: Time spent bootstrapping tablet: real 0.018s user 0.000s sys 0.002s
I20260321 03:02:33.341682 9374 raft_consensus.cc:2243] T 90980515c2f14e4abfff2f3e2edf2f16 P a97f7dd77cf2444f8fdb441019081f79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260321 03:02:33.341724 8260 catalog_manager.cc:5002] TS a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): tablet ed96f3685d004f6f94f50db2651acc1f (table default.table_f8b27d78677b44468e403c75afa5245a [id=9f5de6240b844d57991fc673d061fbf4]) successfully deleted
I20260321 03:02:33.341789 9374 raft_consensus.cc:2272] T 90980515c2f14e4abfff2f3e2edf2f16 P a97f7dd77cf2444f8fdb441019081f79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260321 03:02:33.341902 9373 ts_tablet_manager.cc:1929] T a062f5d0fc344fb9a1e8169401451bad P 4532b54a008a4a39b663112e6d0aacc0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260321 03:02:33.341986 9373 log.cc:1199] T a062f5d0fc344fb9a1e8169401451bad P 4532b54a008a4a39b663112e6d0aacc0: Deleting WAL directory at /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-0/wal/wals/a062f5d0fc344fb9a1e8169401451bad
I20260321 03:02:33.342170 9379 raft_consensus.cc:359] T 60c70af8c0e94b30801ae2437a7f8529 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:33.342226 9374 ts_tablet_manager.cc:1916] T 90980515c2f14e4abfff2f3e2edf2f16 P a97f7dd77cf2444f8fdb441019081f79: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260321 03:02:33.342265 9373 ts_tablet_manager.cc:1950] T a062f5d0fc344fb9a1e8169401451bad P 4532b54a008a4a39b663112e6d0aacc0: Deleting consensus metadata
I20260321 03:02:33.342288 9379 raft_consensus.cc:385] T 60c70af8c0e94b30801ae2437a7f8529 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:33.342321 9379 raft_consensus.cc:740] T 60c70af8c0e94b30801ae2437a7f8529 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70e7666c46844503beb466fdc054a6fc, State: Initialized, Role: FOLLOWER
I20260321 03:02:33.342435 9380 raft_consensus.cc:359] T 60c70af8c0e94b30801ae2437a7f8529 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:33.342555 9380 raft_consensus.cc:385] T 60c70af8c0e94b30801ae2437a7f8529 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:33.342589 9380 raft_consensus.cc:740] T 60c70af8c0e94b30801ae2437a7f8529 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a97f7dd77cf2444f8fdb441019081f79, State: Initialized, Role: FOLLOWER
I20260321 03:02:33.342682 9379 consensus_queue.cc:260] T 60c70af8c0e94b30801ae2437a7f8529 P 70e7666c46844503beb466fdc054a6fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:33.342739 9380 consensus_queue.cc:260] T 60c70af8c0e94b30801ae2437a7f8529 P a97f7dd77cf2444f8fdb441019081f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:33.342996 9379 ts_tablet_manager.cc:1434] T 60c70af8c0e94b30801ae2437a7f8529 P 70e7666c46844503beb466fdc054a6fc: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
I20260321 03:02:33.343153 8258 catalog_manager.cc:5002] TS 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171): tablet a062f5d0fc344fb9a1e8169401451bad (table default.table_10dd23c6f33c4aa0bad0a534fb770d4a [id=94ef39d020ab428b9e0392bedab9483d]) successfully deleted
I20260321 03:02:33.343225 9379 tablet_bootstrap.cc:492] T ba92d73996f84bbfbab47006dc934c8e P 70e7666c46844503beb466fdc054a6fc: Bootstrap starting.
I20260321 03:02:33.343411 9373 tablet_replica.cc:333] T 90980515c2f14e4abfff2f3e2edf2f16 P 4532b54a008a4a39b663112e6d0aacc0: stopping tablet replica
I20260321 03:02:33.343521 9373 raft_consensus.cc:2243] T 90980515c2f14e4abfff2f3e2edf2f16 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 LEADER]: Raft consensus shutting down.
I20260321 03:02:33.343704 9380 ts_tablet_manager.cc:1434] T 60c70af8c0e94b30801ae2437a7f8529 P a97f7dd77cf2444f8fdb441019081f79: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260321 03:02:33.343720 9373 raft_consensus.cc:2272] T 90980515c2f14e4abfff2f3e2edf2f16 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260321 03:02:33.343886 9380 tablet_bootstrap.cc:492] T ba92d73996f84bbfbab47006dc934c8e P a97f7dd77cf2444f8fdb441019081f79: Bootstrap starting.
I20260321 03:02:33.344091 9373 ts_tablet_manager.cc:1916] T 90980515c2f14e4abfff2f3e2edf2f16 P 4532b54a008a4a39b663112e6d0aacc0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260321 03:02:33.344286 9379 tablet_bootstrap.cc:654] T ba92d73996f84bbfbab47006dc934c8e P 70e7666c46844503beb466fdc054a6fc: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:33.344746 9374 ts_tablet_manager.cc:1929] T 90980515c2f14e4abfff2f3e2edf2f16 P a97f7dd77cf2444f8fdb441019081f79: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260321 03:02:33.344808 9374 log.cc:1199] T 90980515c2f14e4abfff2f3e2edf2f16 P a97f7dd77cf2444f8fdb441019081f79: Deleting WAL directory at /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-2/wal/wals/90980515c2f14e4abfff2f3e2edf2f16
I20260321 03:02:33.345043 9380 tablet_bootstrap.cc:654] T ba92d73996f84bbfbab47006dc934c8e P a97f7dd77cf2444f8fdb441019081f79: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:33.345058 9374 ts_tablet_manager.cc:1950] T 90980515c2f14e4abfff2f3e2edf2f16 P a97f7dd77cf2444f8fdb441019081f79: Deleting consensus metadata
@ 0x7fda919346db start_thread at ??:0
I20260321 03:02:33.346378 9373 ts_tablet_manager.cc:1929] T 90980515c2f14e4abfff2f3e2edf2f16 P 4532b54a008a4a39b663112e6d0aacc0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260321 03:02:33.346450 9373 log.cc:1199] T 90980515c2f14e4abfff2f3e2edf2f16 P 4532b54a008a4a39b663112e6d0aacc0: Deleting WAL directory at /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-0/wal/wals/90980515c2f14e4abfff2f3e2edf2f16
I20260321 03:02:33.346625 8260 catalog_manager.cc:5002] TS a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): tablet 90980515c2f14e4abfff2f3e2edf2f16 (table default.table_0e444e840fa14c16a1a1f2e750c73045 [id=c6b5b0c7a19649c2b502921f472fc1dc]) successfully deleted
I20260321 03:02:33.346696 9373 ts_tablet_manager.cc:1950] T 90980515c2f14e4abfff2f3e2edf2f16 P 4532b54a008a4a39b663112e6d0aacc0: Deleting consensus metadata
I20260321 03:02:33.346895 9374 tablet_replica.cc:333] T a062f5d0fc344fb9a1e8169401451bad P a97f7dd77cf2444f8fdb441019081f79: stopping tablet replica
I20260321 03:02:33.347091 9374 raft_consensus.cc:2243] T a062f5d0fc344fb9a1e8169401451bad P a97f7dd77cf2444f8fdb441019081f79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260321 03:02:33.347218 9374 raft_consensus.cc:2272] T a062f5d0fc344fb9a1e8169401451bad P a97f7dd77cf2444f8fdb441019081f79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260321 03:02:33.347649 8258 catalog_manager.cc:5002] TS 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171): tablet 90980515c2f14e4abfff2f3e2edf2f16 (table default.table_0e444e840fa14c16a1a1f2e750c73045 [id=c6b5b0c7a19649c2b502921f472fc1dc]) successfully deleted
@ 0x7fda8edff61f clone at ??:0
I20260321 03:02:33.348896 9374 ts_tablet_manager.cc:1916] T a062f5d0fc344fb9a1e8169401451bad P a97f7dd77cf2444f8fdb441019081f79: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260321 03:02:33.350629 9379 tablet_bootstrap.cc:492] T ba92d73996f84bbfbab47006dc934c8e P 70e7666c46844503beb466fdc054a6fc: No bootstrap required, opened a new log
I20260321 03:02:33.350732 9379 ts_tablet_manager.cc:1403] T ba92d73996f84bbfbab47006dc934c8e P 70e7666c46844503beb466fdc054a6fc: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.002s
I20260321 03:02:33.351245 9379 raft_consensus.cc:359] T ba92d73996f84bbfbab47006dc934c8e P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:33.351359 9379 raft_consensus.cc:385] T ba92d73996f84bbfbab47006dc934c8e P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:33.351418 9379 raft_consensus.cc:740] T ba92d73996f84bbfbab47006dc934c8e P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70e7666c46844503beb466fdc054a6fc, State: Initialized, Role: FOLLOWER
I20260321 03:02:33.351505 9374 ts_tablet_manager.cc:1929] T a062f5d0fc344fb9a1e8169401451bad P a97f7dd77cf2444f8fdb441019081f79: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260321 03:02:33.351580 9374 log.cc:1199] T a062f5d0fc344fb9a1e8169401451bad P a97f7dd77cf2444f8fdb441019081f79: Deleting WAL directory at /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-2/wal/wals/a062f5d0fc344fb9a1e8169401451bad
I20260321 03:02:33.351565 9379 consensus_queue.cc:260] T ba92d73996f84bbfbab47006dc934c8e P 70e7666c46844503beb466fdc054a6fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:33.351841 9374 ts_tablet_manager.cc:1950] T a062f5d0fc344fb9a1e8169401451bad P a97f7dd77cf2444f8fdb441019081f79: Deleting consensus metadata
I20260321 03:02:33.352360 9378 tablet_bootstrap.cc:492] T 60c70af8c0e94b30801ae2437a7f8529 P 4532b54a008a4a39b663112e6d0aacc0: No bootstrap required, opened a new log
I20260321 03:02:33.352460 9378 ts_tablet_manager.cc:1403] T 60c70af8c0e94b30801ae2437a7f8529 P 4532b54a008a4a39b663112e6d0aacc0: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.000s
I20260321 03:02:33.352559 9380 tablet_bootstrap.cc:492] T ba92d73996f84bbfbab47006dc934c8e P a97f7dd77cf2444f8fdb441019081f79: No bootstrap required, opened a new log
I20260321 03:02:33.352638 9380 ts_tablet_manager.cc:1403] T ba92d73996f84bbfbab47006dc934c8e P a97f7dd77cf2444f8fdb441019081f79: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.002s
I20260321 03:02:33.352968 9378 raft_consensus.cc:359] T 60c70af8c0e94b30801ae2437a7f8529 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:33.353051 9379 ts_tablet_manager.cc:1434] T ba92d73996f84bbfbab47006dc934c8e P 70e7666c46844503beb466fdc054a6fc: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260321 03:02:33.353088 9378 raft_consensus.cc:385] T 60c70af8c0e94b30801ae2437a7f8529 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:33.353123 9378 raft_consensus.cc:740] T 60c70af8c0e94b30801ae2437a7f8529 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4532b54a008a4a39b663112e6d0aacc0, State: Initialized, Role: FOLLOWER
I20260321 03:02:33.353068 9380 raft_consensus.cc:359] T ba92d73996f84bbfbab47006dc934c8e P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:33.353168 9380 raft_consensus.cc:385] T ba92d73996f84bbfbab47006dc934c8e P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:33.353199 9380 raft_consensus.cc:740] T ba92d73996f84bbfbab47006dc934c8e P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a97f7dd77cf2444f8fdb441019081f79, State: Initialized, Role: FOLLOWER
I20260321 03:02:33.353286 9378 consensus_queue.cc:260] T 60c70af8c0e94b30801ae2437a7f8529 P 4532b54a008a4a39b663112e6d0aacc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:33.353348 9380 consensus_queue.cc:260] T ba92d73996f84bbfbab47006dc934c8e P a97f7dd77cf2444f8fdb441019081f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:33.353580 9378 ts_tablet_manager.cc:1434] T 60c70af8c0e94b30801ae2437a7f8529 P 4532b54a008a4a39b663112e6d0aacc0: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260321 03:02:33.353792 9378 tablet_bootstrap.cc:492] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0: Bootstrap starting.
I20260321 03:02:33.353941 9379 tablet_bootstrap.cc:492] T 5e67b5247f19477c9091bd936639f40e P 70e7666c46844503beb466fdc054a6fc: Bootstrap starting.
I20260321 03:02:33.354815 9380 ts_tablet_manager.cc:1434] T ba92d73996f84bbfbab47006dc934c8e P a97f7dd77cf2444f8fdb441019081f79: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260321 03:02:33.355206 9378 tablet_bootstrap.cc:654] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:33.355659 9380 tablet_bootstrap.cc:492] T c1e54bc634ac44199436f2c538e6d63f P a97f7dd77cf2444f8fdb441019081f79: Bootstrap starting.
I20260321 03:02:33.357467 9380 tablet_bootstrap.cc:654] T c1e54bc634ac44199436f2c538e6d63f P a97f7dd77cf2444f8fdb441019081f79: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:33.357946 9379 tablet_bootstrap.cc:654] T 5e67b5247f19477c9091bd936639f40e P 70e7666c46844503beb466fdc054a6fc: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:33.358695 9380 tablet_bootstrap.cc:492] T c1e54bc634ac44199436f2c538e6d63f P a97f7dd77cf2444f8fdb441019081f79: No bootstrap required, opened a new log
I20260321 03:02:33.358783 9380 ts_tablet_manager.cc:1403] T c1e54bc634ac44199436f2c538e6d63f P a97f7dd77cf2444f8fdb441019081f79: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260321 03:02:33.359274 9379 tablet_bootstrap.cc:492] T 5e67b5247f19477c9091bd936639f40e P 70e7666c46844503beb466fdc054a6fc: No bootstrap required, opened a new log
I20260321 03:02:33.359366 9379 ts_tablet_manager.cc:1403] T 5e67b5247f19477c9091bd936639f40e P 70e7666c46844503beb466fdc054a6fc: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.002s
I20260321 03:02:33.359687 9378 tablet_bootstrap.cc:492] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0: No bootstrap required, opened a new log
I20260321 03:02:33.359845 9378 ts_tablet_manager.cc:1403] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0: Time spent bootstrapping tablet: real 0.006s user 0.003s sys 0.000s
I20260321 03:02:33.360006 9379 raft_consensus.cc:359] T 5e67b5247f19477c9091bd936639f40e P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:33.360006 9380 raft_consensus.cc:359] T c1e54bc634ac44199436f2c538e6d63f P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:33.360116 9379 raft_consensus.cc:385] T 5e67b5247f19477c9091bd936639f40e P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:33.360114 9380 raft_consensus.cc:385] T c1e54bc634ac44199436f2c538e6d63f P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:33.360149 9379 raft_consensus.cc:740] T 5e67b5247f19477c9091bd936639f40e P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70e7666c46844503beb466fdc054a6fc, State: Initialized, Role: FOLLOWER
I20260321 03:02:33.360149 9380 raft_consensus.cc:740] T c1e54bc634ac44199436f2c538e6d63f P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a97f7dd77cf2444f8fdb441019081f79, State: Initialized, Role: FOLLOWER
I20260321 03:02:33.360313 9379 consensus_queue.cc:260] T 5e67b5247f19477c9091bd936639f40e P 70e7666c46844503beb466fdc054a6fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:33.360306 9380 consensus_queue.cc:260] T c1e54bc634ac44199436f2c538e6d63f P a97f7dd77cf2444f8fdb441019081f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:33.360594 9380 ts_tablet_manager.cc:1434] T c1e54bc634ac44199436f2c538e6d63f P a97f7dd77cf2444f8fdb441019081f79: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260321 03:02:33.360772 9380 tablet_bootstrap.cc:492] T 5e67b5247f19477c9091bd936639f40e P a97f7dd77cf2444f8fdb441019081f79: Bootstrap starting.
I20260321 03:02:33.362187 9380 tablet_bootstrap.cc:654] T 5e67b5247f19477c9091bd936639f40e P a97f7dd77cf2444f8fdb441019081f79: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:33.360406 9378 raft_consensus.cc:359] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:33.362350 9378 raft_consensus.cc:385] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:33.362392 9378 raft_consensus.cc:740] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4532b54a008a4a39b663112e6d0aacc0, State: Initialized, Role: FOLLOWER
I20260321 03:02:33.362568 9378 consensus_queue.cc:260] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:33.363760 9380 tablet_bootstrap.cc:492] T 5e67b5247f19477c9091bd936639f40e P a97f7dd77cf2444f8fdb441019081f79: No bootstrap required, opened a new log
I20260321 03:02:33.363845 9380 ts_tablet_manager.cc:1403] T 5e67b5247f19477c9091bd936639f40e P a97f7dd77cf2444f8fdb441019081f79: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20260321 03:02:33.364125 9378 ts_tablet_manager.cc:1434] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260321 03:02:33.364928 9380 raft_consensus.cc:359] T 5e67b5247f19477c9091bd936639f40e P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:33.365037 9380 raft_consensus.cc:385] T 5e67b5247f19477c9091bd936639f40e P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:33.365051 9378 tablet_bootstrap.cc:492] T c1e54bc634ac44199436f2c538e6d63f P 4532b54a008a4a39b663112e6d0aacc0: Bootstrap starting.
I20260321 03:02:33.365073 9380 raft_consensus.cc:740] T 5e67b5247f19477c9091bd936639f40e P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a97f7dd77cf2444f8fdb441019081f79, State: Initialized, Role: FOLLOWER
I20260321 03:02:33.365320 9380 consensus_queue.cc:260] T 5e67b5247f19477c9091bd936639f40e P a97f7dd77cf2444f8fdb441019081f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:33.365636 9379 ts_tablet_manager.cc:1434] T 5e67b5247f19477c9091bd936639f40e P 70e7666c46844503beb466fdc054a6fc: Time spent starting tablet: real 0.006s user 0.000s sys 0.002s
I20260321 03:02:33.366146 9378 tablet_bootstrap.cc:654] T c1e54bc634ac44199436f2c538e6d63f P 4532b54a008a4a39b663112e6d0aacc0: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:33.366812 9380 ts_tablet_manager.cc:1434] T 5e67b5247f19477c9091bd936639f40e P a97f7dd77cf2444f8fdb441019081f79: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260321 03:02:33.367162 9090 raft_consensus.cc:493] T ba92d73996f84bbfbab47006dc934c8e P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260321 03:02:33.367257 9090 raft_consensus.cc:515] T ba92d73996f84bbfbab47006dc934c8e P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:33.367650 9090 leader_election.cc:290] T ba92d73996f84bbfbab47006dc934c8e P 70e7666c46844503beb466fdc054a6fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
I20260321 03:02:33.367769 9380 tablet_bootstrap.cc:492] T a4a81619964144e9aae068ed1e9eeaff P a97f7dd77cf2444f8fdb441019081f79: Bootstrap starting.
I20260321 03:02:33.368146 8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba92d73996f84bbfbab47006dc934c8e" candidate_uuid: "70e7666c46844503beb466fdc054a6fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a97f7dd77cf2444f8fdb441019081f79" is_pre_election: true
I20260321 03:02:33.368273 8804 raft_consensus.cc:2468] T ba92d73996f84bbfbab47006dc934c8e P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70e7666c46844503beb466fdc054a6fc in term 0.
I20260321 03:02:33.368669 8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba92d73996f84bbfbab47006dc934c8e" candidate_uuid: "70e7666c46844503beb466fdc054a6fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4532b54a008a4a39b663112e6d0aacc0" is_pre_election: true
I20260321 03:02:33.368736 8604 leader_election.cc:304] T ba92d73996f84bbfbab47006dc934c8e P 70e7666c46844503beb466fdc054a6fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79; no voters:
I20260321 03:02:33.368795 8531 raft_consensus.cc:2468] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70e7666c46844503beb466fdc054a6fc in term 0.
I20260321 03:02:33.368970 9380 tablet_bootstrap.cc:654] T a4a81619964144e9aae068ed1e9eeaff P a97f7dd77cf2444f8fdb441019081f79: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:33.369158 9090 raft_consensus.cc:2804] T ba92d73996f84bbfbab47006dc934c8e P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260321 03:02:33.369206 9090 raft_consensus.cc:493] T ba92d73996f84bbfbab47006dc934c8e P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260321 03:02:33.369299 9090 raft_consensus.cc:3060] T ba92d73996f84bbfbab47006dc934c8e P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:33.370289 9090 raft_consensus.cc:515] T ba92d73996f84bbfbab47006dc934c8e P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:33.370642 9090 leader_election.cc:290] T ba92d73996f84bbfbab47006dc934c8e P 70e7666c46844503beb466fdc054a6fc [CANDIDATE]: Term 1 election: Requested vote from peers 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
I20260321 03:02:33.370734 9090 consensus_queue.cc:1048] T d254157f7738406eb700e7e9af6adab3 P 70e7666c46844503beb466fdc054a6fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260321 03:02:33.370877 8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba92d73996f84bbfbab47006dc934c8e" candidate_uuid: "70e7666c46844503beb466fdc054a6fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4532b54a008a4a39b663112e6d0aacc0"
I20260321 03:02:33.370986 8531 raft_consensus.cc:3060] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:33.372004 8531 raft_consensus.cc:2468] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70e7666c46844503beb466fdc054a6fc in term 1.
I20260321 03:02:33.372180 8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba92d73996f84bbfbab47006dc934c8e" candidate_uuid: "70e7666c46844503beb466fdc054a6fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a97f7dd77cf2444f8fdb441019081f79"
I20260321 03:02:33.372296 8804 raft_consensus.cc:3060] T ba92d73996f84bbfbab47006dc934c8e P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:33.372326 8602 leader_election.cc:304] T ba92d73996f84bbfbab47006dc934c8e P 70e7666c46844503beb466fdc054a6fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0, 70e7666c46844503beb466fdc054a6fc; no voters:
I20260321 03:02:33.373040 8804 raft_consensus.cc:2468] T ba92d73996f84bbfbab47006dc934c8e P a97f7dd77cf2444f8fdb441019081f79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70e7666c46844503beb466fdc054a6fc in term 1.
I20260321 03:02:33.374529 9090 raft_consensus.cc:2804] T ba92d73996f84bbfbab47006dc934c8e P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Leader election won for term 1
I20260321 03:02:33.374713 9090 raft_consensus.cc:697] T ba92d73996f84bbfbab47006dc934c8e P 70e7666c46844503beb466fdc054a6fc [term 1 LEADER]: Becoming Leader. State: Replica: 70e7666c46844503beb466fdc054a6fc, State: Running, Role: LEADER
I20260321 03:02:33.374848 9090 consensus_queue.cc:237] T ba92d73996f84bbfbab47006dc934c8e P 70e7666c46844503beb466fdc054a6fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:33.380932 9090 consensus_queue.cc:1048] T d254157f7738406eb700e7e9af6adab3 P 70e7666c46844503beb466fdc054a6fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260321 03:02:33.383782 9379 tablet_bootstrap.cc:492] T c1e54bc634ac44199436f2c538e6d63f P 70e7666c46844503beb466fdc054a6fc: Bootstrap starting.
I20260321 03:02:33.385306 9379 tablet_bootstrap.cc:654] T c1e54bc634ac44199436f2c538e6d63f P 70e7666c46844503beb466fdc054a6fc: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:33.386620 9379 tablet_bootstrap.cc:492] T c1e54bc634ac44199436f2c538e6d63f P 70e7666c46844503beb466fdc054a6fc: No bootstrap required, opened a new log
I20260321 03:02:33.386731 9379 ts_tablet_manager.cc:1403] T c1e54bc634ac44199436f2c538e6d63f P 70e7666c46844503beb466fdc054a6fc: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20260321 03:02:33.387416 9379 raft_consensus.cc:359] T c1e54bc634ac44199436f2c538e6d63f P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:33.387576 9379 raft_consensus.cc:385] T c1e54bc634ac44199436f2c538e6d63f P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:33.387615 9379 raft_consensus.cc:740] T c1e54bc634ac44199436f2c538e6d63f P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70e7666c46844503beb466fdc054a6fc, State: Initialized, Role: FOLLOWER
I20260321 03:02:33.387770 9379 consensus_queue.cc:260] T c1e54bc634ac44199436f2c538e6d63f P 70e7666c46844503beb466fdc054a6fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:33.388147 9379 ts_tablet_manager.cc:1434] T c1e54bc634ac44199436f2c538e6d63f P 70e7666c46844503beb466fdc054a6fc: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260321 03:02:33.388321 9379 tablet_bootstrap.cc:492] T a4a81619964144e9aae068ed1e9eeaff P 70e7666c46844503beb466fdc054a6fc: Bootstrap starting.
I20260321 03:02:33.389694 9379 tablet_bootstrap.cc:654] T a4a81619964144e9aae068ed1e9eeaff P 70e7666c46844503beb466fdc054a6fc: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:33.390977 9380 tablet_bootstrap.cc:492] T a4a81619964144e9aae068ed1e9eeaff P a97f7dd77cf2444f8fdb441019081f79: No bootstrap required, opened a new log
I20260321 03:02:33.391083 9380 ts_tablet_manager.cc:1403] T a4a81619964144e9aae068ed1e9eeaff P a97f7dd77cf2444f8fdb441019081f79: Time spent bootstrapping tablet: real 0.023s user 0.000s sys 0.002s
I20260321 03:02:33.391741 9380 raft_consensus.cc:359] T a4a81619964144e9aae068ed1e9eeaff P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:33.391858 9380 raft_consensus.cc:385] T a4a81619964144e9aae068ed1e9eeaff P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:33.391891 9380 raft_consensus.cc:740] T a4a81619964144e9aae068ed1e9eeaff P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a97f7dd77cf2444f8fdb441019081f79, State: Initialized, Role: FOLLOWER
I20260321 03:02:33.392031 9380 consensus_queue.cc:260] T a4a81619964144e9aae068ed1e9eeaff P a97f7dd77cf2444f8fdb441019081f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:33.392432 9380 ts_tablet_manager.cc:1434] T a4a81619964144e9aae068ed1e9eeaff P a97f7dd77cf2444f8fdb441019081f79: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260321 03:02:33.395031 9378 tablet_bootstrap.cc:492] T c1e54bc634ac44199436f2c538e6d63f P 4532b54a008a4a39b663112e6d0aacc0: No bootstrap required, opened a new log
I20260321 03:02:33.395141 9378 ts_tablet_manager.cc:1403] T c1e54bc634ac44199436f2c538e6d63f P 4532b54a008a4a39b663112e6d0aacc0: Time spent bootstrapping tablet: real 0.030s user 0.000s sys 0.002s
I20260321 03:02:33.395710 9378 raft_consensus.cc:359] T c1e54bc634ac44199436f2c538e6d63f P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:33.395957 9378 raft_consensus.cc:385] T c1e54bc634ac44199436f2c538e6d63f P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:33.396023 9378 raft_consensus.cc:740] T c1e54bc634ac44199436f2c538e6d63f P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4532b54a008a4a39b663112e6d0aacc0, State: Initialized, Role: FOLLOWER
I20260321 03:02:33.396196 9378 consensus_queue.cc:260] T c1e54bc634ac44199436f2c538e6d63f P 4532b54a008a4a39b663112e6d0aacc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:33.396533 9378 ts_tablet_manager.cc:1434] T c1e54bc634ac44199436f2c538e6d63f P 4532b54a008a4a39b663112e6d0aacc0: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260321 03:02:33.396755 9378 tablet_bootstrap.cc:492] T 5e67b5247f19477c9091bd936639f40e P 4532b54a008a4a39b663112e6d0aacc0: Bootstrap starting.
I20260321 03:02:33.398100 9378 tablet_bootstrap.cc:654] T 5e67b5247f19477c9091bd936639f40e P 4532b54a008a4a39b663112e6d0aacc0: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:33.399441 9379 tablet_bootstrap.cc:492] T a4a81619964144e9aae068ed1e9eeaff P 70e7666c46844503beb466fdc054a6fc: No bootstrap required, opened a new log
I20260321 03:02:33.399545 9379 ts_tablet_manager.cc:1403] T a4a81619964144e9aae068ed1e9eeaff P 70e7666c46844503beb466fdc054a6fc: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.000s
I20260321 03:02:33.400141 9379 raft_consensus.cc:359] T a4a81619964144e9aae068ed1e9eeaff P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:33.400242 9379 raft_consensus.cc:385] T a4a81619964144e9aae068ed1e9eeaff P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:33.400264 9379 raft_consensus.cc:740] T a4a81619964144e9aae068ed1e9eeaff P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70e7666c46844503beb466fdc054a6fc, State: Initialized, Role: FOLLOWER
I20260321 03:02:33.400398 9379 consensus_queue.cc:260] T a4a81619964144e9aae068ed1e9eeaff P 70e7666c46844503beb466fdc054a6fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:33.402463 9379 ts_tablet_manager.cc:1434] T a4a81619964144e9aae068ed1e9eeaff P 70e7666c46844503beb466fdc054a6fc: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260321 03:02:33.403085 9378 tablet_bootstrap.cc:492] T 5e67b5247f19477c9091bd936639f40e P 4532b54a008a4a39b663112e6d0aacc0: No bootstrap required, opened a new log
I20260321 03:02:33.403208 9378 ts_tablet_manager.cc:1403] T 5e67b5247f19477c9091bd936639f40e P 4532b54a008a4a39b663112e6d0aacc0: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.001s
I20260321 03:02:33.403743 9378 raft_consensus.cc:359] T 5e67b5247f19477c9091bd936639f40e P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:33.403864 9378 raft_consensus.cc:385] T 5e67b5247f19477c9091bd936639f40e P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:33.403903 9378 raft_consensus.cc:740] T 5e67b5247f19477c9091bd936639f40e P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4532b54a008a4a39b663112e6d0aacc0, State: Initialized, Role: FOLLOWER
I20260321 03:02:33.404057 9378 consensus_queue.cc:260] T 5e67b5247f19477c9091bd936639f40e P 4532b54a008a4a39b663112e6d0aacc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:33.404260 9208 raft_consensus.cc:493] T a4a81619964144e9aae068ed1e9eeaff P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260321 03:02:33.404366 9378 ts_tablet_manager.cc:1434] T 5e67b5247f19477c9091bd936639f40e P 4532b54a008a4a39b663112e6d0aacc0: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20260321 03:02:33.404580 9378 tablet_bootstrap.cc:492] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0: Bootstrap starting.
I20260321 03:02:33.405911 9378 tablet_bootstrap.cc:654] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:33.404353 9208 raft_consensus.cc:515] T a4a81619964144e9aae068ed1e9eeaff P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:33.407392 9378 tablet_bootstrap.cc:492] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0: No bootstrap required, opened a new log
I20260321 03:02:33.411008 9378 ts_tablet_manager.cc:1403] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0: Time spent bootstrapping tablet: real 0.006s user 0.003s sys 0.000s
I20260321 03:02:33.411218 9208 leader_election.cc:290] T a4a81619964144e9aae068ed1e9eeaff P a97f7dd77cf2444f8fdb441019081f79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171), 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713)
I20260321 03:02:33.411661 8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a81619964144e9aae068ed1e9eeaff" candidate_uuid: "a97f7dd77cf2444f8fdb441019081f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4532b54a008a4a39b663112e6d0aacc0" is_pre_election: true
I20260321 03:02:33.411643 8667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a81619964144e9aae068ed1e9eeaff" candidate_uuid: "a97f7dd77cf2444f8fdb441019081f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70e7666c46844503beb466fdc054a6fc" is_pre_election: true
I20260321 03:02:33.411787 8667 raft_consensus.cc:2468] T a4a81619964144e9aae068ed1e9eeaff P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a97f7dd77cf2444f8fdb441019081f79 in term 0.
I20260321 03:02:33.411669 9378 raft_consensus.cc:359] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:33.411859 9378 raft_consensus.cc:385] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:33.411892 9378 raft_consensus.cc:740] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4532b54a008a4a39b663112e6d0aacc0, State: Initialized, Role: FOLLOWER
I20260321 03:02:33.412020 9378 consensus_queue.cc:260] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:33.412081 8737 leader_election.cc:304] T a4a81619964144e9aae068ed1e9eeaff P a97f7dd77cf2444f8fdb441019081f79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79; no voters:
I20260321 03:02:33.412269 9208 raft_consensus.cc:2804] T a4a81619964144e9aae068ed1e9eeaff P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260321 03:02:33.422049 9208 raft_consensus.cc:493] T a4a81619964144e9aae068ed1e9eeaff P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260321 03:02:33.422185 9208 raft_consensus.cc:3060] T a4a81619964144e9aae068ed1e9eeaff P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:33.412150 8532 raft_consensus.cc:2468] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a97f7dd77cf2444f8fdb441019081f79 in term 0.
I20260321 03:02:33.412312 9378 ts_tablet_manager.cc:1434] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260321 03:02:33.414825 9192 raft_consensus.cc:493] T 5e67b5247f19477c9091bd936639f40e P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260321 03:02:33.423058 9192 raft_consensus.cc:515] T 5e67b5247f19477c9091bd936639f40e P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:33.423409 9208 raft_consensus.cc:515] T a4a81619964144e9aae068ed1e9eeaff P a97f7dd77cf2444f8fdb441019081f79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:33.423708 9192 leader_election.cc:290] T 5e67b5247f19477c9091bd936639f40e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
I20260321 03:02:33.423799 9208 leader_election.cc:290] T a4a81619964144e9aae068ed1e9eeaff P a97f7dd77cf2444f8fdb441019081f79 [CANDIDATE]: Term 1 election: Requested vote from peers 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171), 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713)
I20260321 03:02:33.424306 8667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a81619964144e9aae068ed1e9eeaff" candidate_uuid: "a97f7dd77cf2444f8fdb441019081f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70e7666c46844503beb466fdc054a6fc"
I20260321 03:02:33.424449 8667 raft_consensus.cc:3060] T a4a81619964144e9aae068ed1e9eeaff P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:33.424559 8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e67b5247f19477c9091bd936639f40e" candidate_uuid: "4532b54a008a4a39b663112e6d0aacc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a97f7dd77cf2444f8fdb441019081f79" is_pre_election: true
I20260321 03:02:33.424679 8804 raft_consensus.cc:2468] T 5e67b5247f19477c9091bd936639f40e P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4532b54a008a4a39b663112e6d0aacc0 in term 0.
I20260321 03:02:33.424794 8668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e67b5247f19477c9091bd936639f40e" candidate_uuid: "4532b54a008a4a39b663112e6d0aacc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70e7666c46844503beb466fdc054a6fc" is_pre_election: true
I20260321 03:02:33.424897 8668 raft_consensus.cc:2468] T 5e67b5247f19477c9091bd936639f40e P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4532b54a008a4a39b663112e6d0aacc0 in term 0.
I20260321 03:02:33.425030 8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a81619964144e9aae068ed1e9eeaff" candidate_uuid: "a97f7dd77cf2444f8fdb441019081f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4532b54a008a4a39b663112e6d0aacc0"
I20260321 03:02:33.425158 8532 raft_consensus.cc:3060] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:33.425832 8667 raft_consensus.cc:2468] T a4a81619964144e9aae068ed1e9eeaff P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a97f7dd77cf2444f8fdb441019081f79 in term 1.
I20260321 03:02:33.417335 9101 raft_consensus.cc:493] T 60c70af8c0e94b30801ae2437a7f8529 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260321 03:02:33.426211 8466 leader_election.cc:304] T 5e67b5247f19477c9091bd936639f40e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0, 70e7666c46844503beb466fdc054a6fc; no voters:
I20260321 03:02:33.426182 9101 raft_consensus.cc:515] T 60c70af8c0e94b30801ae2437a7f8529 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:33.426432 8737 leader_election.cc:304] T a4a81619964144e9aae068ed1e9eeaff P a97f7dd77cf2444f8fdb441019081f79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79; no voters:
I20260321 03:02:33.426597 9101 leader_election.cc:290] T 60c70af8c0e94b30801ae2437a7f8529 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
I20260321 03:02:33.426695 9101 raft_consensus.cc:2804] T 5e67b5247f19477c9091bd936639f40e P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260321 03:02:33.426735 9101 raft_consensus.cc:493] T 5e67b5247f19477c9091bd936639f40e P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260321 03:02:33.426772 9101 raft_consensus.cc:3060] T 5e67b5247f19477c9091bd936639f40e P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:33.427250 9208 raft_consensus.cc:2804] T a4a81619964144e9aae068ed1e9eeaff P a97f7dd77cf2444f8fdb441019081f79 [term 1 FOLLOWER]: Leader election won for term 1
I20260321 03:02:33.427250 8667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60c70af8c0e94b30801ae2437a7f8529" candidate_uuid: "4532b54a008a4a39b663112e6d0aacc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70e7666c46844503beb466fdc054a6fc" is_pre_election: true
I20260321 03:02:33.427361 9208 raft_consensus.cc:697] T a4a81619964144e9aae068ed1e9eeaff P a97f7dd77cf2444f8fdb441019081f79 [term 1 LEADER]: Becoming Leader. State: Replica: a97f7dd77cf2444f8fdb441019081f79, State: Running, Role: LEADER
I20260321 03:02:33.427366 8667 raft_consensus.cc:2468] T 60c70af8c0e94b30801ae2437a7f8529 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4532b54a008a4a39b663112e6d0aacc0 in term 0.
I20260321 03:02:33.427515 9208 consensus_queue.cc:237] T a4a81619964144e9aae068ed1e9eeaff P a97f7dd77cf2444f8fdb441019081f79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:33.427690 8466 leader_election.cc:304] T 60c70af8c0e94b30801ae2437a7f8529 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0, 70e7666c46844503beb466fdc054a6fc; no voters:
I20260321 03:02:33.427882 9192 raft_consensus.cc:2804] T 60c70af8c0e94b30801ae2437a7f8529 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260321 03:02:33.427853 9101 raft_consensus.cc:515] T 5e67b5247f19477c9091bd936639f40e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:33.427918 9192 raft_consensus.cc:493] T 60c70af8c0e94b30801ae2437a7f8529 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260321 03:02:33.427976 9192 raft_consensus.cc:3060] T 60c70af8c0e94b30801ae2437a7f8529 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:33.428231 9101 leader_election.cc:290] T 5e67b5247f19477c9091bd936639f40e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 1 election: Requested vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
I20260321 03:02:33.429018 9192 raft_consensus.cc:515] T 60c70af8c0e94b30801ae2437a7f8529 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:33.429410 9192 leader_election.cc:290] T 60c70af8c0e94b30801ae2437a7f8529 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 1 election: Requested vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
I20260321 03:02:33.430361 8668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60c70af8c0e94b30801ae2437a7f8529" candidate_uuid: "4532b54a008a4a39b663112e6d0aacc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70e7666c46844503beb466fdc054a6fc"
I20260321 03:02:33.429075 8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60c70af8c0e94b30801ae2437a7f8529" candidate_uuid: "4532b54a008a4a39b663112e6d0aacc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a97f7dd77cf2444f8fdb441019081f79" is_pre_election: true
I20260321 03:02:33.429193 8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e67b5247f19477c9091bd936639f40e" candidate_uuid: "4532b54a008a4a39b663112e6d0aacc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a97f7dd77cf2444f8fdb441019081f79"
I20260321 03:02:33.436960 8668 raft_consensus.cc:3060] T 60c70af8c0e94b30801ae2437a7f8529 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:33.436972 8804 raft_consensus.cc:2468] T 60c70af8c0e94b30801ae2437a7f8529 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4532b54a008a4a39b663112e6d0aacc0 in term 0.
I20260321 03:02:33.437093 8803 raft_consensus.cc:3060] T 5e67b5247f19477c9091bd936639f40e P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:33.429951 8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60c70af8c0e94b30801ae2437a7f8529" candidate_uuid: "4532b54a008a4a39b663112e6d0aacc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a97f7dd77cf2444f8fdb441019081f79"
I20260321 03:02:33.437286 8802 raft_consensus.cc:3060] T 60c70af8c0e94b30801ae2437a7f8529 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:33.438221 8803 raft_consensus.cc:2468] T 5e67b5247f19477c9091bd936639f40e P a97f7dd77cf2444f8fdb441019081f79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4532b54a008a4a39b663112e6d0aacc0 in term 1.
I20260321 03:02:33.438217 8668 raft_consensus.cc:2468] T 60c70af8c0e94b30801ae2437a7f8529 P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4532b54a008a4a39b663112e6d0aacc0 in term 1.
I20260321 03:02:33.438285 8802 raft_consensus.cc:2468] T 60c70af8c0e94b30801ae2437a7f8529 P a97f7dd77cf2444f8fdb441019081f79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4532b54a008a4a39b663112e6d0aacc0 in term 1.
I20260321 03:02:33.430492 8667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e67b5247f19477c9091bd936639f40e" candidate_uuid: "4532b54a008a4a39b663112e6d0aacc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70e7666c46844503beb466fdc054a6fc"
I20260321 03:02:33.438457 8667 raft_consensus.cc:3060] T 5e67b5247f19477c9091bd936639f40e P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:33.439404 8667 raft_consensus.cc:2468] T 5e67b5247f19477c9091bd936639f40e P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4532b54a008a4a39b663112e6d0aacc0 in term 1.
I20260321 03:02:33.426196 8532 raft_consensus.cc:2468] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a97f7dd77cf2444f8fdb441019081f79 in term 1.
I20260321 03:02:33.438803 8469 leader_election.cc:304] T 5e67b5247f19477c9091bd936639f40e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0, a97f7dd77cf2444f8fdb441019081f79; no voters:
I20260321 03:02:33.438803 8466 leader_election.cc:304] T 60c70af8c0e94b30801ae2437a7f8529 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0, 70e7666c46844503beb466fdc054a6fc; no voters:
I20260321 03:02:33.440092 9192 raft_consensus.cc:2804] T 5e67b5247f19477c9091bd936639f40e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader election won for term 1
I20260321 03:02:33.440232 9101 raft_consensus.cc:2804] T 60c70af8c0e94b30801ae2437a7f8529 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader election won for term 1
I20260321 03:02:33.440330 9192 raft_consensus.cc:697] T 5e67b5247f19477c9091bd936639f40e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 LEADER]: Becoming Leader. State: Replica: 4532b54a008a4a39b663112e6d0aacc0, State: Running, Role: LEADER
I20260321 03:02:33.440513 9192 consensus_queue.cc:237] T 5e67b5247f19477c9091bd936639f40e P 4532b54a008a4a39b663112e6d0aacc0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:33.440573 9101 raft_consensus.cc:697] T 60c70af8c0e94b30801ae2437a7f8529 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 LEADER]: Becoming Leader. State: Replica: 4532b54a008a4a39b663112e6d0aacc0, State: Running, Role: LEADER
I20260321 03:02:33.440749 9101 consensus_queue.cc:237] T 60c70af8c0e94b30801ae2437a7f8529 P 4532b54a008a4a39b663112e6d0aacc0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
W20260321 03:02:33.560144 8739 connection.cc:537] client connection to 127.7.178.253:46595 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260321 03:02:33.560144 8859 connection.cc:537] client connection to 127.7.178.253:46595 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260321 03:02:33.561074 8468 connection.cc:537] client connection to 127.7.178.253:46595 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260321 03:02:33.562098 9363 negotiation.cc:337] Failed RPC negotiation. Trace:
0321 03:02:33.561098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.178.253:46595 (local address 127.7.178.195:49097)
0321 03:02:33.561381 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0321 03:02:33.561410 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0321 03:02:33.561529 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0321 03:02:33.561961 (+ 432us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":181}
W20260321 03:02:33.562896 8738 connection.cc:537] server connection from 127.0.0.1:58810 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260321 03:02:33.563894 9416 raft_consensus.cc:493] T c1e54bc634ac44199436f2c538e6d63f P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260321 03:02:33.563922 9401 raft_consensus.cc:493] T c1e54bc634ac44199436f2c538e6d63f P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260321 03:02:33.564038 9401 raft_consensus.cc:515] T c1e54bc634ac44199436f2c538e6d63f P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:33.564308 9416 raft_consensus.cc:515] T c1e54bc634ac44199436f2c538e6d63f P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:33.564947 9401 leader_election.cc:290] T c1e54bc634ac44199436f2c538e6d63f P 70e7666c46844503beb466fdc054a6fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
I20260321 03:02:33.564981 9416 leader_election.cc:290] T c1e54bc634ac44199436f2c538e6d63f P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
I20260321 03:02:33.565323 8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e54bc634ac44199436f2c538e6d63f" candidate_uuid: "70e7666c46844503beb466fdc054a6fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4532b54a008a4a39b663112e6d0aacc0" is_pre_election: true
I20260321 03:02:33.565356 8667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e54bc634ac44199436f2c538e6d63f" candidate_uuid: "4532b54a008a4a39b663112e6d0aacc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70e7666c46844503beb466fdc054a6fc" is_pre_election: true
I20260321 03:02:33.565510 8532 raft_consensus.cc:2468] T c1e54bc634ac44199436f2c538e6d63f P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70e7666c46844503beb466fdc054a6fc in term 0.
I20260321 03:02:33.565490 8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e54bc634ac44199436f2c538e6d63f" candidate_uuid: "4532b54a008a4a39b663112e6d0aacc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a97f7dd77cf2444f8fdb441019081f79" is_pre_election: true
I20260321 03:02:33.565531 8667 raft_consensus.cc:2468] T c1e54bc634ac44199436f2c538e6d63f P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4532b54a008a4a39b663112e6d0aacc0 in term 0.
I20260321 03:02:33.565528 8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e54bc634ac44199436f2c538e6d63f" candidate_uuid: "70e7666c46844503beb466fdc054a6fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a97f7dd77cf2444f8fdb441019081f79" is_pre_election: true
I20260321 03:02:33.565623 8802 raft_consensus.cc:2468] T c1e54bc634ac44199436f2c538e6d63f P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4532b54a008a4a39b663112e6d0aacc0 in term 0.
I20260321 03:02:33.565958 8469 leader_election.cc:304] T c1e54bc634ac44199436f2c538e6d63f P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0, a97f7dd77cf2444f8fdb441019081f79; no voters:
I20260321 03:02:33.566193 8602 leader_election.cc:304] T c1e54bc634ac44199436f2c538e6d63f P 70e7666c46844503beb466fdc054a6fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0, 70e7666c46844503beb466fdc054a6fc; no voters: a97f7dd77cf2444f8fdb441019081f79
I20260321 03:02:33.566239 9416 raft_consensus.cc:2804] T c1e54bc634ac44199436f2c538e6d63f P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260321 03:02:33.566298 9416 raft_consensus.cc:493] T c1e54bc634ac44199436f2c538e6d63f P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260321 03:02:33.566339 9416 raft_consensus.cc:3060] T c1e54bc634ac44199436f2c538e6d63f P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:33.566385 9401 raft_consensus.cc:2804] T c1e54bc634ac44199436f2c538e6d63f P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260321 03:02:33.566438 9401 raft_consensus.cc:493] T c1e54bc634ac44199436f2c538e6d63f P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260321 03:02:33.566476 9401 raft_consensus.cc:3060] T c1e54bc634ac44199436f2c538e6d63f P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:33.567484 9416 raft_consensus.cc:515] T c1e54bc634ac44199436f2c538e6d63f P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:33.567484 9401 raft_consensus.cc:515] T c1e54bc634ac44199436f2c538e6d63f P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:33.567991 9416 leader_election.cc:290] T c1e54bc634ac44199436f2c538e6d63f P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 1 election: Requested vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
I20260321 03:02:33.568219 8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e54bc634ac44199436f2c538e6d63f" candidate_uuid: "70e7666c46844503beb466fdc054a6fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a97f7dd77cf2444f8fdb441019081f79"
I20260321 03:02:33.568233 8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e54bc634ac44199436f2c538e6d63f" candidate_uuid: "4532b54a008a4a39b663112e6d0aacc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a97f7dd77cf2444f8fdb441019081f79"
I20260321 03:02:33.568356 8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e54bc634ac44199436f2c538e6d63f" candidate_uuid: "70e7666c46844503beb466fdc054a6fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4532b54a008a4a39b663112e6d0aacc0"
I20260321 03:02:33.568352 8803 raft_consensus.cc:3060] T c1e54bc634ac44199436f2c538e6d63f P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:33.568533 8532 raft_consensus.cc:2393] T c1e54bc634ac44199436f2c538e6d63f P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 70e7666c46844503beb466fdc054a6fc in current term 1: Already voted for candidate 4532b54a008a4a39b663112e6d0aacc0 in this term.
I20260321 03:02:33.568655 8667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e54bc634ac44199436f2c538e6d63f" candidate_uuid: "4532b54a008a4a39b663112e6d0aacc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70e7666c46844503beb466fdc054a6fc"
I20260321 03:02:33.568773 8667 raft_consensus.cc:2393] T c1e54bc634ac44199436f2c538e6d63f P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4532b54a008a4a39b663112e6d0aacc0 in current term 1: Already voted for candidate 70e7666c46844503beb466fdc054a6fc in this term.
I20260321 03:02:33.569043 8466 leader_election.cc:304] T c1e54bc634ac44199436f2c538e6d63f P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:02:33.569202 9416 raft_consensus.cc:2749] T c1e54bc634ac44199436f2c538e6d63f P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260321 03:02:33.569299 9401 leader_election.cc:290] T c1e54bc634ac44199436f2c538e6d63f P 70e7666c46844503beb466fdc054a6fc [CANDIDATE]: Term 1 election: Requested vote from peers 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
I20260321 03:02:33.569504 8803 raft_consensus.cc:2468] T c1e54bc634ac44199436f2c538e6d63f P a97f7dd77cf2444f8fdb441019081f79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70e7666c46844503beb466fdc054a6fc in term 1.
I20260321 03:02:33.569856 8604 leader_election.cc:304] T c1e54bc634ac44199436f2c538e6d63f P 70e7666c46844503beb466fdc054a6fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79; no voters: 4532b54a008a4a39b663112e6d0aacc0
I20260321 03:02:33.570042 9401 raft_consensus.cc:2804] T c1e54bc634ac44199436f2c538e6d63f P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Leader election won for term 1
I20260321 03:02:33.570137 9401 raft_consensus.cc:697] T c1e54bc634ac44199436f2c538e6d63f P 70e7666c46844503beb466fdc054a6fc [term 1 LEADER]: Becoming Leader. State: Replica: 70e7666c46844503beb466fdc054a6fc, State: Running, Role: LEADER
I20260321 03:02:33.570284 9401 consensus_queue.cc:237] T c1e54bc634ac44199436f2c538e6d63f P 70e7666c46844503beb466fdc054a6fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:33.812120 9367 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7451d7c0a71f4620a6607f74b5a22f2e)
I20260321 03:02:33.812337 9367 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:02:33.813711 9367 leader_election.cc:290] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651), 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595)
W20260321 03:02:33.814451 9273 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111)
W20260321 03:02:33.815506 9273 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651): Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111)
W20260321 03:02:33.815656 9273 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595): Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
I20260321 03:02:33.815708 9273 leader_election.cc:304] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3df5e4492f3049c1b09fea013b92f863; no voters: 4a187d1fb5804686b4aff01e47fd0284, 7451d7c0a71f4620a6607f74b5a22f2e
I20260321 03:02:33.815953 9367 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260321 03:02:33.856506 9101 consensus_queue.cc:1048] T 5e67b5247f19477c9091bd936639f40e P 4532b54a008a4a39b663112e6d0aacc0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260321 03:02:33.860523 9415 consensus_queue.cc:1048] T 5e67b5247f19477c9091bd936639f40e P 4532b54a008a4a39b663112e6d0aacc0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260321 03:02:33.862329 9396 consensus_queue.cc:1048] T ba92d73996f84bbfbab47006dc934c8e P 70e7666c46844503beb466fdc054a6fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260321 03:02:33.866420 9399 consensus_queue.cc:1048] T ba92d73996f84bbfbab47006dc934c8e P 70e7666c46844503beb466fdc054a6fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260321 03:02:33.882761 9101 consensus_queue.cc:1048] T 60c70af8c0e94b30801ae2437a7f8529 P 4532b54a008a4a39b663112e6d0aacc0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260321 03:02:33.887138 9415 consensus_queue.cc:1048] T 60c70af8c0e94b30801ae2437a7f8529 P 4532b54a008a4a39b663112e6d0aacc0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260321 03:02:33.915244 9208 consensus_queue.cc:1048] T a4a81619964144e9aae068ed1e9eeaff P a97f7dd77cf2444f8fdb441019081f79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260321 03:02:33.919322 9208 consensus_queue.cc:1048] T a4a81619964144e9aae068ed1e9eeaff P a97f7dd77cf2444f8fdb441019081f79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260321 03:02:33.960227 9396 consensus_queue.cc:1048] T c1e54bc634ac44199436f2c538e6d63f P 70e7666c46844503beb466fdc054a6fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260321 03:02:33.964023 9090 consensus_queue.cc:1048] T c1e54bc634ac44199436f2c538e6d63f P 70e7666c46844503beb466fdc054a6fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260321 03:02:34.535857 9441 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7451d7c0a71f4620a6607f74b5a22f2e)
I20260321 03:02:34.536023 9441 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:02:34.536839 9441 leader_election.cc:290] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651), 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595)
W20260321 03:02:34.538314 9273 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651): Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111)
W20260321 03:02:34.538462 9273 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595): Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
I20260321 03:02:34.538498 9273 leader_election.cc:304] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3df5e4492f3049c1b09fea013b92f863; no voters: 4a187d1fb5804686b4aff01e47fd0284, 7451d7c0a71f4620a6607f74b5a22f2e
I20260321 03:02:34.538641 9441 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260321 03:02:35.546813 9456 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7451d7c0a71f4620a6607f74b5a22f2e)
I20260321 03:02:35.546962 9456 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:02:35.547529 9456 leader_election.cc:290] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651), 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595)
W20260321 03:02:35.548931 9273 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651): Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111)
W20260321 03:02:35.549073 9273 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595): Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
I20260321 03:02:35.549180 9273 leader_election.cc:304] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3df5e4492f3049c1b09fea013b92f863; no voters: 4a187d1fb5804686b4aff01e47fd0284, 7451d7c0a71f4620a6607f74b5a22f2e
I20260321 03:02:35.549374 9456 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260321 03:02:35.941879 7883 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskZ5BwAx/build/debug/bin/kudu
/tmp/dist-test-taskZ5BwAx/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.178.254:38651
--webserver_interface=127.7.178.254
--webserver_port=43827
--builtin_ntp_servers=127.7.178.212:39683
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145
--hive_metastore_uris=thrift://127.0.0.1:35641
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260321 03:02:36.071164 9464 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260321 03:02:36.071496 9464 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260321 03:02:36.071588 9464 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260321 03:02:36.075556 9464 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260321 03:02:36.075666 9464 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260321 03:02:36.075702 9464 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260321 03:02:36.075745 9464 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260321 03:02:36.080286 9464 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.178.212:39683
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-0/wal
--hive_metastore_uris=thrift://127.0.0.1:35641
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.178.254:38651
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.178.254
--webserver_port=43827
--never_fsync=true
--heap_profile_path=/tmp/kudu.9464
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 68f10dd41067059260a5fb5c725b178b69c38aed
build type DEBUG
built by None at 21 Mar 2026 02:43:15 UTC on bdcb31816ec0
build id 11028
I20260321 03:02:36.081516 9464 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260321 03:02:36.082676 9464 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260321 03:02:36.089160 9474 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260321 03:02:36.089221 9472 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260321 03:02:36.089160 9471 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260321 03:02:36.089555 9464 server_base.cc:1061] running on GCE node
I20260321 03:02:36.090056 9464 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260321 03:02:36.091060 9464 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260321 03:02:36.092255 9464 hybrid_clock.cc:648] HybridClock initialized: now 1774062156092222 us; error 46 us; skew 500 ppm
I20260321 03:02:36.094696 9464 webserver.cc:492] Webserver started at http://127.7.178.254:43827/ using document root <none> and password file <none>
I20260321 03:02:36.095501 9464 fs_manager.cc:362] Metadata directory not provided
I20260321 03:02:36.095628 9464 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260321 03:02:36.103731 9464 fs_manager.cc:714] Time spent opening directory manager: real 0.006s user 0.002s sys 0.000s
I20260321 03:02:36.108784 9480 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260321 03:02:36.110525 9464 fs_manager.cc:730] Time spent opening block manager: real 0.005s user 0.002s sys 0.000s
I20260321 03:02:36.110692 9464 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-0/wal
uuid: "4a187d1fb5804686b4aff01e47fd0284"
format_stamp: "Formatted at 2026-03-21 03:02:27 on dist-test-slave-bwf0"
I20260321 03:02:36.111281 9464 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260321 03:02:36.146657 9464 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260321 03:02:36.147469 9464 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260321 03:02:36.147676 9464 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260321 03:02:36.156970 9464 rpc_server.cc:307] RPC server started. Bound to: 127.7.178.254:38651
I20260321 03:02:36.157084 9532 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.178.254:38651 every 8 connection(s)
I20260321 03:02:36.158913 9464 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-0/data/info.pb
I20260321 03:02:36.160374 7883 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskZ5BwAx/build/debug/bin/kudu as pid 9464
I20260321 03:02:36.177639 9533 sys_catalog.cc:263] Verifying existing consensus state
I20260321 03:02:36.180035 9533 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284: Bootstrap starting.
I20260321 03:02:36.189886 9533 log.cc:826] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284: Log is configured to *not* fsync() on all Append() calls
I20260321 03:02:36.230647 9533 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284: Bootstrap replayed 1/1 log segments. Stats: ops{read=70 overwritten=0 applied=70 ignored=0} inserts{seen=43 ignored=0} mutations{seen=57 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260321 03:02:36.231379 9533 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284: Bootstrap complete.
I20260321 03:02:36.235122 9533 raft_consensus.cc:359] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 4 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:02:36.235512 9533 raft_consensus.cc:740] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 4 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a187d1fb5804686b4aff01e47fd0284, State: Initialized, Role: FOLLOWER
I20260321 03:02:36.235965 9533 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 70, Last appended: 4.70, Last appended by leader: 70, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:02:36.236456 9537 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 4 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } } }
I20260321 03:02:36.236613 9537 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [sys.catalog]: This master's current role is: FOLLOWER
I20260321 03:02:36.237164 9533 sys_catalog.cc:565] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [sys.catalog]: configured and running, proceeding with master startup.
I20260321 03:02:36.244015 9551 catalog_manager.cc:1269] Loaded cluster ID: 30588dbe2d29416e8c640adf9bfaba1f
I20260321 03:02:36.244189 9551 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284: loading cluster ID for follower catalog manager: success
I20260321 03:02:36.247318 9551 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284: acquiring CA information for follower catalog manager: success
I20260321 03:02:36.249723 9551 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260321 03:02:36.250757 9464 master_runner.cc:186] Error getting master registration for 127.7.178.253:46595: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111),
I20260321 03:02:36.252384 9464 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260321 03:02:36.306288 8580 heartbeater.cc:344] Connected to a master server at 127.7.178.254:38651
I20260321 03:02:36.308611 9496 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" instance_seqno: 1774062147955760) as {username='slave'} at 127.7.178.193:51091; Asking this server to re-register.
I20260321 03:02:36.309556 8580 heartbeater.cc:461] Registering TS with master...
I20260321 03:02:36.311391 9495 ts_manager.cc:194] Registered new tserver with Master: 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171)
I20260321 03:02:36.384804 8715 heartbeater.cc:344] Connected to a master server at 127.7.178.254:38651
I20260321 03:02:36.384997 8715 heartbeater.cc:499] Master 127.7.178.254:38651 was elected leader, sending a full tablet report...
I20260321 03:02:36.387259 9495 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "70e7666c46844503beb466fdc054a6fc" instance_seqno: 1774062148158895) as {username='slave'} at 127.7.178.194:45419; Asking this server to re-register.
I20260321 03:02:36.387807 8715 heartbeater.cc:461] Registering TS with master...
I20260321 03:02:36.388932 9495 ts_manager.cc:194] Registered new tserver with Master: 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713)
I20260321 03:02:36.509996 8851 heartbeater.cc:344] Connected to a master server at 127.7.178.254:38651
I20260321 03:02:36.510165 8851 heartbeater.cc:499] Master 127.7.178.254:38651 was elected leader, sending a full tablet report...
I20260321 03:02:36.511835 9495 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" instance_seqno: 1774062148360782) as {username='slave'} at 127.7.178.195:48633; Asking this server to re-register.
I20260321 03:02:36.512694 8851 heartbeater.cc:461] Registering TS with master...
I20260321 03:02:36.514331 9495 ts_manager.cc:194] Registered new tserver with Master: a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
I20260321 03:02:36.732761 9537 raft_consensus.cc:493] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260321 03:02:36.733107 9537 raft_consensus.cc:515] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:02:36.734529 9537 leader_election.cc:290] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595), 3df5e4492f3049c1b09fea013b92f863 (127.7.178.252:45145)
W20260321 03:02:36.735670 9483 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
W20260321 03:02:36.736728 9483 leader_election.cc:336] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595): Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
I20260321 03:02:36.738940 9300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4a187d1fb5804686b4aff01e47fd0284" candidate_term: 5 candidate_status { last_received { term: 4 index: 70 } } ignore_live_leader: false dest_uuid: "3df5e4492f3049c1b09fea013b92f863" is_pre_election: true
I20260321 03:02:36.739168 9300 raft_consensus.cc:2393] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a187d1fb5804686b4aff01e47fd0284 in current term 5: Already voted for candidate 7451d7c0a71f4620a6607f74b5a22f2e in this term.
I20260321 03:02:36.739648 9481 leader_election.cc:304] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a187d1fb5804686b4aff01e47fd0284; no voters: 3df5e4492f3049c1b09fea013b92f863, 7451d7c0a71f4620a6607f74b5a22f2e
I20260321 03:02:36.739931 9537 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 4 FOLLOWER]: Advancing to term 5
I20260321 03:02:36.742121 9537 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260321 03:02:36.902557 9564 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7451d7c0a71f4620a6607f74b5a22f2e)
I20260321 03:02:36.902737 9564 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:02:36.903218 9564 leader_election.cc:290] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651), 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595)
W20260321 03:02:36.905009 9273 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595): Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
I20260321 03:02:36.907545 9507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3df5e4492f3049c1b09fea013b92f863" candidate_term: 6 candidate_status { last_received { term: 5 index: 78 } } ignore_live_leader: false dest_uuid: "4a187d1fb5804686b4aff01e47fd0284" is_pre_election: true
I20260321 03:02:36.907866 9507 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3df5e4492f3049c1b09fea013b92f863 in term 5.
I20260321 03:02:36.908583 9273 leader_election.cc:304] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3df5e4492f3049c1b09fea013b92f863, 4a187d1fb5804686b4aff01e47fd0284; no voters: 7451d7c0a71f4620a6607f74b5a22f2e
I20260321 03:02:36.908856 9564 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260321 03:02:36.908917 9564 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7451d7c0a71f4620a6607f74b5a22f2e)
I20260321 03:02:36.908948 9564 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 5 FOLLOWER]: Advancing to term 6
I20260321 03:02:36.910008 9564 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:02:36.910450 9564 leader_election.cc:290] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 6 election: Requested vote from peers 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651), 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595)
I20260321 03:02:36.911227 9507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3df5e4492f3049c1b09fea013b92f863" candidate_term: 6 candidate_status { last_received { term: 5 index: 78 } } ignore_live_leader: false dest_uuid: "4a187d1fb5804686b4aff01e47fd0284"
I20260321 03:02:36.911396 9507 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 5 FOLLOWER]: Advancing to term 6
W20260321 03:02:36.911955 9273 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595): Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
I20260321 03:02:36.912592 9507 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3df5e4492f3049c1b09fea013b92f863 in term 6.
I20260321 03:02:36.912993 9273 leader_election.cc:304] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3df5e4492f3049c1b09fea013b92f863, 4a187d1fb5804686b4aff01e47fd0284; no voters: 7451d7c0a71f4620a6607f74b5a22f2e
I20260321 03:02:36.913302 9564 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 6 FOLLOWER]: Leader election won for term 6
I20260321 03:02:36.913694 9564 raft_consensus.cc:697] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 6 LEADER]: Becoming Leader. State: Replica: 3df5e4492f3049c1b09fea013b92f863, State: Running, Role: LEADER
I20260321 03:02:36.914117 9564 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 78, Committed index: 78, Last appended: 5.78, Last appended by leader: 78, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:02:36.915302 9568 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3df5e4492f3049c1b09fea013b92f863. Latest consensus state: current_term: 6 leader_uuid: "3df5e4492f3049c1b09fea013b92f863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } } }
I20260321 03:02:36.915477 9568 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [sys.catalog]: This master's current role is: LEADER
I20260321 03:02:36.915869 9570 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260321 03:02:36.918053 9570 catalog_manager.cc:679] Loaded metadata for table default.table_c8e5202d265f463bbcf568d34a1e64a2 [id=4ac1925a391a48ea86c63da0c1d8c442]
I20260321 03:02:36.918352 9570 catalog_manager.cc:679] Loaded metadata for table default.table_0e0c55f293274457aed5e8d315334903 [id=850c888ac63d4c048f27ceeb1ddd4f83]
I20260321 03:02:36.918637 9570 catalog_manager.cc:679] Loaded metadata for table default.table_10dd23c6f33c4aa0bad0a534fb770d4a [id=94ef39d020ab428b9e0392bedab9483d]
I20260321 03:02:36.918879 9570 catalog_manager.cc:679] Loaded metadata for table default.table_60888690371e4e1d8d9e6a31f44b55a5 [id=9bc91b7f6cb8477ab6ed1ee5ed74f608]
I20260321 03:02:36.919112 9570 catalog_manager.cc:679] Loaded metadata for table default.table_f8b27d78677b44468e403c75afa5245a [id=9f5de6240b844d57991fc673d061fbf4]
I20260321 03:02:36.919348 9570 catalog_manager.cc:679] Loaded metadata for table default.table_d52655a709224a7d999af3a2f1f2a678 [id=a69b5fce47c341fe9f48dd5e36364533]
I20260321 03:02:36.919659 9570 catalog_manager.cc:679] Loaded metadata for table default.table_0e444e840fa14c16a1a1f2e750c73045 [id=c6b5b0c7a19649c2b502921f472fc1dc]
I20260321 03:02:36.919876 9570 catalog_manager.cc:679] Loaded metadata for table default.table_06e0fbe90fe0411d95d76f56b53fb175 [id=c7602cbc743a43239656449386fbeb83]
I20260321 03:02:36.921902 9570 tablet_loader.cc:96] loaded metadata for tablet 5e67b5247f19477c9091bd936639f40e (table default.table_10dd23c6f33c4aa0bad0a534fb770d4a [id=94ef39d020ab428b9e0392bedab9483d])
I20260321 03:02:36.922101 9570 tablet_loader.cc:96] loaded metadata for tablet 60c70af8c0e94b30801ae2437a7f8529 (table default.table_c8e5202d265f463bbcf568d34a1e64a2 [id=4ac1925a391a48ea86c63da0c1d8c442])
I20260321 03:02:36.922462 9570 tablet_loader.cc:96] loaded metadata for tablet 8535a1895af2482f90cfd53a79de88d5 (table default.table_60888690371e4e1d8d9e6a31f44b55a5 [id=9bc91b7f6cb8477ab6ed1ee5ed74f608])
I20260321 03:02:36.922639 9570 tablet_loader.cc:96] loaded metadata for tablet 89ae9cb00ef14b5d9d88dfb94a55e5d5 (table default.table_0e0c55f293274457aed5e8d315334903 [id=850c888ac63d4c048f27ceeb1ddd4f83])
I20260321 03:02:36.923039 9570 tablet_loader.cc:96] loaded metadata for tablet a4a81619964144e9aae068ed1e9eeaff (table default.table_0e444e840fa14c16a1a1f2e750c73045 [id=c6b5b0c7a19649c2b502921f472fc1dc])
I20260321 03:02:36.923377 9570 tablet_loader.cc:96] loaded metadata for tablet ba92d73996f84bbfbab47006dc934c8e (table default.table_d52655a709224a7d999af3a2f1f2a678 [id=a69b5fce47c341fe9f48dd5e36364533])
I20260321 03:02:36.923585 9570 tablet_loader.cc:96] loaded metadata for tablet c1e54bc634ac44199436f2c538e6d63f (table default.table_f8b27d78677b44468e403c75afa5245a [id=9f5de6240b844d57991fc673d061fbf4])
I20260321 03:02:36.924059 9570 tablet_loader.cc:96] loaded metadata for tablet d254157f7738406eb700e7e9af6adab3 (table default.table_06e0fbe90fe0411d95d76f56b53fb175 [id=c7602cbc743a43239656449386fbeb83])
I20260321 03:02:36.924510 9570 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260321 03:02:36.925330 9570 catalog_manager.cc:1269] Loaded cluster ID: 30588dbe2d29416e8c640adf9bfaba1f
I20260321 03:02:36.925400 9570 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260321 03:02:36.926256 9570 catalog_manager.cc:1514] Loading token signing keys...
I20260321 03:02:36.926891 9570 catalog_manager.cc:6055] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863: Loaded TSK: 0
I20260321 03:02:36.928630 9570 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260321 03:02:36.930289 9570 catalog_manager.cc:1537] Loading latest processed Hive Metastore notification log event ID...
I20260321 03:02:36.931012 9570 catalog_manager.cc:5893] Last processed Hive Metastore notification event ID: 21
I20260321 03:02:36.943303 9289 master_service.cc:954] ReplaceTablet: received request to replace tablet 5e67b5247f19477c9091bd936639f40e from {username='slave'} at 127.0.0.1:40020
I20260321 03:02:36.943411 9290 master_service.cc:954] ReplaceTablet: received request to replace tablet 89ae9cb00ef14b5d9d88dfb94a55e5d5 from {username='slave'} at 127.0.0.1:40020
I20260321 03:02:36.943710 9286 master_service.cc:954] ReplaceTablet: received request to replace tablet d254157f7738406eb700e7e9af6adab3 from {username='slave'} at 127.0.0.1:40020
I20260321 03:02:36.943893 9287 master_service.cc:954] ReplaceTablet: received request to replace tablet 5e67b5247f19477c9091bd936639f40e from {username='slave'} at 127.0.0.1:40020
I20260321 03:02:36.943924 9283 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40020:
table { table_name: "default.Table_0e0c55f293274457aed5e8d315334903" } modify_external_catalogs: true
I20260321 03:02:36.944042 9288 master_service.cc:954] ReplaceTablet: received request to replace tablet 60c70af8c0e94b30801ae2437a7f8529 from {username='slave'} at 127.0.0.1:40020
I20260321 03:02:36.944108 9283 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40020:
table { table_name: "default.Table_0e0c55f293274457aed5e8d315334903" } modify_external_catalogs: true
I20260321 03:02:36.944545 9281 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40020:
name: "default.Table_d2585fcc892d4f4882c0a068ce656fee"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260321 03:02:36.944752 9285 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40020:
table { table_name: "default.Table_f8b27d78677b44468e403c75afa5245a" } new_table_name: "default.Table_a144cb0fc86946c095774662670afa8a" modify_external_catalogs: true
I20260321 03:02:36.945010 9284 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40020:
table { table_name: "default.Table_c8e5202d265f463bbcf568d34a1e64a2" } new_table_name: "default.Table_75e35409dad54304bbd621a1202abbec" modify_external_catalogs: true
I20260321 03:02:36.945220 9282 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40020:
table { table_name: "default.Table_60888690371e4e1d8d9e6a31f44b55a5" } modify_external_catalogs: true
I20260321 03:02:36.945358 9282 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40020:
table { table_name: "default.Table_60888690371e4e1d8d9e6a31f44b55a5" } modify_external_catalogs: true
I20260321 03:02:36.948367 9507 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 6 FOLLOWER]: Refusing update from remote peer 3df5e4492f3049c1b09fea013b92f863: Log matching property violated. Preceding OpId in replica: term: 4 index: 70. Preceding OpId from leader: term: 6 index: 80. (index mismatch)
W20260321 03:02:36.949108 9273 consensus_peers.cc:597] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 -> Peer 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595): Couldn't send request to peer 7451d7c0a71f4620a6607f74b5a22f2e. Status: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260321 03:02:36.949867 9564 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 79, Last known committed idx: 70, Time since last communication: 0.000s
F20260321 03:02:36.950500 9343 hms_notification_log_listener.cc:287] non-monotonous event IDs from HMS: current 23, previous 23; dumping first 3 out of 6 received events: NotificationEvent(eventId=22, eventTime=1774062151, eventType=DROP_TABLE, dbName=default, tableName=table_79533ce61645417d9d18b6b2820ee1af, message={"server":"","servicePrincipal":"","db":"default","table":"table_79533ce61645417d9d18b6b2820ee1af","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_79533ce61645417d9d18b6b2820ee1af\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1774062150},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/warehouse/table_79533ce61645417d9d18b6b2820ee1af\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_79533ce61645417d9d18b6b2820ee1af\",\"kudu.table_id\":\"435759bdc4464e5f859546dfc760d6ad\",\"transient_lastDdlTime\":\"1774062150\",\"comment\":\"\",\"kudu.master_addresses\":\"127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"30588dbe2d29416e8c640adf9bfaba1f\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1774062151}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=23, eventTime=1774062151, eventType=DROP_TABLE, dbName=default, tableName=table_0e0c55f293274457aed5e8d315334903, message={"server":"","servicePrincipal":"","db":"default","table":"table_0e0c55f293274457aed5e8d315334903","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_0e0c55f293274457aed5e8d315334903\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1774062149},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/warehouse/table_0e0c55f293274457aed5e8d315334903\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_0e0c55f293274457aed5e8d315334903\",\"kudu.table_id\":\"850c888ac63d4c048f27ceeb1ddd4f83\",\"transient_lastDdlTime\":\"1774062149\",\"comment\":\"\",\"kudu.master_addresses\":\"127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"30588dbe2d29416e8c640adf9bfaba1f\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1774062151}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=23, eventTime=1774062151, eventType=DROP_TABLE, dbName=default, tableName=table_492554e7d97c4920bdf854ca950c0179, message={"server":"","servicePrincipal":"","db":"default","table":"table_492554e7d97c4920bdf854ca950c0179","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_492554e7d97c4920bdf854ca950c0179\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1774062151},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/warehouse/table_492554e7d97c4920bdf854ca950c0179\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_492554e7d97c4920bdf854ca950c0179\",\"kudu.table_id\":\"1eabb731ef9a41249c3e08ccf80157e4\",\"transient_lastDdlTime\":\"1774062151\",\"comment\":\"\",\"kudu.master_addresses\":\"127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"30588dbe2d29416e8c640adf9bfaba1f\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1774062151}, messageFormat=json-0.2, catName=hive);
*** Check failure stack trace: ***
@ 0x7f10e644bdcd google::LogMessage::Fail() at ??:0
@ 0x7f10e644fb93 google::LogMessage::SendToLog() at ??:0
I20260321 03:02:36.956568 9537 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3df5e4492f3049c1b09fea013b92f863. Latest consensus state: current_term: 6 leader_uuid: "3df5e4492f3049c1b09fea013b92f863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } } }
I20260321 03:02:36.956707 9537 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [sys.catalog]: This master's current role is: FOLLOWER
I20260321 03:02:36.956807 9537 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 6 leader_uuid: "3df5e4492f3049c1b09fea013b92f863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } } }
I20260321 03:02:36.956871 9537 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [sys.catalog]: This master's current role is: FOLLOWER
I20260321 03:02:36.957906 9568 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 6 leader_uuid: "3df5e4492f3049c1b09fea013b92f863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } } }
I20260321 03:02:36.958029 9568 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [sys.catalog]: This master's current role is: LEADER
I20260321 03:02:36.958312 9537 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 6 leader_uuid: "3df5e4492f3049c1b09fea013b92f863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } } }
I20260321 03:02:36.958406 9537 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [sys.catalog]: This master's current role is: FOLLOWER
@ 0x7f10e644b7cc google::LogMessage::Flush() at ??:0
I20260321 03:02:36.960959 9286 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863: Sending DeleteTablet for 3 replicas of tablet d254157f7738406eb700e7e9af6adab3
@ 0x7f10e644ba11 google::LogMessage::~LogMessage() at ??:0
I20260321 03:02:36.962332 9572 mvcc.cc:204] Tried to move back new op lower bound from 7266558594857676800 to 7266558579655380992. Current Snapshot: MvccSnapshot[applied={T|T < 7266558594852052992}]
I20260321 03:02:36.962383 9286 catalog_manager.cc:6741] ReplaceTablet: tablet d254157f7738406eb700e7e9af6adab3 deleted and replaced by tablet e72dc676a2fb4fe98229b8f0767952a9
I20260321 03:02:36.962765 9286 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40020:
name: "default.Table_9017f1e107c846008985a821415447b8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260321 03:02:36.964537 9290 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863: Sending DeleteTablet for 3 replicas of tablet 89ae9cb00ef14b5d9d88dfb94a55e5d5
I20260321 03:02:36.964854 9290 catalog_manager.cc:6741] ReplaceTablet: tablet 89ae9cb00ef14b5d9d88dfb94a55e5d5 deleted and replaced by tablet 0c90afb0d24a428f846cc2bfc24379ab
I20260321 03:02:36.964953 9289 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863: Sending DeleteTablet for 3 replicas of tablet 5e67b5247f19477c9091bd936639f40e
I20260321 03:02:36.965164 9289 catalog_manager.cc:6741] ReplaceTablet: tablet 5e67b5247f19477c9091bd936639f40e deleted and replaced by tablet e55ead2b80354ddf8876a5f8410122a2
I20260321 03:02:36.965091 9290 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40020:
name: "default.Table_79533ce61645417d9d18b6b2820ee1af"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260321 03:02:36.965350 9288 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863: Sending DeleteTablet for 3 replicas of tablet 60c70af8c0e94b30801ae2437a7f8529
I20260321 03:02:36.965622 9288 catalog_manager.cc:6741] ReplaceTablet: tablet 60c70af8c0e94b30801ae2437a7f8529 deleted and replaced by tablet 3722d9914162463ba9cd377dee251be0
I20260321 03:02:36.965816 9288 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40020:
name: "default.Table_492554e7d97c4920bdf854ca950c0179"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260321 03:02:36.966413 9287 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40020:
name: "default.Table_01a908196f6d4a1ba499b382b6932d90"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260321 03:02:36.965361 9289 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40020:
name: "default.Table_9b16e83d2d334faaa3ccd9aaae03ccf7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260321 03:02:36.981148 8505 tablet_service.cc:1558] Processing DeleteTablet for tablet d254157f7738406eb700e7e9af6adab3 with delete_type TABLET_DATA_DELETED (replaced by tablet e72dc676a2fb4fe98229b8f0767952a9) from {username='slave'} at 127.0.0.1:60616
I20260321 03:02:36.981494 8504 tablet_service.cc:1558] Processing DeleteTablet for tablet 5e67b5247f19477c9091bd936639f40e with delete_type TABLET_DATA_DELETED (replaced by tablet e55ead2b80354ddf8876a5f8410122a2) from {username='slave'} at 127.0.0.1:60616
I20260321 03:02:36.981627 8507 tablet_service.cc:1558] Processing DeleteTablet for tablet 60c70af8c0e94b30801ae2437a7f8529 with delete_type TABLET_DATA_DELETED (replaced by tablet 3722d9914162463ba9cd377dee251be0) from {username='slave'} at 127.0.0.1:60616
I20260321 03:02:36.981885 8508 tablet_service.cc:1511] Processing CreateTablet for tablet e72dc676a2fb4fe98229b8f0767952a9 (DEFAULT_TABLE table=default.table_06e0fbe90fe0411d95d76f56b53fb175 [id=c7602cbc743a43239656449386fbeb83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:36.982177 8508 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e72dc676a2fb4fe98229b8f0767952a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:36.983538 8646 tablet_service.cc:1558] Processing DeleteTablet for tablet d254157f7738406eb700e7e9af6adab3 with delete_type TABLET_DATA_DELETED (replaced by tablet e72dc676a2fb4fe98229b8f0767952a9) from {username='slave'} at 127.0.0.1:43454
I20260321 03:02:36.983664 8644 tablet_service.cc:1558] Processing DeleteTablet for tablet 60c70af8c0e94b30801ae2437a7f8529 with delete_type TABLET_DATA_DELETED (replaced by tablet 3722d9914162463ba9cd377dee251be0) from {username='slave'} at 127.0.0.1:43454
I20260321 03:02:36.983736 8645 tablet_service.cc:1558] Processing DeleteTablet for tablet 89ae9cb00ef14b5d9d88dfb94a55e5d5 with delete_type TABLET_DATA_DELETED (replaced by tablet 0c90afb0d24a428f846cc2bfc24379ab) from {username='slave'} at 127.0.0.1:43454
I20260321 03:02:36.983858 8639 tablet_service.cc:1558] Processing DeleteTablet for tablet 5e67b5247f19477c9091bd936639f40e with delete_type TABLET_DATA_DELETED (replaced by tablet e55ead2b80354ddf8876a5f8410122a2) from {username='slave'} at 127.0.0.1:43454
I20260321 03:02:36.984112 8642 tablet_service.cc:1511] Processing CreateTablet for tablet e72dc676a2fb4fe98229b8f0767952a9 (DEFAULT_TABLE table=default.table_06e0fbe90fe0411d95d76f56b53fb175 [id=c7602cbc743a43239656449386fbeb83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:36.984390 8642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e72dc676a2fb4fe98229b8f0767952a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:36.981148 8506 tablet_service.cc:1558] Processing DeleteTablet for tablet 89ae9cb00ef14b5d9d88dfb94a55e5d5 with delete_type TABLET_DATA_DELETED (replaced by tablet 0c90afb0d24a428f846cc2bfc24379ab) from {username='slave'} at 127.0.0.1:60616
I20260321 03:02:36.984756 9592 tablet_bootstrap.cc:492] T e72dc676a2fb4fe98229b8f0767952a9 P 4532b54a008a4a39b663112e6d0aacc0: Bootstrap starting.
I20260321 03:02:36.986009 9592 tablet_bootstrap.cc:654] T e72dc676a2fb4fe98229b8f0767952a9 P 4532b54a008a4a39b663112e6d0aacc0: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:36.986569 8506 tablet_service.cc:1511] Processing CreateTablet for tablet 3722d9914162463ba9cd377dee251be0 (DEFAULT_TABLE table=default.table_c8e5202d265f463bbcf568d34a1e64a2 [id=4ac1925a391a48ea86c63da0c1d8c442]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:36.986851 8506 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3722d9914162463ba9cd377dee251be0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:36.986987 9595 tablet_bootstrap.cc:492] T e72dc676a2fb4fe98229b8f0767952a9 P 70e7666c46844503beb466fdc054a6fc: Bootstrap starting.
@ 0x7f10eb62444d kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
I20260321 03:02:36.988447 9590 tablet_replica.cc:333] T d254157f7738406eb700e7e9af6adab3 P 4532b54a008a4a39b663112e6d0aacc0: stopping tablet replica
I20260321 03:02:36.988615 9590 raft_consensus.cc:2243] T d254157f7738406eb700e7e9af6adab3 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260321 03:02:36.988741 9590 raft_consensus.cc:2272] T d254157f7738406eb700e7e9af6adab3 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260321 03:02:36.988713 8779 tablet_service.cc:1558] Processing DeleteTablet for tablet d254157f7738406eb700e7e9af6adab3 with delete_type TABLET_DATA_DELETED (replaced by tablet e72dc676a2fb4fe98229b8f0767952a9) from {username='slave'} at 127.0.0.1:44960
I20260321 03:02:36.988998 8777 tablet_service.cc:1558] Processing DeleteTablet for tablet 89ae9cb00ef14b5d9d88dfb94a55e5d5 with delete_type TABLET_DATA_DELETED (replaced by tablet 0c90afb0d24a428f846cc2bfc24379ab) from {username='slave'} at 127.0.0.1:44960
I20260321 03:02:36.989142 8776 tablet_service.cc:1558] Processing DeleteTablet for tablet 5e67b5247f19477c9091bd936639f40e with delete_type TABLET_DATA_DELETED (replaced by tablet e55ead2b80354ddf8876a5f8410122a2) from {username='slave'} at 127.0.0.1:44960
I20260321 03:02:36.989181 9590 ts_tablet_manager.cc:1916] T d254157f7738406eb700e7e9af6adab3 P 4532b54a008a4a39b663112e6d0aacc0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260321 03:02:36.989301 8774 tablet_service.cc:1558] Processing DeleteTablet for tablet 60c70af8c0e94b30801ae2437a7f8529 with delete_type TABLET_DATA_DELETED (replaced by tablet 3722d9914162463ba9cd377dee251be0) from {username='slave'} at 127.0.0.1:44960
I20260321 03:02:36.989575 8775 tablet_service.cc:1511] Processing CreateTablet for tablet e72dc676a2fb4fe98229b8f0767952a9 (DEFAULT_TABLE table=default.table_06e0fbe90fe0411d95d76f56b53fb175 [id=c7602cbc743a43239656449386fbeb83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:36.989856 8775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e72dc676a2fb4fe98229b8f0767952a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:36.991048 8506 tablet_service.cc:1511] Processing CreateTablet for tablet e55ead2b80354ddf8876a5f8410122a2 (DEFAULT_TABLE table=default.table_10dd23c6f33c4aa0bad0a534fb770d4a [id=94ef39d020ab428b9e0392bedab9483d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:36.991285 8506 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e55ead2b80354ddf8876a5f8410122a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:36.991657 9590 ts_tablet_manager.cc:1929] T d254157f7738406eb700e7e9af6adab3 P 4532b54a008a4a39b663112e6d0aacc0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260321 03:02:36.991725 9590 log.cc:1199] T d254157f7738406eb700e7e9af6adab3 P 4532b54a008a4a39b663112e6d0aacc0: Deleting WAL directory at /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-0/wal/wals/d254157f7738406eb700e7e9af6adab3
I20260321 03:02:36.992012 9590 ts_tablet_manager.cc:1950] T d254157f7738406eb700e7e9af6adab3 P 4532b54a008a4a39b663112e6d0aacc0: Deleting consensus metadata
I20260321 03:02:36.993114 8775 tablet_service.cc:1511] Processing CreateTablet for tablet 3722d9914162463ba9cd377dee251be0 (DEFAULT_TABLE table=default.table_c8e5202d265f463bbcf568d34a1e64a2 [id=4ac1925a391a48ea86c63da0c1d8c442]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:36.993400 8775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3722d9914162463ba9cd377dee251be0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:36.994501 8774 tablet_service.cc:1511] Processing CreateTablet for tablet e55ead2b80354ddf8876a5f8410122a2 (DEFAULT_TABLE table=default.table_10dd23c6f33c4aa0bad0a534fb770d4a [id=94ef39d020ab428b9e0392bedab9483d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:36.994753 8774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e55ead2b80354ddf8876a5f8410122a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:36.994861 8508 tablet_service.cc:1511] Processing CreateTablet for tablet 0c90afb0d24a428f846cc2bfc24379ab (DEFAULT_TABLE table=default.table_0e0c55f293274457aed5e8d315334903 [id=850c888ac63d4c048f27ceeb1ddd4f83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:36.995127 8508 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c90afb0d24a428f846cc2bfc24379ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:36.995618 8776 tablet_service.cc:1511] Processing CreateTablet for tablet 0c90afb0d24a428f846cc2bfc24379ab (DEFAULT_TABLE table=default.table_0e0c55f293274457aed5e8d315334903 [id=850c888ac63d4c048f27ceeb1ddd4f83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:36.995826 8776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c90afb0d24a428f846cc2bfc24379ab. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7f10eb623364 kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
I20260321 03:02:36.988201 9595 tablet_bootstrap.cc:654] T e72dc676a2fb4fe98229b8f0767952a9 P 70e7666c46844503beb466fdc054a6fc: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:36.994587 8639 tablet_service.cc:1511] Processing CreateTablet for tablet e55ead2b80354ddf8876a5f8410122a2 (DEFAULT_TABLE table=default.table_10dd23c6f33c4aa0bad0a534fb770d4a [id=94ef39d020ab428b9e0392bedab9483d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:36.998663 8639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e55ead2b80354ddf8876a5f8410122a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:36.998989 9592 tablet_bootstrap.cc:492] T e72dc676a2fb4fe98229b8f0767952a9 P 4532b54a008a4a39b663112e6d0aacc0: No bootstrap required, opened a new log
I20260321 03:02:36.999073 9592 ts_tablet_manager.cc:1403] T e72dc676a2fb4fe98229b8f0767952a9 P 4532b54a008a4a39b663112e6d0aacc0: Time spent bootstrapping tablet: real 0.014s user 0.000s sys 0.002s
I20260321 03:02:36.999456 9595 tablet_bootstrap.cc:492] T e72dc676a2fb4fe98229b8f0767952a9 P 70e7666c46844503beb466fdc054a6fc: No bootstrap required, opened a new log
I20260321 03:02:36.999526 9590 tablet_replica.cc:333] T 5e67b5247f19477c9091bd936639f40e P 4532b54a008a4a39b663112e6d0aacc0: stopping tablet replica
I20260321 03:02:36.999619 9272 catalog_manager.cc:5002] TS 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171): tablet d254157f7738406eb700e7e9af6adab3 (table default.table_06e0fbe90fe0411d95d76f56b53fb175 [id=c7602cbc743a43239656449386fbeb83]) successfully deleted
I20260321 03:02:36.999652 9590 raft_consensus.cc:2243] T 5e67b5247f19477c9091bd936639f40e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 LEADER]: Raft consensus shutting down.
I20260321 03:02:36.999675 9592 raft_consensus.cc:359] T e72dc676a2fb4fe98229b8f0767952a9 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } }
I20260321 03:02:36.999817 9592 raft_consensus.cc:385] T e72dc676a2fb4fe98229b8f0767952a9 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:36.999811 9595 ts_tablet_manager.cc:1403] T e72dc676a2fb4fe98229b8f0767952a9 P 70e7666c46844503beb466fdc054a6fc: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.000s
I20260321 03:02:36.999841 9590 raft_consensus.cc:2272] T 5e67b5247f19477c9091bd936639f40e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260321 03:02:36.997689 9591 tablet_replica.cc:333] T d254157f7738406eb700e7e9af6adab3 P 70e7666c46844503beb466fdc054a6fc: stopping tablet replica
I20260321 03:02:36.995599 8645 tablet_service.cc:1511] Processing CreateTablet for tablet 0c90afb0d24a428f846cc2bfc24379ab (DEFAULT_TABLE table=default.table_0e0c55f293274457aed5e8d315334903 [id=850c888ac63d4c048f27ceeb1ddd4f83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:37.000072 9591 raft_consensus.cc:2243] T d254157f7738406eb700e7e9af6adab3 P 70e7666c46844503beb466fdc054a6fc [term 1 LEADER]: Raft consensus shutting down.
I20260321 03:02:37.000221 8645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c90afb0d24a428f846cc2bfc24379ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:37.000262 9591 raft_consensus.cc:2272] T d254157f7738406eb700e7e9af6adab3 P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260321 03:02:37.000277 9590 ts_tablet_manager.cc:1916] T 5e67b5247f19477c9091bd936639f40e P 4532b54a008a4a39b663112e6d0aacc0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260321 03:02:37.000656 9591 ts_tablet_manager.cc:1916] T d254157f7738406eb700e7e9af6adab3 P 70e7666c46844503beb466fdc054a6fc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260321 03:02:36.990152 8642 tablet_service.cc:1511] Processing CreateTablet for tablet 3722d9914162463ba9cd377dee251be0 (DEFAULT_TABLE table=default.table_c8e5202d265f463bbcf568d34a1e64a2 [id=4ac1925a391a48ea86c63da0c1d8c442]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:37.002607 9590 ts_tablet_manager.cc:1929] T 5e67b5247f19477c9091bd936639f40e P 4532b54a008a4a39b663112e6d0aacc0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260321 03:02:37.002673 9590 log.cc:1199] T 5e67b5247f19477c9091bd936639f40e P 4532b54a008a4a39b663112e6d0aacc0: Deleting WAL directory at /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-0/wal/wals/5e67b5247f19477c9091bd936639f40e
I20260321 03:02:37.002687 8642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3722d9914162463ba9cd377dee251be0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:37.002939 9590 ts_tablet_manager.cc:1950] T 5e67b5247f19477c9091bd936639f40e P 4532b54a008a4a39b663112e6d0aacc0: Deleting consensus metadata
I20260321 03:02:37.003144 9591 ts_tablet_manager.cc:1929] T d254157f7738406eb700e7e9af6adab3 P 70e7666c46844503beb466fdc054a6fc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260321 03:02:37.003218 9591 log.cc:1199] T d254157f7738406eb700e7e9af6adab3 P 70e7666c46844503beb466fdc054a6fc: Deleting WAL directory at /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-1/wal/wals/d254157f7738406eb700e7e9af6adab3
@ 0x7f10eb622ac7 _ZZN4kudu6master30HmsNotificationLogListenerTask4InitEvENKUlvE_clEv at ??:0
I20260321 03:02:37.003638 9590 tablet_replica.cc:333] T 60c70af8c0e94b30801ae2437a7f8529 P 4532b54a008a4a39b663112e6d0aacc0: stopping tablet replica
I20260321 03:02:37.003697 9591 ts_tablet_manager.cc:1950] T d254157f7738406eb700e7e9af6adab3 P 70e7666c46844503beb466fdc054a6fc: Deleting consensus metadata
I20260321 03:02:37.003762 9590 raft_consensus.cc:2243] T 60c70af8c0e94b30801ae2437a7f8529 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 LEADER]: Raft consensus shutting down.
I20260321 03:02:37.003959 9590 raft_consensus.cc:2272] T 60c70af8c0e94b30801ae2437a7f8529 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260321 03:02:37.004326 9590 ts_tablet_manager.cc:1916] T 60c70af8c0e94b30801ae2437a7f8529 P 4532b54a008a4a39b663112e6d0aacc0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260321 03:02:37.004372 9591 tablet_replica.cc:333] T 60c70af8c0e94b30801ae2437a7f8529 P 70e7666c46844503beb466fdc054a6fc: stopping tablet replica
I20260321 03:02:37.004508 9591 raft_consensus.cc:2243] T 60c70af8c0e94b30801ae2437a7f8529 P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260321 03:02:37.004631 9591 raft_consensus.cc:2272] T 60c70af8c0e94b30801ae2437a7f8529 P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260321 03:02:37.004735 9272 catalog_manager.cc:5002] TS 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171): tablet 5e67b5247f19477c9091bd936639f40e (table default.table_10dd23c6f33c4aa0bad0a534fb770d4a [id=94ef39d020ab428b9e0392bedab9483d]) successfully deleted
I20260321 03:02:37.005071 9591 ts_tablet_manager.cc:1916] T 60c70af8c0e94b30801ae2437a7f8529 P 70e7666c46844503beb466fdc054a6fc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260321 03:02:37.005153 9271 catalog_manager.cc:5002] TS 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): tablet d254157f7738406eb700e7e9af6adab3 (table default.table_06e0fbe90fe0411d95d76f56b53fb175 [id=c7602cbc743a43239656449386fbeb83]) successfully deleted
I20260321 03:02:36.999852 9592 raft_consensus.cc:740] T e72dc676a2fb4fe98229b8f0767952a9 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4532b54a008a4a39b663112e6d0aacc0, State: Initialized, Role: FOLLOWER
I20260321 03:02:37.005481 9592 consensus_queue.cc:260] T e72dc676a2fb4fe98229b8f0767952a9 P 4532b54a008a4a39b663112e6d0aacc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } }
I20260321 03:02:37.005528 9595 raft_consensus.cc:359] T e72dc676a2fb4fe98229b8f0767952a9 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } }
I20260321 03:02:37.005614 9595 raft_consensus.cc:385] T e72dc676a2fb4fe98229b8f0767952a9 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:37.005647 9595 raft_consensus.cc:740] T e72dc676a2fb4fe98229b8f0767952a9 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70e7666c46844503beb466fdc054a6fc, State: Initialized, Role: FOLLOWER
I20260321 03:02:37.005810 9592 ts_tablet_manager.cc:1434] T e72dc676a2fb4fe98229b8f0767952a9 P 4532b54a008a4a39b663112e6d0aacc0: Time spent starting tablet: real 0.007s user 0.000s sys 0.001s
I20260321 03:02:37.005784 9595 consensus_queue.cc:260] T e72dc676a2fb4fe98229b8f0767952a9 P 70e7666c46844503beb466fdc054a6fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } }
I20260321 03:02:37.006014 9592 tablet_bootstrap.cc:492] T 3722d9914162463ba9cd377dee251be0 P 4532b54a008a4a39b663112e6d0aacc0: Bootstrap starting.
I20260321 03:02:37.007436 9591 ts_tablet_manager.cc:1929] T 60c70af8c0e94b30801ae2437a7f8529 P 70e7666c46844503beb466fdc054a6fc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260321 03:02:37.007500 9591 log.cc:1199] T 60c70af8c0e94b30801ae2437a7f8529 P 70e7666c46844503beb466fdc054a6fc: Deleting WAL directory at /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-1/wal/wals/60c70af8c0e94b30801ae2437a7f8529
I20260321 03:02:37.007761 9591 ts_tablet_manager.cc:1950] T 60c70af8c0e94b30801ae2437a7f8529 P 70e7666c46844503beb466fdc054a6fc: Deleting consensus metadata
I20260321 03:02:37.008462 9592 tablet_bootstrap.cc:654] T 3722d9914162463ba9cd377dee251be0 P 4532b54a008a4a39b663112e6d0aacc0: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:37.008675 9595 ts_tablet_manager.cc:1434] T e72dc676a2fb4fe98229b8f0767952a9 P 70e7666c46844503beb466fdc054a6fc: Time spent starting tablet: real 0.009s user 0.001s sys 0.000s
I20260321 03:02:37.010236 9591 tablet_replica.cc:333] T 89ae9cb00ef14b5d9d88dfb94a55e5d5 P 70e7666c46844503beb466fdc054a6fc: stopping tablet replica
I20260321 03:02:37.010316 9271 catalog_manager.cc:5002] TS 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): tablet 60c70af8c0e94b30801ae2437a7f8529 (table default.table_c8e5202d265f463bbcf568d34a1e64a2 [id=4ac1925a391a48ea86c63da0c1d8c442]) successfully deleted
I20260321 03:02:37.010370 9591 raft_consensus.cc:2243] T 89ae9cb00ef14b5d9d88dfb94a55e5d5 P 70e7666c46844503beb466fdc054a6fc [term 1 LEADER]: Raft consensus shutting down.
@ 0x7f10eb6281ce _ZNSt17_Function_handlerIFvvEZN4kudu6master30HmsNotificationLogListenerTask4InitEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
I20260321 03:02:37.010612 9591 raft_consensus.cc:2272] T 89ae9cb00ef14b5d9d88dfb94a55e5d5 P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260321 03:02:37.011018 9591 ts_tablet_manager.cc:1916] T 89ae9cb00ef14b5d9d88dfb94a55e5d5 P 70e7666c46844503beb466fdc054a6fc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260321 03:02:37.011241 9595 tablet_bootstrap.cc:492] T e55ead2b80354ddf8876a5f8410122a2 P 70e7666c46844503beb466fdc054a6fc: Bootstrap starting.
@ 0x5563dcda218a std::function<>::operator()() at ??:0
I20260321 03:02:37.012363 9595 tablet_bootstrap.cc:654] T e55ead2b80354ddf8876a5f8410122a2 P 70e7666c46844503beb466fdc054a6fc: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:37.013605 9592 tablet_bootstrap.cc:492] T 3722d9914162463ba9cd377dee251be0 P 4532b54a008a4a39b663112e6d0aacc0: No bootstrap required, opened a new log
I20260321 03:02:37.013693 9596 tablet_replica.cc:333] T d254157f7738406eb700e7e9af6adab3 P a97f7dd77cf2444f8fdb441019081f79: stopping tablet replica
I20260321 03:02:37.013696 9592 ts_tablet_manager.cc:1403] T 3722d9914162463ba9cd377dee251be0 P 4532b54a008a4a39b663112e6d0aacc0: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.002s
I20260321 03:02:37.013764 9595 tablet_bootstrap.cc:492] T e55ead2b80354ddf8876a5f8410122a2 P 70e7666c46844503beb466fdc054a6fc: No bootstrap required, opened a new log
I20260321 03:02:37.013844 9596 raft_consensus.cc:2243] T d254157f7738406eb700e7e9af6adab3 P a97f7dd77cf2444f8fdb441019081f79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260321 03:02:37.013855 9595 ts_tablet_manager.cc:1403] T e55ead2b80354ddf8876a5f8410122a2 P 70e7666c46844503beb466fdc054a6fc: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260321 03:02:37.013985 9596 raft_consensus.cc:2272] T d254157f7738406eb700e7e9af6adab3 P a97f7dd77cf2444f8fdb441019081f79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260321 03:02:37.014261 9592 raft_consensus.cc:359] T 3722d9914162463ba9cd377dee251be0 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:37.014379 9592 raft_consensus.cc:385] T 3722d9914162463ba9cd377dee251be0 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:37.014413 9592 raft_consensus.cc:740] T 3722d9914162463ba9cd377dee251be0 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4532b54a008a4a39b663112e6d0aacc0, State: Initialized, Role: FOLLOWER
I20260321 03:02:37.014441 9596 ts_tablet_manager.cc:1916] T d254157f7738406eb700e7e9af6adab3 P a97f7dd77cf2444f8fdb441019081f79: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260321 03:02:37.014470 9595 raft_consensus.cc:359] T e55ead2b80354ddf8876a5f8410122a2 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:37.014604 9595 raft_consensus.cc:385] T e55ead2b80354ddf8876a5f8410122a2 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:37.014590 9592 consensus_queue.cc:260] T 3722d9914162463ba9cd377dee251be0 P 4532b54a008a4a39b663112e6d0aacc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:37.014647 9595 raft_consensus.cc:740] T e55ead2b80354ddf8876a5f8410122a2 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70e7666c46844503beb466fdc054a6fc, State: Initialized, Role: FOLLOWER
I20260321 03:02:37.014813 9595 consensus_queue.cc:260] T e55ead2b80354ddf8876a5f8410122a2 P 70e7666c46844503beb466fdc054a6fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:37.014878 9592 ts_tablet_manager.cc:1434] T 3722d9914162463ba9cd377dee251be0 P 4532b54a008a4a39b663112e6d0aacc0: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260321 03:02:37.015905 9595 ts_tablet_manager.cc:1434] T e55ead2b80354ddf8876a5f8410122a2 P 70e7666c46844503beb466fdc054a6fc: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260321 03:02:37.016101 9595 tablet_bootstrap.cc:492] T 0c90afb0d24a428f846cc2bfc24379ab P 70e7666c46844503beb466fdc054a6fc: Bootstrap starting.
I20260321 03:02:37.016614 9597 tablet_bootstrap.cc:492] T e72dc676a2fb4fe98229b8f0767952a9 P a97f7dd77cf2444f8fdb441019081f79: Bootstrap starting.
I20260321 03:02:37.016741 9592 tablet_bootstrap.cc:492] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0: Bootstrap starting.
I20260321 03:02:37.017339 9595 tablet_bootstrap.cc:654] T 0c90afb0d24a428f846cc2bfc24379ab P 70e7666c46844503beb466fdc054a6fc: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:37.017649 9597 tablet_bootstrap.cc:654] T e72dc676a2fb4fe98229b8f0767952a9 P a97f7dd77cf2444f8fdb441019081f79: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:37.019034 9592 tablet_bootstrap.cc:654] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0: Neither blocks nor log segments found. Creating new log.
@ 0x7f10e7950028 kudu::Thread::SuperviseThread() at ??:0
I20260321 03:02:37.020061 9596 ts_tablet_manager.cc:1929] T d254157f7738406eb700e7e9af6adab3 P a97f7dd77cf2444f8fdb441019081f79: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260321 03:02:37.020126 9596 log.cc:1199] T d254157f7738406eb700e7e9af6adab3 P a97f7dd77cf2444f8fdb441019081f79: Deleting WAL directory at /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-2/wal/wals/d254157f7738406eb700e7e9af6adab3
I20260321 03:02:37.020150 9597 tablet_bootstrap.cc:492] T e72dc676a2fb4fe98229b8f0767952a9 P a97f7dd77cf2444f8fdb441019081f79: No bootstrap required, opened a new log
I20260321 03:02:37.020228 9597 ts_tablet_manager.cc:1403] T e72dc676a2fb4fe98229b8f0767952a9 P a97f7dd77cf2444f8fdb441019081f79: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260321 03:02:37.020714 9596 ts_tablet_manager.cc:1950] T d254157f7738406eb700e7e9af6adab3 P a97f7dd77cf2444f8fdb441019081f79: Deleting consensus metadata
I20260321 03:02:37.020825 9597 raft_consensus.cc:359] T e72dc676a2fb4fe98229b8f0767952a9 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } }
I20260321 03:02:37.020931 9597 raft_consensus.cc:385] T e72dc676a2fb4fe98229b8f0767952a9 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:37.020962 9597 raft_consensus.cc:740] T e72dc676a2fb4fe98229b8f0767952a9 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a97f7dd77cf2444f8fdb441019081f79, State: Initialized, Role: FOLLOWER
I20260321 03:02:37.021137 9597 consensus_queue.cc:260] T e72dc676a2fb4fe98229b8f0767952a9 P a97f7dd77cf2444f8fdb441019081f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } }
I20260321 03:02:37.013440 9591 ts_tablet_manager.cc:1929] T 89ae9cb00ef14b5d9d88dfb94a55e5d5 P 70e7666c46844503beb466fdc054a6fc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260321 03:02:37.021417 9591 log.cc:1199] T 89ae9cb00ef14b5d9d88dfb94a55e5d5 P 70e7666c46844503beb466fdc054a6fc: Deleting WAL directory at /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-1/wal/wals/89ae9cb00ef14b5d9d88dfb94a55e5d5
I20260321 03:02:37.021677 9591 ts_tablet_manager.cc:1950] T 89ae9cb00ef14b5d9d88dfb94a55e5d5 P 70e7666c46844503beb466fdc054a6fc: Deleting consensus metadata
I20260321 03:02:37.022239 9597 ts_tablet_manager.cc:1434] T e72dc676a2fb4fe98229b8f0767952a9 P a97f7dd77cf2444f8fdb441019081f79: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260321 03:02:37.022490 9597 tablet_bootstrap.cc:492] T e55ead2b80354ddf8876a5f8410122a2 P a97f7dd77cf2444f8fdb441019081f79: Bootstrap starting.
@ 0x7f10e81376db start_thread at ??:0
I20260321 03:02:37.024181 9591 tablet_replica.cc:333] T 5e67b5247f19477c9091bd936639f40e P 70e7666c46844503beb466fdc054a6fc: stopping tablet replica
I20260321 03:02:37.024194 9595 tablet_bootstrap.cc:492] T 0c90afb0d24a428f846cc2bfc24379ab P 70e7666c46844503beb466fdc054a6fc: No bootstrap required, opened a new log
I20260321 03:02:37.024348 9595 ts_tablet_manager.cc:1403] T 0c90afb0d24a428f846cc2bfc24379ab P 70e7666c46844503beb466fdc054a6fc: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.002s
I20260321 03:02:37.024485 9271 catalog_manager.cc:5002] TS 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): tablet 89ae9cb00ef14b5d9d88dfb94a55e5d5 (table default.table_0e0c55f293274457aed5e8d315334903 [id=850c888ac63d4c048f27ceeb1ddd4f83]) successfully deleted
I20260321 03:02:37.024988 9595 raft_consensus.cc:359] T 0c90afb0d24a428f846cc2bfc24379ab P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:37.025125 9595 raft_consensus.cc:385] T 0c90afb0d24a428f846cc2bfc24379ab P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:37.025167 9595 raft_consensus.cc:740] T 0c90afb0d24a428f846cc2bfc24379ab P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70e7666c46844503beb466fdc054a6fc, State: Initialized, Role: FOLLOWER
@ 0x7f10e560261f clone at ??:0
I20260321 03:02:37.025368 9595 consensus_queue.cc:260] T 0c90afb0d24a428f846cc2bfc24379ab P 70e7666c46844503beb466fdc054a6fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:37.024351 9591 raft_consensus.cc:2243] T 5e67b5247f19477c9091bd936639f40e P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260321 03:02:37.025913 9591 raft_consensus.cc:2272] T 5e67b5247f19477c9091bd936639f40e P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260321 03:02:37.026489 9591 ts_tablet_manager.cc:1916] T 5e67b5247f19477c9091bd936639f40e P 70e7666c46844503beb466fdc054a6fc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260321 03:02:37.026957 9595 ts_tablet_manager.cc:1434] T 0c90afb0d24a428f846cc2bfc24379ab P 70e7666c46844503beb466fdc054a6fc: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260321 03:02:37.027216 9595 tablet_bootstrap.cc:492] T 3722d9914162463ba9cd377dee251be0 P 70e7666c46844503beb466fdc054a6fc: Bootstrap starting.
I20260321 03:02:37.027753 9596 tablet_replica.cc:333] T 89ae9cb00ef14b5d9d88dfb94a55e5d5 P a97f7dd77cf2444f8fdb441019081f79: stopping tablet replica
I20260321 03:02:37.027895 9596 raft_consensus.cc:2243] T 89ae9cb00ef14b5d9d88dfb94a55e5d5 P a97f7dd77cf2444f8fdb441019081f79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260321 03:02:37.028012 9596 raft_consensus.cc:2272] T 89ae9cb00ef14b5d9d88dfb94a55e5d5 P a97f7dd77cf2444f8fdb441019081f79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260321 03:02:37.028486 9596 ts_tablet_manager.cc:1916] T 89ae9cb00ef14b5d9d88dfb94a55e5d5 P a97f7dd77cf2444f8fdb441019081f79: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260321 03:02:37.028609 9595 tablet_bootstrap.cc:654] T 3722d9914162463ba9cd377dee251be0 P 70e7666c46844503beb466fdc054a6fc: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:37.030206 9592 tablet_bootstrap.cc:492] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0: No bootstrap required, opened a new log
I20260321 03:02:37.030328 9592 ts_tablet_manager.cc:1403] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.000s
I20260321 03:02:37.030911 9592 raft_consensus.cc:359] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:37.031164 9592 raft_consensus.cc:385] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:37.031229 9592 raft_consensus.cc:740] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4532b54a008a4a39b663112e6d0aacc0, State: Initialized, Role: FOLLOWER
I20260321 03:02:37.031424 9592 consensus_queue.cc:260] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:37.032042 9591 ts_tablet_manager.cc:1929] T 5e67b5247f19477c9091bd936639f40e P 70e7666c46844503beb466fdc054a6fc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260321 03:02:37.032114 9591 log.cc:1199] T 5e67b5247f19477c9091bd936639f40e P 70e7666c46844503beb466fdc054a6fc: Deleting WAL directory at /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-1/wal/wals/5e67b5247f19477c9091bd936639f40e
I20260321 03:02:37.032491 9591 ts_tablet_manager.cc:1950] T 5e67b5247f19477c9091bd936639f40e P 70e7666c46844503beb466fdc054a6fc: Deleting consensus metadata
I20260321 03:02:37.032629 9592 ts_tablet_manager.cc:1434] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260321 03:02:37.030054 9590 ts_tablet_manager.cc:1929] T 60c70af8c0e94b30801ae2437a7f8529 P 4532b54a008a4a39b663112e6d0aacc0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260321 03:02:37.032778 9590 log.cc:1199] T 60c70af8c0e94b30801ae2437a7f8529 P 4532b54a008a4a39b663112e6d0aacc0: Deleting WAL directory at /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-0/wal/wals/60c70af8c0e94b30801ae2437a7f8529
I20260321 03:02:37.033047 9590 ts_tablet_manager.cc:1950] T 60c70af8c0e94b30801ae2437a7f8529 P 4532b54a008a4a39b663112e6d0aacc0: Deleting consensus metadata
I20260321 03:02:37.033790 9590 tablet_replica.cc:333] T 89ae9cb00ef14b5d9d88dfb94a55e5d5 P 4532b54a008a4a39b663112e6d0aacc0: stopping tablet replica
I20260321 03:02:37.033840 9592 tablet_bootstrap.cc:492] T 0c90afb0d24a428f846cc2bfc24379ab P 4532b54a008a4a39b663112e6d0aacc0: Bootstrap starting.
I20260321 03:02:37.033914 9590 raft_consensus.cc:2243] T 89ae9cb00ef14b5d9d88dfb94a55e5d5 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260321 03:02:37.034014 9590 raft_consensus.cc:2272] T 89ae9cb00ef14b5d9d88dfb94a55e5d5 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260321 03:02:37.034473 9590 ts_tablet_manager.cc:1916] T 89ae9cb00ef14b5d9d88dfb94a55e5d5 P 4532b54a008a4a39b663112e6d0aacc0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260321 03:02:37.034937 9592 tablet_bootstrap.cc:654] T 0c90afb0d24a428f846cc2bfc24379ab P 4532b54a008a4a39b663112e6d0aacc0: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:37.036897 9597 tablet_bootstrap.cc:654] T e55ead2b80354ddf8876a5f8410122a2 P a97f7dd77cf2444f8fdb441019081f79: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:37.037381 9590 ts_tablet_manager.cc:1929] T 89ae9cb00ef14b5d9d88dfb94a55e5d5 P 4532b54a008a4a39b663112e6d0aacc0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260321 03:02:37.037451 9590 log.cc:1199] T 89ae9cb00ef14b5d9d88dfb94a55e5d5 P 4532b54a008a4a39b663112e6d0aacc0: Deleting WAL directory at /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-0/wal/wals/89ae9cb00ef14b5d9d88dfb94a55e5d5
I20260321 03:02:37.037696 9590 ts_tablet_manager.cc:1950] T 89ae9cb00ef14b5d9d88dfb94a55e5d5 P 4532b54a008a4a39b663112e6d0aacc0: Deleting consensus metadata
I20260321 03:02:37.038684 9595 tablet_bootstrap.cc:492] T 3722d9914162463ba9cd377dee251be0 P 70e7666c46844503beb466fdc054a6fc: No bootstrap required, opened a new log
I20260321 03:02:37.038784 9595 ts_tablet_manager.cc:1403] T 3722d9914162463ba9cd377dee251be0 P 70e7666c46844503beb466fdc054a6fc: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.001s
I20260321 03:02:37.039749 9596 ts_tablet_manager.cc:1929] T 89ae9cb00ef14b5d9d88dfb94a55e5d5 P a97f7dd77cf2444f8fdb441019081f79: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260321 03:02:37.039785 9592 tablet_bootstrap.cc:492] T 0c90afb0d24a428f846cc2bfc24379ab P 4532b54a008a4a39b663112e6d0aacc0: No bootstrap required, opened a new log
I20260321 03:02:37.039824 9596 log.cc:1199] T 89ae9cb00ef14b5d9d88dfb94a55e5d5 P a97f7dd77cf2444f8fdb441019081f79: Deleting WAL directory at /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-2/wal/wals/89ae9cb00ef14b5d9d88dfb94a55e5d5
I20260321 03:02:37.039866 9592 ts_tablet_manager.cc:1403] T 0c90afb0d24a428f846cc2bfc24379ab P 4532b54a008a4a39b663112e6d0aacc0: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.001s
I20260321 03:02:37.040086 9596 ts_tablet_manager.cc:1950] T 89ae9cb00ef14b5d9d88dfb94a55e5d5 P a97f7dd77cf2444f8fdb441019081f79: Deleting consensus metadata
I20260321 03:02:37.040412 9592 raft_consensus.cc:359] T 0c90afb0d24a428f846cc2bfc24379ab P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:37.040519 9592 raft_consensus.cc:385] T 0c90afb0d24a428f846cc2bfc24379ab P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:37.040551 9592 raft_consensus.cc:740] T 0c90afb0d24a428f846cc2bfc24379ab P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4532b54a008a4a39b663112e6d0aacc0, State: Initialized, Role: FOLLOWER
I20260321 03:02:37.040678 9592 consensus_queue.cc:260] T 0c90afb0d24a428f846cc2bfc24379ab P 4532b54a008a4a39b663112e6d0aacc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:37.040813 9596 tablet_replica.cc:333] T 5e67b5247f19477c9091bd936639f40e P a97f7dd77cf2444f8fdb441019081f79: stopping tablet replica
I20260321 03:02:37.040920 9596 raft_consensus.cc:2243] T 5e67b5247f19477c9091bd936639f40e P a97f7dd77cf2444f8fdb441019081f79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260321 03:02:37.040961 9592 ts_tablet_manager.cc:1434] T 0c90afb0d24a428f846cc2bfc24379ab P 4532b54a008a4a39b663112e6d0aacc0: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20260321 03:02:37.041023 9596 raft_consensus.cc:2272] T 5e67b5247f19477c9091bd936639f40e P a97f7dd77cf2444f8fdb441019081f79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260321 03:02:37.041428 9596 ts_tablet_manager.cc:1916] T 5e67b5247f19477c9091bd936639f40e P a97f7dd77cf2444f8fdb441019081f79: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260321 03:02:37.043220 9595 raft_consensus.cc:359] T 3722d9914162463ba9cd377dee251be0 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:37.043352 9595 raft_consensus.cc:385] T 3722d9914162463ba9cd377dee251be0 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:37.043390 9595 raft_consensus.cc:740] T 3722d9914162463ba9cd377dee251be0 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70e7666c46844503beb466fdc054a6fc, State: Initialized, Role: FOLLOWER
I20260321 03:02:37.043569 9596 ts_tablet_manager.cc:1929] T 5e67b5247f19477c9091bd936639f40e P a97f7dd77cf2444f8fdb441019081f79: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260321 03:02:37.043560 9595 consensus_queue.cc:260] T 3722d9914162463ba9cd377dee251be0 P 70e7666c46844503beb466fdc054a6fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:37.043628 9596 log.cc:1199] T 5e67b5247f19477c9091bd936639f40e P a97f7dd77cf2444f8fdb441019081f79: Deleting WAL directory at /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-2/wal/wals/5e67b5247f19477c9091bd936639f40e
I20260321 03:02:37.043879 9596 ts_tablet_manager.cc:1950] T 5e67b5247f19477c9091bd936639f40e P a97f7dd77cf2444f8fdb441019081f79: Deleting consensus metadata
I20260321 03:02:37.044597 9597 tablet_bootstrap.cc:492] T e55ead2b80354ddf8876a5f8410122a2 P a97f7dd77cf2444f8fdb441019081f79: No bootstrap required, opened a new log
I20260321 03:02:37.044682 9597 ts_tablet_manager.cc:1403] T e55ead2b80354ddf8876a5f8410122a2 P a97f7dd77cf2444f8fdb441019081f79: Time spent bootstrapping tablet: real 0.022s user 0.002s sys 0.000s
I20260321 03:02:37.045168 9597 raft_consensus.cc:359] T e55ead2b80354ddf8876a5f8410122a2 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:37.045296 9597 raft_consensus.cc:385] T e55ead2b80354ddf8876a5f8410122a2 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:37.045331 9597 raft_consensus.cc:740] T e55ead2b80354ddf8876a5f8410122a2 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a97f7dd77cf2444f8fdb441019081f79, State: Initialized, Role: FOLLOWER
I20260321 03:02:37.045461 9597 consensus_queue.cc:260] T e55ead2b80354ddf8876a5f8410122a2 P a97f7dd77cf2444f8fdb441019081f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:37.045730 9597 ts_tablet_manager.cc:1434] T e55ead2b80354ddf8876a5f8410122a2 P a97f7dd77cf2444f8fdb441019081f79: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260321 03:02:37.045957 9597 tablet_bootstrap.cc:492] T 0c90afb0d24a428f846cc2bfc24379ab P a97f7dd77cf2444f8fdb441019081f79: Bootstrap starting.
I20260321 03:02:37.046885 9595 ts_tablet_manager.cc:1434] T 3722d9914162463ba9cd377dee251be0 P 70e7666c46844503beb466fdc054a6fc: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260321 03:02:37.048599 9597 tablet_bootstrap.cc:654] T 0c90afb0d24a428f846cc2bfc24379ab P a97f7dd77cf2444f8fdb441019081f79: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:37.049458 9596 tablet_replica.cc:333] T 60c70af8c0e94b30801ae2437a7f8529 P a97f7dd77cf2444f8fdb441019081f79: stopping tablet replica
I20260321 03:02:37.049597 9596 raft_consensus.cc:2243] T 60c70af8c0e94b30801ae2437a7f8529 P a97f7dd77cf2444f8fdb441019081f79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260321 03:02:37.049713 9596 raft_consensus.cc:2272] T 60c70af8c0e94b30801ae2437a7f8529 P a97f7dd77cf2444f8fdb441019081f79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260321 03:02:37.049962 9597 tablet_bootstrap.cc:492] T 0c90afb0d24a428f846cc2bfc24379ab P a97f7dd77cf2444f8fdb441019081f79: No bootstrap required, opened a new log
I20260321 03:02:37.050050 9597 ts_tablet_manager.cc:1403] T 0c90afb0d24a428f846cc2bfc24379ab P a97f7dd77cf2444f8fdb441019081f79: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260321 03:02:37.050082 9596 ts_tablet_manager.cc:1916] T 60c70af8c0e94b30801ae2437a7f8529 P a97f7dd77cf2444f8fdb441019081f79: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260321 03:02:37.050515 9597 raft_consensus.cc:359] T 0c90afb0d24a428f846cc2bfc24379ab P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:37.050593 9597 raft_consensus.cc:385] T 0c90afb0d24a428f846cc2bfc24379ab P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:37.050613 9597 raft_consensus.cc:740] T 0c90afb0d24a428f846cc2bfc24379ab P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a97f7dd77cf2444f8fdb441019081f79, State: Initialized, Role: FOLLOWER
I20260321 03:02:37.050767 9597 consensus_queue.cc:260] T 0c90afb0d24a428f846cc2bfc24379ab P a97f7dd77cf2444f8fdb441019081f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:37.051033 9597 ts_tablet_manager.cc:1434] T 0c90afb0d24a428f846cc2bfc24379ab P a97f7dd77cf2444f8fdb441019081f79: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260321 03:02:37.051218 9597 tablet_bootstrap.cc:492] T 3722d9914162463ba9cd377dee251be0 P a97f7dd77cf2444f8fdb441019081f79: Bootstrap starting.
I20260321 03:02:37.052284 9597 tablet_bootstrap.cc:654] T 3722d9914162463ba9cd377dee251be0 P a97f7dd77cf2444f8fdb441019081f79: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:37.052487 9596 ts_tablet_manager.cc:1929] T 60c70af8c0e94b30801ae2437a7f8529 P a97f7dd77cf2444f8fdb441019081f79: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260321 03:02:37.052563 9596 log.cc:1199] T 60c70af8c0e94b30801ae2437a7f8529 P a97f7dd77cf2444f8fdb441019081f79: Deleting WAL directory at /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-2/wal/wals/60c70af8c0e94b30801ae2437a7f8529
I20260321 03:02:37.052817 9596 ts_tablet_manager.cc:1950] T 60c70af8c0e94b30801ae2437a7f8529 P a97f7dd77cf2444f8fdb441019081f79: Deleting consensus metadata
I20260321 03:02:37.053908 9597 tablet_bootstrap.cc:492] T 3722d9914162463ba9cd377dee251be0 P a97f7dd77cf2444f8fdb441019081f79: No bootstrap required, opened a new log
I20260321 03:02:37.053995 9597 ts_tablet_manager.cc:1403] T 3722d9914162463ba9cd377dee251be0 P a97f7dd77cf2444f8fdb441019081f79: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260321 03:02:37.054507 9597 raft_consensus.cc:359] T 3722d9914162463ba9cd377dee251be0 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:37.054615 9597 raft_consensus.cc:385] T 3722d9914162463ba9cd377dee251be0 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:37.054647 9597 raft_consensus.cc:740] T 3722d9914162463ba9cd377dee251be0 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a97f7dd77cf2444f8fdb441019081f79, State: Initialized, Role: FOLLOWER
I20260321 03:02:37.054795 9597 consensus_queue.cc:260] T 3722d9914162463ba9cd377dee251be0 P a97f7dd77cf2444f8fdb441019081f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:37.055258 9597 ts_tablet_manager.cc:1434] T 3722d9914162463ba9cd377dee251be0 P a97f7dd77cf2444f8fdb441019081f79: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260321 03:02:37.087051 9192 raft_consensus.cc:493] T 3722d9914162463ba9cd377dee251be0 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260321 03:02:37.087283 9192 raft_consensus.cc:515] T 3722d9914162463ba9cd377dee251be0 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:37.087919 9192 leader_election.cc:290] T 3722d9914162463ba9cd377dee251be0 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
I20260321 03:02:37.088456 8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3722d9914162463ba9cd377dee251be0" candidate_uuid: "4532b54a008a4a39b663112e6d0aacc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a97f7dd77cf2444f8fdb441019081f79" is_pre_election: true
I20260321 03:02:37.088497 8667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3722d9914162463ba9cd377dee251be0" candidate_uuid: "4532b54a008a4a39b663112e6d0aacc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70e7666c46844503beb466fdc054a6fc" is_pre_election: true
I20260321 03:02:37.088630 8803 raft_consensus.cc:2468] T 3722d9914162463ba9cd377dee251be0 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4532b54a008a4a39b663112e6d0aacc0 in term 0.
I20260321 03:02:37.088654 8667 raft_consensus.cc:2468] T 3722d9914162463ba9cd377dee251be0 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4532b54a008a4a39b663112e6d0aacc0 in term 0.
I20260321 03:02:37.089042 8466 leader_election.cc:304] T 3722d9914162463ba9cd377dee251be0 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0, 70e7666c46844503beb466fdc054a6fc; no voters:
I20260321 03:02:37.089296 9192 raft_consensus.cc:2804] T 3722d9914162463ba9cd377dee251be0 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260321 03:02:37.089373 9192 raft_consensus.cc:493] T 3722d9914162463ba9cd377dee251be0 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260321 03:02:37.089424 9192 raft_consensus.cc:3060] T 3722d9914162463ba9cd377dee251be0 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:37.090308 9192 raft_consensus.cc:515] T 3722d9914162463ba9cd377dee251be0 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:37.090740 9192 leader_election.cc:290] T 3722d9914162463ba9cd377dee251be0 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 1 election: Requested vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
I20260321 03:02:37.091151 8667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3722d9914162463ba9cd377dee251be0" candidate_uuid: "4532b54a008a4a39b663112e6d0aacc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70e7666c46844503beb466fdc054a6fc"
I20260321 03:02:37.091221 8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3722d9914162463ba9cd377dee251be0" candidate_uuid: "4532b54a008a4a39b663112e6d0aacc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a97f7dd77cf2444f8fdb441019081f79"
I20260321 03:02:37.091303 8667 raft_consensus.cc:3060] T 3722d9914162463ba9cd377dee251be0 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:37.091364 8803 raft_consensus.cc:3060] T 3722d9914162463ba9cd377dee251be0 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:37.092303 8803 raft_consensus.cc:2468] T 3722d9914162463ba9cd377dee251be0 P a97f7dd77cf2444f8fdb441019081f79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4532b54a008a4a39b663112e6d0aacc0 in term 1.
I20260321 03:02:37.092303 8667 raft_consensus.cc:2468] T 3722d9914162463ba9cd377dee251be0 P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4532b54a008a4a39b663112e6d0aacc0 in term 1.
I20260321 03:02:37.092675 8466 leader_election.cc:304] T 3722d9914162463ba9cd377dee251be0 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0, 70e7666c46844503beb466fdc054a6fc; no voters:
I20260321 03:02:37.092870 9192 raft_consensus.cc:2804] T 3722d9914162463ba9cd377dee251be0 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader election won for term 1
I20260321 03:02:37.093093 9192 raft_consensus.cc:697] T 3722d9914162463ba9cd377dee251be0 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 LEADER]: Becoming Leader. State: Replica: 4532b54a008a4a39b663112e6d0aacc0, State: Running, Role: LEADER
I20260321 03:02:37.093319 9192 consensus_queue.cc:237] T 3722d9914162463ba9cd377dee251be0 P 4532b54a008a4a39b663112e6d0aacc0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:37.208580 9208 raft_consensus.cc:493] T e55ead2b80354ddf8876a5f8410122a2 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260321 03:02:37.208745 9208 raft_consensus.cc:515] T e55ead2b80354ddf8876a5f8410122a2 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:37.209300 9208 leader_election.cc:290] T e55ead2b80354ddf8876a5f8410122a2 P a97f7dd77cf2444f8fdb441019081f79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171), 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713)
I20260321 03:02:37.209857 8667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55ead2b80354ddf8876a5f8410122a2" candidate_uuid: "a97f7dd77cf2444f8fdb441019081f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70e7666c46844503beb466fdc054a6fc" is_pre_election: true
I20260321 03:02:37.209846 8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55ead2b80354ddf8876a5f8410122a2" candidate_uuid: "a97f7dd77cf2444f8fdb441019081f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4532b54a008a4a39b663112e6d0aacc0" is_pre_election: true
I20260321 03:02:37.210032 8667 raft_consensus.cc:2468] T e55ead2b80354ddf8876a5f8410122a2 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a97f7dd77cf2444f8fdb441019081f79 in term 0.
I20260321 03:02:37.210031 8532 raft_consensus.cc:2468] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a97f7dd77cf2444f8fdb441019081f79 in term 0.
I20260321 03:02:37.210388 8737 leader_election.cc:304] T e55ead2b80354ddf8876a5f8410122a2 P a97f7dd77cf2444f8fdb441019081f79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79; no voters:
I20260321 03:02:37.210561 9208 raft_consensus.cc:2804] T e55ead2b80354ddf8876a5f8410122a2 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260321 03:02:37.210638 9208 raft_consensus.cc:493] T e55ead2b80354ddf8876a5f8410122a2 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260321 03:02:37.210692 9208 raft_consensus.cc:3060] T e55ead2b80354ddf8876a5f8410122a2 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:37.211561 9208 raft_consensus.cc:515] T e55ead2b80354ddf8876a5f8410122a2 P a97f7dd77cf2444f8fdb441019081f79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:37.211956 9208 leader_election.cc:290] T e55ead2b80354ddf8876a5f8410122a2 P a97f7dd77cf2444f8fdb441019081f79 [CANDIDATE]: Term 1 election: Requested vote from peers 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171), 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713)
I20260321 03:02:37.212371 8667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55ead2b80354ddf8876a5f8410122a2" candidate_uuid: "a97f7dd77cf2444f8fdb441019081f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70e7666c46844503beb466fdc054a6fc"
I20260321 03:02:37.212356 8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55ead2b80354ddf8876a5f8410122a2" candidate_uuid: "a97f7dd77cf2444f8fdb441019081f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4532b54a008a4a39b663112e6d0aacc0"
I20260321 03:02:37.212509 8667 raft_consensus.cc:3060] T e55ead2b80354ddf8876a5f8410122a2 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:37.212512 8532 raft_consensus.cc:3060] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:37.213244 8667 raft_consensus.cc:2468] T e55ead2b80354ddf8876a5f8410122a2 P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a97f7dd77cf2444f8fdb441019081f79 in term 1.
I20260321 03:02:37.213624 8737 leader_election.cc:304] T e55ead2b80354ddf8876a5f8410122a2 P a97f7dd77cf2444f8fdb441019081f79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79; no voters:
I20260321 03:02:37.213794 9208 raft_consensus.cc:2804] T e55ead2b80354ddf8876a5f8410122a2 P a97f7dd77cf2444f8fdb441019081f79 [term 1 FOLLOWER]: Leader election won for term 1
I20260321 03:02:37.213908 8532 raft_consensus.cc:2468] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a97f7dd77cf2444f8fdb441019081f79 in term 1.
I20260321 03:02:37.214051 9208 raft_consensus.cc:697] T e55ead2b80354ddf8876a5f8410122a2 P a97f7dd77cf2444f8fdb441019081f79 [term 1 LEADER]: Becoming Leader. State: Replica: a97f7dd77cf2444f8fdb441019081f79, State: Running, Role: LEADER
I20260321 03:02:37.214223 9208 consensus_queue.cc:237] T e55ead2b80354ddf8876a5f8410122a2 P a97f7dd77cf2444f8fdb441019081f79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
W20260321 03:02:37.215750 8466 connection.cc:537] server connection from 127.0.0.1:60616 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260321 03:02:37.215741 8602 connection.cc:537] server connection from 127.0.0.1:43454 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260321 03:02:37.215899 8739 connection.cc:537] server connection from 127.0.0.1:44960 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260321 03:02:37.217422 8857 connection.cc:537] client connection to 127.7.178.252:45145 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260321 03:02:37.217888 8857 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.7.178.252:45145)
W20260321 03:02:37.218294 8857 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.7.178.252:45145)
W20260321 03:02:37.218461 8857 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.7.178.252:45145)
W20260321 03:02:37.218608 8857 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.7.178.252:45145)
W20260321 03:02:37.219771 9558 negotiation.cc:337] Failed RPC negotiation. Trace:
0321 03:02:37.216587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.178.252:45145 (local address 127.7.178.195:40995)
0321 03:02:37.216756 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0321 03:02:37.216772 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0321 03:02:37.216855 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0321 03:02:37.219654 (+ 2799us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.178.252:45145: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":92}
W20260321 03:02:37.220176 9555 negotiation.cc:337] Failed RPC negotiation. Trace:
0321 03:02:37.216666 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.178.252:45145 (local address 127.7.178.193:56999)
0321 03:02:37.216840 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0321 03:02:37.216855 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0321 03:02:37.216934 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0321 03:02:37.220082 (+ 3148us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.178.252:45145: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":95}
W20260321 03:02:37.220631 9556 negotiation.cc:337] Failed RPC negotiation. Trace:
0321 03:02:37.217066 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.178.252:45145 (local address 127.7.178.194:49161)
0321 03:02:37.217225 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0321 03:02:37.217242 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0321 03:02:37.217363 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0321 03:02:37.220496 (+ 3133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.178.252:45145: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":58}
W20260321 03:02:37.220695 9132 negotiation.cc:337] Failed RPC negotiation. Trace:
0321 03:02:37.219310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.178.252:45145 (local address 127.0.0.1:40038)
0321 03:02:37.219475 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0321 03:02:37.219494 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0321 03:02:37.219585 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0321 03:02:37.220582 (+ 997us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.178.252:45145: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":58}
I20260321 03:02:37.229596 9192 raft_consensus.cc:493] T e72dc676a2fb4fe98229b8f0767952a9 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260321 03:02:37.229832 9192 raft_consensus.cc:515] T e72dc676a2fb4fe98229b8f0767952a9 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } }
I20260321 03:02:37.230393 9192 leader_election.cc:290] T e72dc676a2fb4fe98229b8f0767952a9 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091), 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713)
I20260321 03:02:37.230863 8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72dc676a2fb4fe98229b8f0767952a9" candidate_uuid: "4532b54a008a4a39b663112e6d0aacc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a97f7dd77cf2444f8fdb441019081f79" is_pre_election: true
I20260321 03:02:37.230970 8667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72dc676a2fb4fe98229b8f0767952a9" candidate_uuid: "4532b54a008a4a39b663112e6d0aacc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70e7666c46844503beb466fdc054a6fc" is_pre_election: true
I20260321 03:02:37.231140 8803 raft_consensus.cc:2468] T e72dc676a2fb4fe98229b8f0767952a9 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4532b54a008a4a39b663112e6d0aacc0 in term 0.
I20260321 03:02:37.231245 8667 raft_consensus.cc:2468] T e72dc676a2fb4fe98229b8f0767952a9 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4532b54a008a4a39b663112e6d0aacc0 in term 0.
I20260321 03:02:37.231649 8469 leader_election.cc:304] T e72dc676a2fb4fe98229b8f0767952a9 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0, a97f7dd77cf2444f8fdb441019081f79; no voters:
I20260321 03:02:37.231858 9192 raft_consensus.cc:2804] T e72dc676a2fb4fe98229b8f0767952a9 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260321 03:02:37.232601 9192 raft_consensus.cc:493] T e72dc676a2fb4fe98229b8f0767952a9 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260321 03:02:37.232669 9192 raft_consensus.cc:3060] T e72dc676a2fb4fe98229b8f0767952a9 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:37.233654 9192 raft_consensus.cc:515] T e72dc676a2fb4fe98229b8f0767952a9 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } }
I20260321 03:02:37.234064 9192 leader_election.cc:290] T e72dc676a2fb4fe98229b8f0767952a9 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 1 election: Requested vote from peers a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091), 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713)
I20260321 03:02:37.234649 8667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72dc676a2fb4fe98229b8f0767952a9" candidate_uuid: "4532b54a008a4a39b663112e6d0aacc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70e7666c46844503beb466fdc054a6fc"
I20260321 03:02:37.234661 8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72dc676a2fb4fe98229b8f0767952a9" candidate_uuid: "4532b54a008a4a39b663112e6d0aacc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a97f7dd77cf2444f8fdb441019081f79"
I20260321 03:02:37.234781 8667 raft_consensus.cc:3060] T e72dc676a2fb4fe98229b8f0767952a9 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:37.234823 8803 raft_consensus.cc:3060] T e72dc676a2fb4fe98229b8f0767952a9 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:37.235668 8667 raft_consensus.cc:2468] T e72dc676a2fb4fe98229b8f0767952a9 P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4532b54a008a4a39b663112e6d0aacc0 in term 1.
I20260321 03:02:37.235673 8803 raft_consensus.cc:2468] T e72dc676a2fb4fe98229b8f0767952a9 P a97f7dd77cf2444f8fdb441019081f79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4532b54a008a4a39b663112e6d0aacc0 in term 1.
I20260321 03:02:37.236029 8466 leader_election.cc:304] T e72dc676a2fb4fe98229b8f0767952a9 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0, 70e7666c46844503beb466fdc054a6fc; no voters:
I20260321 03:02:37.236248 9192 raft_consensus.cc:2804] T e72dc676a2fb4fe98229b8f0767952a9 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader election won for term 1
I20260321 03:02:37.236426 9192 raft_consensus.cc:697] T e72dc676a2fb4fe98229b8f0767952a9 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 LEADER]: Becoming Leader. State: Replica: 4532b54a008a4a39b663112e6d0aacc0, State: Running, Role: LEADER
I20260321 03:02:37.236616 9192 consensus_queue.cc:237] T e72dc676a2fb4fe98229b8f0767952a9 P 4532b54a008a4a39b663112e6d0aacc0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } }
I20260321 03:02:37.335557 9208 raft_consensus.cc:493] T 0c90afb0d24a428f846cc2bfc24379ab P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260321 03:02:37.335682 9208 raft_consensus.cc:515] T 0c90afb0d24a428f846cc2bfc24379ab P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:37.336066 9208 leader_election.cc:290] T 0c90afb0d24a428f846cc2bfc24379ab P a97f7dd77cf2444f8fdb441019081f79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171), 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713)
I20260321 03:02:37.336436 8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c90afb0d24a428f846cc2bfc24379ab" candidate_uuid: "a97f7dd77cf2444f8fdb441019081f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4532b54a008a4a39b663112e6d0aacc0" is_pre_election: true
I20260321 03:02:37.336510 8667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c90afb0d24a428f846cc2bfc24379ab" candidate_uuid: "a97f7dd77cf2444f8fdb441019081f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70e7666c46844503beb466fdc054a6fc" is_pre_election: true
I20260321 03:02:37.336587 8532 raft_consensus.cc:2468] T 0c90afb0d24a428f846cc2bfc24379ab P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a97f7dd77cf2444f8fdb441019081f79 in term 0.
I20260321 03:02:37.337004 8738 leader_election.cc:304] T 0c90afb0d24a428f846cc2bfc24379ab P a97f7dd77cf2444f8fdb441019081f79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0, a97f7dd77cf2444f8fdb441019081f79; no voters:
I20260321 03:02:37.337225 9208 raft_consensus.cc:2804] T 0c90afb0d24a428f846cc2bfc24379ab P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260321 03:02:37.337340 9208 raft_consensus.cc:493] T 0c90afb0d24a428f846cc2bfc24379ab P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260321 03:02:37.337404 9208 raft_consensus.cc:3060] T 0c90afb0d24a428f846cc2bfc24379ab P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:37.337884 8667 raft_consensus.cc:2468] T 0c90afb0d24a428f846cc2bfc24379ab P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a97f7dd77cf2444f8fdb441019081f79 in term 0.
I20260321 03:02:37.338721 9208 raft_consensus.cc:515] T 0c90afb0d24a428f846cc2bfc24379ab P a97f7dd77cf2444f8fdb441019081f79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:37.339165 9208 leader_election.cc:290] T 0c90afb0d24a428f846cc2bfc24379ab P a97f7dd77cf2444f8fdb441019081f79 [CANDIDATE]: Term 1 election: Requested vote from peers 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171), 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713)
I20260321 03:02:37.339562 8667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c90afb0d24a428f846cc2bfc24379ab" candidate_uuid: "a97f7dd77cf2444f8fdb441019081f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70e7666c46844503beb466fdc054a6fc"
I20260321 03:02:37.339610 8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c90afb0d24a428f846cc2bfc24379ab" candidate_uuid: "a97f7dd77cf2444f8fdb441019081f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4532b54a008a4a39b663112e6d0aacc0"
I20260321 03:02:37.339677 8667 raft_consensus.cc:3060] T 0c90afb0d24a428f846cc2bfc24379ab P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:37.339798 8532 raft_consensus.cc:3060] T 0c90afb0d24a428f846cc2bfc24379ab P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:37.340544 8667 raft_consensus.cc:2468] T 0c90afb0d24a428f846cc2bfc24379ab P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a97f7dd77cf2444f8fdb441019081f79 in term 1.
I20260321 03:02:37.340687 8532 raft_consensus.cc:2468] T 0c90afb0d24a428f846cc2bfc24379ab P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a97f7dd77cf2444f8fdb441019081f79 in term 1.
I20260321 03:02:37.340898 8737 leader_election.cc:304] T 0c90afb0d24a428f846cc2bfc24379ab P a97f7dd77cf2444f8fdb441019081f79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79; no voters:
I20260321 03:02:37.341151 9208 raft_consensus.cc:2804] T 0c90afb0d24a428f846cc2bfc24379ab P a97f7dd77cf2444f8fdb441019081f79 [term 1 FOLLOWER]: Leader election won for term 1
I20260321 03:02:37.341316 9208 raft_consensus.cc:697] T 0c90afb0d24a428f846cc2bfc24379ab P a97f7dd77cf2444f8fdb441019081f79 [term 1 LEADER]: Becoming Leader. State: Replica: a97f7dd77cf2444f8fdb441019081f79, State: Running, Role: LEADER
I20260321 03:02:37.341454 9208 consensus_queue.cc:237] T 0c90afb0d24a428f846cc2bfc24379ab P a97f7dd77cf2444f8fdb441019081f79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:37.487473 9627 raft_consensus.cc:493] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3df5e4492f3049c1b09fea013b92f863)
I20260321 03:02:37.487646 9627 raft_consensus.cc:515] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:02:37.488523 9627 leader_election.cc:290] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595), 3df5e4492f3049c1b09fea013b92f863 (127.7.178.252:45145)
I20260321 03:02:37.490059 9192 consensus_queue.cc:1048] T 3722d9914162463ba9cd377dee251be0 P 4532b54a008a4a39b663112e6d0aacc0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260321 03:02:37.490512 9483 leader_election.cc:336] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595): Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
W20260321 03:02:37.491000 9481 leader_election.cc:336] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 3df5e4492f3049c1b09fea013b92f863 (127.7.178.252:45145): Network error: Client connection negotiation failed: client connection to 127.7.178.252:45145: connect: Connection refused (error 111)
I20260321 03:02:37.491151 9481 leader_election.cc:304] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a187d1fb5804686b4aff01e47fd0284; no voters: 3df5e4492f3049c1b09fea013b92f863, 7451d7c0a71f4620a6607f74b5a22f2e
I20260321 03:02:37.491473 9627 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260321 03:02:37.495713 9618 consensus_queue.cc:1048] T 3722d9914162463ba9cd377dee251be0 P 4532b54a008a4a39b663112e6d0aacc0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260321 03:02:37.604755 9620 consensus_queue.cc:1048] T e55ead2b80354ddf8876a5f8410122a2 P a97f7dd77cf2444f8fdb441019081f79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260321 03:02:37.609807 9640 consensus_queue.cc:1048] T e55ead2b80354ddf8876a5f8410122a2 P a97f7dd77cf2444f8fdb441019081f79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260321 03:02:37.687142 9618 consensus_queue.cc:1048] T e72dc676a2fb4fe98229b8f0767952a9 P 4532b54a008a4a39b663112e6d0aacc0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260321 03:02:37.691510 9618 consensus_queue.cc:1048] T e72dc676a2fb4fe98229b8f0767952a9 P 4532b54a008a4a39b663112e6d0aacc0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260321 03:02:37.813421 9640 consensus_queue.cc:1048] T 0c90afb0d24a428f846cc2bfc24379ab P a97f7dd77cf2444f8fdb441019081f79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260321 03:02:37.817842 9640 consensus_queue.cc:1048] T 0c90afb0d24a428f846cc2bfc24379ab P a97f7dd77cf2444f8fdb441019081f79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260321 03:02:38.081588 9646 raft_consensus.cc:493] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3df5e4492f3049c1b09fea013b92f863)
I20260321 03:02:38.081728 9646 raft_consensus.cc:515] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:02:38.082306 9646 leader_election.cc:290] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595), 3df5e4492f3049c1b09fea013b92f863 (127.7.178.252:45145)
W20260321 03:02:38.083799 9483 leader_election.cc:336] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595): Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
W20260321 03:02:38.083967 9481 leader_election.cc:336] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 3df5e4492f3049c1b09fea013b92f863 (127.7.178.252:45145): Network error: Client connection negotiation failed: client connection to 127.7.178.252:45145: connect: Connection refused (error 111)
I20260321 03:02:38.084064 9481 leader_election.cc:304] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a187d1fb5804686b4aff01e47fd0284; no voters: 3df5e4492f3049c1b09fea013b92f863, 7451d7c0a71f4620a6607f74b5a22f2e
I20260321 03:02:38.084378 9646 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260321 03:02:38.705415 7883 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskZ5BwAx/build/debug/bin/kudu with pid 9464
W20260321 03:02:38.713591 8739 connection.cc:537] client connection to 127.7.178.254:38651 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260321 03:02:39.666906 7883 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskZ5BwAx/build/debug/bin/kudu
/tmp/dist-test-taskZ5BwAx/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.178.254:38651
--webserver_interface=127.7.178.254
--webserver_port=43827
--builtin_ntp_servers=127.7.178.212:39683
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145
--hive_metastore_uris=thrift://127.0.0.1:35641
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260321 03:02:39.801107 9666 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260321 03:02:39.801441 9666 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260321 03:02:39.801487 9666 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260321 03:02:39.805856 9666 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260321 03:02:39.805986 9666 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260321 03:02:39.806028 9666 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260321 03:02:39.806049 9666 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260321 03:02:39.810626 9666 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.178.212:39683
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-0/wal
--hive_metastore_uris=thrift://127.0.0.1:35641
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.178.254:38651
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.178.254
--webserver_port=43827
--never_fsync=true
--heap_profile_path=/tmp/kudu.9666
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 68f10dd41067059260a5fb5c725b178b69c38aed
build type DEBUG
built by None at 21 Mar 2026 02:43:15 UTC on bdcb31816ec0
build id 11028
I20260321 03:02:39.811863 9666 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260321 03:02:39.813053 9666 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260321 03:02:39.819885 9672 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260321 03:02:39.819895 9675 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260321 03:02:39.819893 9673 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260321 03:02:39.820683 9666 server_base.cc:1061] running on GCE node
I20260321 03:02:39.821370 9666 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260321 03:02:39.822479 9666 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260321 03:02:39.823679 9666 hybrid_clock.cc:648] HybridClock initialized: now 1774062159823624 us; error 77 us; skew 500 ppm
I20260321 03:02:39.826730 9666 webserver.cc:492] Webserver started at http://127.7.178.254:43827/ using document root <none> and password file <none>
I20260321 03:02:39.827442 9666 fs_manager.cc:362] Metadata directory not provided
I20260321 03:02:39.827548 9666 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260321 03:02:39.832543 9666 fs_manager.cc:714] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260321 03:02:39.835805 9684 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260321 03:02:39.837843 9666 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260321 03:02:39.838039 9666 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-0/wal
uuid: "4a187d1fb5804686b4aff01e47fd0284"
format_stamp: "Formatted at 2026-03-21 03:02:27 on dist-test-slave-bwf0"
I20260321 03:02:39.839531 9666 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260321 03:02:39.866125 9666 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260321 03:02:39.867251 9666 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260321 03:02:39.867610 9666 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260321 03:02:39.883363 9666 rpc_server.cc:307] RPC server started. Bound to: 127.7.178.254:38651
I20260321 03:02:39.883584 9736 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.178.254:38651 every 8 connection(s)
I20260321 03:02:39.884634 9666 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-0/data/info.pb
I20260321 03:02:39.885733 7883 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskZ5BwAx/build/debug/bin/kudu as pid 9666
I20260321 03:02:39.892740 9737 sys_catalog.cc:263] Verifying existing consensus state
I20260321 03:02:39.896338 9737 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284: Bootstrap starting.
I20260321 03:02:39.914381 9737 log.cc:826] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284: Log is configured to *not* fsync() on all Append() calls
I20260321 03:02:39.972417 9737 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284: Bootstrap replayed 1/1 log segments. Stats: ops{read=85 overwritten=0 applied=85 ignored=0} inserts{seen=52 ignored=0} mutations{seen=75 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260321 03:02:39.972884 9737 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284: Bootstrap complete.
I20260321 03:02:39.976275 9737 raft_consensus.cc:359] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 6 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:02:39.976706 9737 raft_consensus.cc:740] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 6 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a187d1fb5804686b4aff01e47fd0284, State: Initialized, Role: FOLLOWER
I20260321 03:02:39.977214 9737 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 85, Last appended: 6.85, Last appended by leader: 85, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:02:39.977773 9741 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 6 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } } }
I20260321 03:02:39.977912 9741 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [sys.catalog]: This master's current role is: FOLLOWER
I20260321 03:02:39.978545 9737 sys_catalog.cc:565] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [sys.catalog]: configured and running, proceeding with master startup.
I20260321 03:02:39.986657 9755 catalog_manager.cc:1269] Loaded cluster ID: 30588dbe2d29416e8c640adf9bfaba1f
I20260321 03:02:39.986754 9755 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284: loading cluster ID for follower catalog manager: success
I20260321 03:02:39.989806 9755 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284: acquiring CA information for follower catalog manager: success
I20260321 03:02:39.991915 9755 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260321 03:02:39.991766 9666 master_runner.cc:186] Error getting master registration for 127.7.178.253:46595: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111),
I20260321 03:02:39.993898 9666 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260321 03:02:40.174532 8580 heartbeater.cc:344] Connected to a master server at 127.7.178.254:38651
I20260321 03:02:40.176739 9701 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" instance_seqno: 1774062147955760) as {username='slave'} at 127.7.178.193:37747; Asking this server to re-register.
I20260321 03:02:40.177611 8580 heartbeater.cc:461] Registering TS with master...
I20260321 03:02:40.179265 9701 ts_manager.cc:194] Registered new tserver with Master: 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171)
I20260321 03:02:40.220611 8851 heartbeater.cc:344] Connected to a master server at 127.7.178.254:38651
I20260321 03:02:40.222424 9701 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" instance_seqno: 1774062148360782) as {username='slave'} at 127.7.178.195:60837; Asking this server to re-register.
I20260321 03:02:40.223044 8851 heartbeater.cc:461] Registering TS with master...
I20260321 03:02:40.224260 9701 ts_manager.cc:194] Registered new tserver with Master: a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
I20260321 03:02:40.330382 8715 heartbeater.cc:344] Connected to a master server at 127.7.178.254:38651
I20260321 03:02:40.331384 9701 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "70e7666c46844503beb466fdc054a6fc" instance_seqno: 1774062148158895) as {username='slave'} at 127.7.178.194:59223; Asking this server to re-register.
I20260321 03:02:40.331791 8715 heartbeater.cc:461] Registering TS with master...
I20260321 03:02:40.332819 9701 ts_manager.cc:194] Registered new tserver with Master: 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713)
I20260321 03:02:40.370749 9741 raft_consensus.cc:493] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260321 03:02:40.370935 9741 raft_consensus.cc:515] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:02:40.372365 9741 leader_election.cc:290] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595), 3df5e4492f3049c1b09fea013b92f863 (127.7.178.252:45145)
W20260321 03:02:40.372880 9685 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.178.252:45145: connect: Connection refused (error 111)
W20260321 03:02:40.374127 9685 leader_election.cc:336] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 3df5e4492f3049c1b09fea013b92f863 (127.7.178.252:45145): Network error: Client connection negotiation failed: client connection to 127.7.178.252:45145: connect: Connection refused (error 111)
W20260321 03:02:40.374325 9687 leader_election.cc:336] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595): Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
I20260321 03:02:40.374419 9687 leader_election.cc:304] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a187d1fb5804686b4aff01e47fd0284; no voters: 3df5e4492f3049c1b09fea013b92f863, 7451d7c0a71f4620a6607f74b5a22f2e
I20260321 03:02:40.374652 9741 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260321 03:02:41.071893 9768 raft_consensus.cc:493] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260321 03:02:41.072085 9768 raft_consensus.cc:515] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:02:41.072624 9768 leader_election.cc:290] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595), 3df5e4492f3049c1b09fea013b92f863 (127.7.178.252:45145)
W20260321 03:02:41.074388 9685 leader_election.cc:336] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 3df5e4492f3049c1b09fea013b92f863 (127.7.178.252:45145): Network error: Client connection negotiation failed: client connection to 127.7.178.252:45145: connect: Connection refused (error 111)
W20260321 03:02:41.074496 9687 leader_election.cc:336] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595): Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
I20260321 03:02:41.074560 9687 leader_election.cc:304] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a187d1fb5804686b4aff01e47fd0284; no voters: 3df5e4492f3049c1b09fea013b92f863, 7451d7c0a71f4620a6607f74b5a22f2e
I20260321 03:02:41.074726 9768 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260321 03:02:42.049057 7883 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskZ5BwAx/build/debug/bin/kudu with pid 9666
I20260321 03:02:42.611620 7883 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskZ5BwAx/build/debug/bin/kudu
/tmp/dist-test-taskZ5BwAx/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.178.254:38651
--webserver_interface=127.7.178.254
--webserver_port=43827
--builtin_ntp_servers=127.7.178.212:39683
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145
--hive_metastore_uris=thrift://127.0.0.1:35641
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260321 03:02:42.725828 9792 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260321 03:02:42.726130 9792 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260321 03:02:42.726223 9792 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260321 03:02:42.730103 9792 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260321 03:02:42.730196 9792 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260321 03:02:42.730237 9792 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260321 03:02:42.730315 9792 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260321 03:02:42.734848 9792 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.178.212:39683
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-0/wal
--hive_metastore_uris=thrift://127.0.0.1:35641
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.178.254:38651
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.178.254
--webserver_port=43827
--never_fsync=true
--heap_profile_path=/tmp/kudu.9792
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 68f10dd41067059260a5fb5c725b178b69c38aed
build type DEBUG
built by None at 21 Mar 2026 02:43:15 UTC on bdcb31816ec0
build id 11028
I20260321 03:02:42.735986 9792 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260321 03:02:42.737121 9792 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260321 03:02:42.743326 9800 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260321 03:02:42.743326 9802 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260321 03:02:42.743393 9799 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260321 03:02:42.743659 9792 server_base.cc:1061] running on GCE node
I20260321 03:02:42.744218 9792 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260321 03:02:42.745219 9792 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260321 03:02:42.746467 9792 hybrid_clock.cc:648] HybridClock initialized: now 1774062162746440 us; error 42 us; skew 500 ppm
I20260321 03:02:42.748776 9792 webserver.cc:492] Webserver started at http://127.7.178.254:43827/ using document root <none> and password file <none>
I20260321 03:02:42.749715 9792 fs_manager.cc:362] Metadata directory not provided
I20260321 03:02:42.749828 9792 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260321 03:02:42.753847 9792 fs_manager.cc:714] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260321 03:02:42.756500 9808 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260321 03:02:42.758281 9792 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260321 03:02:42.758490 9792 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-0/wal
uuid: "4a187d1fb5804686b4aff01e47fd0284"
format_stamp: "Formatted at 2026-03-21 03:02:27 on dist-test-slave-bwf0"
I20260321 03:02:42.758976 9792 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260321 03:02:42.776137 9792 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260321 03:02:42.776870 9792 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260321 03:02:42.777086 9792 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260321 03:02:42.785329 9792 rpc_server.cc:307] RPC server started. Bound to: 127.7.178.254:38651
I20260321 03:02:42.785338 9860 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.178.254:38651 every 8 connection(s)
I20260321 03:02:42.786484 9792 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-0/data/info.pb
I20260321 03:02:42.789417 7883 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskZ5BwAx/build/debug/bin/kudu as pid 9792
I20260321 03:02:42.791134 9861 sys_catalog.cc:263] Verifying existing consensus state
I20260321 03:02:42.793558 9861 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284: Bootstrap starting.
I20260321 03:02:42.805918 9861 log.cc:826] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284: Log is configured to *not* fsync() on all Append() calls
I20260321 03:02:42.846223 8715 heartbeater.cc:344] Connected to a master server at 127.7.178.254:38651
I20260321 03:02:42.852409 9861 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284: Bootstrap replayed 1/1 log segments. Stats: ops{read=85 overwritten=0 applied=85 ignored=0} inserts{seen=52 ignored=0} mutations{seen=75 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260321 03:02:42.852825 9861 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284: Bootstrap complete.
I20260321 03:02:42.855708 9861 raft_consensus.cc:359] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 6 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:02:42.856091 9861 raft_consensus.cc:740] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 6 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a187d1fb5804686b4aff01e47fd0284, State: Initialized, Role: FOLLOWER
I20260321 03:02:42.856503 9861 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 85, Last appended: 6.85, Last appended by leader: 85, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:02:42.857069 9866 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 6 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } } }
I20260321 03:02:42.857235 9866 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [sys.catalog]: This master's current role is: FOLLOWER
I20260321 03:02:42.857798 9861 sys_catalog.cc:565] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [sys.catalog]: configured and running, proceeding with master startup.
I20260321 03:02:42.865486 9880 catalog_manager.cc:1269] Loaded cluster ID: 30588dbe2d29416e8c640adf9bfaba1f
I20260321 03:02:42.865633 9880 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284: loading cluster ID for follower catalog manager: success
I20260321 03:02:42.868867 9880 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284: acquiring CA information for follower catalog manager: success
I20260321 03:02:42.871130 9880 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260321 03:02:42.870884 9792 master_runner.cc:186] Error getting master registration for 127.7.178.253:46595: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111),
I20260321 03:02:42.873039 9792 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260321 03:02:43.193941 8580 heartbeater.cc:344] Connected to a master server at 127.7.178.254:38651
I20260321 03:02:43.195879 9825 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" instance_seqno: 1774062147955760) as {username='slave'} at 127.7.178.193:36535; Asking this server to re-register.
I20260321 03:02:43.196568 8580 heartbeater.cc:461] Registering TS with master...
I20260321 03:02:43.198143 9825 ts_manager.cc:194] Registered new tserver with Master: 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171)
I20260321 03:02:43.238622 8851 heartbeater.cc:344] Connected to a master server at 127.7.178.254:38651
I20260321 03:02:43.240449 9825 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" instance_seqno: 1774062148360782) as {username='slave'} at 127.7.178.195:43765; Asking this server to re-register.
I20260321 03:02:43.241422 8851 heartbeater.cc:461] Registering TS with master...
I20260321 03:02:43.242851 9825 ts_manager.cc:194] Registered new tserver with Master: a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
I20260321 03:02:43.279052 9866 raft_consensus.cc:493] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260321 03:02:43.279346 9866 raft_consensus.cc:515] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:02:43.280771 9866 leader_election.cc:290] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595), 3df5e4492f3049c1b09fea013b92f863 (127.7.178.252:45145)
W20260321 03:02:43.281320 9811 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
W20260321 03:02:43.282603 9809 leader_election.cc:336] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 3df5e4492f3049c1b09fea013b92f863 (127.7.178.252:45145): Network error: Client connection negotiation failed: client connection to 127.7.178.252:45145: connect: Connection refused (error 111)
W20260321 03:02:43.282855 9811 leader_election.cc:336] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595): Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
I20260321 03:02:43.282953 9811 leader_election.cc:304] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a187d1fb5804686b4aff01e47fd0284; no voters: 3df5e4492f3049c1b09fea013b92f863, 7451d7c0a71f4620a6607f74b5a22f2e
I20260321 03:02:43.283241 9866 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260321 03:02:43.349632 9825 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "70e7666c46844503beb466fdc054a6fc" instance_seqno: 1774062148158895) as {username='slave'} at 127.7.178.194:46947; Asking this server to re-register.
I20260321 03:02:43.350301 8715 heartbeater.cc:461] Registering TS with master...
I20260321 03:02:43.351496 9825 ts_manager.cc:194] Registered new tserver with Master: 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713)
I20260321 03:02:43.917542 9894 raft_consensus.cc:493] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260321 03:02:43.917687 9894 raft_consensus.cc:515] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:02:43.918313 9894 leader_election.cc:290] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595), 3df5e4492f3049c1b09fea013b92f863 (127.7.178.252:45145)
W20260321 03:02:43.920149 9811 leader_election.cc:336] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595): Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
W20260321 03:02:43.920267 9809 leader_election.cc:336] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 3df5e4492f3049c1b09fea013b92f863 (127.7.178.252:45145): Network error: Client connection negotiation failed: client connection to 127.7.178.252:45145: connect: Connection refused (error 111)
I20260321 03:02:43.920389 9809 leader_election.cc:304] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a187d1fb5804686b4aff01e47fd0284; no voters: 3df5e4492f3049c1b09fea013b92f863, 7451d7c0a71f4620a6607f74b5a22f2e
I20260321 03:02:43.920598 9894 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260321 03:02:44.745162 9908 raft_consensus.cc:493] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260321 03:02:44.745401 9908 raft_consensus.cc:515] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:02:44.745908 9908 leader_election.cc:290] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595), 3df5e4492f3049c1b09fea013b92f863 (127.7.178.252:45145)
W20260321 03:02:44.747176 9811 leader_election.cc:336] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595): Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
W20260321 03:02:44.747289 9809 leader_election.cc:336] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 3df5e4492f3049c1b09fea013b92f863 (127.7.178.252:45145): Network error: Client connection negotiation failed: client connection to 127.7.178.252:45145: connect: Connection refused (error 111)
I20260321 03:02:44.747370 9809 leader_election.cc:304] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a187d1fb5804686b4aff01e47fd0284; no voters: 3df5e4492f3049c1b09fea013b92f863, 7451d7c0a71f4620a6607f74b5a22f2e
I20260321 03:02:44.747540 9908 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260321 03:02:45.366415 7883 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskZ5BwAx/build/debug/bin/kudu with pid 9792
I20260321 03:02:46.193476 7883 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskZ5BwAx/build/debug/bin/kudu
/tmp/dist-test-taskZ5BwAx/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.178.254:38651
--webserver_interface=127.7.178.254
--webserver_port=43827
--builtin_ntp_servers=127.7.178.212:39683
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145
--hive_metastore_uris=thrift://127.0.0.1:35641
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260321 03:02:46.312397 9928 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260321 03:02:46.312664 9928 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260321 03:02:46.312713 9928 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260321 03:02:46.316545 9928 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260321 03:02:46.316633 9928 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260321 03:02:46.316655 9928 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260321 03:02:46.316673 9928 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260321 03:02:46.321316 9928 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.178.212:39683
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-0/wal
--hive_metastore_uris=thrift://127.0.0.1:35641
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.178.254:38651
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.178.254
--webserver_port=43827
--never_fsync=true
--heap_profile_path=/tmp/kudu.9928
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 68f10dd41067059260a5fb5c725b178b69c38aed
build type DEBUG
built by None at 21 Mar 2026 02:43:15 UTC on bdcb31816ec0
build id 11028
I20260321 03:02:46.322606 9928 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260321 03:02:46.323974 9928 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260321 03:02:46.330363 9934 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260321 03:02:46.330363 9935 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260321 03:02:46.330524 9928 server_base.cc:1061] running on GCE node
W20260321 03:02:46.330411 9937 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260321 03:02:46.331264 9928 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260321 03:02:46.332444 9928 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260321 03:02:46.333731 9928 hybrid_clock.cc:648] HybridClock initialized: now 1774062166333656 us; error 125 us; skew 500 ppm
I20260321 03:02:46.335999 9928 webserver.cc:492] Webserver started at http://127.7.178.254:43827/ using document root <none> and password file <none>
I20260321 03:02:46.336650 9928 fs_manager.cc:362] Metadata directory not provided
I20260321 03:02:46.336711 9928 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260321 03:02:46.341118 9928 fs_manager.cc:714] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260321 03:02:46.343580 9944 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260321 03:02:46.344866 9928 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260321 03:02:46.345024 9928 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-0/wal
uuid: "4a187d1fb5804686b4aff01e47fd0284"
format_stamp: "Formatted at 2026-03-21 03:02:27 on dist-test-slave-bwf0"
I20260321 03:02:46.345561 9928 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260321 03:02:46.365938 9928 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260321 03:02:46.366756 9928 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260321 03:02:46.366992 9928 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260321 03:02:46.375555 9996 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.178.254:38651 every 8 connection(s)
I20260321 03:02:46.375562 9928 rpc_server.cc:307] RPC server started. Bound to: 127.7.178.254:38651
I20260321 03:02:46.376976 9928 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-0/data/info.pb
I20260321 03:02:46.381065 7883 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskZ5BwAx/build/debug/bin/kudu as pid 9928
I20260321 03:02:46.381600 9997 sys_catalog.cc:263] Verifying existing consensus state
I20260321 03:02:46.383600 9997 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284: Bootstrap starting.
I20260321 03:02:46.395221 9997 log.cc:826] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284: Log is configured to *not* fsync() on all Append() calls
I20260321 03:02:46.439589 9997 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284: Bootstrap replayed 1/1 log segments. Stats: ops{read=85 overwritten=0 applied=85 ignored=0} inserts{seen=52 ignored=0} mutations{seen=75 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260321 03:02:46.440428 9997 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284: Bootstrap complete.
I20260321 03:02:46.443444 9997 raft_consensus.cc:359] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 6 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:02:46.443871 9997 raft_consensus.cc:740] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 6 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a187d1fb5804686b4aff01e47fd0284, State: Initialized, Role: FOLLOWER
I20260321 03:02:46.444339 9997 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 85, Last appended: 6.85, Last appended by leader: 85, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:02:46.444871 10001 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 6 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } } }
I20260321 03:02:46.444998 10001 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [sys.catalog]: This master's current role is: FOLLOWER
I20260321 03:02:46.445593 9997 sys_catalog.cc:565] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [sys.catalog]: configured and running, proceeding with master startup.
I20260321 03:02:46.455454 10015 catalog_manager.cc:1269] Loaded cluster ID: 30588dbe2d29416e8c640adf9bfaba1f
I20260321 03:02:46.455616 10015 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284: loading cluster ID for follower catalog manager: success
I20260321 03:02:46.457440 9928 master_runner.cc:186] Error getting master registration for 127.7.178.253:46595: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111),
I20260321 03:02:46.459920 9928 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260321 03:02:46.460436 10015 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284: acquiring CA information for follower catalog manager: success
I20260321 03:02:46.463233 10015 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260321 03:02:46.716152 8580 heartbeater.cc:344] Connected to a master server at 127.7.178.254:38651
I20260321 03:02:46.718165 9961 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" instance_seqno: 1774062147955760) as {username='slave'} at 127.7.178.193:35445; Asking this server to re-register.
I20260321 03:02:46.718834 8580 heartbeater.cc:461] Registering TS with master...
I20260321 03:02:46.720302 9961 ts_manager.cc:194] Registered new tserver with Master: 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171)
I20260321 03:02:46.759476 8851 heartbeater.cc:344] Connected to a master server at 127.7.178.254:38651
I20260321 03:02:46.760576 9961 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" instance_seqno: 1774062148360782) as {username='slave'} at 127.7.178.195:49483; Asking this server to re-register.
I20260321 03:02:46.761087 8851 heartbeater.cc:461] Registering TS with master...
I20260321 03:02:46.762187 9961 ts_manager.cc:194] Registered new tserver with Master: a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
I20260321 03:02:46.867697 8715 heartbeater.cc:344] Connected to a master server at 127.7.178.254:38651
I20260321 03:02:46.868860 9961 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "70e7666c46844503beb466fdc054a6fc" instance_seqno: 1774062148158895) as {username='slave'} at 127.7.178.194:58579; Asking this server to re-register.
I20260321 03:02:46.869467 8715 heartbeater.cc:461] Registering TS with master...
I20260321 03:02:46.870520 9961 ts_manager.cc:194] Registered new tserver with Master: 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713)
I20260321 03:02:46.920464 10001 raft_consensus.cc:493] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260321 03:02:46.920684 10001 raft_consensus.cc:515] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:02:46.922150 10001 leader_election.cc:290] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595), 3df5e4492f3049c1b09fea013b92f863 (127.7.178.252:45145)
W20260321 03:02:46.922816 9945 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.178.252:45145: connect: Connection refused (error 111)
W20260321 03:02:46.923703 9947 leader_election.cc:336] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595): Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
W20260321 03:02:46.923843 9945 leader_election.cc:336] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 3df5e4492f3049c1b09fea013b92f863 (127.7.178.252:45145): Network error: Client connection negotiation failed: client connection to 127.7.178.252:45145: connect: Connection refused (error 111)
I20260321 03:02:46.923982 9945 leader_election.cc:304] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a187d1fb5804686b4aff01e47fd0284; no voters: 3df5e4492f3049c1b09fea013b92f863, 7451d7c0a71f4620a6607f74b5a22f2e
I20260321 03:02:46.924300 10001 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260321 03:02:47.499081 10027 raft_consensus.cc:493] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260321 03:02:47.499235 10027 raft_consensus.cc:515] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:02:47.499634 10027 leader_election.cc:290] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595), 3df5e4492f3049c1b09fea013b92f863 (127.7.178.252:45145)
W20260321 03:02:47.501592 9947 leader_election.cc:336] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595): Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
W20260321 03:02:47.501792 9945 leader_election.cc:336] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 3df5e4492f3049c1b09fea013b92f863 (127.7.178.252:45145): Network error: Client connection negotiation failed: client connection to 127.7.178.252:45145: connect: Connection refused (error 111)
I20260321 03:02:47.501946 9945 leader_election.cc:304] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a187d1fb5804686b4aff01e47fd0284; no voters: 3df5e4492f3049c1b09fea013b92f863, 7451d7c0a71f4620a6607f74b5a22f2e
I20260321 03:02:47.502140 10027 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260321 03:02:48.190737 10039 raft_consensus.cc:493] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260321 03:02:48.190909 10039 raft_consensus.cc:515] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:02:48.191479 10039 leader_election.cc:290] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595), 3df5e4492f3049c1b09fea013b92f863 (127.7.178.252:45145)
W20260321 03:02:48.193064 9945 leader_election.cc:336] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 3df5e4492f3049c1b09fea013b92f863 (127.7.178.252:45145): Network error: Client connection negotiation failed: client connection to 127.7.178.252:45145: connect: Connection refused (error 111)
W20260321 03:02:48.193153 9947 leader_election.cc:336] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595): Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
I20260321 03:02:48.193195 9945 leader_election.cc:304] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a187d1fb5804686b4aff01e47fd0284; no voters: 3df5e4492f3049c1b09fea013b92f863, 7451d7c0a71f4620a6607f74b5a22f2e
I20260321 03:02:48.193395 10039 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260321 03:02:49.522305 7883 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskZ5BwAx/build/debug/bin/kudu
/tmp/dist-test-taskZ5BwAx/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.178.253:46595
--webserver_interface=127.7.178.253
--webserver_port=43169
--builtin_ntp_servers=127.7.178.212:39683
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145
--hive_metastore_uris=thrift://127.0.0.1:35641
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260321 03:02:49.636262 10061 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260321 03:02:49.636561 10061 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260321 03:02:49.636648 10061 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260321 03:02:49.640764 10061 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260321 03:02:49.640875 10061 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260321 03:02:49.640915 10061 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260321 03:02:49.640978 10061 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260321 03:02:49.645383 10061 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.178.212:39683
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-1/wal
--hive_metastore_uris=thrift://127.0.0.1:35641
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.178.253:46595
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.7.178.253
--webserver_port=43169
--never_fsync=true
--heap_profile_path=/tmp/kudu.10061
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 68f10dd41067059260a5fb5c725b178b69c38aed
build type DEBUG
built by None at 21 Mar 2026 02:43:15 UTC on bdcb31816ec0
build id 11028
I20260321 03:02:49.646739 10061 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260321 03:02:49.648072 10061 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260321 03:02:49.654474 10067 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260321 03:02:49.654493 10066 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260321 03:02:49.654585 10069 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260321 03:02:49.654562 10061 server_base.cc:1061] running on GCE node
I20260321 03:02:49.655257 10061 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260321 03:02:49.656266 10061 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260321 03:02:49.657454 10061 hybrid_clock.cc:648] HybridClock initialized: now 1774062169657426 us; error 42 us; skew 500 ppm
I20260321 03:02:49.659475 10061 webserver.cc:492] Webserver started at http://127.7.178.253:43169/ using document root <none> and password file <none>
I20260321 03:02:49.660116 10061 fs_manager.cc:362] Metadata directory not provided
I20260321 03:02:49.660228 10061 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260321 03:02:49.664179 10061 fs_manager.cc:714] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260321 03:02:49.666769 10075 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260321 03:02:49.668057 10061 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260321 03:02:49.668231 10061 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-1/data,/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-1/wal
uuid: "7451d7c0a71f4620a6607f74b5a22f2e"
format_stamp: "Formatted at 2026-03-21 03:02:27 on dist-test-slave-bwf0"
I20260321 03:02:49.668679 10061 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260321 03:02:49.683313 10061 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260321 03:02:49.684053 10061 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260321 03:02:49.684262 10061 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260321 03:02:49.692938 10061 rpc_server.cc:307] RPC server started. Bound to: 127.7.178.253:46595
I20260321 03:02:49.692925 10129 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.178.253:46595 every 8 connection(s)
I20260321 03:02:49.694391 10061 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-1/data/info.pb
I20260321 03:02:49.699033 10130 sys_catalog.cc:263] Verifying existing consensus state
I20260321 03:02:49.699685 7883 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskZ5BwAx/build/debug/bin/kudu as pid 10061
I20260321 03:02:49.701404 10130 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e: Bootstrap starting.
I20260321 03:02:49.712342 10130 log.cc:826] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e: Log is configured to *not* fsync() on all Append() calls
I20260321 03:02:49.742475 8852 heartbeater.cc:344] Connected to a master server at 127.7.178.253:46595
I20260321 03:02:49.755026 10130 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e: Bootstrap replayed 1/1 log segments. Stats: ops{read=78 overwritten=0 applied=78 ignored=0} inserts{seen=48 ignored=0} mutations{seen=67 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260321 03:02:49.755553 10130 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e: Bootstrap complete.
I20260321 03:02:49.758673 10130 raft_consensus.cc:359] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [term 5 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:02:49.759033 10130 raft_consensus.cc:740] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [term 5 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7451d7c0a71f4620a6607f74b5a22f2e, State: Initialized, Role: FOLLOWER
I20260321 03:02:49.759490 10130 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 78, Last appended: 5.78, Last appended by leader: 78, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:02:49.760030 10136 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 5 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } } }
I20260321 03:02:49.760193 10136 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [sys.catalog]: This master's current role is: FOLLOWER
I20260321 03:02:49.760921 10130 sys_catalog.cc:565] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [sys.catalog]: configured and running, proceeding with master startup.
I20260321 03:02:49.768293 10150 catalog_manager.cc:1269] Loaded cluster ID: 30588dbe2d29416e8c640adf9bfaba1f
I20260321 03:02:49.768373 10150 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e: loading cluster ID for follower catalog manager: success
I20260321 03:02:49.771217 10150 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e: acquiring CA information for follower catalog manager: success
I20260321 03:02:49.773435 10150 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260321 03:02:49.782969 10155 raft_consensus.cc:493] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260321 03:02:49.785614 10155 raft_consensus.cc:515] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:02:49.783301 10061 master_runner.cc:186] Error getting master registration for 127.7.178.252:45145: Network error: Client connection negotiation failed: client connection to 127.7.178.252:45145: connect: Connection refused (error 111),
I20260321 03:02:49.785956 10061 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260321 03:02:49.786260 10155 leader_election.cc:290] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595), 3df5e4492f3049c1b09fea013b92f863 (127.7.178.252:45145)
W20260321 03:02:49.787667 9945 leader_election.cc:336] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 3df5e4492f3049c1b09fea013b92f863 (127.7.178.252:45145): Network error: Client connection negotiation failed: client connection to 127.7.178.252:45145: connect: Connection refused (error 111)
I20260321 03:02:49.790874 10102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4a187d1fb5804686b4aff01e47fd0284" candidate_term: 7 candidate_status { last_received { term: 6 index: 85 } } ignore_live_leader: false dest_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" is_pre_election: true
I20260321 03:02:49.791250 10102 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a187d1fb5804686b4aff01e47fd0284 in term 5.
I20260321 03:02:49.791724 9947 leader_election.cc:304] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a187d1fb5804686b4aff01e47fd0284, 7451d7c0a71f4620a6607f74b5a22f2e; no voters: 3df5e4492f3049c1b09fea013b92f863
I20260321 03:02:49.792032 10155 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260321 03:02:49.792109 10155 raft_consensus.cc:493] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260321 03:02:49.792171 10155 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 6 FOLLOWER]: Advancing to term 7
I20260321 03:02:49.794445 10155 raft_consensus.cc:515] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:02:49.795393 10155 leader_election.cc:290] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [CANDIDATE]: Term 7 election: Requested vote from peers 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595), 3df5e4492f3049c1b09fea013b92f863 (127.7.178.252:45145)
I20260321 03:02:49.796059 10102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4a187d1fb5804686b4aff01e47fd0284" candidate_term: 7 candidate_status { last_received { term: 6 index: 85 } } ignore_live_leader: false dest_uuid: "7451d7c0a71f4620a6607f74b5a22f2e"
I20260321 03:02:49.796216 10102 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [term 5 FOLLOWER]: Advancing to term 7
I20260321 03:02:49.798187 10102 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a187d1fb5804686b4aff01e47fd0284 in term 7.
I20260321 03:02:49.798668 9947 leader_election.cc:304] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a187d1fb5804686b4aff01e47fd0284, 7451d7c0a71f4620a6607f74b5a22f2e; no voters:
I20260321 03:02:49.799749 10155 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 7 FOLLOWER]: Leader election won for term 7
I20260321 03:02:49.800123 10155 raft_consensus.cc:697] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [term 7 LEADER]: Becoming Leader. State: Replica: 4a187d1fb5804686b4aff01e47fd0284, State: Running, Role: LEADER
I20260321 03:02:49.800513 10155 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 85, Committed index: 85, Last appended: 6.85, Last appended by leader: 85, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
W20260321 03:02:49.800901 9945 leader_election.cc:336] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 3df5e4492f3049c1b09fea013b92f863 (127.7.178.252:45145): Network error: Client connection negotiation failed: client connection to 127.7.178.252:45145: connect: Connection refused (error 111)
I20260321 03:02:49.802659 10159 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4a187d1fb5804686b4aff01e47fd0284. Latest consensus state: current_term: 7 leader_uuid: "4a187d1fb5804686b4aff01e47fd0284" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } } }
I20260321 03:02:49.802882 10159 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [sys.catalog]: This master's current role is: LEADER
I20260321 03:02:49.803282 10161 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260321 03:02:49.805636 10161 catalog_manager.cc:679] Loaded metadata for table default.table_c8e5202d265f463bbcf568d34a1e64a2 [id=4ac1925a391a48ea86c63da0c1d8c442]
I20260321 03:02:49.805930 10161 catalog_manager.cc:679] Loaded metadata for table default.table_0e0c55f293274457aed5e8d315334903 [id=850c888ac63d4c048f27ceeb1ddd4f83]
I20260321 03:02:49.806185 10161 catalog_manager.cc:679] Loaded metadata for table default.table_10dd23c6f33c4aa0bad0a534fb770d4a [id=94ef39d020ab428b9e0392bedab9483d]
I20260321 03:02:49.806411 10161 catalog_manager.cc:679] Loaded metadata for table default.table_60888690371e4e1d8d9e6a31f44b55a5 [id=9bc91b7f6cb8477ab6ed1ee5ed74f608]
I20260321 03:02:49.806635 10161 catalog_manager.cc:679] Loaded metadata for table default.table_f8b27d78677b44468e403c75afa5245a [id=9f5de6240b844d57991fc673d061fbf4]
I20260321 03:02:49.806865 10161 catalog_manager.cc:679] Loaded metadata for table default.table_d52655a709224a7d999af3a2f1f2a678 [id=a69b5fce47c341fe9f48dd5e36364533]
I20260321 03:02:49.807178 10161 catalog_manager.cc:679] Loaded metadata for table default.table_0e444e840fa14c16a1a1f2e750c73045 [id=c6b5b0c7a19649c2b502921f472fc1dc]
I20260321 03:02:49.807399 10161 catalog_manager.cc:679] Loaded metadata for table default.table_06e0fbe90fe0411d95d76f56b53fb175 [id=c7602cbc743a43239656449386fbeb83]
I20260321 03:02:49.808629 10161 tablet_loader.cc:96] loaded metadata for tablet 0c90afb0d24a428f846cc2bfc24379ab (table default.table_0e0c55f293274457aed5e8d315334903 [id=850c888ac63d4c048f27ceeb1ddd4f83])
I20260321 03:02:49.809231 10161 tablet_loader.cc:96] loaded metadata for tablet 3722d9914162463ba9cd377dee251be0 (table default.table_c8e5202d265f463bbcf568d34a1e64a2 [id=4ac1925a391a48ea86c63da0c1d8c442])
I20260321 03:02:49.810076 10161 tablet_loader.cc:96] loaded metadata for tablet 8535a1895af2482f90cfd53a79de88d5 (table default.table_60888690371e4e1d8d9e6a31f44b55a5 [id=9bc91b7f6cb8477ab6ed1ee5ed74f608])
I20260321 03:02:49.810639 10161 tablet_loader.cc:96] loaded metadata for tablet a4a81619964144e9aae068ed1e9eeaff (table default.table_0e444e840fa14c16a1a1f2e750c73045 [id=c6b5b0c7a19649c2b502921f472fc1dc])
I20260321 03:02:49.810932 10161 tablet_loader.cc:96] loaded metadata for tablet ba92d73996f84bbfbab47006dc934c8e (table default.table_d52655a709224a7d999af3a2f1f2a678 [id=a69b5fce47c341fe9f48dd5e36364533])
I20260321 03:02:49.811127 10161 tablet_loader.cc:96] loaded metadata for tablet c1e54bc634ac44199436f2c538e6d63f (table default.table_f8b27d78677b44468e403c75afa5245a [id=9f5de6240b844d57991fc673d061fbf4])
I20260321 03:02:49.811717 10161 tablet_loader.cc:96] loaded metadata for tablet e55ead2b80354ddf8876a5f8410122a2 (table default.table_10dd23c6f33c4aa0bad0a534fb770d4a [id=94ef39d020ab428b9e0392bedab9483d])
I20260321 03:02:49.812556 10161 tablet_loader.cc:96] loaded metadata for tablet e72dc676a2fb4fe98229b8f0767952a9 (table default.table_06e0fbe90fe0411d95d76f56b53fb175 [id=c7602cbc743a43239656449386fbeb83])
I20260321 03:02:49.813031 10161 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260321 03:02:49.813877 10161 catalog_manager.cc:1269] Loaded cluster ID: 30588dbe2d29416e8c640adf9bfaba1f
I20260321 03:02:49.813963 10161 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260321 03:02:49.814785 10161 catalog_manager.cc:1514] Loading token signing keys...
I20260321 03:02:49.815421 10161 catalog_manager.cc:6055] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284: Loaded TSK: 0
I20260321 03:02:49.816188 10161 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260321 03:02:49.816818 10161 catalog_manager.cc:1537] Loading latest processed Hive Metastore notification log event ID...
I20260321 03:02:49.817492 10161 catalog_manager.cc:5893] Last processed Hive Metastore notification event ID: 21
I20260321 03:02:49.853706 8716 heartbeater.cc:344] Connected to a master server at 127.7.178.253:46595
I20260321 03:02:49.855768 10092 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "70e7666c46844503beb466fdc054a6fc" instance_seqno: 1774062148158895) as {username='slave'} at 127.7.178.194:46145; Asking this server to re-register.
I20260321 03:02:49.856386 8716 heartbeater.cc:461] Registering TS with master...
I20260321 03:02:49.857833 10092 ts_manager.cc:194] Registered new tserver with Master: 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713)
I20260321 03:02:49.969985 9957 master_service.cc:954] ReplaceTablet: received request to replace tablet e55ead2b80354ddf8876a5f8410122a2 from {username='slave'} at 127.0.0.1:58812
I20260321 03:02:49.970065 9958 master_service.cc:954] ReplaceTablet: received request to replace tablet e72dc676a2fb4fe98229b8f0767952a9 from {username='slave'} at 127.0.0.1:58812
I20260321 03:02:49.970577 9956 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58812:
name: "default.Table_bda6f16160c04b1190bb1866f63d3af2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260321 03:02:49.971017 9960 master_service.cc:954] ReplaceTablet: received request to replace tablet ba92d73996f84bbfbab47006dc934c8e from {username='slave'} at 127.0.0.1:58812
I20260321 03:02:49.972059 9959 master_service.cc:954] ReplaceTablet: received request to replace tablet e72dc676a2fb4fe98229b8f0767952a9 from {username='slave'} at 127.0.0.1:58812
I20260321 03:02:49.972270 9955 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58812:
name: "default.Table_ba8bb11787c9433093d74640a71395f2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260321 03:02:49.972537 9953 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58812:
table { table_name: "default.Table_06e0fbe90fe0411d95d76f56b53fb175" } modify_external_catalogs: true
I20260321 03:02:49.972589 9954 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58812:
table { table_name: "default.Table_10dd23c6f33c4aa0bad0a534fb770d4a" } new_table_name: "default.Table_91567c8331f247aebc889906e9067634" modify_external_catalogs: true
I20260321 03:02:49.972677 9953 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58812:
table { table_name: "default.Table_06e0fbe90fe0411d95d76f56b53fb175" } modify_external_catalogs: true
I20260321 03:02:49.972873 9952 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58812:
name: "default.Table_a8ad6a72849a42ab9d21634ee3041396"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260321 03:02:49.973443 9961 master_service.cc:954] ReplaceTablet: received request to replace tablet a4a81619964144e9aae068ed1e9eeaff from {username='slave'} at 127.0.0.1:58812
F20260321 03:02:49.977427 10014 hms_notification_log_listener.cc:287] non-monotonous event IDs from HMS: current 23, previous 23; dumping first 3 out of 6 received events: NotificationEvent(eventId=22, eventTime=1774062151, eventType=DROP_TABLE, dbName=default, tableName=table_79533ce61645417d9d18b6b2820ee1af, message={"server":"","servicePrincipal":"","db":"default","table":"table_79533ce61645417d9d18b6b2820ee1af","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_79533ce61645417d9d18b6b2820ee1af\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1774062150},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/warehouse/table_79533ce61645417d9d18b6b2820ee1af\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_79533ce61645417d9d18b6b2820ee1af\",\"kudu.table_id\":\"435759bdc4464e5f859546dfc760d6ad\",\"transient_lastDdlTime\":\"1774062150\",\"comment\":\"\",\"kudu.master_addresses\":\"127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"30588dbe2d29416e8c640adf9bfaba1f\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1774062151}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=23, eventTime=1774062151, eventType=DROP_TABLE, dbName=default, tableName=table_0e0c55f293274457aed5e8d315334903, message={"server":"","servicePrincipal":"","db":"default","table":"table_0e0c55f293274457aed5e8d315334903","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_0e0c55f293274457aed5e8d315334903\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1774062149},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/warehouse/table_0e0c55f293274457aed5e8d315334903\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_0e0c55f293274457aed5e8d315334903\",\"kudu.table_id\":\"850c888ac63d4c048f27ceeb1ddd4f83\",\"transient_lastDdlTime\":\"1774062149\",\"comment\":\"\",\"kudu.master_addresses\":\"127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"30588dbe2d29416e8c640adf9bfaba1f\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1774062151}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=23, eventTime=1774062151, eventType=DROP_TABLE, dbName=default, tableName=table_492554e7d97c4920bdf854ca950c0179, message={"server":"","servicePrincipal":"","db":"default","table":"table_492554e7d97c4920bdf854ca950c0179","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_492554e7d97c4920bdf854ca950c0179\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1774062151},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/warehouse/table_492554e7d97c4920bdf854ca950c0179\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_492554e7d97c4920bdf854ca950c0179\",\"kudu.table_id\":\"1eabb731ef9a41249c3e08ccf80157e4\",\"transient_lastDdlTime\":\"1774062151\",\"comment\":\"\",\"kudu.master_addresses\":\"127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"30588dbe2d29416e8c640adf9bfaba1f\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1774062151}, messageFormat=json-0.2, catName=hive);
*** Check failure stack trace: ***
@ 0x7f31cffa0dcd google::LogMessage::Fail() at ??:0
@ 0x7f31cffa4b93 google::LogMessage::SendToLog() at ??:0
W20260321 03:02:49.983696 9945 consensus_peers.cc:597] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 -> Peer 3df5e4492f3049c1b09fea013b92f863 (127.7.178.252:45145): Couldn't send request to peer 3df5e4492f3049c1b09fea013b92f863. Status: Network error: Client connection negotiation failed: client connection to 127.7.178.252:45145: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260321 03:02:49.985018 10102 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [term 7 FOLLOWER]: Refusing update from remote peer 4a187d1fb5804686b4aff01e47fd0284: Log matching property violated. Preceding OpId in replica: term: 5 index: 78. Preceding OpId from leader: term: 7 index: 87. (index mismatch)
I20260321 03:02:49.985795 10159 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 86, Last known committed idx: 78, Time since last communication: 0.000s
@ 0x7f31cffa07cc google::LogMessage::Flush() at ??:0
@ 0x7f31cffa0a11 google::LogMessage::~LogMessage() at ??:0
I20260321 03:02:49.992269 10136 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4a187d1fb5804686b4aff01e47fd0284. Latest consensus state: current_term: 7 leader_uuid: "4a187d1fb5804686b4aff01e47fd0284" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } } }
I20260321 03:02:49.992413 10136 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [sys.catalog]: This master's current role is: FOLLOWER
I20260321 03:02:49.992507 10136 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 7 leader_uuid: "4a187d1fb5804686b4aff01e47fd0284" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } } }
I20260321 03:02:49.992564 10136 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [sys.catalog]: This master's current role is: FOLLOWER
I20260321 03:02:49.993745 10155 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 7 leader_uuid: "4a187d1fb5804686b4aff01e47fd0284" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } } }
I20260321 03:02:49.993893 10155 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284 [sys.catalog]: This master's current role is: LEADER
I20260321 03:02:49.994050 10164 mvcc.cc:204] Tried to move back new op lower bound from 7266558648224448512 to 7266558647506755584. Current Snapshot: MvccSnapshot[applied={T|T < 7266558648215764992}]
I20260321 03:02:49.994590 10136 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 7 leader_uuid: "4a187d1fb5804686b4aff01e47fd0284" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } } }
I20260321 03:02:49.994700 10136 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [sys.catalog]: This master's current role is: FOLLOWER
@ 0x7f31d517944d kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
I20260321 03:02:49.997669 9960 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284: Sending DeleteTablet for 3 replicas of tablet ba92d73996f84bbfbab47006dc934c8e
I20260321 03:02:49.999293 9960 catalog_manager.cc:6741] ReplaceTablet: tablet ba92d73996f84bbfbab47006dc934c8e deleted and replaced by tablet 684e6213d9044b6794a012a83714b731
I20260321 03:02:49.999881 9957 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284: Sending DeleteTablet for 3 replicas of tablet e55ead2b80354ddf8876a5f8410122a2
I20260321 03:02:50.000214 9957 catalog_manager.cc:6741] ReplaceTablet: tablet e55ead2b80354ddf8876a5f8410122a2 deleted and replaced by tablet fa013cbd4162443893013c61552ba5ea
I20260321 03:02:49.999687 9960 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58812:
table { table_name: "default.Table_0e444e840fa14c16a1a1f2e750c73045" } new_table_name: "default.Table_eb81105465414fdd9c4d66d6aefc3120" modify_external_catalogs: true
I20260321 03:02:50.000475 9957 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58812:
name: "default.Table_a6ce605126a947cfa6a44f2124f15087"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260321 03:02:50.001610 9958 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284: Sending DeleteTablet for 3 replicas of tablet e72dc676a2fb4fe98229b8f0767952a9
I20260321 03:02:50.002481 9958 catalog_manager.cc:6741] ReplaceTablet: tablet e72dc676a2fb4fe98229b8f0767952a9 deleted and replaced by tablet 6ece6bb47b4f4e83995fb467d2335f4c
I20260321 03:02:50.002782 9958 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58812:
table { table_name: "default.Table_f8b27d78677b44468e403c75afa5245a" } new_table_name: "default.Table_a144cb0fc86946c095774662670afa8a" modify_external_catalogs: true
I20260321 03:02:50.003008 10166 mvcc.cc:204] Tried to move back new op lower bound from 7266558648224448512 to 7266558594722926592. Current Snapshot: MvccSnapshot[applied={T|T < 7266558648221679616}]
@ 0x7f31d5178364 kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
I20260321 03:02:50.003391 9959 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58812:
table { table_name: "default.Table_c8e5202d265f463bbcf568d34a1e64a2" } new_table_name: "default.Table_75e35409dad54304bbd621a1202abbec" modify_external_catalogs: true
I20260321 03:02:50.001613 9961 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 4a187d1fb5804686b4aff01e47fd0284: Sending DeleteTablet for 3 replicas of tablet a4a81619964144e9aae068ed1e9eeaff
I20260321 03:02:50.004392 9961 catalog_manager.cc:6741] ReplaceTablet: tablet a4a81619964144e9aae068ed1e9eeaff deleted and replaced by tablet ebfa020468594a5eaf76a794a51ca1e3
I20260321 03:02:50.004782 9961 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58812:
table { table_name: "default.Table_0e0c55f293274457aed5e8d315334903" } modify_external_catalogs: true
I20260321 03:02:50.004993 9961 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58812:
table { table_name: "default.Table_0e0c55f293274457aed5e8d315334903" } modify_external_catalogs: true
@ 0x7f31d5177ac7 _ZZN4kudu6master30HmsNotificationLogListenerTask4InitEvENKUlvE_clEv at ??:0
I20260321 03:02:50.011416 8642 tablet_service.cc:1558] Processing DeleteTablet for tablet ba92d73996f84bbfbab47006dc934c8e with delete_type TABLET_DATA_DELETED (replaced by tablet 684e6213d9044b6794a012a83714b731) from {username='slave'} at 127.0.0.1:59156
I20260321 03:02:50.011500 8645 tablet_service.cc:1558] Processing DeleteTablet for tablet e55ead2b80354ddf8876a5f8410122a2 with delete_type TABLET_DATA_DELETED (replaced by tablet fa013cbd4162443893013c61552ba5ea) from {username='slave'} at 127.0.0.1:59156
I20260321 03:02:50.011575 8639 tablet_service.cc:1558] Processing DeleteTablet for tablet e72dc676a2fb4fe98229b8f0767952a9 with delete_type TABLET_DATA_DELETED (replaced by tablet 6ece6bb47b4f4e83995fb467d2335f4c) from {username='slave'} at 127.0.0.1:59156
I20260321 03:02:50.011688 8646 tablet_service.cc:1558] Processing DeleteTablet for tablet a4a81619964144e9aae068ed1e9eeaff with delete_type TABLET_DATA_DELETED (replaced by tablet ebfa020468594a5eaf76a794a51ca1e3) from {username='slave'} at 127.0.0.1:59156
@ 0x7f31d517d1ce _ZNSt17_Function_handlerIFvvEZN4kudu6master30HmsNotificationLogListenerTask4InitEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
I20260321 03:02:50.011763 10185 tablet_replica.cc:333] T ba92d73996f84bbfbab47006dc934c8e P 70e7666c46844503beb466fdc054a6fc: stopping tablet replica
I20260321 03:02:50.011888 10185 raft_consensus.cc:2243] T ba92d73996f84bbfbab47006dc934c8e P 70e7666c46844503beb466fdc054a6fc [term 1 LEADER]: Raft consensus shutting down.
I20260321 03:02:50.012097 10185 raft_consensus.cc:2272] T ba92d73996f84bbfbab47006dc934c8e P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Raft consensus is shut down!
@ 0x5646dcd1418a std::function<>::operator()() at ??:0
I20260321 03:02:50.014218 8646 tablet_service.cc:1511] Processing CreateTablet for tablet 6ece6bb47b4f4e83995fb467d2335f4c (DEFAULT_TABLE table=default.table_06e0fbe90fe0411d95d76f56b53fb175 [id=c7602cbc743a43239656449386fbeb83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:50.014545 8646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ece6bb47b4f4e83995fb467d2335f4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:50.015280 10185 ts_tablet_manager.cc:1916] T ba92d73996f84bbfbab47006dc934c8e P 70e7666c46844503beb466fdc054a6fc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260321 03:02:50.015424 8775 tablet_service.cc:1558] Processing DeleteTablet for tablet ba92d73996f84bbfbab47006dc934c8e with delete_type TABLET_DATA_DELETED (replaced by tablet 684e6213d9044b6794a012a83714b731) from {username='slave'} at 127.0.0.1:34332
I20260321 03:02:50.015755 8776 tablet_service.cc:1558] Processing DeleteTablet for tablet e55ead2b80354ddf8876a5f8410122a2 with delete_type TABLET_DATA_DELETED (replaced by tablet fa013cbd4162443893013c61552ba5ea) from {username='slave'} at 127.0.0.1:34332
I20260321 03:02:50.015892 8774 tablet_service.cc:1558] Processing DeleteTablet for tablet e72dc676a2fb4fe98229b8f0767952a9 with delete_type TABLET_DATA_DELETED (replaced by tablet 6ece6bb47b4f4e83995fb467d2335f4c) from {username='slave'} at 127.0.0.1:34332
I20260321 03:02:50.016017 8777 tablet_service.cc:1558] Processing DeleteTablet for tablet a4a81619964144e9aae068ed1e9eeaff with delete_type TABLET_DATA_DELETED (replaced by tablet ebfa020468594a5eaf76a794a51ca1e3) from {username='slave'} at 127.0.0.1:34332
@ 0x7f31d14a5028 kudu::Thread::SuperviseThread() at ??:0
I20260321 03:02:50.017992 10185 ts_tablet_manager.cc:1929] T ba92d73996f84bbfbab47006dc934c8e P 70e7666c46844503beb466fdc054a6fc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260321 03:02:50.018074 10185 log.cc:1199] T ba92d73996f84bbfbab47006dc934c8e P 70e7666c46844503beb466fdc054a6fc: Deleting WAL directory at /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-1/wal/wals/ba92d73996f84bbfbab47006dc934c8e
I20260321 03:02:50.018353 10185 ts_tablet_manager.cc:1950] T ba92d73996f84bbfbab47006dc934c8e P 70e7666c46844503beb466fdc054a6fc: Deleting consensus metadata
I20260321 03:02:50.018663 10187 tablet_bootstrap.cc:492] T 6ece6bb47b4f4e83995fb467d2335f4c P 70e7666c46844503beb466fdc054a6fc: Bootstrap starting.
I20260321 03:02:50.018748 8777 tablet_service.cc:1511] Processing CreateTablet for tablet 6ece6bb47b4f4e83995fb467d2335f4c (DEFAULT_TABLE table=default.table_06e0fbe90fe0411d95d76f56b53fb175 [id=c7602cbc743a43239656449386fbeb83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:50.019141 8777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ece6bb47b4f4e83995fb467d2335f4c. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7f31d1c8c6db start_thread at ??:0
I20260321 03:02:50.019549 10185 tablet_replica.cc:333] T e55ead2b80354ddf8876a5f8410122a2 P 70e7666c46844503beb466fdc054a6fc: stopping tablet replica
I20260321 03:02:50.019672 10185 raft_consensus.cc:2243] T e55ead2b80354ddf8876a5f8410122a2 P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260321 03:02:50.019671 9945 catalog_manager.cc:5002] TS 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): tablet ba92d73996f84bbfbab47006dc934c8e (table default.table_d52655a709224a7d999af3a2f1f2a678 [id=a69b5fce47c341fe9f48dd5e36364533]) successfully deleted
I20260321 03:02:50.019804 10185 raft_consensus.cc:2272] T e55ead2b80354ddf8876a5f8410122a2 P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260321 03:02:50.020058 8646 tablet_service.cc:1511] Processing CreateTablet for tablet ebfa020468594a5eaf76a794a51ca1e3 (DEFAULT_TABLE table=default.table_0e444e840fa14c16a1a1f2e750c73045 [id=c6b5b0c7a19649c2b502921f472fc1dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:50.020203 10185 ts_tablet_manager.cc:1916] T e55ead2b80354ddf8876a5f8410122a2 P 70e7666c46844503beb466fdc054a6fc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260321 03:02:50.020290 8646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebfa020468594a5eaf76a794a51ca1e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:50.021111 10187 tablet_bootstrap.cc:654] T 6ece6bb47b4f4e83995fb467d2335f4c P 70e7666c46844503beb466fdc054a6fc: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:50.021587 8774 tablet_service.cc:1511] Processing CreateTablet for tablet ebfa020468594a5eaf76a794a51ca1e3 (DEFAULT_TABLE table=default.table_0e444e840fa14c16a1a1f2e750c73045 [id=c6b5b0c7a19649c2b502921f472fc1dc]), partition=RANGE (key) PARTITION UNBOUNDED
@ 0x7f31cf15761f clone at ??:0
I20260321 03:02:50.021876 8774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebfa020468594a5eaf76a794a51ca1e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:50.023473 10186 tablet_replica.cc:333] T ba92d73996f84bbfbab47006dc934c8e P a97f7dd77cf2444f8fdb441019081f79: stopping tablet replica
I20260321 03:02:50.023597 10186 raft_consensus.cc:2243] T ba92d73996f84bbfbab47006dc934c8e P a97f7dd77cf2444f8fdb441019081f79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260321 03:02:50.023728 10186 raft_consensus.cc:2272] T ba92d73996f84bbfbab47006dc934c8e P a97f7dd77cf2444f8fdb441019081f79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260321 03:02:50.024144 10186 ts_tablet_manager.cc:1916] T ba92d73996f84bbfbab47006dc934c8e P a97f7dd77cf2444f8fdb441019081f79: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260321 03:02:50.024281 10189 tablet_bootstrap.cc:492] T 6ece6bb47b4f4e83995fb467d2335f4c P a97f7dd77cf2444f8fdb441019081f79: Bootstrap starting.
I20260321 03:02:50.024435 10185 ts_tablet_manager.cc:1929] T e55ead2b80354ddf8876a5f8410122a2 P 70e7666c46844503beb466fdc054a6fc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260321 03:02:50.024500 10185 log.cc:1199] T e55ead2b80354ddf8876a5f8410122a2 P 70e7666c46844503beb466fdc054a6fc: Deleting WAL directory at /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-1/wal/wals/e55ead2b80354ddf8876a5f8410122a2
I20260321 03:02:50.024698 10187 tablet_bootstrap.cc:492] T 6ece6bb47b4f4e83995fb467d2335f4c P 70e7666c46844503beb466fdc054a6fc: No bootstrap required, opened a new log
I20260321 03:02:50.024761 10185 ts_tablet_manager.cc:1950] T e55ead2b80354ddf8876a5f8410122a2 P 70e7666c46844503beb466fdc054a6fc: Deleting consensus metadata
I20260321 03:02:50.024780 10187 ts_tablet_manager.cc:1403] T 6ece6bb47b4f4e83995fb467d2335f4c P 70e7666c46844503beb466fdc054a6fc: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260321 03:02:50.025391 10189 tablet_bootstrap.cc:654] T 6ece6bb47b4f4e83995fb467d2335f4c P a97f7dd77cf2444f8fdb441019081f79: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:50.025343 10187 raft_consensus.cc:359] T 6ece6bb47b4f4e83995fb467d2335f4c P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:50.025455 10187 raft_consensus.cc:385] T 6ece6bb47b4f4e83995fb467d2335f4c P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:50.025496 10187 raft_consensus.cc:740] T 6ece6bb47b4f4e83995fb467d2335f4c P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70e7666c46844503beb466fdc054a6fc, State: Initialized, Role: FOLLOWER
I20260321 03:02:50.025647 10185 tablet_replica.cc:333] T e72dc676a2fb4fe98229b8f0767952a9 P 70e7666c46844503beb466fdc054a6fc: stopping tablet replica
I20260321 03:02:50.025672 10187 consensus_queue.cc:260] T 6ece6bb47b4f4e83995fb467d2335f4c P 70e7666c46844503beb466fdc054a6fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:50.025764 10185 raft_consensus.cc:2243] T e72dc676a2fb4fe98229b8f0767952a9 P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260321 03:02:50.025859 10185 raft_consensus.cc:2272] T e72dc676a2fb4fe98229b8f0767952a9 P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260321 03:02:50.026103 8715 heartbeater.cc:499] Master 127.7.178.254:38651 was elected leader, sending a full tablet report...
I20260321 03:02:50.026197 10185 ts_tablet_manager.cc:1916] T e72dc676a2fb4fe98229b8f0767952a9 P 70e7666c46844503beb466fdc054a6fc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260321 03:02:50.026278 10186 ts_tablet_manager.cc:1929] T ba92d73996f84bbfbab47006dc934c8e P a97f7dd77cf2444f8fdb441019081f79: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260321 03:02:50.026337 10186 log.cc:1199] T ba92d73996f84bbfbab47006dc934c8e P a97f7dd77cf2444f8fdb441019081f79: Deleting WAL directory at /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-2/wal/wals/ba92d73996f84bbfbab47006dc934c8e
I20260321 03:02:50.026607 10186 ts_tablet_manager.cc:1950] T ba92d73996f84bbfbab47006dc934c8e P a97f7dd77cf2444f8fdb441019081f79: Deleting consensus metadata
I20260321 03:02:50.027542 10186 tablet_replica.cc:333] T e55ead2b80354ddf8876a5f8410122a2 P a97f7dd77cf2444f8fdb441019081f79: stopping tablet replica
I20260321 03:02:50.027698 10186 raft_consensus.cc:2243] T e55ead2b80354ddf8876a5f8410122a2 P a97f7dd77cf2444f8fdb441019081f79 [term 1 LEADER]: Raft consensus shutting down.
I20260321 03:02:50.028028 10186 raft_consensus.cc:2272] T e55ead2b80354ddf8876a5f8410122a2 P a97f7dd77cf2444f8fdb441019081f79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260321 03:02:50.028620 10187 ts_tablet_manager.cc:1434] T 6ece6bb47b4f4e83995fb467d2335f4c P 70e7666c46844503beb466fdc054a6fc: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260321 03:02:50.028862 10187 tablet_bootstrap.cc:492] T ebfa020468594a5eaf76a794a51ca1e3 P 70e7666c46844503beb466fdc054a6fc: Bootstrap starting.
I20260321 03:02:50.029685 10186 ts_tablet_manager.cc:1916] T e55ead2b80354ddf8876a5f8410122a2 P a97f7dd77cf2444f8fdb441019081f79: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260321 03:02:50.030421 10185 ts_tablet_manager.cc:1929] T e72dc676a2fb4fe98229b8f0767952a9 P 70e7666c46844503beb466fdc054a6fc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260321 03:02:50.030484 10185 log.cc:1199] T e72dc676a2fb4fe98229b8f0767952a9 P 70e7666c46844503beb466fdc054a6fc: Deleting WAL directory at /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-1/wal/wals/e72dc676a2fb4fe98229b8f0767952a9
I20260321 03:02:50.030754 10185 ts_tablet_manager.cc:1950] T e72dc676a2fb4fe98229b8f0767952a9 P 70e7666c46844503beb466fdc054a6fc: Deleting consensus metadata
I20260321 03:02:50.031416 10185 tablet_replica.cc:333] T a4a81619964144e9aae068ed1e9eeaff P 70e7666c46844503beb466fdc054a6fc: stopping tablet replica
I20260321 03:02:50.031524 10185 raft_consensus.cc:2243] T a4a81619964144e9aae068ed1e9eeaff P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260321 03:02:50.031563 10187 tablet_bootstrap.cc:654] T ebfa020468594a5eaf76a794a51ca1e3 P 70e7666c46844503beb466fdc054a6fc: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:50.031620 10185 raft_consensus.cc:2272] T a4a81619964144e9aae068ed1e9eeaff P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260321 03:02:50.032013 10185 ts_tablet_manager.cc:1916] T a4a81619964144e9aae068ed1e9eeaff P 70e7666c46844503beb466fdc054a6fc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260321 03:02:50.032110 10186 ts_tablet_manager.cc:1929] T e55ead2b80354ddf8876a5f8410122a2 P a97f7dd77cf2444f8fdb441019081f79: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260321 03:02:50.032169 10186 log.cc:1199] T e55ead2b80354ddf8876a5f8410122a2 P a97f7dd77cf2444f8fdb441019081f79: Deleting WAL directory at /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-2/wal/wals/e55ead2b80354ddf8876a5f8410122a2
I20260321 03:02:50.032414 10186 ts_tablet_manager.cc:1950] T e55ead2b80354ddf8876a5f8410122a2 P a97f7dd77cf2444f8fdb441019081f79: Deleting consensus metadata
I20260321 03:02:50.032832 10187 tablet_bootstrap.cc:492] T ebfa020468594a5eaf76a794a51ca1e3 P 70e7666c46844503beb466fdc054a6fc: No bootstrap required, opened a new log
I20260321 03:02:50.032932 10187 ts_tablet_manager.cc:1403] T ebfa020468594a5eaf76a794a51ca1e3 P 70e7666c46844503beb466fdc054a6fc: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260321 03:02:50.033339 10186 tablet_replica.cc:333] T e72dc676a2fb4fe98229b8f0767952a9 P a97f7dd77cf2444f8fdb441019081f79: stopping tablet replica
I20260321 03:02:50.033458 10186 raft_consensus.cc:2243] T e72dc676a2fb4fe98229b8f0767952a9 P a97f7dd77cf2444f8fdb441019081f79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260321 03:02:50.033571 10186 raft_consensus.cc:2272] T e72dc676a2fb4fe98229b8f0767952a9 P a97f7dd77cf2444f8fdb441019081f79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260321 03:02:50.033624 10187 raft_consensus.cc:359] T ebfa020468594a5eaf76a794a51ca1e3 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } }
I20260321 03:02:50.033830 10187 raft_consensus.cc:385] T ebfa020468594a5eaf76a794a51ca1e3 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:50.033890 10187 raft_consensus.cc:740] T ebfa020468594a5eaf76a794a51ca1e3 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70e7666c46844503beb466fdc054a6fc, State: Initialized, Role: FOLLOWER
I20260321 03:02:50.033914 10186 ts_tablet_manager.cc:1916] T e72dc676a2fb4fe98229b8f0767952a9 P a97f7dd77cf2444f8fdb441019081f79: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260321 03:02:50.034044 10187 consensus_queue.cc:260] T ebfa020468594a5eaf76a794a51ca1e3 P 70e7666c46844503beb466fdc054a6fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } }
I20260321 03:02:50.034174 10185 ts_tablet_manager.cc:1929] T a4a81619964144e9aae068ed1e9eeaff P 70e7666c46844503beb466fdc054a6fc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260321 03:02:50.034232 10185 log.cc:1199] T a4a81619964144e9aae068ed1e9eeaff P 70e7666c46844503beb466fdc054a6fc: Deleting WAL directory at /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-1/wal/wals/a4a81619964144e9aae068ed1e9eeaff
I20260321 03:02:50.034546 10185 ts_tablet_manager.cc:1950] T a4a81619964144e9aae068ed1e9eeaff P 70e7666c46844503beb466fdc054a6fc: Deleting consensus metadata
I20260321 03:02:50.035676 10189 tablet_bootstrap.cc:492] T 6ece6bb47b4f4e83995fb467d2335f4c P a97f7dd77cf2444f8fdb441019081f79: No bootstrap required, opened a new log
I20260321 03:02:50.035766 10189 ts_tablet_manager.cc:1403] T 6ece6bb47b4f4e83995fb467d2335f4c P a97f7dd77cf2444f8fdb441019081f79: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.002s
I20260321 03:02:50.036231 10189 raft_consensus.cc:359] T 6ece6bb47b4f4e83995fb467d2335f4c P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:50.036331 10189 raft_consensus.cc:385] T 6ece6bb47b4f4e83995fb467d2335f4c P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:50.036362 10189 raft_consensus.cc:740] T 6ece6bb47b4f4e83995fb467d2335f4c P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a97f7dd77cf2444f8fdb441019081f79, State: Initialized, Role: FOLLOWER
I20260321 03:02:50.036496 10189 consensus_queue.cc:260] T 6ece6bb47b4f4e83995fb467d2335f4c P a97f7dd77cf2444f8fdb441019081f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:50.036613 10187 ts_tablet_manager.cc:1434] T ebfa020468594a5eaf76a794a51ca1e3 P 70e7666c46844503beb466fdc054a6fc: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260321 03:02:50.036723 10186 ts_tablet_manager.cc:1929] T e72dc676a2fb4fe98229b8f0767952a9 P a97f7dd77cf2444f8fdb441019081f79: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260321 03:02:50.036782 10186 log.cc:1199] T e72dc676a2fb4fe98229b8f0767952a9 P a97f7dd77cf2444f8fdb441019081f79: Deleting WAL directory at /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-2/wal/wals/e72dc676a2fb4fe98229b8f0767952a9
I20260321 03:02:50.036839 10189 ts_tablet_manager.cc:1434] T 6ece6bb47b4f4e83995fb467d2335f4c P a97f7dd77cf2444f8fdb441019081f79: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260321 03:02:50.037014 10189 tablet_bootstrap.cc:492] T ebfa020468594a5eaf76a794a51ca1e3 P a97f7dd77cf2444f8fdb441019081f79: Bootstrap starting.
I20260321 03:02:50.037030 10186 ts_tablet_manager.cc:1950] T e72dc676a2fb4fe98229b8f0767952a9 P a97f7dd77cf2444f8fdb441019081f79: Deleting consensus metadata
I20260321 03:02:50.037704 10186 tablet_replica.cc:333] T a4a81619964144e9aae068ed1e9eeaff P a97f7dd77cf2444f8fdb441019081f79: stopping tablet replica
I20260321 03:02:50.037807 10186 raft_consensus.cc:2243] T a4a81619964144e9aae068ed1e9eeaff P a97f7dd77cf2444f8fdb441019081f79 [term 1 LEADER]: Raft consensus shutting down.
I20260321 03:02:50.037983 10186 raft_consensus.cc:2272] T a4a81619964144e9aae068ed1e9eeaff P a97f7dd77cf2444f8fdb441019081f79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260321 03:02:50.038049 10189 tablet_bootstrap.cc:654] T ebfa020468594a5eaf76a794a51ca1e3 P a97f7dd77cf2444f8fdb441019081f79: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:50.038339 10186 ts_tablet_manager.cc:1916] T a4a81619964144e9aae068ed1e9eeaff P a97f7dd77cf2444f8fdb441019081f79: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260321 03:02:50.039043 10092 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" instance_seqno: 1774062148360782) as {username='slave'} at 127.7.178.195:55787; Asking this server to re-register.
I20260321 03:02:50.039531 8852 heartbeater.cc:461] Registering TS with master...
I20260321 03:02:50.039898 10186 ts_tablet_manager.cc:1929] T a4a81619964144e9aae068ed1e9eeaff P a97f7dd77cf2444f8fdb441019081f79: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260321 03:02:50.039942 10186 log.cc:1199] T a4a81619964144e9aae068ed1e9eeaff P a97f7dd77cf2444f8fdb441019081f79: Deleting WAL directory at /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-2/wal/wals/a4a81619964144e9aae068ed1e9eeaff
I20260321 03:02:50.040169 10186 ts_tablet_manager.cc:1950] T a4a81619964144e9aae068ed1e9eeaff P a97f7dd77cf2444f8fdb441019081f79: Deleting consensus metadata
I20260321 03:02:50.040553 10092 ts_manager.cc:194] Registered new tserver with Master: a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
I20260321 03:02:50.041380 10189 tablet_bootstrap.cc:492] T ebfa020468594a5eaf76a794a51ca1e3 P a97f7dd77cf2444f8fdb441019081f79: No bootstrap required, opened a new log
I20260321 03:02:50.041456 10189 ts_tablet_manager.cc:1403] T ebfa020468594a5eaf76a794a51ca1e3 P a97f7dd77cf2444f8fdb441019081f79: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260321 03:02:50.041967 10189 raft_consensus.cc:359] T ebfa020468594a5eaf76a794a51ca1e3 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } }
I20260321 03:02:50.042085 10189 raft_consensus.cc:385] T ebfa020468594a5eaf76a794a51ca1e3 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:50.042122 10189 raft_consensus.cc:740] T ebfa020468594a5eaf76a794a51ca1e3 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a97f7dd77cf2444f8fdb441019081f79, State: Initialized, Role: FOLLOWER
I20260321 03:02:50.042271 10189 consensus_queue.cc:260] T ebfa020468594a5eaf76a794a51ca1e3 P a97f7dd77cf2444f8fdb441019081f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } }
I20260321 03:02:50.042604 10189 ts_tablet_manager.cc:1434] T ebfa020468594a5eaf76a794a51ca1e3 P a97f7dd77cf2444f8fdb441019081f79: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260321 03:02:50.184118 10053 raft_consensus.cc:493] T ebfa020468594a5eaf76a794a51ca1e3 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260321 03:02:50.184288 10053 raft_consensus.cc:515] T ebfa020468594a5eaf76a794a51ca1e3 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } }
I20260321 03:02:50.184906 10053 leader_election.cc:290] T ebfa020468594a5eaf76a794a51ca1e3 P 70e7666c46844503beb466fdc054a6fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
I20260321 03:02:50.185500 8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebfa020468594a5eaf76a794a51ca1e3" candidate_uuid: "70e7666c46844503beb466fdc054a6fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a97f7dd77cf2444f8fdb441019081f79" is_pre_election: true
I20260321 03:02:50.185678 8802 raft_consensus.cc:2468] T ebfa020468594a5eaf76a794a51ca1e3 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70e7666c46844503beb466fdc054a6fc in term 0.
I20260321 03:02:50.186041 8604 leader_election.cc:304] T ebfa020468594a5eaf76a794a51ca1e3 P 70e7666c46844503beb466fdc054a6fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79; no voters:
I20260321 03:02:50.186360 10053 raft_consensus.cc:2804] T ebfa020468594a5eaf76a794a51ca1e3 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260321 03:02:50.186421 10053 raft_consensus.cc:493] T ebfa020468594a5eaf76a794a51ca1e3 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260321 03:02:50.186482 10053 raft_consensus.cc:3060] T ebfa020468594a5eaf76a794a51ca1e3 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:50.187373 10053 raft_consensus.cc:515] T ebfa020468594a5eaf76a794a51ca1e3 P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } }
I20260321 03:02:50.187763 10053 leader_election.cc:290] T ebfa020468594a5eaf76a794a51ca1e3 P 70e7666c46844503beb466fdc054a6fc [CANDIDATE]: Term 1 election: Requested vote from peers 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:02:50.186407 8602 leader_election.cc:343] T ebfa020468594a5eaf76a794a51ca1e3 P 70e7666c46844503beb466fdc054a6fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171): Not found: Tablet not found: ebfa020468594a5eaf76a794a51ca1e3
I20260321 03:02:50.188216 8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebfa020468594a5eaf76a794a51ca1e3" candidate_uuid: "70e7666c46844503beb466fdc054a6fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a97f7dd77cf2444f8fdb441019081f79"
I20260321 03:02:50.188328 8802 raft_consensus.cc:3060] T ebfa020468594a5eaf76a794a51ca1e3 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Advancing to term 1
W20260321 03:02:50.188774 8602 leader_election.cc:343] T ebfa020468594a5eaf76a794a51ca1e3 P 70e7666c46844503beb466fdc054a6fc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171): Not found: Tablet not found: ebfa020468594a5eaf76a794a51ca1e3
I20260321 03:02:50.189437 8802 raft_consensus.cc:2468] T ebfa020468594a5eaf76a794a51ca1e3 P a97f7dd77cf2444f8fdb441019081f79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70e7666c46844503beb466fdc054a6fc in term 1.
I20260321 03:02:50.189755 8604 leader_election.cc:304] T ebfa020468594a5eaf76a794a51ca1e3 P 70e7666c46844503beb466fdc054a6fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79; no voters: 4532b54a008a4a39b663112e6d0aacc0
I20260321 03:02:50.190018 10053 raft_consensus.cc:2804] T ebfa020468594a5eaf76a794a51ca1e3 P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Leader election won for term 1
I20260321 03:02:50.190331 10053 raft_consensus.cc:697] T ebfa020468594a5eaf76a794a51ca1e3 P 70e7666c46844503beb466fdc054a6fc [term 1 LEADER]: Becoming Leader. State: Replica: 70e7666c46844503beb466fdc054a6fc, State: Running, Role: LEADER
I20260321 03:02:50.190505 10053 consensus_queue.cc:237] T ebfa020468594a5eaf76a794a51ca1e3 P 70e7666c46844503beb466fdc054a6fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } }
I20260321 03:02:50.196149 8581 heartbeater.cc:344] Connected to a master server at 127.7.178.253:46595
I20260321 03:02:50.197570 10092 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" instance_seqno: 1774062147955760) as {username='slave'} at 127.7.178.193:57149; Asking this server to re-register.
I20260321 03:02:50.198288 8581 heartbeater.cc:461] Registering TS with master...
I20260321 03:02:50.199438 10092 ts_manager.cc:194] Registered new tserver with Master: 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171)
W20260321 03:02:50.215409 8604 connection.cc:537] server connection from 127.0.0.1:59156 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260321 03:02:50.215432 8740 connection.cc:537] server connection from 127.0.0.1:34332 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260321 03:02:50.215754 10182 negotiation.cc:337] Failed RPC negotiation. Trace:
0321 03:02:50.006430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34610 (local address 127.7.178.193:46171)
0321 03:02:50.011496 (+ 5066us) server_negotiation.cc:207] Beginning negotiation
0321 03:02:50.011500 (+ 4us) server_negotiation.cc:400] Waiting for connection header
0321 03:02:50.011518 (+ 18us) server_negotiation.cc:408] Connection header received
0321 03:02:50.011574 (+ 56us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
0321 03:02:50.011577 (+ 3us) server_negotiation.cc:462] Received NEGOTIATE request from client
0321 03:02:50.011643 (+ 66us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
0321 03:02:50.011750 (+ 107us) server_negotiation.cc:227] Negotiated authn=CERTIFICATE
0321 03:02:50.022967 (+ 11217us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
0321 03:02:50.023946 (+ 979us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
0321 03:02:50.215527 (+191581us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34610: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"server-negotiator.queue_time_us":4962,"thread_start_us":94,"threads_started":1}
W20260321 03:02:50.215796 8739 connection.cc:537] client connection to 127.7.178.254:38651 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260321 03:02:50.216403 8603 connection.cc:537] client connection to 127.7.178.254:38651 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260321 03:02:50.217435 8859 connection.cc:537] client connection to 127.7.178.254:38651 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260321 03:02:50.217613 10162 negotiation.cc:337] Failed RPC negotiation. Trace:
0321 03:02:50.217093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.178.254:38651 (local address 127.7.178.194:56689)
0321 03:02:50.217238 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0321 03:02:50.217297 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0321 03:02:50.217400 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0321 03:02:50.217504 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: BlockingWrite error: write error: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":64}
W20260321 03:02:50.217921 10134 negotiation.cc:337] Failed RPC negotiation. Trace:
0321 03:02:50.216598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.178.254:38651 (local address 127.7.178.195:37889)
0321 03:02:50.216802 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0321 03:02:50.216820 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0321 03:02:50.216922 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0321 03:02:50.217826 (+ 904us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":118}
W20260321 03:02:50.218108 8859 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.7.178.254:38651)
W20260321 03:02:50.218449 8859 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.7.178.254:38651)
W20260321 03:02:50.218595 8859 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.7.178.254:38651)
W20260321 03:02:50.218926 8859 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.7.178.254:38651)
W20260321 03:02:50.227365 8466 consensus_peers.cc:597] T e72dc676a2fb4fe98229b8f0767952a9 P 4532b54a008a4a39b663112e6d0aacc0 -> Peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Couldn't send request to peer 70e7666c46844503beb466fdc054a6fc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e72dc676a2fb4fe98229b8f0767952a9. This is attempt 1: this message will repeat every 5th retry.
I20260321 03:02:50.407493 10196 raft_consensus.cc:493] T 6ece6bb47b4f4e83995fb467d2335f4c P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260321 03:02:50.407629 10196 raft_consensus.cc:515] T 6ece6bb47b4f4e83995fb467d2335f4c P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:50.408227 10196 leader_election.cc:290] T 6ece6bb47b4f4e83995fb467d2335f4c P a97f7dd77cf2444f8fdb441019081f79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171), 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713)
I20260321 03:02:50.408806 8667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ece6bb47b4f4e83995fb467d2335f4c" candidate_uuid: "a97f7dd77cf2444f8fdb441019081f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70e7666c46844503beb466fdc054a6fc" is_pre_election: true
I20260321 03:02:50.408990 8667 raft_consensus.cc:2468] T 6ece6bb47b4f4e83995fb467d2335f4c P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a97f7dd77cf2444f8fdb441019081f79 in term 0.
W20260321 03:02:50.409096 8738 leader_election.cc:343] T 6ece6bb47b4f4e83995fb467d2335f4c P a97f7dd77cf2444f8fdb441019081f79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171): Not found: Tablet not found: 6ece6bb47b4f4e83995fb467d2335f4c
I20260321 03:02:50.409399 8737 leader_election.cc:304] T 6ece6bb47b4f4e83995fb467d2335f4c P a97f7dd77cf2444f8fdb441019081f79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79; no voters: 4532b54a008a4a39b663112e6d0aacc0
I20260321 03:02:50.409588 10196 raft_consensus.cc:2804] T 6ece6bb47b4f4e83995fb467d2335f4c P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260321 03:02:50.409654 10196 raft_consensus.cc:493] T 6ece6bb47b4f4e83995fb467d2335f4c P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260321 03:02:50.409708 10196 raft_consensus.cc:3060] T 6ece6bb47b4f4e83995fb467d2335f4c P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:50.410661 10196 raft_consensus.cc:515] T 6ece6bb47b4f4e83995fb467d2335f4c P a97f7dd77cf2444f8fdb441019081f79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:50.411199 10196 leader_election.cc:290] T 6ece6bb47b4f4e83995fb467d2335f4c P a97f7dd77cf2444f8fdb441019081f79 [CANDIDATE]: Term 1 election: Requested vote from peers 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171), 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713)
I20260321 03:02:50.411646 8667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ece6bb47b4f4e83995fb467d2335f4c" candidate_uuid: "a97f7dd77cf2444f8fdb441019081f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70e7666c46844503beb466fdc054a6fc"
I20260321 03:02:50.411798 8667 raft_consensus.cc:3060] T 6ece6bb47b4f4e83995fb467d2335f4c P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Advancing to term 1
W20260321 03:02:50.411864 8738 leader_election.cc:343] T 6ece6bb47b4f4e83995fb467d2335f4c P a97f7dd77cf2444f8fdb441019081f79 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171): Not found: Tablet not found: 6ece6bb47b4f4e83995fb467d2335f4c
I20260321 03:02:50.412912 8667 raft_consensus.cc:2468] T 6ece6bb47b4f4e83995fb467d2335f4c P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a97f7dd77cf2444f8fdb441019081f79 in term 1.
I20260321 03:02:50.413342 8737 leader_election.cc:304] T 6ece6bb47b4f4e83995fb467d2335f4c P a97f7dd77cf2444f8fdb441019081f79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79; no voters: 4532b54a008a4a39b663112e6d0aacc0
I20260321 03:02:50.413625 10196 raft_consensus.cc:2804] T 6ece6bb47b4f4e83995fb467d2335f4c P a97f7dd77cf2444f8fdb441019081f79 [term 1 FOLLOWER]: Leader election won for term 1
I20260321 03:02:50.413736 10196 raft_consensus.cc:697] T 6ece6bb47b4f4e83995fb467d2335f4c P a97f7dd77cf2444f8fdb441019081f79 [term 1 LEADER]: Becoming Leader. State: Replica: a97f7dd77cf2444f8fdb441019081f79, State: Running, Role: LEADER
I20260321 03:02:50.413905 10196 consensus_queue.cc:237] T 6ece6bb47b4f4e83995fb467d2335f4c P a97f7dd77cf2444f8fdb441019081f79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
W20260321 03:02:50.476598 8469 consensus_peers.cc:597] T e72dc676a2fb4fe98229b8f0767952a9 P 4532b54a008a4a39b663112e6d0aacc0 -> Peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Couldn't send request to peer a97f7dd77cf2444f8fdb441019081f79. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e72dc676a2fb4fe98229b8f0767952a9. This is attempt 1: this message will repeat every 5th retry.
I20260321 03:02:50.511523 10207 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4a187d1fb5804686b4aff01e47fd0284)
I20260321 03:02:50.511653 10207 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:02:50.512992 10207 leader_election.cc:290] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651), 3df5e4492f3049c1b09fea013b92f863 (127.7.178.252:45145)
W20260321 03:02:50.513540 10078 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111)
W20260321 03:02:50.514325 10078 leader_election.cc:336] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651): Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111)
W20260321 03:02:50.514528 10076 leader_election.cc:336] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 3df5e4492f3049c1b09fea013b92f863 (127.7.178.252:45145): Network error: Client connection negotiation failed: client connection to 127.7.178.252:45145: connect: Connection refused (error 111)
I20260321 03:02:50.514619 10076 leader_election.cc:304] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7451d7c0a71f4620a6607f74b5a22f2e; no voters: 3df5e4492f3049c1b09fea013b92f863, 4a187d1fb5804686b4aff01e47fd0284
I20260321 03:02:50.514979 10207 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260321 03:02:50.596671 8602 consensus_peers.cc:597] T ebfa020468594a5eaf76a794a51ca1e3 P 70e7666c46844503beb466fdc054a6fc -> Peer 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171): Couldn't send request to peer 4532b54a008a4a39b663112e6d0aacc0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ebfa020468594a5eaf76a794a51ca1e3. This is attempt 1: this message will repeat every 5th retry.
I20260321 03:02:50.733325 10053 consensus_queue.cc:1048] T ebfa020468594a5eaf76a794a51ca1e3 P 70e7666c46844503beb466fdc054a6fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260321 03:02:50.958385 8738 consensus_peers.cc:597] T 6ece6bb47b4f4e83995fb467d2335f4c P a97f7dd77cf2444f8fdb441019081f79 -> Peer 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171): Couldn't send request to peer 4532b54a008a4a39b663112e6d0aacc0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6ece6bb47b4f4e83995fb467d2335f4c. This is attempt 1: this message will repeat every 5th retry.
I20260321 03:02:50.977617 10196 consensus_queue.cc:1048] T 6ece6bb47b4f4e83995fb467d2335f4c P a97f7dd77cf2444f8fdb441019081f79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260321 03:02:51.038492 10225 ts_tablet_manager.cc:933] T ebfa020468594a5eaf76a794a51ca1e3 P 4532b54a008a4a39b663112e6d0aacc0: Initiating tablet copy from peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713)
I20260321 03:02:51.039108 10225 tablet_copy_client.cc:323] T ebfa020468594a5eaf76a794a51ca1e3 P 4532b54a008a4a39b663112e6d0aacc0: tablet copy: Beginning tablet copy session from remote peer at address 127.7.178.194:44713
I20260321 03:02:51.040205 8687 tablet_copy_service.cc:140] P 70e7666c46844503beb466fdc054a6fc: Received BeginTabletCopySession request for tablet ebfa020468594a5eaf76a794a51ca1e3 from peer 4532b54a008a4a39b663112e6d0aacc0 ({username='slave'} at 127.7.178.193:33649)
I20260321 03:02:51.040383 8687 tablet_copy_service.cc:161] P 70e7666c46844503beb466fdc054a6fc: Beginning new tablet copy session on tablet ebfa020468594a5eaf76a794a51ca1e3 from peer 4532b54a008a4a39b663112e6d0aacc0 at {username='slave'} at 127.7.178.193:33649: session id = 4532b54a008a4a39b663112e6d0aacc0-ebfa020468594a5eaf76a794a51ca1e3
I20260321 03:02:51.041829 8687 tablet_copy_source_session.cc:215] T ebfa020468594a5eaf76a794a51ca1e3 P 70e7666c46844503beb466fdc054a6fc: Tablet Copy: opened 0 blocks and 1 log segments
I20260321 03:02:51.043740 10225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebfa020468594a5eaf76a794a51ca1e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:51.046208 10225 tablet_copy_client.cc:806] T ebfa020468594a5eaf76a794a51ca1e3 P 4532b54a008a4a39b663112e6d0aacc0: tablet copy: Starting download of 0 data blocks...
I20260321 03:02:51.046506 10225 tablet_copy_client.cc:670] T ebfa020468594a5eaf76a794a51ca1e3 P 4532b54a008a4a39b663112e6d0aacc0: tablet copy: Starting download of 1 WAL segments...
I20260321 03:02:51.048877 10225 tablet_copy_client.cc:538] T ebfa020468594a5eaf76a794a51ca1e3 P 4532b54a008a4a39b663112e6d0aacc0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260321 03:02:51.050537 10225 tablet_bootstrap.cc:492] T ebfa020468594a5eaf76a794a51ca1e3 P 4532b54a008a4a39b663112e6d0aacc0: Bootstrap starting.
I20260321 03:02:51.054759 10225 tablet_bootstrap.cc:492] T ebfa020468594a5eaf76a794a51ca1e3 P 4532b54a008a4a39b663112e6d0aacc0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260321 03:02:51.055097 10225 tablet_bootstrap.cc:492] T ebfa020468594a5eaf76a794a51ca1e3 P 4532b54a008a4a39b663112e6d0aacc0: Bootstrap complete.
I20260321 03:02:51.055292 10225 ts_tablet_manager.cc:1403] T ebfa020468594a5eaf76a794a51ca1e3 P 4532b54a008a4a39b663112e6d0aacc0: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260321 03:02:51.055899 10225 raft_consensus.cc:359] T ebfa020468594a5eaf76a794a51ca1e3 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } }
I20260321 03:02:51.056074 10225 raft_consensus.cc:740] T ebfa020468594a5eaf76a794a51ca1e3 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4532b54a008a4a39b663112e6d0aacc0, State: Initialized, Role: FOLLOWER
I20260321 03:02:51.056267 10225 consensus_queue.cc:260] T ebfa020468594a5eaf76a794a51ca1e3 P 4532b54a008a4a39b663112e6d0aacc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } }
I20260321 03:02:51.056586 10225 ts_tablet_manager.cc:1434] T ebfa020468594a5eaf76a794a51ca1e3 P 4532b54a008a4a39b663112e6d0aacc0: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260321 03:02:51.057101 10211 raft_consensus.cc:493] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a97f7dd77cf2444f8fdb441019081f79)
I20260321 03:02:51.057205 10211 raft_consensus.cc:515] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:51.057610 8687 tablet_copy_service.cc:342] P 70e7666c46844503beb466fdc054a6fc: Request end of tablet copy session 4532b54a008a4a39b663112e6d0aacc0-ebfa020468594a5eaf76a794a51ca1e3 received from {username='slave'} at 127.7.178.193:33649
I20260321 03:02:51.057724 10211 leader_election.cc:290] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
I20260321 03:02:51.057744 8687 tablet_copy_service.cc:434] P 70e7666c46844503beb466fdc054a6fc: ending tablet copy session 4532b54a008a4a39b663112e6d0aacc0-ebfa020468594a5eaf76a794a51ca1e3 on tablet ebfa020468594a5eaf76a794a51ca1e3 with peer 4532b54a008a4a39b663112e6d0aacc0
W20260321 03:02:51.058516 8469 leader_election.cc:343] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: a4a81619964144e9aae068ed1e9eeaff
W20260321 03:02:51.059365 8466 leader_election.cc:343] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: a4a81619964144e9aae068ed1e9eeaff
I20260321 03:02:51.059445 8466 leader_election.cc:304] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:02:51.059625 10211 raft_consensus.cc:2749] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:02:51.232518 10228 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4a187d1fb5804686b4aff01e47fd0284)
I20260321 03:02:51.232719 10228 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:02:51.233392 10228 leader_election.cc:290] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651), 3df5e4492f3049c1b09fea013b92f863 (127.7.178.252:45145)
W20260321 03:02:51.234902 10078 leader_election.cc:336] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651): Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111)
W20260321 03:02:51.235086 10076 leader_election.cc:336] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 3df5e4492f3049c1b09fea013b92f863 (127.7.178.252:45145): Network error: Client connection negotiation failed: client connection to 127.7.178.252:45145: connect: Connection refused (error 111)
I20260321 03:02:51.235173 10076 leader_election.cc:304] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7451d7c0a71f4620a6607f74b5a22f2e; no voters: 3df5e4492f3049c1b09fea013b92f863, 4a187d1fb5804686b4aff01e47fd0284
I20260321 03:02:51.235354 10228 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260321 03:02:51.296792 10211 raft_consensus.cc:493] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 70e7666c46844503beb466fdc054a6fc)
I20260321 03:02:51.296953 10211 raft_consensus.cc:515] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:51.297602 10211 leader_election.cc:290] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:02:51.298556 8466 leader_election.cc:343] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: ba92d73996f84bbfbab47006dc934c8e
W20260321 03:02:51.298661 8469 leader_election.cc:343] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: ba92d73996f84bbfbab47006dc934c8e
I20260321 03:02:51.298739 8469 leader_election.cc:304] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:02:51.298923 10211 raft_consensus.cc:2749] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:02:51.436424 10225 ts_tablet_manager.cc:933] T 6ece6bb47b4f4e83995fb467d2335f4c P 4532b54a008a4a39b663112e6d0aacc0: Initiating tablet copy from peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
I20260321 03:02:51.436827 10225 tablet_copy_client.cc:323] T 6ece6bb47b4f4e83995fb467d2335f4c P 4532b54a008a4a39b663112e6d0aacc0: tablet copy: Beginning tablet copy session from remote peer at address 127.7.178.195:42091
I20260321 03:02:51.437796 8820 tablet_copy_service.cc:140] P a97f7dd77cf2444f8fdb441019081f79: Received BeginTabletCopySession request for tablet 6ece6bb47b4f4e83995fb467d2335f4c from peer 4532b54a008a4a39b663112e6d0aacc0 ({username='slave'} at 127.7.178.193:47015)
I20260321 03:02:51.438025 8820 tablet_copy_service.cc:161] P a97f7dd77cf2444f8fdb441019081f79: Beginning new tablet copy session on tablet 6ece6bb47b4f4e83995fb467d2335f4c from peer 4532b54a008a4a39b663112e6d0aacc0 at {username='slave'} at 127.7.178.193:47015: session id = 4532b54a008a4a39b663112e6d0aacc0-6ece6bb47b4f4e83995fb467d2335f4c
I20260321 03:02:51.439507 8820 tablet_copy_source_session.cc:215] T 6ece6bb47b4f4e83995fb467d2335f4c P a97f7dd77cf2444f8fdb441019081f79: Tablet Copy: opened 0 blocks and 1 log segments
I20260321 03:02:51.440959 10225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ece6bb47b4f4e83995fb467d2335f4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:51.443601 10225 tablet_copy_client.cc:806] T 6ece6bb47b4f4e83995fb467d2335f4c P 4532b54a008a4a39b663112e6d0aacc0: tablet copy: Starting download of 0 data blocks...
I20260321 03:02:51.443862 10225 tablet_copy_client.cc:670] T 6ece6bb47b4f4e83995fb467d2335f4c P 4532b54a008a4a39b663112e6d0aacc0: tablet copy: Starting download of 1 WAL segments...
I20260321 03:02:51.446195 10225 tablet_copy_client.cc:538] T 6ece6bb47b4f4e83995fb467d2335f4c P 4532b54a008a4a39b663112e6d0aacc0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260321 03:02:51.447575 10225 tablet_bootstrap.cc:492] T 6ece6bb47b4f4e83995fb467d2335f4c P 4532b54a008a4a39b663112e6d0aacc0: Bootstrap starting.
I20260321 03:02:51.450766 10225 tablet_bootstrap.cc:492] T 6ece6bb47b4f4e83995fb467d2335f4c P 4532b54a008a4a39b663112e6d0aacc0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260321 03:02:51.451084 10225 tablet_bootstrap.cc:492] T 6ece6bb47b4f4e83995fb467d2335f4c P 4532b54a008a4a39b663112e6d0aacc0: Bootstrap complete.
I20260321 03:02:51.451283 10225 ts_tablet_manager.cc:1403] T 6ece6bb47b4f4e83995fb467d2335f4c P 4532b54a008a4a39b663112e6d0aacc0: Time spent bootstrapping tablet: real 0.004s user 0.004s sys 0.000s
I20260321 03:02:51.451848 10225 raft_consensus.cc:359] T 6ece6bb47b4f4e83995fb467d2335f4c P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:51.452044 10225 raft_consensus.cc:740] T 6ece6bb47b4f4e83995fb467d2335f4c P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4532b54a008a4a39b663112e6d0aacc0, State: Initialized, Role: FOLLOWER
I20260321 03:02:51.452248 10225 consensus_queue.cc:260] T 6ece6bb47b4f4e83995fb467d2335f4c P 4532b54a008a4a39b663112e6d0aacc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:51.452553 10225 ts_tablet_manager.cc:1434] T 6ece6bb47b4f4e83995fb467d2335f4c P 4532b54a008a4a39b663112e6d0aacc0: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260321 03:02:51.453382 8820 tablet_copy_service.cc:342] P a97f7dd77cf2444f8fdb441019081f79: Request end of tablet copy session 4532b54a008a4a39b663112e6d0aacc0-6ece6bb47b4f4e83995fb467d2335f4c received from {username='slave'} at 127.7.178.193:47015
I20260321 03:02:51.453500 8820 tablet_copy_service.cc:434] P a97f7dd77cf2444f8fdb441019081f79: ending tablet copy session 4532b54a008a4a39b663112e6d0aacc0-6ece6bb47b4f4e83995fb467d2335f4c on tablet 6ece6bb47b4f4e83995fb467d2335f4c with peer 4532b54a008a4a39b663112e6d0aacc0
I20260321 03:02:51.499413 8532 raft_consensus.cc:1217] T ebfa020468594a5eaf76a794a51ca1e3 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 0.0->[1.1-1.1] Dedup: 1.1->[]
I20260321 03:02:51.529511 10211 raft_consensus.cc:493] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a97f7dd77cf2444f8fdb441019081f79)
I20260321 03:02:51.529672 10211 raft_consensus.cc:515] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:51.530153 10211 leader_election.cc:290] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:02:51.531108 8466 leader_election.cc:343] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: e55ead2b80354ddf8876a5f8410122a2
W20260321 03:02:51.531221 8469 leader_election.cc:343] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: e55ead2b80354ddf8876a5f8410122a2
I20260321 03:02:51.531284 8469 leader_election.cc:304] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:02:51.531451 10211 raft_consensus.cc:2749] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:02:51.866366 8532 raft_consensus.cc:1217] T 6ece6bb47b4f4e83995fb467d2335f4c P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 0.0->[1.1-1.1] Dedup: 1.1->[]
I20260321 03:02:52.107100 10246 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4a187d1fb5804686b4aff01e47fd0284)
I20260321 03:02:52.107259 10246 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:02:52.107882 10246 leader_election.cc:290] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651), 3df5e4492f3049c1b09fea013b92f863 (127.7.178.252:45145)
W20260321 03:02:52.109416 10076 leader_election.cc:336] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 3df5e4492f3049c1b09fea013b92f863 (127.7.178.252:45145): Network error: Client connection negotiation failed: client connection to 127.7.178.252:45145: connect: Connection refused (error 111)
W20260321 03:02:52.109582 10078 leader_election.cc:336] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651): Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111)
I20260321 03:02:52.109696 10078 leader_election.cc:304] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7451d7c0a71f4620a6607f74b5a22f2e; no voters: 3df5e4492f3049c1b09fea013b92f863, 4a187d1fb5804686b4aff01e47fd0284
I20260321 03:02:52.110001 10246 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260321 03:02:52.621558 10212 raft_consensus.cc:493] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a97f7dd77cf2444f8fdb441019081f79)
I20260321 03:02:52.621735 10212 raft_consensus.cc:515] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:52.622238 10212 leader_election.cc:290] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:02:52.623343 8466 leader_election.cc:343] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: a4a81619964144e9aae068ed1e9eeaff
W20260321 03:02:52.623560 8469 leader_election.cc:343] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: a4a81619964144e9aae068ed1e9eeaff
I20260321 03:02:52.623636 8469 leader_election.cc:304] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:02:52.624120 10211 raft_consensus.cc:2749] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:02:52.862171 7883 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskZ5BwAx/build/debug/bin/kudu
/tmp/dist-test-taskZ5BwAx/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.178.252:45145
--webserver_interface=127.7.178.252
--webserver_port=36797
--builtin_ntp_servers=127.7.178.212:39683
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145
--hive_metastore_uris=thrift://127.0.0.1:35641
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260321 03:02:52.979189 10254 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260321 03:02:52.979457 10254 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260321 03:02:52.979501 10254 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260321 03:02:52.983634 10254 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260321 03:02:52.983752 10254 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260321 03:02:52.983793 10254 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260321 03:02:52.983834 10254 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260321 03:02:52.989024 10254 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.178.212:39683
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-2/wal
--hive_metastore_uris=thrift://127.0.0.1:35641
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.178.252:45145
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.7.178.252
--webserver_port=36797
--never_fsync=true
--heap_profile_path=/tmp/kudu.10254
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 68f10dd41067059260a5fb5c725b178b69c38aed
build type DEBUG
built by None at 21 Mar 2026 02:43:15 UTC on bdcb31816ec0
build id 11028
I20260321 03:02:52.990314 10254 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260321 03:02:52.991837 10254 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260321 03:02:53.001464 10265 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260321 03:02:53.001609 10263 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260321 03:02:53.001619 10262 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260321 03:02:53.001768 10254 server_base.cc:1061] running on GCE node
I20260321 03:02:53.003261 10254 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260321 03:02:53.004701 10254 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260321 03:02:53.005932 10254 hybrid_clock.cc:648] HybridClock initialized: now 1774062173005899 us; error 58 us; skew 500 ppm
I20260321 03:02:53.007977 10254 webserver.cc:492] Webserver started at http://127.7.178.252:36797/ using document root <none> and password file <none>
I20260321 03:02:53.008638 10254 fs_manager.cc:362] Metadata directory not provided
I20260321 03:02:53.008702 10254 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260321 03:02:53.012750 10254 fs_manager.cc:714] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260321 03:02:53.015396 10273 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260321 03:02:53.017102 10254 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260321 03:02:53.017302 10254 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-2/data,/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-2/wal
uuid: "3df5e4492f3049c1b09fea013b92f863"
format_stamp: "Formatted at 2026-03-21 03:02:27 on dist-test-slave-bwf0"
I20260321 03:02:53.017788 10254 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260321 03:02:53.029363 10254 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260321 03:02:53.030138 10254 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260321 03:02:53.030339 10254 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260321 03:02:53.038298 10325 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.178.252:45145 every 8 connection(s)
I20260321 03:02:53.038314 10254 rpc_server.cc:307] RPC server started. Bound to: 127.7.178.252:45145
I20260321 03:02:53.039657 10254 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-2/data/info.pb
I20260321 03:02:53.044543 10326 sys_catalog.cc:263] Verifying existing consensus state
I20260321 03:02:53.046568 10326 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863: Bootstrap starting.
I20260321 03:02:53.049952 7883 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskZ5BwAx/build/debug/bin/kudu as pid 10254
I20260321 03:02:53.058126 10326 log.cc:826] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863: Log is configured to *not* fsync() on all Append() calls
I20260321 03:02:53.103048 10211 raft_consensus.cc:493] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a97f7dd77cf2444f8fdb441019081f79)
I20260321 03:02:53.103224 10211 raft_consensus.cc:515] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:53.103434 10326 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863: Bootstrap replayed 1/1 log segments. Stats: ops{read=85 overwritten=0 applied=85 ignored=0} inserts{seen=52 ignored=0} mutations{seen=75 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260321 03:02:53.103801 10211 leader_election.cc:290] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
I20260321 03:02:53.104020 10326 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863: Bootstrap complete.
W20260321 03:02:53.104612 8466 leader_election.cc:343] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: e55ead2b80354ddf8876a5f8410122a2
W20260321 03:02:53.104724 8469 leader_election.cc:343] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: e55ead2b80354ddf8876a5f8410122a2
I20260321 03:02:53.104827 8469 leader_election.cc:304] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:02:53.104990 10211 raft_consensus.cc:2749] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:02:53.107237 10326 raft_consensus.cc:359] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 6 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:02:53.107637 10326 raft_consensus.cc:740] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 6 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3df5e4492f3049c1b09fea013b92f863, State: Initialized, Role: FOLLOWER
I20260321 03:02:53.108062 10326 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 85, Last appended: 6.85, Last appended by leader: 85, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:02:53.108549 10330 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 6 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } } }
I20260321 03:02:53.108784 10330 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [sys.catalog]: This master's current role is: FOLLOWER
I20260321 03:02:53.109368 10326 sys_catalog.cc:565] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [sys.catalog]: configured and running, proceeding with master startup.
I20260321 03:02:53.116146 10344 catalog_manager.cc:1269] Loaded cluster ID: 30588dbe2d29416e8c640adf9bfaba1f
I20260321 03:02:53.116356 10344 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863: loading cluster ID for follower catalog manager: success
I20260321 03:02:53.118976 10344 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863: acquiring CA information for follower catalog manager: success
I20260321 03:02:53.120797 10344 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260321 03:02:53.121598 10254 master_runner.cc:186] Error getting master registration for 127.7.178.254:38651: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111),
I20260321 03:02:53.123919 10254 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260321 03:02:53.237183 8579 heartbeater.cc:344] Connected to a master server at 127.7.178.252:45145
I20260321 03:02:53.239612 10290 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" instance_seqno: 1774062147955760) as {username='slave'} at 127.7.178.193:33531; Asking this server to re-register.
I20260321 03:02:53.240288 8579 heartbeater.cc:461] Registering TS with master...
I20260321 03:02:53.241955 10290 ts_manager.cc:194] Registered new tserver with Master: 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171)
I20260321 03:02:53.252868 10349 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4a187d1fb5804686b4aff01e47fd0284)
I20260321 03:02:53.253067 10349 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:02:53.253620 10349 leader_election.cc:290] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651), 3df5e4492f3049c1b09fea013b92f863 (127.7.178.252:45145)
W20260321 03:02:53.255275 10078 leader_election.cc:336] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651): Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111)
I20260321 03:02:53.258184 10300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" candidate_term: 8 candidate_status { last_received { term: 7 index: 91 } } ignore_live_leader: false dest_uuid: "3df5e4492f3049c1b09fea013b92f863" is_pre_election: true
I20260321 03:02:53.258548 10300 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7451d7c0a71f4620a6607f74b5a22f2e in term 6.
I20260321 03:02:53.258994 10076 leader_election.cc:304] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3df5e4492f3049c1b09fea013b92f863, 7451d7c0a71f4620a6607f74b5a22f2e; no voters: 4a187d1fb5804686b4aff01e47fd0284
I20260321 03:02:53.259277 10349 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260321 03:02:53.259342 10349 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4a187d1fb5804686b4aff01e47fd0284)
I20260321 03:02:53.259398 10349 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [term 7 FOLLOWER]: Advancing to term 8
I20260321 03:02:53.260293 10349 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:02:53.260752 10349 leader_election.cc:290] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [CANDIDATE]: Term 8 election: Requested vote from peers 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651), 3df5e4492f3049c1b09fea013b92f863 (127.7.178.252:45145)
I20260321 03:02:53.261294 10300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" candidate_term: 8 candidate_status { last_received { term: 7 index: 91 } } ignore_live_leader: false dest_uuid: "3df5e4492f3049c1b09fea013b92f863"
I20260321 03:02:53.261451 10300 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 6 FOLLOWER]: Advancing to term 8
W20260321 03:02:53.261799 10078 leader_election.cc:336] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651): Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111)
I20260321 03:02:53.264057 10300 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7451d7c0a71f4620a6607f74b5a22f2e in term 8.
I20260321 03:02:53.264564 10076 leader_election.cc:304] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3df5e4492f3049c1b09fea013b92f863, 7451d7c0a71f4620a6607f74b5a22f2e; no voters: 4a187d1fb5804686b4aff01e47fd0284
I20260321 03:02:53.264843 10349 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [term 8 FOLLOWER]: Leader election won for term 8
I20260321 03:02:53.265141 10349 raft_consensus.cc:697] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [term 8 LEADER]: Becoming Leader. State: Replica: 7451d7c0a71f4620a6607f74b5a22f2e, State: Running, Role: LEADER
I20260321 03:02:53.265498 10349 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 91, Committed index: 91, Last appended: 7.91, Last appended by leader: 91, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:02:53.266623 10353 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7451d7c0a71f4620a6607f74b5a22f2e. Latest consensus state: current_term: 8 leader_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } } }
I20260321 03:02:53.266752 10353 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [sys.catalog]: This master's current role is: LEADER
I20260321 03:02:53.267069 10355 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260321 03:02:53.269097 10355 catalog_manager.cc:679] Loaded metadata for table default.table_c8e5202d265f463bbcf568d34a1e64a2 [id=4ac1925a391a48ea86c63da0c1d8c442]
I20260321 03:02:53.269428 10355 catalog_manager.cc:679] Loaded metadata for table default.table_0e0c55f293274457aed5e8d315334903 [id=850c888ac63d4c048f27ceeb1ddd4f83]
I20260321 03:02:53.269668 10355 catalog_manager.cc:679] Loaded metadata for table default.table_10dd23c6f33c4aa0bad0a534fb770d4a [id=94ef39d020ab428b9e0392bedab9483d]
I20260321 03:02:53.269899 10355 catalog_manager.cc:679] Loaded metadata for table default.table_60888690371e4e1d8d9e6a31f44b55a5 [id=9bc91b7f6cb8477ab6ed1ee5ed74f608]
I20260321 03:02:53.270123 10355 catalog_manager.cc:679] Loaded metadata for table default.table_f8b27d78677b44468e403c75afa5245a [id=9f5de6240b844d57991fc673d061fbf4]
I20260321 03:02:53.270499 10355 catalog_manager.cc:679] Loaded metadata for table default.table_d52655a709224a7d999af3a2f1f2a678 [id=a69b5fce47c341fe9f48dd5e36364533]
I20260321 03:02:53.270959 10355 catalog_manager.cc:679] Loaded metadata for table default.table_0e444e840fa14c16a1a1f2e750c73045 [id=c6b5b0c7a19649c2b502921f472fc1dc]
I20260321 03:02:53.271211 10355 catalog_manager.cc:679] Loaded metadata for table default.table_06e0fbe90fe0411d95d76f56b53fb175 [id=c7602cbc743a43239656449386fbeb83]
I20260321 03:02:53.272496 10355 tablet_loader.cc:96] loaded metadata for tablet 0c90afb0d24a428f846cc2bfc24379ab (table default.table_0e0c55f293274457aed5e8d315334903 [id=850c888ac63d4c048f27ceeb1ddd4f83])
I20260321 03:02:53.273269 10355 tablet_loader.cc:96] loaded metadata for tablet 3722d9914162463ba9cd377dee251be0 (table default.table_c8e5202d265f463bbcf568d34a1e64a2 [id=4ac1925a391a48ea86c63da0c1d8c442])
I20260321 03:02:53.274058 10355 tablet_loader.cc:96] loaded metadata for tablet 684e6213d9044b6794a012a83714b731 (table default.table_d52655a709224a7d999af3a2f1f2a678 [id=a69b5fce47c341fe9f48dd5e36364533])
I20260321 03:02:53.274407 10355 tablet_loader.cc:96] loaded metadata for tablet 6ece6bb47b4f4e83995fb467d2335f4c (table default.table_06e0fbe90fe0411d95d76f56b53fb175 [id=c7602cbc743a43239656449386fbeb83])
I20260321 03:02:53.274685 10355 tablet_loader.cc:96] loaded metadata for tablet 8535a1895af2482f90cfd53a79de88d5 (table default.table_60888690371e4e1d8d9e6a31f44b55a5 [id=9bc91b7f6cb8477ab6ed1ee5ed74f608])
I20260321 03:02:53.275431 10355 tablet_loader.cc:96] loaded metadata for tablet c1e54bc634ac44199436f2c538e6d63f (table default.table_f8b27d78677b44468e403c75afa5245a [id=9f5de6240b844d57991fc673d061fbf4])
I20260321 03:02:53.276213 10355 tablet_loader.cc:96] loaded metadata for tablet ebfa020468594a5eaf76a794a51ca1e3 (table default.table_0e444e840fa14c16a1a1f2e750c73045 [id=c6b5b0c7a19649c2b502921f472fc1dc])
I20260321 03:02:53.276495 10355 tablet_loader.cc:96] loaded metadata for tablet fa013cbd4162443893013c61552ba5ea (table default.table_10dd23c6f33c4aa0bad0a534fb770d4a [id=94ef39d020ab428b9e0392bedab9483d])
I20260321 03:02:53.276757 10355 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260321 03:02:53.277634 10355 catalog_manager.cc:1269] Loaded cluster ID: 30588dbe2d29416e8c640adf9bfaba1f
I20260321 03:02:53.277704 10355 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260321 03:02:53.278529 10355 catalog_manager.cc:1514] Loading token signing keys...
I20260321 03:02:53.279183 10355 catalog_manager.cc:6055] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e: Loaded TSK: 0
I20260321 03:02:53.279902 10355 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260321 03:02:53.280561 10355 catalog_manager.cc:1537] Loading latest processed Hive Metastore notification log event ID...
I20260321 03:02:53.281195 10355 catalog_manager.cc:5893] Last processed Hive Metastore notification event ID: 21
I20260321 03:02:53.302923 10091 master_service.cc:954] ReplaceTablet: received request to replace tablet 0c90afb0d24a428f846cc2bfc24379ab from {username='slave'} at 127.0.0.1:35282
I20260321 03:02:53.302938 10092 master_service.cc:954] ReplaceTablet: received request to replace tablet c1e54bc634ac44199436f2c538e6d63f from {username='slave'} at 127.0.0.1:35282
I20260321 03:02:53.304198 10090 master_service.cc:954] ReplaceTablet: received request to replace tablet 3722d9914162463ba9cd377dee251be0 from {username='slave'} at 127.0.0.1:35282
I20260321 03:02:53.304908 10088 master_service.cc:954] ReplaceTablet: received request to replace tablet 0c90afb0d24a428f846cc2bfc24379ab from {username='slave'} at 127.0.0.1:35282
I20260321 03:02:53.305061 10083 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35282:
name: "default.Table_79533ce61645417d9d18b6b2820ee1af"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260321 03:02:53.305202 10086 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:35282:
table { table_name: "default.Table_d52655a709224a7d999af3a2f1f2a678" } modify_external_catalogs: true
I20260321 03:02:53.305357 10086 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:35282:
table { table_name: "default.Table_d52655a709224a7d999af3a2f1f2a678" } modify_external_catalogs: true
I20260321 03:02:53.305083 10089 master_service.cc:954] ReplaceTablet: received request to replace tablet 8535a1895af2482f90cfd53a79de88d5 from {username='slave'} at 127.0.0.1:35282
I20260321 03:02:53.306094 10087 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35282:
name: "default.Table_01a908196f6d4a1ba499b382b6932d90"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260321 03:02:53.307447 10300 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Refusing update from remote peer 7451d7c0a71f4620a6607f74b5a22f2e: Log matching property violated. Preceding OpId in replica: term: 6 index: 85. Preceding OpId from leader: term: 8 index: 93. (index mismatch)
I20260321 03:02:53.307904 10084 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35282:
name: "default.Table_492554e7d97c4920bdf854ca950c0179"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260321 03:02:53.308193 10349 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 92, Last known committed idx: 85, Time since last communication: 0.000s
I20260321 03:02:53.308270 10085 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35282:
name: "default.Table_9b16e83d2d334faaa3ccd9aaae03ccf7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260321 03:02:53.310518 10212 raft_consensus.cc:493] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 70e7666c46844503beb466fdc054a6fc)
I20260321 03:02:53.310665 10212 raft_consensus.cc:515] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:53.311141 10212 leader_election.cc:290] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:02:53.311861 8469 leader_election.cc:343] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: ba92d73996f84bbfbab47006dc934c8e
W20260321 03:02:53.311983 8466 leader_election.cc:343] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: ba92d73996f84bbfbab47006dc934c8e
I20260321 03:02:53.312048 8466 leader_election.cc:304] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:02:53.312187 10212 raft_consensus.cc:2749] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
F20260321 03:02:53.313057 10149 hms_notification_log_listener.cc:287] non-monotonous event IDs from HMS: current 23, previous 23; dumping first 3 out of 6 received events: NotificationEvent(eventId=22, eventTime=1774062151, eventType=DROP_TABLE, dbName=default, tableName=table_79533ce61645417d9d18b6b2820ee1af, message={"server":"","servicePrincipal":"","db":"default","table":"table_79533ce61645417d9d18b6b2820ee1af","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_79533ce61645417d9d18b6b2820ee1af\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1774062150},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/warehouse/table_79533ce61645417d9d18b6b2820ee1af\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_79533ce61645417d9d18b6b2820ee1af\",\"kudu.table_id\":\"435759bdc4464e5f859546dfc760d6ad\",\"transient_lastDdlTime\":\"1774062150\",\"comment\":\"\",\"kudu.master_addresses\":\"127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"30588dbe2d29416e8c640adf9bfaba1f\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1774062151}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=23, eventTime=1774062151, eventType=DROP_TABLE, dbName=default, tableName=table_0e0c55f293274457aed5e8d315334903, message={"server":"","servicePrincipal":"","db":"default","table":"table_0e0c55f293274457aed5e8d315334903","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_0e0c55f293274457aed5e8d315334903\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1774062149},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/warehouse/table_0e0c55f293274457aed5e8d315334903\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_0e0c55f293274457aed5e8d315334903\",\"kudu.table_id\":\"850c888ac63d4c048f27ceeb1ddd4f83\",\"transient_lastDdlTime\":\"1774062149\",\"comment\":\"\",\"kudu.master_addresses\":\"127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"30588dbe2d29416e8c640adf9bfaba1f\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1774062151}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=23, eventTime=1774062151, eventType=DROP_TABLE, dbName=default, tableName=table_492554e7d97c4920bdf854ca950c0179, message={"server":"","servicePrincipal":"","db":"default","table":"table_492554e7d97c4920bdf854ca950c0179","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_492554e7d97c4920bdf854ca950c0179\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1774062151},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/warehouse/table_492554e7d97c4920bdf854ca950c0179\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_492554e7d97c4920bdf854ca950c0179\",\"kudu.table_id\":\"1eabb731ef9a41249c3e08ccf80157e4\",\"transient_lastDdlTime\":\"1774062151\",\"comment\":\"\",\"kudu.master_addresses\":\"127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"30588dbe2d29416e8c640adf9bfaba1f\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1774062151}, messageFormat=json-0.2, catName=hive);
*** Check failure stack trace: ***
W20260321 03:02:53.313284 10078 consensus_peers.cc:597] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e -> Peer 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651): Couldn't send request to peer 4a187d1fb5804686b4aff01e47fd0284. Status: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260321 03:02:53.315533 10330 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7451d7c0a71f4620a6607f74b5a22f2e. Latest consensus state: current_term: 8 leader_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } } }
I20260321 03:02:53.315703 10330 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [sys.catalog]: This master's current role is: FOLLOWER
I20260321 03:02:53.315819 10330 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 8 leader_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } } }
I20260321 03:02:53.315894 10330 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [sys.catalog]: This master's current role is: FOLLOWER
@ 0x7f2256f01dcd google::LogMessage::Fail() at ??:0
I20260321 03:02:53.317662 10358 mvcc.cc:204] Tried to move back new op lower bound from 7266558648348495872 to 7266558647506755584. Current Snapshot: MvccSnapshot[applied={T|T < 7266558648348495872 or (T in {7266558648348495872})}]
I20260321 03:02:53.318246 10353 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 8 leader_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } } }
I20260321 03:02:53.318377 10353 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e [sys.catalog]: This master's current role is: LEADER
I20260321 03:02:53.319094 10092 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e: Sending DeleteTablet for 3 replicas of tablet c1e54bc634ac44199436f2c538e6d63f
I20260321 03:02:53.319375 10088 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35282:
name: "default.Table_9017f1e107c846008985a821415447b8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260321 03:02:53.319486 10089 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e: Sending DeleteTablet for 3 replicas of tablet 8535a1895af2482f90cfd53a79de88d5
I20260321 03:02:53.320286 10092 catalog_manager.cc:6741] ReplaceTablet: tablet c1e54bc634ac44199436f2c538e6d63f deleted and replaced by tablet 32505df528a5474392351292dbd040a3
I20260321 03:02:53.320286 10360 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 8 leader_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } } }
I20260321 03:02:53.320407 10360 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [sys.catalog]: This master's current role is: FOLLOWER
I20260321 03:02:53.320508 10092 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35282:
name: "default.Table_d2585fcc892d4f4882c0a068ce656fee"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260321 03:02:53.320973 10091 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e: Sending DeleteTablet for 3 replicas of tablet 0c90afb0d24a428f846cc2bfc24379ab
I20260321 03:02:53.321349 10091 catalog_manager.cc:6741] ReplaceTablet: tablet 0c90afb0d24a428f846cc2bfc24379ab deleted and replaced by tablet d6b5027920604b03a7cf9d54045c5a48
I20260321 03:02:53.321594 10091 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35282:
name: "default.Table_bda6f16160c04b1190bb1866f63d3af2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
@ 0x7f2256f05b93 google::LogMessage::SendToLog() at ??:0
@ 0x7f2256f017cc google::LogMessage::Flush() at ??:0
I20260321 03:02:53.326334 8508 tablet_service.cc:1558] Processing DeleteTablet for tablet c1e54bc634ac44199436f2c538e6d63f with delete_type TABLET_DATA_DELETED (replaced by tablet 32505df528a5474392351292dbd040a3) from {username='slave'} at 127.0.0.1:43458
I20260321 03:02:53.326419 8506 tablet_service.cc:1558] Processing DeleteTablet for tablet 8535a1895af2482f90cfd53a79de88d5 with delete_type TABLET_DATA_DELETED (replaced by tablet 9547a447294045e8a7973aef3b84b6a9) from {username='slave'} at 127.0.0.1:43458
I20260321 03:02:53.326768 10089 catalog_manager.cc:6741] ReplaceTablet: tablet 8535a1895af2482f90cfd53a79de88d5 deleted and replaced by tablet 9547a447294045e8a7973aef3b84b6a9
I20260321 03:02:53.327049 10089 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35282:
name: "default.Table_ba8bb11787c9433093d74640a71395f2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260321 03:02:53.326440 8507 tablet_service.cc:1558] Processing DeleteTablet for tablet 0c90afb0d24a428f846cc2bfc24379ab with delete_type TABLET_DATA_DELETED (replaced by tablet d6b5027920604b03a7cf9d54045c5a48) from {username='slave'} at 127.0.0.1:43458
@ 0x7f2256f01a11 google::LogMessage::~LogMessage() at ??:0
I20260321 03:02:53.328167 10090 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 7451d7c0a71f4620a6607f74b5a22f2e: Sending DeleteTablet for 3 replicas of tablet 3722d9914162463ba9cd377dee251be0
I20260321 03:02:53.328451 10090 catalog_manager.cc:6741] ReplaceTablet: tablet 3722d9914162463ba9cd377dee251be0 deleted and replaced by tablet b7d23a8a43e742819ca49eb3a49f9ffc
I20260321 03:02:53.330359 10090 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:35282:
table { table_name: "default.Table_06e0fbe90fe0411d95d76f56b53fb175" } modify_external_catalogs: true
I20260321 03:02:53.330500 10090 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:35282:
table { table_name: "default.Table_06e0fbe90fe0411d95d76f56b53fb175" } modify_external_catalogs: true
@ 0x7f225c0da44d kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
I20260321 03:02:53.334043 8646 tablet_service.cc:1558] Processing DeleteTablet for tablet c1e54bc634ac44199436f2c538e6d63f with delete_type TABLET_DATA_DELETED (replaced by tablet 32505df528a5474392351292dbd040a3) from {username='slave'} at 127.0.0.1:53668
I20260321 03:02:53.334236 8506 tablet_service.cc:1558] Processing DeleteTablet for tablet e72dc676a2fb4fe98229b8f0767952a9 with delete_type TABLET_DATA_DELETED (replaced by tablet 6ece6bb47b4f4e83995fb467d2335f4c) from {username='slave'} at 127.0.0.1:43458
I20260321 03:02:53.334311 8639 tablet_service.cc:1558] Processing DeleteTablet for tablet 0c90afb0d24a428f846cc2bfc24379ab with delete_type TABLET_DATA_DELETED (replaced by tablet d6b5027920604b03a7cf9d54045c5a48) from {username='slave'} at 127.0.0.1:53668
I20260321 03:02:53.334424 8642 tablet_service.cc:1558] Processing DeleteTablet for tablet 8535a1895af2482f90cfd53a79de88d5 with delete_type TABLET_DATA_DELETED (replaced by tablet 9547a447294045e8a7973aef3b84b6a9) from {username='slave'} at 127.0.0.1:53668
I20260321 03:02:53.334513 8645 tablet_service.cc:1558] Processing DeleteTablet for tablet 3722d9914162463ba9cd377dee251be0 with delete_type TABLET_DATA_DELETED (replaced by tablet b7d23a8a43e742819ca49eb3a49f9ffc) from {username='slave'} at 127.0.0.1:53668
I20260321 03:02:53.334818 8507 tablet_service.cc:1558] Processing DeleteTablet for tablet 3722d9914162463ba9cd377dee251be0 with delete_type TABLET_DATA_DELETED (replaced by tablet b7d23a8a43e742819ca49eb3a49f9ffc) from {username='slave'} at 127.0.0.1:43458
I20260321 03:02:53.335279 10376 tablet_replica.cc:333] T c1e54bc634ac44199436f2c538e6d63f P 70e7666c46844503beb466fdc054a6fc: stopping tablet replica
I20260321 03:02:53.335323 8774 tablet_service.cc:1558] Processing DeleteTablet for tablet c1e54bc634ac44199436f2c538e6d63f with delete_type TABLET_DATA_DELETED (replaced by tablet 32505df528a5474392351292dbd040a3) from {username='slave'} at 127.0.0.1:38380
I20260321 03:02:53.335423 10376 raft_consensus.cc:2243] T c1e54bc634ac44199436f2c538e6d63f P 70e7666c46844503beb466fdc054a6fc [term 1 LEADER]: Raft consensus shutting down.
I20260321 03:02:53.335649 10376 raft_consensus.cc:2272] T c1e54bc634ac44199436f2c538e6d63f P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260321 03:02:53.335687 8777 tablet_service.cc:1558] Processing DeleteTablet for tablet 0c90afb0d24a428f846cc2bfc24379ab with delete_type TABLET_DATA_DELETED (replaced by tablet d6b5027920604b03a7cf9d54045c5a48) from {username='slave'} at 127.0.0.1:38380
I20260321 03:02:53.335829 8776 tablet_service.cc:1558] Processing DeleteTablet for tablet 8535a1895af2482f90cfd53a79de88d5 with delete_type TABLET_DATA_DELETED (replaced by tablet 9547a447294045e8a7973aef3b84b6a9) from {username='slave'} at 127.0.0.1:38380
I20260321 03:02:53.335974 8775 tablet_service.cc:1558] Processing DeleteTablet for tablet 3722d9914162463ba9cd377dee251be0 with delete_type TABLET_DATA_DELETED (replaced by tablet b7d23a8a43e742819ca49eb3a49f9ffc) from {username='slave'} at 127.0.0.1:38380
I20260321 03:02:53.336062 10376 ts_tablet_manager.cc:1916] T c1e54bc634ac44199436f2c538e6d63f P 70e7666c46844503beb466fdc054a6fc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260321 03:02:53.336189 10374 tablet_replica.cc:333] T c1e54bc634ac44199436f2c538e6d63f P 4532b54a008a4a39b663112e6d0aacc0: stopping tablet replica
I20260321 03:02:53.336367 10374 raft_consensus.cc:2243] T c1e54bc634ac44199436f2c538e6d63f P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260321 03:02:53.336513 10374 raft_consensus.cc:2272] T c1e54bc634ac44199436f2c538e6d63f P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260321 03:02:53.337049 10374 ts_tablet_manager.cc:1916] T c1e54bc634ac44199436f2c538e6d63f P 4532b54a008a4a39b663112e6d0aacc0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260321 03:02:53.338594 10376 ts_tablet_manager.cc:1929] T c1e54bc634ac44199436f2c538e6d63f P 70e7666c46844503beb466fdc054a6fc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260321 03:02:53.338677 10376 log.cc:1199] T c1e54bc634ac44199436f2c538e6d63f P 70e7666c46844503beb466fdc054a6fc: Deleting WAL directory at /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-1/wal/wals/c1e54bc634ac44199436f2c538e6d63f
@ 0x7f225c0d9364 kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
I20260321 03:02:53.338955 10376 ts_tablet_manager.cc:1950] T c1e54bc634ac44199436f2c538e6d63f P 70e7666c46844503beb466fdc054a6fc: Deleting consensus metadata
I20260321 03:02:53.339254 10377 tablet_replica.cc:333] T c1e54bc634ac44199436f2c538e6d63f P a97f7dd77cf2444f8fdb441019081f79: stopping tablet replica
I20260321 03:02:53.339380 10377 raft_consensus.cc:2243] T c1e54bc634ac44199436f2c538e6d63f P a97f7dd77cf2444f8fdb441019081f79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260321 03:02:53.339672 10377 raft_consensus.cc:2272] T c1e54bc634ac44199436f2c538e6d63f P a97f7dd77cf2444f8fdb441019081f79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260321 03:02:53.340044 10377 ts_tablet_manager.cc:1916] T c1e54bc634ac44199436f2c538e6d63f P a97f7dd77cf2444f8fdb441019081f79: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260321 03:02:53.340153 10374 ts_tablet_manager.cc:1929] T c1e54bc634ac44199436f2c538e6d63f P 4532b54a008a4a39b663112e6d0aacc0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260321 03:02:53.340236 10374 log.cc:1199] T c1e54bc634ac44199436f2c538e6d63f P 4532b54a008a4a39b663112e6d0aacc0: Deleting WAL directory at /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-0/wal/wals/c1e54bc634ac44199436f2c538e6d63f
I20260321 03:02:53.340550 10374 ts_tablet_manager.cc:1950] T c1e54bc634ac44199436f2c538e6d63f P 4532b54a008a4a39b663112e6d0aacc0: Deleting consensus metadata
I20260321 03:02:53.340778 8775 tablet_service.cc:1511] Processing CreateTablet for tablet 9547a447294045e8a7973aef3b84b6a9 (DEFAULT_TABLE table=default.table_60888690371e4e1d8d9e6a31f44b55a5 [id=9bc91b7f6cb8477ab6ed1ee5ed74f608]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:53.341051 8775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9547a447294045e8a7973aef3b84b6a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:53.341696 10077 catalog_manager.cc:5002] TS 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171): tablet c1e54bc634ac44199436f2c538e6d63f (table default.table_f8b27d78677b44468e403c75afa5245a [id=9f5de6240b844d57991fc673d061fbf4]) successfully deleted
I20260321 03:02:53.341790 10374 tablet_replica.cc:333] T 8535a1895af2482f90cfd53a79de88d5 P 4532b54a008a4a39b663112e6d0aacc0: stopping tablet replica
I20260321 03:02:53.341975 10374 raft_consensus.cc:2243] T 8535a1895af2482f90cfd53a79de88d5 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 LEADER]: Raft consensus shutting down.
I20260321 03:02:53.342227 10374 raft_consensus.cc:2272] T 8535a1895af2482f90cfd53a79de88d5 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260321 03:02:53.342269 10377 ts_tablet_manager.cc:1929] T c1e54bc634ac44199436f2c538e6d63f P a97f7dd77cf2444f8fdb441019081f79: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260321 03:02:53.342332 10377 log.cc:1199] T c1e54bc634ac44199436f2c538e6d63f P a97f7dd77cf2444f8fdb441019081f79: Deleting WAL directory at /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-2/wal/wals/c1e54bc634ac44199436f2c538e6d63f
I20260321 03:02:53.342590 10377 ts_tablet_manager.cc:1950] T c1e54bc634ac44199436f2c538e6d63f P a97f7dd77cf2444f8fdb441019081f79: Deleting consensus metadata
I20260321 03:02:53.342718 10374 ts_tablet_manager.cc:1916] T 8535a1895af2482f90cfd53a79de88d5 P 4532b54a008a4a39b663112e6d0aacc0: Deleting tablet data with delete state TABLET_DATA_DELETED
@ 0x7f225c0d8ac7 _ZZN4kudu6master30HmsNotificationLogListenerTask4InitEvENKUlvE_clEv at ??:0
I20260321 03:02:53.343325 10079 catalog_manager.cc:5002] TS a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): tablet c1e54bc634ac44199436f2c538e6d63f (table default.table_f8b27d78677b44468e403c75afa5245a [id=9f5de6240b844d57991fc673d061fbf4]) successfully deleted
I20260321 03:02:53.344408 10076 catalog_manager.cc:5002] TS 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): tablet c1e54bc634ac44199436f2c538e6d63f (table default.table_f8b27d78677b44468e403c75afa5245a [id=9f5de6240b844d57991fc673d061fbf4]) successfully deleted
I20260321 03:02:53.345014 8507 tablet_service.cc:1511] Processing CreateTablet for tablet 9547a447294045e8a7973aef3b84b6a9 (DEFAULT_TABLE table=default.table_60888690371e4e1d8d9e6a31f44b55a5 [id=9bc91b7f6cb8477ab6ed1ee5ed74f608]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:53.344987 8645 tablet_service.cc:1511] Processing CreateTablet for tablet 9547a447294045e8a7973aef3b84b6a9 (DEFAULT_TABLE table=default.table_60888690371e4e1d8d9e6a31f44b55a5 [id=9bc91b7f6cb8477ab6ed1ee5ed74f608]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:53.345242 8507 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9547a447294045e8a7973aef3b84b6a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:53.345242 8645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9547a447294045e8a7973aef3b84b6a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:53.345422 10374 ts_tablet_manager.cc:1929] T 8535a1895af2482f90cfd53a79de88d5 P 4532b54a008a4a39b663112e6d0aacc0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260321 03:02:53.345525 10374 log.cc:1199] T 8535a1895af2482f90cfd53a79de88d5 P 4532b54a008a4a39b663112e6d0aacc0: Deleting WAL directory at /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-0/wal/wals/8535a1895af2482f90cfd53a79de88d5
I20260321 03:02:53.345835 10374 ts_tablet_manager.cc:1950] T 8535a1895af2482f90cfd53a79de88d5 P 4532b54a008a4a39b663112e6d0aacc0: Deleting consensus metadata
I20260321 03:02:53.346601 10374 tablet_replica.cc:333] T 0c90afb0d24a428f846cc2bfc24379ab P 4532b54a008a4a39b663112e6d0aacc0: stopping tablet replica
I20260321 03:02:53.346776 10374 raft_consensus.cc:2243] T 0c90afb0d24a428f846cc2bfc24379ab P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Raft consensus shutting down.
@ 0x7f225c0de1ce _ZNSt17_Function_handlerIFvvEZN4kudu6master30HmsNotificationLogListenerTask4InitEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
I20260321 03:02:53.346933 10374 raft_consensus.cc:2272] T 0c90afb0d24a428f846cc2bfc24379ab P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260321 03:02:53.347450 10374 ts_tablet_manager.cc:1916] T 0c90afb0d24a428f846cc2bfc24379ab P 4532b54a008a4a39b663112e6d0aacc0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260321 03:02:53.347605 10077 catalog_manager.cc:5002] TS 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171): tablet 8535a1895af2482f90cfd53a79de88d5 (table default.table_60888690371e4e1d8d9e6a31f44b55a5 [id=9bc91b7f6cb8477ab6ed1ee5ed74f608]) successfully deleted
I20260321 03:02:53.347770 10376 tablet_replica.cc:333] T 0c90afb0d24a428f846cc2bfc24379ab P 70e7666c46844503beb466fdc054a6fc: stopping tablet replica
@ 0x55591fc9218a std::function<>::operator()() at ??:0
I20260321 03:02:53.347882 10376 raft_consensus.cc:2243] T 0c90afb0d24a428f846cc2bfc24379ab P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260321 03:02:53.347983 10376 raft_consensus.cc:2272] T 0c90afb0d24a428f846cc2bfc24379ab P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260321 03:02:53.348829 8507 tablet_service.cc:1511] Processing CreateTablet for tablet 32505df528a5474392351292dbd040a3 (DEFAULT_TABLE table=default.table_f8b27d78677b44468e403c75afa5245a [id=9f5de6240b844d57991fc673d061fbf4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:53.348829 8645 tablet_service.cc:1511] Processing CreateTablet for tablet 32505df528a5474392351292dbd040a3 (DEFAULT_TABLE table=default.table_f8b27d78677b44468e403c75afa5245a [id=9f5de6240b844d57991fc673d061fbf4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:53.349071 8645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32505df528a5474392351292dbd040a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:53.349071 8507 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32505df528a5474392351292dbd040a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:53.350013 8775 tablet_service.cc:1511] Processing CreateTablet for tablet 32505df528a5474392351292dbd040a3 (DEFAULT_TABLE table=default.table_f8b27d78677b44468e403c75afa5245a [id=9f5de6240b844d57991fc673d061fbf4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:53.350060 10374 ts_tablet_manager.cc:1929] T 0c90afb0d24a428f846cc2bfc24379ab P 4532b54a008a4a39b663112e6d0aacc0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260321 03:02:53.350142 10374 log.cc:1199] T 0c90afb0d24a428f846cc2bfc24379ab P 4532b54a008a4a39b663112e6d0aacc0: Deleting WAL directory at /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-0/wal/wals/0c90afb0d24a428f846cc2bfc24379ab
I20260321 03:02:53.350270 8775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32505df528a5474392351292dbd040a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:53.350435 10374 ts_tablet_manager.cc:1950] T 0c90afb0d24a428f846cc2bfc24379ab P 4532b54a008a4a39b663112e6d0aacc0: Deleting consensus metadata
I20260321 03:02:53.351554 8642 tablet_service.cc:1511] Processing CreateTablet for tablet d6b5027920604b03a7cf9d54045c5a48 (DEFAULT_TABLE table=default.table_0e0c55f293274457aed5e8d315334903 [id=850c888ac63d4c048f27ceeb1ddd4f83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:53.351855 8642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6b5027920604b03a7cf9d54045c5a48. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7f2258406028 kudu::Thread::SuperviseThread() at ??:0
I20260321 03:02:53.352334 8507 tablet_service.cc:1511] Processing CreateTablet for tablet d6b5027920604b03a7cf9d54045c5a48 (DEFAULT_TABLE table=default.table_0e0c55f293274457aed5e8d315334903 [id=850c888ac63d4c048f27ceeb1ddd4f83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:53.352738 8507 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6b5027920604b03a7cf9d54045c5a48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260321 03:02:53.353901 8776 tablet_service.cc:1511] Processing CreateTablet for tablet d6b5027920604b03a7cf9d54045c5a48 (DEFAULT_TABLE table=default.table_0e0c55f293274457aed5e8d315334903 [id=850c888ac63d4c048f27ceeb1ddd4f83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260321 03:02:53.354213 8776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6b5027920604b03a7cf9d54045c5a48. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7f2258bed6db start_thread at ??:0
@ 0x7f22560b861f clone at ??:0
I20260321 03:02:53.358435 10377 tablet_replica.cc:333] T 0c90afb0d24a428f846cc2bfc24379ab P a97f7dd77cf2444f8fdb441019081f79: stopping tablet replica
I20260321 03:02:53.358588 10377 raft_consensus.cc:2243] T 0c90afb0d24a428f846cc2bfc24379ab P a97f7dd77cf2444f8fdb441019081f79 [term 1 LEADER]: Raft consensus shutting down.
I20260321 03:02:53.358773 10376 ts_tablet_manager.cc:1916] T 0c90afb0d24a428f846cc2bfc24379ab P 70e7666c46844503beb466fdc054a6fc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260321 03:02:53.358893 10374 tablet_replica.cc:333] T e72dc676a2fb4fe98229b8f0767952a9 P 4532b54a008a4a39b663112e6d0aacc0: stopping tablet replica
I20260321 03:02:53.358928 10377 raft_consensus.cc:2272] T 0c90afb0d24a428f846cc2bfc24379ab P a97f7dd77cf2444f8fdb441019081f79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260321 03:02:53.359040 10374 raft_consensus.cc:2243] T e72dc676a2fb4fe98229b8f0767952a9 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 LEADER]: Raft consensus shutting down.
I20260321 03:02:53.359243 10374 raft_consensus.cc:2272] T e72dc676a2fb4fe98229b8f0767952a9 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260321 03:02:53.359325 10377 ts_tablet_manager.cc:1916] T 0c90afb0d24a428f846cc2bfc24379ab P a97f7dd77cf2444f8fdb441019081f79: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260321 03:02:53.359601 10374 ts_tablet_manager.cc:1916] T e72dc676a2fb4fe98229b8f0767952a9 P 4532b54a008a4a39b663112e6d0aacc0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260321 03:02:53.361470 10377 ts_tablet_manager.cc:1929] T 0c90afb0d24a428f846cc2bfc24379ab P a97f7dd77cf2444f8fdb441019081f79: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260321 03:02:53.361464 10376 ts_tablet_manager.cc:1929] T 0c90afb0d24a428f846cc2bfc24379ab P 70e7666c46844503beb466fdc054a6fc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260321 03:02:53.361541 10377 log.cc:1199] T 0c90afb0d24a428f846cc2bfc24379ab P a97f7dd77cf2444f8fdb441019081f79: Deleting WAL directory at /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-2/wal/wals/0c90afb0d24a428f846cc2bfc24379ab
I20260321 03:02:53.361548 10376 log.cc:1199] T 0c90afb0d24a428f846cc2bfc24379ab P 70e7666c46844503beb466fdc054a6fc: Deleting WAL directory at /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-1/wal/wals/0c90afb0d24a428f846cc2bfc24379ab
I20260321 03:02:53.361837 10377 ts_tablet_manager.cc:1950] T 0c90afb0d24a428f846cc2bfc24379ab P a97f7dd77cf2444f8fdb441019081f79: Deleting consensus metadata
I20260321 03:02:53.361845 10376 ts_tablet_manager.cc:1950] T 0c90afb0d24a428f846cc2bfc24379ab P 70e7666c46844503beb466fdc054a6fc: Deleting consensus metadata
I20260321 03:02:53.362193 10379 tablet_bootstrap.cc:492] T 9547a447294045e8a7973aef3b84b6a9 P 4532b54a008a4a39b663112e6d0aacc0: Bootstrap starting.
I20260321 03:02:53.362336 10378 tablet_bootstrap.cc:492] T 9547a447294045e8a7973aef3b84b6a9 P a97f7dd77cf2444f8fdb441019081f79: Bootstrap starting.
I20260321 03:02:53.362429 10380 tablet_bootstrap.cc:492] T 9547a447294045e8a7973aef3b84b6a9 P 70e7666c46844503beb466fdc054a6fc: Bootstrap starting.
I20260321 03:02:53.363494 10380 tablet_bootstrap.cc:654] T 9547a447294045e8a7973aef3b84b6a9 P 70e7666c46844503beb466fdc054a6fc: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:53.363494 10378 tablet_bootstrap.cc:654] T 9547a447294045e8a7973aef3b84b6a9 P a97f7dd77cf2444f8fdb441019081f79: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:53.363626 10379 tablet_bootstrap.cc:654] T 9547a447294045e8a7973aef3b84b6a9 P 4532b54a008a4a39b663112e6d0aacc0: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:53.362196 10374 ts_tablet_manager.cc:1929] T e72dc676a2fb4fe98229b8f0767952a9 P 4532b54a008a4a39b663112e6d0aacc0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260321 03:02:53.364253 10374 log.cc:1199] T e72dc676a2fb4fe98229b8f0767952a9 P 4532b54a008a4a39b663112e6d0aacc0: Deleting WAL directory at /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-0/wal/wals/e72dc676a2fb4fe98229b8f0767952a9
I20260321 03:02:53.364511 10374 ts_tablet_manager.cc:1950] T e72dc676a2fb4fe98229b8f0767952a9 P 4532b54a008a4a39b663112e6d0aacc0: Deleting consensus metadata
I20260321 03:02:53.364876 10377 tablet_replica.cc:333] T 8535a1895af2482f90cfd53a79de88d5 P a97f7dd77cf2444f8fdb441019081f79: stopping tablet replica
I20260321 03:02:53.364881 10376 tablet_replica.cc:333] T 8535a1895af2482f90cfd53a79de88d5 P 70e7666c46844503beb466fdc054a6fc: stopping tablet replica
I20260321 03:02:53.365013 10376 raft_consensus.cc:2243] T 8535a1895af2482f90cfd53a79de88d5 P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260321 03:02:53.365121 10374 tablet_replica.cc:333] T 3722d9914162463ba9cd377dee251be0 P 4532b54a008a4a39b663112e6d0aacc0: stopping tablet replica
I20260321 03:02:53.365128 10376 raft_consensus.cc:2272] T 8535a1895af2482f90cfd53a79de88d5 P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260321 03:02:53.364995 10377 raft_consensus.cc:2243] T 8535a1895af2482f90cfd53a79de88d5 P a97f7dd77cf2444f8fdb441019081f79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260321 03:02:53.365227 10374 raft_consensus.cc:2243] T 3722d9914162463ba9cd377dee251be0 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 LEADER]: Raft consensus shutting down.
I20260321 03:02:53.365245 10377 raft_consensus.cc:2272] T 8535a1895af2482f90cfd53a79de88d5 P a97f7dd77cf2444f8fdb441019081f79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260321 03:02:53.365463 10374 raft_consensus.cc:2272] T 3722d9914162463ba9cd377dee251be0 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260321 03:02:53.365590 10376 ts_tablet_manager.cc:1916] T 8535a1895af2482f90cfd53a79de88d5 P 70e7666c46844503beb466fdc054a6fc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260321 03:02:53.365686 10377 ts_tablet_manager.cc:1916] T 8535a1895af2482f90cfd53a79de88d5 P a97f7dd77cf2444f8fdb441019081f79: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260321 03:02:53.365828 10374 ts_tablet_manager.cc:1916] T 3722d9914162463ba9cd377dee251be0 P 4532b54a008a4a39b663112e6d0aacc0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260321 03:02:53.368284 10374 ts_tablet_manager.cc:1929] T 3722d9914162463ba9cd377dee251be0 P 4532b54a008a4a39b663112e6d0aacc0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260321 03:02:53.368357 10374 log.cc:1199] T 3722d9914162463ba9cd377dee251be0 P 4532b54a008a4a39b663112e6d0aacc0: Deleting WAL directory at /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-0/wal/wals/3722d9914162463ba9cd377dee251be0
I20260321 03:02:53.368393 10376 ts_tablet_manager.cc:1929] T 8535a1895af2482f90cfd53a79de88d5 P 70e7666c46844503beb466fdc054a6fc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260321 03:02:53.368472 10376 log.cc:1199] T 8535a1895af2482f90cfd53a79de88d5 P 70e7666c46844503beb466fdc054a6fc: Deleting WAL directory at /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-1/wal/wals/8535a1895af2482f90cfd53a79de88d5
I20260321 03:02:53.368625 10374 ts_tablet_manager.cc:1950] T 3722d9914162463ba9cd377dee251be0 P 4532b54a008a4a39b663112e6d0aacc0: Deleting consensus metadata
I20260321 03:02:53.368770 10376 ts_tablet_manager.cc:1950] T 8535a1895af2482f90cfd53a79de88d5 P 70e7666c46844503beb466fdc054a6fc: Deleting consensus metadata
I20260321 03:02:53.369561 10376 tablet_replica.cc:333] T 3722d9914162463ba9cd377dee251be0 P 70e7666c46844503beb466fdc054a6fc: stopping tablet replica
I20260321 03:02:53.369701 10376 raft_consensus.cc:2243] T 3722d9914162463ba9cd377dee251be0 P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260321 03:02:53.369839 10376 raft_consensus.cc:2272] T 3722d9914162463ba9cd377dee251be0 P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260321 03:02:53.370224 10376 ts_tablet_manager.cc:1916] T 3722d9914162463ba9cd377dee251be0 P 70e7666c46844503beb466fdc054a6fc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260321 03:02:53.370661 10377 ts_tablet_manager.cc:1929] T 8535a1895af2482f90cfd53a79de88d5 P a97f7dd77cf2444f8fdb441019081f79: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260321 03:02:53.370733 10377 log.cc:1199] T 8535a1895af2482f90cfd53a79de88d5 P a97f7dd77cf2444f8fdb441019081f79: Deleting WAL directory at /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-2/wal/wals/8535a1895af2482f90cfd53a79de88d5
I20260321 03:02:53.371011 10377 ts_tablet_manager.cc:1950] T 8535a1895af2482f90cfd53a79de88d5 P a97f7dd77cf2444f8fdb441019081f79: Deleting consensus metadata
I20260321 03:02:53.372116 10380 tablet_bootstrap.cc:492] T 9547a447294045e8a7973aef3b84b6a9 P 70e7666c46844503beb466fdc054a6fc: No bootstrap required, opened a new log
I20260321 03:02:53.372211 10380 ts_tablet_manager.cc:1403] T 9547a447294045e8a7973aef3b84b6a9 P 70e7666c46844503beb466fdc054a6fc: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20260321 03:02:53.372484 10376 ts_tablet_manager.cc:1929] T 3722d9914162463ba9cd377dee251be0 P 70e7666c46844503beb466fdc054a6fc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260321 03:02:53.372552 10376 log.cc:1199] T 3722d9914162463ba9cd377dee251be0 P 70e7666c46844503beb466fdc054a6fc: Deleting WAL directory at /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-1/wal/wals/3722d9914162463ba9cd377dee251be0
I20260321 03:02:53.372679 10380 raft_consensus.cc:359] T 9547a447294045e8a7973aef3b84b6a9 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } }
I20260321 03:02:53.372784 10380 raft_consensus.cc:385] T 9547a447294045e8a7973aef3b84b6a9 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:53.372814 10380 raft_consensus.cc:740] T 9547a447294045e8a7973aef3b84b6a9 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70e7666c46844503beb466fdc054a6fc, State: Initialized, Role: FOLLOWER
I20260321 03:02:53.372826 10376 ts_tablet_manager.cc:1950] T 3722d9914162463ba9cd377dee251be0 P 70e7666c46844503beb466fdc054a6fc: Deleting consensus metadata
I20260321 03:02:53.373003 10380 consensus_queue.cc:260] T 9547a447294045e8a7973aef3b84b6a9 P 70e7666c46844503beb466fdc054a6fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } }
I20260321 03:02:53.373327 10380 ts_tablet_manager.cc:1434] T 9547a447294045e8a7973aef3b84b6a9 P 70e7666c46844503beb466fdc054a6fc: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260321 03:02:53.373502 10380 tablet_bootstrap.cc:492] T d6b5027920604b03a7cf9d54045c5a48 P 70e7666c46844503beb466fdc054a6fc: Bootstrap starting.
I20260321 03:02:53.374194 10377 tablet_replica.cc:333] T 3722d9914162463ba9cd377dee251be0 P a97f7dd77cf2444f8fdb441019081f79: stopping tablet replica
I20260321 03:02:53.374318 10377 raft_consensus.cc:2243] T 3722d9914162463ba9cd377dee251be0 P a97f7dd77cf2444f8fdb441019081f79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260321 03:02:53.374426 10377 raft_consensus.cc:2272] T 3722d9914162463ba9cd377dee251be0 P a97f7dd77cf2444f8fdb441019081f79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260321 03:02:53.374855 10377 ts_tablet_manager.cc:1916] T 3722d9914162463ba9cd377dee251be0 P a97f7dd77cf2444f8fdb441019081f79: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260321 03:02:53.374946 10380 tablet_bootstrap.cc:654] T d6b5027920604b03a7cf9d54045c5a48 P 70e7666c46844503beb466fdc054a6fc: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:53.377351 10377 ts_tablet_manager.cc:1929] T 3722d9914162463ba9cd377dee251be0 P a97f7dd77cf2444f8fdb441019081f79: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260321 03:02:53.377427 10377 log.cc:1199] T 3722d9914162463ba9cd377dee251be0 P a97f7dd77cf2444f8fdb441019081f79: Deleting WAL directory at /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/ts-2/wal/wals/3722d9914162463ba9cd377dee251be0
I20260321 03:02:53.377702 10377 ts_tablet_manager.cc:1950] T 3722d9914162463ba9cd377dee251be0 P a97f7dd77cf2444f8fdb441019081f79: Deleting consensus metadata
I20260321 03:02:53.379267 10379 tablet_bootstrap.cc:492] T 9547a447294045e8a7973aef3b84b6a9 P 4532b54a008a4a39b663112e6d0aacc0: No bootstrap required, opened a new log
I20260321 03:02:53.379379 10379 ts_tablet_manager.cc:1403] T 9547a447294045e8a7973aef3b84b6a9 P 4532b54a008a4a39b663112e6d0aacc0: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.000s
I20260321 03:02:53.379948 10379 raft_consensus.cc:359] T 9547a447294045e8a7973aef3b84b6a9 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } }
I20260321 03:02:53.380069 10379 raft_consensus.cc:385] T 9547a447294045e8a7973aef3b84b6a9 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:53.380105 10379 raft_consensus.cc:740] T 9547a447294045e8a7973aef3b84b6a9 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4532b54a008a4a39b663112e6d0aacc0, State: Initialized, Role: FOLLOWER
I20260321 03:02:53.380118 10378 tablet_bootstrap.cc:492] T 9547a447294045e8a7973aef3b84b6a9 P a97f7dd77cf2444f8fdb441019081f79: No bootstrap required, opened a new log
I20260321 03:02:53.380246 10379 consensus_queue.cc:260] T 9547a447294045e8a7973aef3b84b6a9 P 4532b54a008a4a39b663112e6d0aacc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } }
I20260321 03:02:53.380532 10379 ts_tablet_manager.cc:1434] T 9547a447294045e8a7973aef3b84b6a9 P 4532b54a008a4a39b663112e6d0aacc0: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260321 03:02:53.380774 10379 tablet_bootstrap.cc:492] T 32505df528a5474392351292dbd040a3 P 4532b54a008a4a39b663112e6d0aacc0: Bootstrap starting.
I20260321 03:02:53.381788 8581 heartbeater.cc:499] Master 127.7.178.253:46595 was elected leader, sending a full tablet report...
I20260321 03:02:53.382954 10379 tablet_bootstrap.cc:654] T 32505df528a5474392351292dbd040a3 P 4532b54a008a4a39b663112e6d0aacc0: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:53.384334 10378 ts_tablet_manager.cc:1403] T 9547a447294045e8a7973aef3b84b6a9 P a97f7dd77cf2444f8fdb441019081f79: Time spent bootstrapping tablet: real 0.022s user 0.002s sys 0.000s
I20260321 03:02:53.384912 10378 raft_consensus.cc:359] T 9547a447294045e8a7973aef3b84b6a9 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } }
I20260321 03:02:53.385018 10378 raft_consensus.cc:385] T 9547a447294045e8a7973aef3b84b6a9 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:53.385046 10378 raft_consensus.cc:740] T 9547a447294045e8a7973aef3b84b6a9 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a97f7dd77cf2444f8fdb441019081f79, State: Initialized, Role: FOLLOWER
I20260321 03:02:53.385165 10378 consensus_queue.cc:260] T 9547a447294045e8a7973aef3b84b6a9 P a97f7dd77cf2444f8fdb441019081f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } }
I20260321 03:02:53.385505 10378 ts_tablet_manager.cc:1434] T 9547a447294045e8a7973aef3b84b6a9 P a97f7dd77cf2444f8fdb441019081f79: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260321 03:02:53.385684 10378 tablet_bootstrap.cc:492] T d6b5027920604b03a7cf9d54045c5a48 P a97f7dd77cf2444f8fdb441019081f79: Bootstrap starting.
I20260321 03:02:53.385888 10380 tablet_bootstrap.cc:492] T d6b5027920604b03a7cf9d54045c5a48 P 70e7666c46844503beb466fdc054a6fc: No bootstrap required, opened a new log
I20260321 03:02:53.385980 10380 ts_tablet_manager.cc:1403] T d6b5027920604b03a7cf9d54045c5a48 P 70e7666c46844503beb466fdc054a6fc: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.000s
I20260321 03:02:53.386494 10380 raft_consensus.cc:359] T d6b5027920604b03a7cf9d54045c5a48 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } }
I20260321 03:02:53.386595 10380 raft_consensus.cc:385] T d6b5027920604b03a7cf9d54045c5a48 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:53.386624 10380 raft_consensus.cc:740] T d6b5027920604b03a7cf9d54045c5a48 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70e7666c46844503beb466fdc054a6fc, State: Initialized, Role: FOLLOWER
I20260321 03:02:53.386759 10378 tablet_bootstrap.cc:654] T d6b5027920604b03a7cf9d54045c5a48 P a97f7dd77cf2444f8fdb441019081f79: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:53.386763 10380 consensus_queue.cc:260] T d6b5027920604b03a7cf9d54045c5a48 P 70e7666c46844503beb466fdc054a6fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } }
I20260321 03:02:53.387061 10380 ts_tablet_manager.cc:1434] T d6b5027920604b03a7cf9d54045c5a48 P 70e7666c46844503beb466fdc054a6fc: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260321 03:02:53.387240 10380 tablet_bootstrap.cc:492] T 32505df528a5474392351292dbd040a3 P 70e7666c46844503beb466fdc054a6fc: Bootstrap starting.
I20260321 03:02:53.388265 10380 tablet_bootstrap.cc:654] T 32505df528a5474392351292dbd040a3 P 70e7666c46844503beb466fdc054a6fc: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:53.388911 10379 tablet_bootstrap.cc:492] T 32505df528a5474392351292dbd040a3 P 4532b54a008a4a39b663112e6d0aacc0: No bootstrap required, opened a new log
I20260321 03:02:53.389003 10379 ts_tablet_manager.cc:1403] T 32505df528a5474392351292dbd040a3 P 4532b54a008a4a39b663112e6d0aacc0: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.002s
I20260321 03:02:53.389540 10379 raft_consensus.cc:359] T 32505df528a5474392351292dbd040a3 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } }
I20260321 03:02:53.389662 10379 raft_consensus.cc:385] T 32505df528a5474392351292dbd040a3 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:53.389693 10379 raft_consensus.cc:740] T 32505df528a5474392351292dbd040a3 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4532b54a008a4a39b663112e6d0aacc0, State: Initialized, Role: FOLLOWER
I20260321 03:02:53.389822 10379 consensus_queue.cc:260] T 32505df528a5474392351292dbd040a3 P 4532b54a008a4a39b663112e6d0aacc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } }
I20260321 03:02:53.390136 10379 ts_tablet_manager.cc:1434] T 32505df528a5474392351292dbd040a3 P 4532b54a008a4a39b663112e6d0aacc0: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260321 03:02:53.390251 8714 heartbeater.cc:344] Connected to a master server at 127.7.178.252:45145
I20260321 03:02:53.390347 10379 tablet_bootstrap.cc:492] T d6b5027920604b03a7cf9d54045c5a48 P 4532b54a008a4a39b663112e6d0aacc0: Bootstrap starting.
I20260321 03:02:53.391335 10379 tablet_bootstrap.cc:654] T d6b5027920604b03a7cf9d54045c5a48 P 4532b54a008a4a39b663112e6d0aacc0: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:53.392197 10290 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "70e7666c46844503beb466fdc054a6fc" instance_seqno: 1774062148158895) as {username='slave'} at 127.7.178.194:49791; Asking this server to re-register.
I20260321 03:02:53.392655 8714 heartbeater.cc:461] Registering TS with master...
I20260321 03:02:53.392709 10378 tablet_bootstrap.cc:492] T d6b5027920604b03a7cf9d54045c5a48 P a97f7dd77cf2444f8fdb441019081f79: No bootstrap required, opened a new log
I20260321 03:02:53.392787 10378 ts_tablet_manager.cc:1403] T d6b5027920604b03a7cf9d54045c5a48 P a97f7dd77cf2444f8fdb441019081f79: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260321 03:02:53.393303 10378 raft_consensus.cc:359] T d6b5027920604b03a7cf9d54045c5a48 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } }
I20260321 03:02:53.393416 10378 raft_consensus.cc:385] T d6b5027920604b03a7cf9d54045c5a48 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:53.393453 10378 raft_consensus.cc:740] T d6b5027920604b03a7cf9d54045c5a48 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a97f7dd77cf2444f8fdb441019081f79, State: Initialized, Role: FOLLOWER
I20260321 03:02:53.393574 10378 consensus_queue.cc:260] T d6b5027920604b03a7cf9d54045c5a48 P a97f7dd77cf2444f8fdb441019081f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } }
I20260321 03:02:53.393862 10378 ts_tablet_manager.cc:1434] T d6b5027920604b03a7cf9d54045c5a48 P a97f7dd77cf2444f8fdb441019081f79: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260321 03:02:53.394048 10378 tablet_bootstrap.cc:492] T 32505df528a5474392351292dbd040a3 P a97f7dd77cf2444f8fdb441019081f79: Bootstrap starting.
I20260321 03:02:53.395020 8850 heartbeater.cc:344] Connected to a master server at 127.7.178.252:45145
I20260321 03:02:53.395380 10378 tablet_bootstrap.cc:654] T 32505df528a5474392351292dbd040a3 P a97f7dd77cf2444f8fdb441019081f79: Neither blocks nor log segments found. Creating new log.
I20260321 03:02:53.396167 10290 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" instance_seqno: 1774062148360782) as {username='slave'} at 127.7.178.195:39483; Asking this server to re-register.
I20260321 03:02:53.396579 8850 heartbeater.cc:461] Registering TS with master...
I20260321 03:02:53.397630 10378 tablet_bootstrap.cc:492] T 32505df528a5474392351292dbd040a3 P a97f7dd77cf2444f8fdb441019081f79: No bootstrap required, opened a new log
I20260321 03:02:53.397724 10378 ts_tablet_manager.cc:1403] T 32505df528a5474392351292dbd040a3 P a97f7dd77cf2444f8fdb441019081f79: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260321 03:02:53.397693 10289 ts_manager.cc:194] Registered new tserver with Master: 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713)
I20260321 03:02:53.398195 10378 raft_consensus.cc:359] T 32505df528a5474392351292dbd040a3 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } }
I20260321 03:02:53.398291 10378 raft_consensus.cc:385] T 32505df528a5474392351292dbd040a3 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:53.398305 10290 ts_manager.cc:194] Registered new tserver with Master: a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
I20260321 03:02:53.398325 10378 raft_consensus.cc:740] T 32505df528a5474392351292dbd040a3 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a97f7dd77cf2444f8fdb441019081f79, State: Initialized, Role: FOLLOWER
I20260321 03:02:53.398453 10378 consensus_queue.cc:260] T 32505df528a5474392351292dbd040a3 P a97f7dd77cf2444f8fdb441019081f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } }
I20260321 03:02:53.398749 10378 ts_tablet_manager.cc:1434] T 32505df528a5474392351292dbd040a3 P a97f7dd77cf2444f8fdb441019081f79: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260321 03:02:53.400216 10380 tablet_bootstrap.cc:492] T 32505df528a5474392351292dbd040a3 P 70e7666c46844503beb466fdc054a6fc: No bootstrap required, opened a new log
I20260321 03:02:53.400310 10380 ts_tablet_manager.cc:1403] T 32505df528a5474392351292dbd040a3 P 70e7666c46844503beb466fdc054a6fc: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.000s
I20260321 03:02:53.400830 10380 raft_consensus.cc:359] T 32505df528a5474392351292dbd040a3 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } }
I20260321 03:02:53.400939 10380 raft_consensus.cc:385] T 32505df528a5474392351292dbd040a3 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:53.400970 10380 raft_consensus.cc:740] T 32505df528a5474392351292dbd040a3 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70e7666c46844503beb466fdc054a6fc, State: Initialized, Role: FOLLOWER
I20260321 03:02:53.401090 10380 consensus_queue.cc:260] T 32505df528a5474392351292dbd040a3 P 70e7666c46844503beb466fdc054a6fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } }
I20260321 03:02:53.401373 10379 tablet_bootstrap.cc:492] T d6b5027920604b03a7cf9d54045c5a48 P 4532b54a008a4a39b663112e6d0aacc0: No bootstrap required, opened a new log
I20260321 03:02:53.401456 10379 ts_tablet_manager.cc:1403] T d6b5027920604b03a7cf9d54045c5a48 P 4532b54a008a4a39b663112e6d0aacc0: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.001s
I20260321 03:02:53.401444 10380 ts_tablet_manager.cc:1434] T 32505df528a5474392351292dbd040a3 P 70e7666c46844503beb466fdc054a6fc: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260321 03:02:53.401918 10379 raft_consensus.cc:359] T d6b5027920604b03a7cf9d54045c5a48 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } }
I20260321 03:02:53.402012 10379 raft_consensus.cc:385] T d6b5027920604b03a7cf9d54045c5a48 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260321 03:02:53.402042 10379 raft_consensus.cc:740] T d6b5027920604b03a7cf9d54045c5a48 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4532b54a008a4a39b663112e6d0aacc0, State: Initialized, Role: FOLLOWER
I20260321 03:02:53.402164 10379 consensus_queue.cc:260] T d6b5027920604b03a7cf9d54045c5a48 P 4532b54a008a4a39b663112e6d0aacc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } }
I20260321 03:02:53.402405 10379 ts_tablet_manager.cc:1434] T d6b5027920604b03a7cf9d54045c5a48 P 4532b54a008a4a39b663112e6d0aacc0: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
W20260321 03:02:53.543777 8740 connection.cc:537] server connection from 127.0.0.1:38380 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260321 03:02:53.543941 8739 connection.cc:537] client connection to 127.7.178.253:46595 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260321 03:02:53.544452 8604 connection.cc:537] server connection from 127.0.0.1:53668 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260321 03:02:53.543778 8468 connection.cc:537] client connection to 127.7.178.253:46595 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260321 03:02:53.544714 8603 connection.cc:537] client connection to 127.7.178.253:46595 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260321 03:02:53.544842 8468 connection.cc:537] server connection from 127.0.0.1:43458 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260321 03:02:53.545002 8859 connection.cc:537] client connection to 127.7.178.253:46595 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260321 03:02:53.545439 8859 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.7.178.253:46595)
W20260321 03:02:53.545797 8859 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.7.178.253:46595)
W20260321 03:02:53.545959 8859 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.7.178.253:46595)
W20260321 03:02:53.546087 8859 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.7.178.253:46595)
I20260321 03:02:53.549674 10211 raft_consensus.cc:493] T 9547a447294045e8a7973aef3b84b6a9 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260321 03:02:53.550230 10211 raft_consensus.cc:515] T 9547a447294045e8a7973aef3b84b6a9 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } }
I20260321 03:02:53.550695 10211 leader_election.cc:290] T 9547a447294045e8a7973aef3b84b6a9 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091), 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713)
I20260321 03:02:53.551141 8667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9547a447294045e8a7973aef3b84b6a9" candidate_uuid: "4532b54a008a4a39b663112e6d0aacc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70e7666c46844503beb466fdc054a6fc" is_pre_election: true
I20260321 03:02:53.551141 8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9547a447294045e8a7973aef3b84b6a9" candidate_uuid: "4532b54a008a4a39b663112e6d0aacc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a97f7dd77cf2444f8fdb441019081f79" is_pre_election: true
I20260321 03:02:53.551302 8667 raft_consensus.cc:2468] T 9547a447294045e8a7973aef3b84b6a9 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4532b54a008a4a39b663112e6d0aacc0 in term 0.
I20260321 03:02:53.551312 8802 raft_consensus.cc:2468] T 9547a447294045e8a7973aef3b84b6a9 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4532b54a008a4a39b663112e6d0aacc0 in term 0.
I20260321 03:02:53.551623 8466 leader_election.cc:304] T 9547a447294045e8a7973aef3b84b6a9 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0, 70e7666c46844503beb466fdc054a6fc; no voters:
I20260321 03:02:53.551805 10211 raft_consensus.cc:2804] T 9547a447294045e8a7973aef3b84b6a9 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260321 03:02:53.551863 10211 raft_consensus.cc:493] T 9547a447294045e8a7973aef3b84b6a9 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260321 03:02:53.551934 10211 raft_consensus.cc:3060] T 9547a447294045e8a7973aef3b84b6a9 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:53.552814 10211 raft_consensus.cc:515] T 9547a447294045e8a7973aef3b84b6a9 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } }
I20260321 03:02:53.553202 10211 leader_election.cc:290] T 9547a447294045e8a7973aef3b84b6a9 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 1 election: Requested vote from peers a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091), 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713)
I20260321 03:02:53.553654 8667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9547a447294045e8a7973aef3b84b6a9" candidate_uuid: "4532b54a008a4a39b663112e6d0aacc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70e7666c46844503beb466fdc054a6fc"
I20260321 03:02:53.553817 8667 raft_consensus.cc:3060] T 9547a447294045e8a7973aef3b84b6a9 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:53.554718 8667 raft_consensus.cc:2468] T 9547a447294045e8a7973aef3b84b6a9 P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4532b54a008a4a39b663112e6d0aacc0 in term 1.
I20260321 03:02:53.555016 8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9547a447294045e8a7973aef3b84b6a9" candidate_uuid: "4532b54a008a4a39b663112e6d0aacc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a97f7dd77cf2444f8fdb441019081f79"
I20260321 03:02:53.555159 8802 raft_consensus.cc:3060] T 9547a447294045e8a7973aef3b84b6a9 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:53.555117 8466 leader_election.cc:304] T 9547a447294045e8a7973aef3b84b6a9 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0, 70e7666c46844503beb466fdc054a6fc; no voters:
I20260321 03:02:53.555400 10211 raft_consensus.cc:2804] T 9547a447294045e8a7973aef3b84b6a9 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader election won for term 1
I20260321 03:02:53.555513 10211 raft_consensus.cc:697] T 9547a447294045e8a7973aef3b84b6a9 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 LEADER]: Becoming Leader. State: Replica: 4532b54a008a4a39b663112e6d0aacc0, State: Running, Role: LEADER
I20260321 03:02:53.555696 10211 consensus_queue.cc:237] T 9547a447294045e8a7973aef3b84b6a9 P 4532b54a008a4a39b663112e6d0aacc0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } }
I20260321 03:02:53.556218 8802 raft_consensus.cc:2468] T 9547a447294045e8a7973aef3b84b6a9 P a97f7dd77cf2444f8fdb441019081f79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4532b54a008a4a39b663112e6d0aacc0 in term 1.
I20260321 03:02:53.558894 10242 raft_consensus.cc:493] T 32505df528a5474392351292dbd040a3 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260321 03:02:53.559044 10242 raft_consensus.cc:515] T 32505df528a5474392351292dbd040a3 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } }
I20260321 03:02:53.559445 10242 leader_election.cc:290] T 32505df528a5474392351292dbd040a3 P a97f7dd77cf2444f8fdb441019081f79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171)
I20260321 03:02:53.559830 8667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32505df528a5474392351292dbd040a3" candidate_uuid: "a97f7dd77cf2444f8fdb441019081f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70e7666c46844503beb466fdc054a6fc" is_pre_election: true
I20260321 03:02:53.559876 8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32505df528a5474392351292dbd040a3" candidate_uuid: "a97f7dd77cf2444f8fdb441019081f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4532b54a008a4a39b663112e6d0aacc0" is_pre_election: true
I20260321 03:02:53.559978 8667 raft_consensus.cc:2468] T 32505df528a5474392351292dbd040a3 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a97f7dd77cf2444f8fdb441019081f79 in term 0.
I20260321 03:02:53.560143 8532 raft_consensus.cc:2468] T 32505df528a5474392351292dbd040a3 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a97f7dd77cf2444f8fdb441019081f79 in term 0.
I20260321 03:02:53.560266 8737 leader_election.cc:304] T 32505df528a5474392351292dbd040a3 P a97f7dd77cf2444f8fdb441019081f79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79; no voters:
I20260321 03:02:53.560436 10242 raft_consensus.cc:2804] T 32505df528a5474392351292dbd040a3 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260321 03:02:53.560511 10242 raft_consensus.cc:493] T 32505df528a5474392351292dbd040a3 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260321 03:02:53.560560 10242 raft_consensus.cc:3060] T 32505df528a5474392351292dbd040a3 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:53.561692 10242 raft_consensus.cc:515] T 32505df528a5474392351292dbd040a3 P a97f7dd77cf2444f8fdb441019081f79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } }
I20260321 03:02:53.562104 10242 leader_election.cc:290] T 32505df528a5474392351292dbd040a3 P a97f7dd77cf2444f8fdb441019081f79 [CANDIDATE]: Term 1 election: Requested vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171)
I20260321 03:02:53.562489 8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32505df528a5474392351292dbd040a3" candidate_uuid: "a97f7dd77cf2444f8fdb441019081f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4532b54a008a4a39b663112e6d0aacc0"
I20260321 03:02:53.562515 8667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32505df528a5474392351292dbd040a3" candidate_uuid: "a97f7dd77cf2444f8fdb441019081f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70e7666c46844503beb466fdc054a6fc"
I20260321 03:02:53.562639 8667 raft_consensus.cc:3060] T 32505df528a5474392351292dbd040a3 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:53.562639 8532 raft_consensus.cc:3060] T 32505df528a5474392351292dbd040a3 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:53.563656 8532 raft_consensus.cc:2468] T 32505df528a5474392351292dbd040a3 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a97f7dd77cf2444f8fdb441019081f79 in term 1.
I20260321 03:02:53.563742 8667 raft_consensus.cc:2468] T 32505df528a5474392351292dbd040a3 P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a97f7dd77cf2444f8fdb441019081f79 in term 1.
I20260321 03:02:53.564049 8738 leader_election.cc:304] T 32505df528a5474392351292dbd040a3 P a97f7dd77cf2444f8fdb441019081f79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0, a97f7dd77cf2444f8fdb441019081f79; no voters:
I20260321 03:02:53.564301 10242 raft_consensus.cc:2804] T 32505df528a5474392351292dbd040a3 P a97f7dd77cf2444f8fdb441019081f79 [term 1 FOLLOWER]: Leader election won for term 1
I20260321 03:02:53.564534 10242 raft_consensus.cc:697] T 32505df528a5474392351292dbd040a3 P a97f7dd77cf2444f8fdb441019081f79 [term 1 LEADER]: Becoming Leader. State: Replica: a97f7dd77cf2444f8fdb441019081f79, State: Running, Role: LEADER
I20260321 03:02:53.564765 10242 consensus_queue.cc:237] T 32505df528a5474392351292dbd040a3 P a97f7dd77cf2444f8fdb441019081f79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } }
I20260321 03:02:53.631201 10242 raft_consensus.cc:493] T d6b5027920604b03a7cf9d54045c5a48 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260321 03:02:53.631357 10242 raft_consensus.cc:515] T d6b5027920604b03a7cf9d54045c5a48 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } }
I20260321 03:02:53.631865 10242 leader_election.cc:290] T d6b5027920604b03a7cf9d54045c5a48 P a97f7dd77cf2444f8fdb441019081f79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171)
I20260321 03:02:53.632346 8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b5027920604b03a7cf9d54045c5a48" candidate_uuid: "a97f7dd77cf2444f8fdb441019081f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4532b54a008a4a39b663112e6d0aacc0" is_pre_election: true
I20260321 03:02:53.632346 8667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b5027920604b03a7cf9d54045c5a48" candidate_uuid: "a97f7dd77cf2444f8fdb441019081f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70e7666c46844503beb466fdc054a6fc" is_pre_election: true
I20260321 03:02:53.632503 8532 raft_consensus.cc:2468] T d6b5027920604b03a7cf9d54045c5a48 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a97f7dd77cf2444f8fdb441019081f79 in term 0.
I20260321 03:02:53.632541 8667 raft_consensus.cc:2468] T d6b5027920604b03a7cf9d54045c5a48 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a97f7dd77cf2444f8fdb441019081f79 in term 0.
I20260321 03:02:53.632895 8737 leader_election.cc:304] T d6b5027920604b03a7cf9d54045c5a48 P a97f7dd77cf2444f8fdb441019081f79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79; no voters:
I20260321 03:02:53.633090 10242 raft_consensus.cc:2804] T d6b5027920604b03a7cf9d54045c5a48 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260321 03:02:53.633144 10242 raft_consensus.cc:493] T d6b5027920604b03a7cf9d54045c5a48 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260321 03:02:53.633201 10242 raft_consensus.cc:3060] T d6b5027920604b03a7cf9d54045c5a48 P a97f7dd77cf2444f8fdb441019081f79 [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:53.634111 10242 raft_consensus.cc:515] T d6b5027920604b03a7cf9d54045c5a48 P a97f7dd77cf2444f8fdb441019081f79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } }
I20260321 03:02:53.634485 10242 leader_election.cc:290] T d6b5027920604b03a7cf9d54045c5a48 P a97f7dd77cf2444f8fdb441019081f79 [CANDIDATE]: Term 1 election: Requested vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171)
I20260321 03:02:53.634891 8667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b5027920604b03a7cf9d54045c5a48" candidate_uuid: "a97f7dd77cf2444f8fdb441019081f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70e7666c46844503beb466fdc054a6fc"
I20260321 03:02:53.634914 8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b5027920604b03a7cf9d54045c5a48" candidate_uuid: "a97f7dd77cf2444f8fdb441019081f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4532b54a008a4a39b663112e6d0aacc0"
I20260321 03:02:53.635061 8532 raft_consensus.cc:3060] T d6b5027920604b03a7cf9d54045c5a48 P 4532b54a008a4a39b663112e6d0aacc0 [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:53.635061 8667 raft_consensus.cc:3060] T d6b5027920604b03a7cf9d54045c5a48 P 70e7666c46844503beb466fdc054a6fc [term 0 FOLLOWER]: Advancing to term 1
I20260321 03:02:53.635915 8667 raft_consensus.cc:2468] T d6b5027920604b03a7cf9d54045c5a48 P 70e7666c46844503beb466fdc054a6fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a97f7dd77cf2444f8fdb441019081f79 in term 1.
I20260321 03:02:53.635918 8532 raft_consensus.cc:2468] T d6b5027920604b03a7cf9d54045c5a48 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a97f7dd77cf2444f8fdb441019081f79 in term 1.
I20260321 03:02:53.636251 8737 leader_election.cc:304] T d6b5027920604b03a7cf9d54045c5a48 P a97f7dd77cf2444f8fdb441019081f79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79; no voters:
I20260321 03:02:53.636436 10242 raft_consensus.cc:2804] T d6b5027920604b03a7cf9d54045c5a48 P a97f7dd77cf2444f8fdb441019081f79 [term 1 FOLLOWER]: Leader election won for term 1
I20260321 03:02:53.636508 10242 raft_consensus.cc:697] T d6b5027920604b03a7cf9d54045c5a48 P a97f7dd77cf2444f8fdb441019081f79 [term 1 LEADER]: Becoming Leader. State: Replica: a97f7dd77cf2444f8fdb441019081f79, State: Running, Role: LEADER
I20260321 03:02:53.636659 10242 consensus_queue.cc:237] T d6b5027920604b03a7cf9d54045c5a48 P a97f7dd77cf2444f8fdb441019081f79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } } peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } }
I20260321 03:02:53.839066 10408 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7451d7c0a71f4620a6607f74b5a22f2e)
I20260321 03:02:53.839218 10408 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:02:53.840485 10408 leader_election.cc:290] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651), 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595)
W20260321 03:02:53.841250 10276 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111)
W20260321 03:02:53.842304 10276 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651): Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111)
W20260321 03:02:53.842461 10276 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595): Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
I20260321 03:02:53.842528 10276 leader_election.cc:304] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3df5e4492f3049c1b09fea013b92f863; no voters: 4a187d1fb5804686b4aff01e47fd0284, 7451d7c0a71f4620a6607f74b5a22f2e
I20260321 03:02:53.842763 10408 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260321 03:02:53.947414 10211 consensus_queue.cc:1048] T 9547a447294045e8a7973aef3b84b6a9 P 4532b54a008a4a39b663112e6d0aacc0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260321 03:02:53.952021 10413 consensus_queue.cc:1048] T 9547a447294045e8a7973aef3b84b6a9 P 4532b54a008a4a39b663112e6d0aacc0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260321 03:02:54.083585 10242 consensus_queue.cc:1048] T 32505df528a5474392351292dbd040a3 P a97f7dd77cf2444f8fdb441019081f79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260321 03:02:54.087745 10405 consensus_queue.cc:1048] T 32505df528a5474392351292dbd040a3 P a97f7dd77cf2444f8fdb441019081f79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260321 03:02:54.172708 10405 consensus_queue.cc:1048] T d6b5027920604b03a7cf9d54045c5a48 P a97f7dd77cf2444f8fdb441019081f79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260321 03:02:54.173194 10405 consensus_queue.cc:1048] T d6b5027920604b03a7cf9d54045c5a48 P a97f7dd77cf2444f8fdb441019081f79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260321 03:02:54.577948 10423 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7451d7c0a71f4620a6607f74b5a22f2e)
I20260321 03:02:54.578107 10423 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:02:54.578557 10423 leader_election.cc:290] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651), 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595)
W20260321 03:02:54.579988 10276 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651): Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111)
W20260321 03:02:54.580125 10276 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595): Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
I20260321 03:02:54.580199 10276 leader_election.cc:304] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3df5e4492f3049c1b09fea013b92f863; no voters: 4a187d1fb5804686b4aff01e47fd0284, 7451d7c0a71f4620a6607f74b5a22f2e
I20260321 03:02:54.580457 10423 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260321 03:02:54.636397 10211 raft_consensus.cc:493] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a97f7dd77cf2444f8fdb441019081f79)
I20260321 03:02:54.636564 10211 raft_consensus.cc:515] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:54.637176 10211 leader_election.cc:290] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:02:54.637984 8469 leader_election.cc:343] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: e55ead2b80354ddf8876a5f8410122a2
W20260321 03:02:54.638074 8466 leader_election.cc:343] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: e55ead2b80354ddf8876a5f8410122a2
I20260321 03:02:54.638132 8466 leader_election.cc:304] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:02:54.638285 10211 raft_consensus.cc:2749] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:02:54.966782 10211 raft_consensus.cc:493] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a97f7dd77cf2444f8fdb441019081f79)
I20260321 03:02:54.966956 10211 raft_consensus.cc:515] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:54.967497 10211 leader_election.cc:290] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:02:54.968236 8466 leader_election.cc:343] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: a4a81619964144e9aae068ed1e9eeaff
W20260321 03:02:54.968339 8469 leader_election.cc:343] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: a4a81619964144e9aae068ed1e9eeaff
I20260321 03:02:54.968436 8469 leader_election.cc:304] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:02:54.968672 10211 raft_consensus.cc:2749] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:02:55.316368 10435 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7451d7c0a71f4620a6607f74b5a22f2e)
I20260321 03:02:55.316615 10435 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:02:55.317087 10435 leader_election.cc:290] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651), 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595)
W20260321 03:02:55.318638 10276 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651): Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111)
W20260321 03:02:55.318802 10276 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595): Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
I20260321 03:02:55.318866 10276 leader_election.cc:304] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3df5e4492f3049c1b09fea013b92f863; no voters: 4a187d1fb5804686b4aff01e47fd0284, 7451d7c0a71f4620a6607f74b5a22f2e
I20260321 03:02:55.319149 10435 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260321 03:02:55.346513 7883 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskZ5BwAx/build/debug/bin/kudu with pid 10254
I20260321 03:02:56.104509 7883 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskZ5BwAx/build/debug/bin/kudu
/tmp/dist-test-taskZ5BwAx/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.178.252:45145
--webserver_interface=127.7.178.252
--webserver_port=36797
--builtin_ntp_servers=127.7.178.212:39683
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145
--hive_metastore_uris=thrift://127.0.0.1:35641
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260321 03:02:56.223273 10447 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260321 03:02:56.223603 10447 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260321 03:02:56.223703 10447 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260321 03:02:56.228185 10447 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260321 03:02:56.228291 10447 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260321 03:02:56.228328 10447 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260321 03:02:56.228384 10447 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260321 03:02:56.233063 10447 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.178.212:39683
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-2/wal
--hive_metastore_uris=thrift://127.0.0.1:35641
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.178.252:45145
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.7.178.252
--webserver_port=36797
--never_fsync=true
--heap_profile_path=/tmp/kudu.10447
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 68f10dd41067059260a5fb5c725b178b69c38aed
build type DEBUG
built by None at 21 Mar 2026 02:43:15 UTC on bdcb31816ec0
build id 11028
I20260321 03:02:56.234330 10447 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260321 03:02:56.235455 10447 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260321 03:02:56.241457 10454 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260321 03:02:56.241544 10447 server_base.cc:1061] running on GCE node
W20260321 03:02:56.241672 10456 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260321 03:02:56.241457 10453 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260321 03:02:56.242218 10447 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260321 03:02:56.243224 10447 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260321 03:02:56.244446 10447 hybrid_clock.cc:648] HybridClock initialized: now 1774062176244411 us; error 51 us; skew 500 ppm
I20260321 03:02:56.246856 10447 webserver.cc:492] Webserver started at http://127.7.178.252:36797/ using document root <none> and password file <none>
I20260321 03:02:56.247495 10447 fs_manager.cc:362] Metadata directory not provided
I20260321 03:02:56.247584 10447 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260321 03:02:56.251650 10447 fs_manager.cc:714] Time spent opening directory manager: real 0.003s user 0.002s sys 0.002s
I20260321 03:02:56.254138 10462 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260321 03:02:56.255560 10447 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260321 03:02:56.255864 10447 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-2/data,/tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-2/wal
uuid: "3df5e4492f3049c1b09fea013b92f863"
format_stamp: "Formatted at 2026-03-21 03:02:27 on dist-test-slave-bwf0"
I20260321 03:02:56.256340 10447 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260321 03:02:56.274194 10447 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260321 03:02:56.274979 10447 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260321 03:02:56.275194 10447 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260321 03:02:56.282835 10447 rpc_server.cc:307] RPC server started. Bound to: 127.7.178.252:45145
I20260321 03:02:56.282819 10514 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.178.252:45145 every 8 connection(s)
I20260321 03:02:56.284001 10447 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ5BwAx/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1774062127437488-7883-0/minicluster-data/master-2/data/info.pb
I20260321 03:02:56.288326 10515 sys_catalog.cc:263] Verifying existing consensus state
I20260321 03:02:56.290201 10515 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863: Bootstrap starting.
I20260321 03:02:56.292469 7883 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskZ5BwAx/build/debug/bin/kudu as pid 10447
I20260321 03:02:56.294480 10211 raft_consensus.cc:493] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a97f7dd77cf2444f8fdb441019081f79)
I20260321 03:02:56.294621 10211 raft_consensus.cc:515] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:56.295126 10211 leader_election.cc:290] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:02:56.295841 8466 leader_election.cc:343] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: e55ead2b80354ddf8876a5f8410122a2
W20260321 03:02:56.296027 8469 leader_election.cc:343] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: e55ead2b80354ddf8876a5f8410122a2
I20260321 03:02:56.296089 8469 leader_election.cc:304] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:02:56.296243 10211 raft_consensus.cc:2749] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:02:56.303673 10515 log.cc:826] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863: Log is configured to *not* fsync() on all Append() calls
I20260321 03:02:56.349875 10515 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863: Bootstrap replayed 1/1 log segments. Stats: ops{read=97 overwritten=0 applied=97 ignored=0} inserts{seen=60 ignored=0} mutations{seen=90 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260321 03:02:56.350354 10515 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863: Bootstrap complete.
I20260321 03:02:56.353325 10515 raft_consensus.cc:359] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:02:56.353744 10515 raft_consensus.cc:740] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3df5e4492f3049c1b09fea013b92f863, State: Initialized, Role: FOLLOWER
I20260321 03:02:56.354194 10515 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 97, Last appended: 8.97, Last appended by leader: 97, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:02:56.354741 10520 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 8 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } } }
I20260321 03:02:56.354878 10520 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [sys.catalog]: This master's current role is: FOLLOWER
I20260321 03:02:56.355449 10515 sys_catalog.cc:565] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [sys.catalog]: configured and running, proceeding with master startup.
I20260321 03:02:56.361905 8579 heartbeater.cc:344] Connected to a master server at 127.7.178.252:45145
I20260321 03:02:56.363844 10535 catalog_manager.cc:1269] Loaded cluster ID: 30588dbe2d29416e8c640adf9bfaba1f
I20260321 03:02:56.363956 10479 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" instance_seqno: 1774062147955760) as {username='slave'} at 127.7.178.193:38599; Asking this server to re-register.
I20260321 03:02:56.364006 10535 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863: loading cluster ID for follower catalog manager: success
I20260321 03:02:56.364650 8579 heartbeater.cc:461] Registering TS with master...
I20260321 03:02:56.364101 10447 master_runner.cc:186] Error getting master registration for 127.7.178.254:38651: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111),
I20260321 03:02:56.365943 10447 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260321 03:02:56.366186 10479 ts_manager.cc:194] Registered new tserver with Master: 4532b54a008a4a39b663112e6d0aacc0 (127.7.178.193:46171)
I20260321 03:02:56.367406 10535 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863: acquiring CA information for follower catalog manager: success
I20260321 03:02:56.369212 10535 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260321 03:02:56.515625 8850 heartbeater.cc:344] Connected to a master server at 127.7.178.252:45145
I20260321 03:02:56.516868 10479 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" instance_seqno: 1774062148360782) as {username='slave'} at 127.7.178.195:55103; Asking this server to re-register.
I20260321 03:02:56.517485 8850 heartbeater.cc:461] Registering TS with master...
I20260321 03:02:56.518759 10479 ts_manager.cc:194] Registered new tserver with Master: a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
I20260321 03:02:56.629491 10211 raft_consensus.cc:493] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 70e7666c46844503beb466fdc054a6fc)
I20260321 03:02:56.629642 10211 raft_consensus.cc:515] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:56.630199 10211 leader_election.cc:290] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:02:56.630993 8469 leader_election.cc:343] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: ba92d73996f84bbfbab47006dc934c8e
W20260321 03:02:56.631093 8466 leader_election.cc:343] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: ba92d73996f84bbfbab47006dc934c8e
I20260321 03:02:56.631208 8466 leader_election.cc:304] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:02:56.631441 10211 raft_consensus.cc:2749] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:02:56.692866 8714 heartbeater.cc:344] Connected to a master server at 127.7.178.252:45145
I20260321 03:02:56.694124 10479 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "70e7666c46844503beb466fdc054a6fc" instance_seqno: 1774062148158895) as {username='slave'} at 127.7.178.194:50981; Asking this server to re-register.
I20260321 03:02:56.694746 8714 heartbeater.cc:461] Registering TS with master...
I20260321 03:02:56.696228 10479 ts_manager.cc:194] Registered new tserver with Master: 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713)
I20260321 03:02:56.878978 10542 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260321 03:02:56.879177 10542 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:02:56.880510 10542 leader_election.cc:290] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651), 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595)
W20260321 03:02:56.881593 10465 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111)
W20260321 03:02:56.882750 10465 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651): Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111)
W20260321 03:02:56.882928 10465 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595): Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
I20260321 03:02:56.882999 10465 leader_election.cc:304] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3df5e4492f3049c1b09fea013b92f863; no voters: 4a187d1fb5804686b4aff01e47fd0284, 7451d7c0a71f4620a6607f74b5a22f2e
I20260321 03:02:56.883296 10542 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260321 03:02:56.963117 10211 raft_consensus.cc:493] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a97f7dd77cf2444f8fdb441019081f79)
I20260321 03:02:56.963289 10211 raft_consensus.cc:515] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:56.963783 10211 leader_election.cc:290] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:02:56.964636 8466 leader_election.cc:343] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: a4a81619964144e9aae068ed1e9eeaff
W20260321 03:02:56.964736 8469 leader_election.cc:343] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: a4a81619964144e9aae068ed1e9eeaff
I20260321 03:02:56.964829 8469 leader_election.cc:304] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:02:56.964993 10211 raft_consensus.cc:2749] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:02:57.435441 10548 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260321 03:02:57.435796 10548 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:02:57.436326 10548 leader_election.cc:290] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651), 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595)
W20260321 03:02:57.438191 10465 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651): Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111)
W20260321 03:02:57.438369 10465 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595): Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
I20260321 03:02:57.438442 10465 leader_election.cc:304] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3df5e4492f3049c1b09fea013b92f863; no voters: 4a187d1fb5804686b4aff01e47fd0284, 7451d7c0a71f4620a6607f74b5a22f2e
I20260321 03:02:57.438694 10548 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260321 03:02:58.145191 10560 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260321 03:02:58.145419 10560 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:02:58.145882 10560 leader_election.cc:290] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651), 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595)
W20260321 03:02:58.147392 10465 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651): Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111)
W20260321 03:02:58.147541 10465 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595): Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
I20260321 03:02:58.147601 10465 leader_election.cc:304] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3df5e4492f3049c1b09fea013b92f863; no voters: 4a187d1fb5804686b4aff01e47fd0284, 7451d7c0a71f4620a6607f74b5a22f2e
I20260321 03:02:58.147773 10560 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260321 03:02:58.226477 10211 raft_consensus.cc:493] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 70e7666c46844503beb466fdc054a6fc)
I20260321 03:02:58.226646 10211 raft_consensus.cc:515] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:58.227159 10211 leader_election.cc:290] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:02:58.228094 8469 leader_election.cc:343] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: ba92d73996f84bbfbab47006dc934c8e
W20260321 03:02:58.228229 8466 leader_election.cc:343] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: ba92d73996f84bbfbab47006dc934c8e
I20260321 03:02:58.228338 8466 leader_election.cc:304] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:02:58.228596 10211 raft_consensus.cc:2749] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:02:58.553774 7883 master-stress-test.cc:577] Killing test thread 1/25
I20260321 03:02:59.387198 10211 raft_consensus.cc:493] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a97f7dd77cf2444f8fdb441019081f79)
I20260321 03:02:59.387360 10211 raft_consensus.cc:515] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:02:59.387970 10211 leader_election.cc:290] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:02:59.388737 8466 leader_election.cc:343] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: a4a81619964144e9aae068ed1e9eeaff
W20260321 03:02:59.388857 8469 leader_election.cc:343] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: a4a81619964144e9aae068ed1e9eeaff
I20260321 03:02:59.388962 8469 leader_election.cc:304] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:02:59.389147 10211 raft_consensus.cc:2749] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:02:59.403290 10577 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260321 03:02:59.403443 10577 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:02:59.403919 10577 leader_election.cc:290] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651), 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595)
W20260321 03:02:59.405114 10465 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651): Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111)
W20260321 03:02:59.405244 10465 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595): Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
I20260321 03:02:59.405349 10465 leader_election.cc:304] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3df5e4492f3049c1b09fea013b92f863; no voters: 4a187d1fb5804686b4aff01e47fd0284, 7451d7c0a71f4620a6607f74b5a22f2e
I20260321 03:02:59.405490 10577 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260321 03:03:00.777226 10596 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260321 03:03:00.777436 10596 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:03:00.777951 10596 leader_election.cc:290] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651), 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595)
W20260321 03:03:00.779541 10465 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651): Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111)
W20260321 03:03:00.779675 10465 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595): Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
I20260321 03:03:00.779718 10465 leader_election.cc:304] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3df5e4492f3049c1b09fea013b92f863; no voters: 4a187d1fb5804686b4aff01e47fd0284, 7451d7c0a71f4620a6607f74b5a22f2e
I20260321 03:03:00.779901 10596 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260321 03:03:01.039368 10211 raft_consensus.cc:493] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 70e7666c46844503beb466fdc054a6fc)
I20260321 03:03:01.039546 10211 raft_consensus.cc:515] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:03:01.040133 10211 leader_election.cc:290] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:03:01.041023 8469 leader_election.cc:343] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: ba92d73996f84bbfbab47006dc934c8e
W20260321 03:03:01.041116 8466 leader_election.cc:343] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: ba92d73996f84bbfbab47006dc934c8e
I20260321 03:03:01.041332 8466 leader_election.cc:304] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:03:01.041751 10211 raft_consensus.cc:2749] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:03:01.367265 10447 master_runner.cc:186] Error getting master registration for 127.7.178.254:38651: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111),
I20260321 03:03:01.367429 10447 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260321 03:03:01.773912 10612 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260321 03:03:01.774065 10612 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:03:01.774619 10612 leader_election.cc:290] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651), 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595)
W20260321 03:03:01.776343 10465 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651): Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111)
W20260321 03:03:01.776485 10465 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595): Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
I20260321 03:03:01.776629 10465 leader_election.cc:304] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3df5e4492f3049c1b09fea013b92f863; no voters: 4a187d1fb5804686b4aff01e47fd0284, 7451d7c0a71f4620a6607f74b5a22f2e
I20260321 03:03:01.776846 10612 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260321 03:03:02.072916 10211 raft_consensus.cc:493] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a97f7dd77cf2444f8fdb441019081f79)
I20260321 03:03:02.073136 10211 raft_consensus.cc:515] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:03:02.073732 10211 leader_election.cc:290] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:03:02.074581 8469 leader_election.cc:343] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: e55ead2b80354ddf8876a5f8410122a2
W20260321 03:03:02.074774 8466 leader_election.cc:343] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: e55ead2b80354ddf8876a5f8410122a2
I20260321 03:03:02.074846 8466 leader_election.cc:304] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:03:02.075026 10211 raft_consensus.cc:2749] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:03:03.110105 10211 raft_consensus.cc:493] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a97f7dd77cf2444f8fdb441019081f79)
I20260321 03:03:03.110281 10211 raft_consensus.cc:515] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:03:03.110767 10211 leader_election.cc:290] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:03:03.112100 8466 leader_election.cc:343] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: a4a81619964144e9aae068ed1e9eeaff
W20260321 03:03:03.112489 8469 leader_election.cc:343] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: a4a81619964144e9aae068ed1e9eeaff
I20260321 03:03:03.112617 8469 leader_election.cc:304] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:03:03.112854 10211 raft_consensus.cc:2749] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:03:04.739562 10651 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260321 03:03:04.739708 10651 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:03:04.740113 10651 leader_election.cc:290] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651), 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595)
W20260321 03:03:04.740835 10465 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111) [suppressed 11 similar messages]
W20260321 03:03:04.741711 10465 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651): Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111)
W20260321 03:03:04.741842 10465 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595): Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
I20260321 03:03:04.741889 10465 leader_election.cc:304] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3df5e4492f3049c1b09fea013b92f863; no voters: 4a187d1fb5804686b4aff01e47fd0284, 7451d7c0a71f4620a6607f74b5a22f2e
I20260321 03:03:04.742149 10651 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260321 03:03:06.368780 10447 master_runner.cc:186] Error getting master registration for 127.7.178.254:38651: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111),
I20260321 03:03:06.368957 10447 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260321 03:03:09.120692 10691 raft_consensus.cc:493] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a97f7dd77cf2444f8fdb441019081f79)
I20260321 03:03:09.120914 10691 raft_consensus.cc:515] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:03:09.121622 10691 leader_election.cc:290] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:03:09.122591 8469 leader_election.cc:343] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: e55ead2b80354ddf8876a5f8410122a2
W20260321 03:03:09.122681 8466 leader_election.cc:343] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: e55ead2b80354ddf8876a5f8410122a2
I20260321 03:03:09.122807 8466 leader_election.cc:304] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:03:09.123015 10691 raft_consensus.cc:2749] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:03:11.062317 10691 raft_consensus.cc:493] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 70e7666c46844503beb466fdc054a6fc)
I20260321 03:03:11.062534 10691 raft_consensus.cc:515] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:03:11.063021 10691 leader_election.cc:290] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:03:11.063714 8466 leader_election.cc:343] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: ba92d73996f84bbfbab47006dc934c8e
W20260321 03:03:11.063810 8469 leader_election.cc:343] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: ba92d73996f84bbfbab47006dc934c8e
I20260321 03:03:11.063912 8469 leader_election.cc:304] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:03:11.064080 10691 raft_consensus.cc:2749] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:03:11.370595 10447 master_runner.cc:186] Error getting master registration for 127.7.178.254:38651: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111),
I20260321 03:03:11.370761 10447 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260321 03:03:11.893431 10691 raft_consensus.cc:493] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a97f7dd77cf2444f8fdb441019081f79)
I20260321 03:03:11.893628 10691 raft_consensus.cc:515] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:03:11.894111 10691 leader_election.cc:290] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:03:11.895213 8469 leader_election.cc:343] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: e55ead2b80354ddf8876a5f8410122a2
W20260321 03:03:11.895352 8466 leader_election.cc:343] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: e55ead2b80354ddf8876a5f8410122a2
I20260321 03:03:11.895473 8466 leader_election.cc:304] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:03:11.895772 10691 raft_consensus.cc:2749] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:03:12.281438 10746 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260321 03:03:12.281581 10746 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:03:12.281986 10746 leader_election.cc:290] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651), 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595)
W20260321 03:03:12.282764 10465 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260321 03:03:12.283643 10465 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651): Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111)
W20260321 03:03:12.283749 10465 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595): Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
I20260321 03:03:12.283777 10465 leader_election.cc:304] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3df5e4492f3049c1b09fea013b92f863; no voters: 4a187d1fb5804686b4aff01e47fd0284, 7451d7c0a71f4620a6607f74b5a22f2e
I20260321 03:03:12.283917 10746 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260321 03:03:12.975589 10758 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260321 03:03:12.975728 10758 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:03:12.976289 10758 leader_election.cc:290] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651), 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595)
W20260321 03:03:12.978008 10465 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651): Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111)
W20260321 03:03:12.978229 10465 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595): Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
I20260321 03:03:12.978276 10465 leader_election.cc:304] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3df5e4492f3049c1b09fea013b92f863; no voters: 4a187d1fb5804686b4aff01e47fd0284, 7451d7c0a71f4620a6607f74b5a22f2e
I20260321 03:03:12.978511 10758 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260321 03:03:14.615622 10781 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260321 03:03:14.615837 10781 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:03:14.616498 10781 leader_election.cc:290] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651), 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595)
W20260321 03:03:14.619167 10465 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651): Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111)
W20260321 03:03:14.619364 10465 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595): Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
I20260321 03:03:14.619442 10465 leader_election.cc:304] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3df5e4492f3049c1b09fea013b92f863; no voters: 4a187d1fb5804686b4aff01e47fd0284, 7451d7c0a71f4620a6607f74b5a22f2e
I20260321 03:03:14.619688 10781 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260321 03:03:15.240229 10691 raft_consensus.cc:493] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a97f7dd77cf2444f8fdb441019081f79)
I20260321 03:03:15.240448 10691 raft_consensus.cc:515] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:03:15.241040 10691 leader_election.cc:290] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:03:15.242024 8466 leader_election.cc:343] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: e55ead2b80354ddf8876a5f8410122a2
W20260321 03:03:15.242291 8469 leader_election.cc:343] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: e55ead2b80354ddf8876a5f8410122a2
I20260321 03:03:15.242453 8469 leader_election.cc:304] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:03:15.242660 10691 raft_consensus.cc:2749] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:03:16.099695 10691 raft_consensus.cc:493] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a97f7dd77cf2444f8fdb441019081f79)
I20260321 03:03:16.099864 10691 raft_consensus.cc:515] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:03:16.100450 10691 leader_election.cc:290] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:03:16.101385 8469 leader_election.cc:343] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: a4a81619964144e9aae068ed1e9eeaff
W20260321 03:03:16.101544 8466 leader_election.cc:343] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: a4a81619964144e9aae068ed1e9eeaff
I20260321 03:03:16.101644 8466 leader_election.cc:304] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:03:16.101809 10691 raft_consensus.cc:2749] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:03:16.372090 10447 master_runner.cc:186] Error getting master registration for 127.7.178.254:38651: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111),
I20260321 03:03:16.372251 10447 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260321 03:03:20.182442 10691 raft_consensus.cc:493] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 70e7666c46844503beb466fdc054a6fc)
I20260321 03:03:20.182603 10691 raft_consensus.cc:515] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:03:20.183051 10691 leader_election.cc:290] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:03:20.184255 8466 leader_election.cc:343] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: ba92d73996f84bbfbab47006dc934c8e
W20260321 03:03:20.184425 8469 leader_election.cc:343] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: ba92d73996f84bbfbab47006dc934c8e
I20260321 03:03:20.184484 8469 leader_election.cc:304] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:03:20.184667 10691 raft_consensus.cc:2749] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:03:20.727615 10691 raft_consensus.cc:493] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a97f7dd77cf2444f8fdb441019081f79)
I20260321 03:03:20.727810 10691 raft_consensus.cc:515] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:03:20.728324 10691 leader_election.cc:290] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:03:20.729434 8469 leader_election.cc:343] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: e55ead2b80354ddf8876a5f8410122a2
W20260321 03:03:20.729597 8466 leader_election.cc:343] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: e55ead2b80354ddf8876a5f8410122a2
I20260321 03:03:20.729704 8466 leader_election.cc:304] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:03:20.730084 10691 raft_consensus.cc:2749] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:03:21.373888 10447 master_runner.cc:186] Error getting master registration for 127.7.178.254:38651: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111),
I20260321 03:03:21.374190 10447 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260321 03:03:24.705533 10691 raft_consensus.cc:493] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a97f7dd77cf2444f8fdb441019081f79)
I20260321 03:03:24.705724 10691 raft_consensus.cc:515] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:03:24.706378 10691 leader_election.cc:290] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:03:24.707401 8466 leader_election.cc:343] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: a4a81619964144e9aae068ed1e9eeaff
W20260321 03:03:24.707551 8469 leader_election.cc:343] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: a4a81619964144e9aae068ed1e9eeaff
I20260321 03:03:24.707617 8469 leader_election.cc:304] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:03:24.707835 10691 raft_consensus.cc:2749] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:03:26.375563 10447 master_runner.cc:186] Error getting master registration for 127.7.178.254:38651: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111),
I20260321 03:03:26.375738 10447 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260321 03:03:28.775676 8715 heartbeater.cc:646] Failed to heartbeat to 127.7.178.254:38651 (92 consecutive failures): Network error: Failed to ping master at 127.7.178.254:38651: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111)
W20260321 03:03:28.945180 8580 heartbeater.cc:646] Failed to heartbeat to 127.7.178.254:38651 (100 consecutive failures): Network error: Failed to ping master at 127.7.178.254:38651: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111)
W20260321 03:03:29.100975 8851 heartbeater.cc:646] Failed to heartbeat to 127.7.178.254:38651 (93 consecutive failures): Network error: Failed to ping master at 127.7.178.254:38651: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111)
I20260321 03:03:30.476604 10691 raft_consensus.cc:493] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 70e7666c46844503beb466fdc054a6fc)
I20260321 03:03:30.476840 10691 raft_consensus.cc:515] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:03:30.477485 10691 leader_election.cc:290] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:03:30.478430 8469 leader_election.cc:343] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: ba92d73996f84bbfbab47006dc934c8e
W20260321 03:03:30.478564 8466 leader_election.cc:343] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: ba92d73996f84bbfbab47006dc934c8e
I20260321 03:03:30.478653 8466 leader_election.cc:304] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:03:30.478951 10691 raft_consensus.cc:2749] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:03:31.377290 10447 master_runner.cc:186] Error getting master registration for 127.7.178.254:38651: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111),
I20260321 03:03:31.377480 10447 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260321 03:03:33.224499 11010 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260321 03:03:33.224673 11010 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:03:33.225382 11010 leader_election.cc:290] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651), 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595)
W20260321 03:03:33.226003 10465 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111) [suppressed 5 similar messages]
W20260321 03:03:33.226804 10465 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651): Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111)
W20260321 03:03:33.226936 10465 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595): Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
I20260321 03:03:33.226980 10465 leader_election.cc:304] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3df5e4492f3049c1b09fea013b92f863; no voters: 4a187d1fb5804686b4aff01e47fd0284, 7451d7c0a71f4620a6607f74b5a22f2e
I20260321 03:03:33.227128 11010 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260321 03:03:36.378578 10447 master_runner.cc:186] Error getting master registration for 127.7.178.254:38651: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111),
I20260321 03:03:36.378739 10447 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260321 03:03:36.627873 11051 raft_consensus.cc:493] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a97f7dd77cf2444f8fdb441019081f79)
I20260321 03:03:36.628095 11051 raft_consensus.cc:515] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:03:36.628634 11051 leader_election.cc:290] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:03:36.629637 8466 leader_election.cc:343] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: e55ead2b80354ddf8876a5f8410122a2
W20260321 03:03:36.629765 8469 leader_election.cc:343] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: e55ead2b80354ddf8876a5f8410122a2
I20260321 03:03:36.629884 8469 leader_election.cc:304] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:03:36.630044 11051 raft_consensus.cc:2749] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:03:38.062909 11073 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260321 03:03:38.063073 11073 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:03:38.063491 11073 leader_election.cc:290] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651), 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595)
W20260321 03:03:38.065100 10465 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651): Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111)
W20260321 03:03:38.065255 10465 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595): Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
I20260321 03:03:38.065351 10465 leader_election.cc:304] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3df5e4492f3049c1b09fea013b92f863; no voters: 4a187d1fb5804686b4aff01e47fd0284, 7451d7c0a71f4620a6607f74b5a22f2e
I20260321 03:03:38.065568 11073 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260321 03:03:39.289029 11051 raft_consensus.cc:493] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a97f7dd77cf2444f8fdb441019081f79)
I20260321 03:03:39.289331 11051 raft_consensus.cc:515] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:03:39.290047 11051 leader_election.cc:290] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:03:39.291196 8466 leader_election.cc:343] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: a4a81619964144e9aae068ed1e9eeaff
W20260321 03:03:39.291308 8469 leader_election.cc:343] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: a4a81619964144e9aae068ed1e9eeaff
I20260321 03:03:39.291368 8469 leader_election.cc:304] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:03:39.291618 11051 raft_consensus.cc:2749] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:03:40.164409 11051 raft_consensus.cc:493] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 70e7666c46844503beb466fdc054a6fc)
I20260321 03:03:40.164587 11051 raft_consensus.cc:515] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:03:40.165243 11051 leader_election.cc:290] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:03:40.166136 8469 leader_election.cc:343] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: ba92d73996f84bbfbab47006dc934c8e
W20260321 03:03:40.166385 8466 leader_election.cc:343] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: ba92d73996f84bbfbab47006dc934c8e
I20260321 03:03:40.166461 8466 leader_election.cc:304] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:03:40.166967 11051 raft_consensus.cc:2749] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:03:41.379788 10447 master_runner.cc:186] Error getting master registration for 127.7.178.254:38651: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111),
I20260321 03:03:41.379932 10447 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260321 03:03:43.724903 11124 raft_consensus.cc:493] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a97f7dd77cf2444f8fdb441019081f79)
I20260321 03:03:43.725116 11124 raft_consensus.cc:515] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:03:43.725705 11124 leader_election.cc:290] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:03:43.726560 8466 leader_election.cc:343] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: e55ead2b80354ddf8876a5f8410122a2
W20260321 03:03:43.726727 8469 leader_election.cc:343] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: e55ead2b80354ddf8876a5f8410122a2
I20260321 03:03:43.726832 8469 leader_election.cc:304] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:03:43.727010 11124 raft_consensus.cc:2749] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:03:45.794301 11170 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260321 03:03:45.794595 11170 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:03:45.795253 11170 leader_election.cc:290] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651), 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595)
W20260321 03:03:45.795975 10465 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260321 03:03:45.797113 10465 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651): Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111)
W20260321 03:03:45.797328 10465 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595): Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
I20260321 03:03:45.797389 10465 leader_election.cc:304] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3df5e4492f3049c1b09fea013b92f863; no voters: 4a187d1fb5804686b4aff01e47fd0284, 7451d7c0a71f4620a6607f74b5a22f2e
I20260321 03:03:45.797708 11170 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260321 03:03:46.381451 10447 master_runner.cc:186] Error getting master registration for 127.7.178.254:38651: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111),
I20260321 03:03:46.381646 10447 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260321 03:03:47.682618 11124 raft_consensus.cc:493] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a97f7dd77cf2444f8fdb441019081f79)
I20260321 03:03:47.682821 11124 raft_consensus.cc:515] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:03:47.683605 11124 leader_election.cc:290] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:03:47.684686 8469 leader_election.cc:343] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: a4a81619964144e9aae068ed1e9eeaff
W20260321 03:03:47.684819 8466 leader_election.cc:343] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: a4a81619964144e9aae068ed1e9eeaff
I20260321 03:03:47.684933 8466 leader_election.cc:304] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:03:47.685236 11124 raft_consensus.cc:2749] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:03:47.927232 11124 raft_consensus.cc:493] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 70e7666c46844503beb466fdc054a6fc)
I20260321 03:03:47.927508 11124 raft_consensus.cc:515] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:03:47.928122 11124 leader_election.cc:290] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:03:47.929050 8469 leader_election.cc:343] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: ba92d73996f84bbfbab47006dc934c8e
W20260321 03:03:47.929459 8466 leader_election.cc:343] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: ba92d73996f84bbfbab47006dc934c8e
I20260321 03:03:47.929591 8466 leader_election.cc:304] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:03:47.930044 11124 raft_consensus.cc:2749] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:03:51.382962 10447 master_runner.cc:186] Error getting master registration for 127.7.178.254:38651: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111),
I20260321 03:03:51.383095 10447 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260321 03:03:51.798287 11124 raft_consensus.cc:493] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 70e7666c46844503beb466fdc054a6fc)
I20260321 03:03:51.798455 11124 raft_consensus.cc:515] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:03:51.798943 11124 leader_election.cc:290] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:03:51.799777 8466 leader_election.cc:343] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: ba92d73996f84bbfbab47006dc934c8e
W20260321 03:03:51.799916 8469 leader_election.cc:343] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: ba92d73996f84bbfbab47006dc934c8e
I20260321 03:03:51.799997 8469 leader_election.cc:304] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:03:51.800166 11124 raft_consensus.cc:2749] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:03:55.130056 11290 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260321 03:03:55.130213 11290 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:03:55.130740 11290 leader_election.cc:290] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651), 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595)
W20260321 03:03:55.131373 10465 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260321 03:03:55.132231 10465 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651): Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111)
W20260321 03:03:55.132349 10465 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595): Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
I20260321 03:03:55.132395 10465 leader_election.cc:304] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3df5e4492f3049c1b09fea013b92f863; no voters: 4a187d1fb5804686b4aff01e47fd0284, 7451d7c0a71f4620a6607f74b5a22f2e
I20260321 03:03:55.132583 11290 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260321 03:03:55.933310 11273 raft_consensus.cc:493] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a97f7dd77cf2444f8fdb441019081f79)
I20260321 03:03:55.933506 11273 raft_consensus.cc:515] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:03:55.934101 11273 leader_election.cc:290] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:03:55.935072 8466 leader_election.cc:343] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: e55ead2b80354ddf8876a5f8410122a2
W20260321 03:03:55.935258 8469 leader_election.cc:343] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: e55ead2b80354ddf8876a5f8410122a2
I20260321 03:03:55.935348 8469 leader_election.cc:304] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:03:55.935537 11273 raft_consensus.cc:2749] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:03:56.052488 11308 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260321 03:03:56.052639 11308 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:03:56.053179 11308 leader_election.cc:290] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651), 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595)
W20260321 03:03:56.054967 10465 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651): Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111)
W20260321 03:03:56.055159 10465 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595): Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
I20260321 03:03:56.055231 10465 leader_election.cc:304] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3df5e4492f3049c1b09fea013b92f863; no voters: 4a187d1fb5804686b4aff01e47fd0284, 7451d7c0a71f4620a6607f74b5a22f2e
I20260321 03:03:56.055426 11308 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260321 03:03:56.384356 10447 master_runner.cc:186] Error getting master registration for 127.7.178.254:38651: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111),
I20260321 03:03:56.384523 10447 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260321 03:03:59.550513 11273 raft_consensus.cc:493] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a97f7dd77cf2444f8fdb441019081f79)
I20260321 03:03:59.550818 11273 raft_consensus.cc:515] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:03:59.551429 11273 leader_election.cc:290] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:03:59.552697 8469 leader_election.cc:343] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: a4a81619964144e9aae068ed1e9eeaff
W20260321 03:03:59.552889 8466 leader_election.cc:343] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: a4a81619964144e9aae068ed1e9eeaff
I20260321 03:03:59.553033 8466 leader_election.cc:304] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:03:59.553385 11273 raft_consensus.cc:2749] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:04:01.386278 10447 master_runner.cc:186] Error getting master registration for 127.7.178.254:38651: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111),
I20260321 03:04:01.386474 10447 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260321 03:04:06.388043 10447 master_runner.cc:186] Error getting master registration for 127.7.178.254:38651: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111),
I20260321 03:04:06.388188 10447 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260321 03:04:07.036886 11443 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260321 03:04:07.037055 11443 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:04:07.037628 11443 leader_election.cc:290] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651), 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595)
W20260321 03:04:07.038486 10465 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260321 03:04:07.039454 10465 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651): Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111)
W20260321 03:04:07.039592 10465 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595): Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
I20260321 03:04:07.039626 10465 leader_election.cc:304] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3df5e4492f3049c1b09fea013b92f863; no voters: 4a187d1fb5804686b4aff01e47fd0284, 7451d7c0a71f4620a6607f74b5a22f2e
I20260321 03:04:07.039776 11443 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260321 03:04:08.790534 11470 raft_consensus.cc:493] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 70e7666c46844503beb466fdc054a6fc)
I20260321 03:04:08.790728 11470 raft_consensus.cc:515] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:04:08.791411 11470 leader_election.cc:290] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:04:08.792389 8466 leader_election.cc:343] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: ba92d73996f84bbfbab47006dc934c8e
W20260321 03:04:08.792616 8469 leader_election.cc:343] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: ba92d73996f84bbfbab47006dc934c8e
I20260321 03:04:08.792740 8469 leader_election.cc:304] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:04:08.793061 11470 raft_consensus.cc:2749] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:04:09.618988 11470 raft_consensus.cc:493] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a97f7dd77cf2444f8fdb441019081f79)
I20260321 03:04:09.619159 11470 raft_consensus.cc:515] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:04:09.619593 11470 leader_election.cc:290] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:04:09.620433 8469 leader_election.cc:343] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: e55ead2b80354ddf8876a5f8410122a2
W20260321 03:04:09.620537 8466 leader_election.cc:343] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: e55ead2b80354ddf8876a5f8410122a2
I20260321 03:04:09.620587 8466 leader_election.cc:304] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:04:09.620801 11470 raft_consensus.cc:2749] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:04:11.389726 10447 master_runner.cc:186] Error getting master registration for 127.7.178.254:38651: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111),
I20260321 03:04:11.390066 10447 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260321 03:04:12.168522 11470 raft_consensus.cc:493] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a97f7dd77cf2444f8fdb441019081f79)
I20260321 03:04:12.168762 11470 raft_consensus.cc:515] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:04:12.169564 11470 leader_election.cc:290] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:04:12.170758 8469 leader_election.cc:343] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: a4a81619964144e9aae068ed1e9eeaff
W20260321 03:04:12.171001 8466 leader_election.cc:343] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: a4a81619964144e9aae068ed1e9eeaff
I20260321 03:04:12.171154 8466 leader_election.cc:304] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:04:12.171377 11470 raft_consensus.cc:2749] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:04:14.029479 11470 raft_consensus.cc:493] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a97f7dd77cf2444f8fdb441019081f79)
I20260321 03:04:14.029680 11470 raft_consensus.cc:515] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:04:14.030227 11470 leader_election.cc:290] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:04:14.031088 8466 leader_election.cc:343] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: e55ead2b80354ddf8876a5f8410122a2
W20260321 03:04:14.031211 8469 leader_election.cc:343] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: e55ead2b80354ddf8876a5f8410122a2
I20260321 03:04:14.031297 8469 leader_election.cc:304] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:04:14.031450 11470 raft_consensus.cc:2749] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:04:15.828613 11559 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260321 03:04:15.828759 11559 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:04:15.829231 11559 leader_election.cc:290] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651), 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595)
W20260321 03:04:15.829939 10465 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260321 03:04:15.830729 10465 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651): Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111)
W20260321 03:04:15.830910 10465 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595): Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
I20260321 03:04:15.830945 10465 leader_election.cc:304] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3df5e4492f3049c1b09fea013b92f863; no voters: 4a187d1fb5804686b4aff01e47fd0284, 7451d7c0a71f4620a6607f74b5a22f2e
I20260321 03:04:15.831091 11559 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260321 03:04:16.391194 10447 master_runner.cc:186] Error getting master registration for 127.7.178.254:38651: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111),
I20260321 03:04:16.391311 10447 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260321 03:04:18.424767 11599 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260321 03:04:18.424963 11599 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:04:18.425531 11599 leader_election.cc:290] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651), 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595)
W20260321 03:04:18.427987 10465 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651): Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111)
W20260321 03:04:18.428246 10465 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595): Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
I20260321 03:04:18.428318 10465 leader_election.cc:304] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3df5e4492f3049c1b09fea013b92f863; no voters: 4a187d1fb5804686b4aff01e47fd0284, 7451d7c0a71f4620a6607f74b5a22f2e
I20260321 03:04:18.428570 11599 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260321 03:04:21.392552 10447 master_runner.cc:186] Error getting master registration for 127.7.178.254:38651: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111),
I20260321 03:04:21.392692 10447 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260321 03:04:21.761101 11646 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260321 03:04:21.761317 11646 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:04:21.761808 11646 leader_election.cc:290] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651), 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595)
W20260321 03:04:21.762483 10465 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260321 03:04:21.763468 10465 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651): Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111)
W20260321 03:04:21.763608 10465 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595): Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
I20260321 03:04:21.763664 10465 leader_election.cc:304] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3df5e4492f3049c1b09fea013b92f863; no voters: 4a187d1fb5804686b4aff01e47fd0284, 7451d7c0a71f4620a6607f74b5a22f2e
I20260321 03:04:21.763907 11646 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260321 03:04:23.075523 11470 raft_consensus.cc:493] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 70e7666c46844503beb466fdc054a6fc)
I20260321 03:04:23.075686 11470 raft_consensus.cc:515] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:04:23.076155 11470 leader_election.cc:290] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:04:23.076992 8469 leader_election.cc:343] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: ba92d73996f84bbfbab47006dc934c8e
W20260321 03:04:23.077093 8466 leader_election.cc:343] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: ba92d73996f84bbfbab47006dc934c8e
I20260321 03:04:23.077221 8466 leader_election.cc:304] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:04:23.077395 11470 raft_consensus.cc:2749] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:04:23.997697 11470 raft_consensus.cc:493] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a97f7dd77cf2444f8fdb441019081f79)
I20260321 03:04:23.997843 11470 raft_consensus.cc:515] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:04:23.998342 11470 leader_election.cc:290] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:04:23.999186 8469 leader_election.cc:343] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: e55ead2b80354ddf8876a5f8410122a2
W20260321 03:04:23.999372 8466 leader_election.cc:343] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: e55ead2b80354ddf8876a5f8410122a2
I20260321 03:04:23.999468 8466 leader_election.cc:304] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:04:23.999702 11470 raft_consensus.cc:2749] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:04:26.394007 10447 master_runner.cc:186] Error getting master registration for 127.7.178.254:38651: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111),
I20260321 03:04:26.394197 10447 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260321 03:04:27.746248 11470 raft_consensus.cc:493] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a97f7dd77cf2444f8fdb441019081f79)
I20260321 03:04:27.746451 11470 raft_consensus.cc:515] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:04:27.747134 11470 leader_election.cc:290] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:04:27.747967 8469 leader_election.cc:343] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: a4a81619964144e9aae068ed1e9eeaff
W20260321 03:04:27.748064 8466 leader_election.cc:343] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: a4a81619964144e9aae068ed1e9eeaff
I20260321 03:04:27.748160 8466 leader_election.cc:304] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:04:27.748301 11470 raft_consensus.cc:2749] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:04:27.805835 11725 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260321 03:04:27.805992 11725 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:04:27.806421 11725 leader_election.cc:290] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651), 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595)
W20260321 03:04:27.807219 10465 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260321 03:04:27.808223 10465 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651): Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111)
W20260321 03:04:27.808342 10465 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595): Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
I20260321 03:04:27.808398 10465 leader_election.cc:304] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3df5e4492f3049c1b09fea013b92f863; no voters: 4a187d1fb5804686b4aff01e47fd0284, 7451d7c0a71f4620a6607f74b5a22f2e
I20260321 03:04:27.808545 11725 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260321 03:04:28.941154 8715 heartbeater.cc:646] Failed to heartbeat to 127.7.178.254:38651 (212 consecutive failures): Network error: Failed to ping master at 127.7.178.254:38651: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111)
W20260321 03:04:29.111259 8581 heartbeater.cc:646] Failed to heartbeat to 127.7.178.253:46595 (198 consecutive failures): Network error: Failed to ping master at 127.7.178.253:46595: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
W20260321 03:04:29.264039 8852 heartbeater.cc:646] Failed to heartbeat to 127.7.178.253:46595 (200 consecutive failures): Network error: Failed to ping master at 127.7.178.253:46595: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
I20260321 03:04:30.009024 11750 raft_consensus.cc:493] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a97f7dd77cf2444f8fdb441019081f79)
I20260321 03:04:30.009208 11750 raft_consensus.cc:515] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:04:30.009929 11750 leader_election.cc:290] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:04:30.010937 8469 leader_election.cc:343] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: a4a81619964144e9aae068ed1e9eeaff
W20260321 03:04:30.011053 8466 leader_election.cc:343] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: a4a81619964144e9aae068ed1e9eeaff
I20260321 03:04:30.011142 8466 leader_election.cc:304] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:04:30.011533 11750 raft_consensus.cc:2749] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:04:31.164309 11750 raft_consensus.cc:493] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a97f7dd77cf2444f8fdb441019081f79)
I20260321 03:04:31.164494 11750 raft_consensus.cc:515] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:04:31.164947 11750 leader_election.cc:290] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:04:31.165907 8469 leader_election.cc:343] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: e55ead2b80354ddf8876a5f8410122a2
W20260321 03:04:31.165998 8466 leader_election.cc:343] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: e55ead2b80354ddf8876a5f8410122a2
I20260321 03:04:31.166085 8466 leader_election.cc:304] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:04:31.166234 11750 raft_consensus.cc:2749] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:04:31.395661 10447 master_runner.cc:186] Error getting master registration for 127.7.178.254:38651: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111),
I20260321 03:04:31.395795 10447 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260321 03:04:36.397009 10447 master_runner.cc:186] Error getting master registration for 127.7.178.254:38651: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111),
I20260321 03:04:36.397125 10447 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260321 03:04:37.951429 11856 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260321 03:04:37.951592 11856 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:04:37.952145 11856 leader_election.cc:290] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651), 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595)
W20260321 03:04:37.953292 10465 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260321 03:04:37.954584 10465 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651): Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111)
W20260321 03:04:37.954799 10465 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595): Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
I20260321 03:04:37.954871 10465 leader_election.cc:304] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3df5e4492f3049c1b09fea013b92f863; no voters: 4a187d1fb5804686b4aff01e47fd0284, 7451d7c0a71f4620a6607f74b5a22f2e
I20260321 03:04:37.955219 11856 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260321 03:04:40.277436 11880 raft_consensus.cc:493] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 70e7666c46844503beb466fdc054a6fc)
I20260321 03:04:40.277606 11880 raft_consensus.cc:515] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:04:40.278098 11880 leader_election.cc:290] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:04:40.279322 8469 leader_election.cc:343] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: ba92d73996f84bbfbab47006dc934c8e
W20260321 03:04:40.279685 8466 leader_election.cc:343] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: ba92d73996f84bbfbab47006dc934c8e
I20260321 03:04:40.279806 8466 leader_election.cc:304] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:04:40.280026 11880 raft_consensus.cc:2749] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:04:41.398741 10447 master_runner.cc:186] Error getting master registration for 127.7.178.254:38651: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111),
I20260321 03:04:41.398885 10447 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260321 03:04:41.915042 11880 raft_consensus.cc:493] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 70e7666c46844503beb466fdc054a6fc)
I20260321 03:04:41.915274 11880 raft_consensus.cc:515] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:04:41.915771 11880 leader_election.cc:290] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:04:41.916711 8466 leader_election.cc:343] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: ba92d73996f84bbfbab47006dc934c8e
W20260321 03:04:41.916802 8469 leader_election.cc:343] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: ba92d73996f84bbfbab47006dc934c8e
I20260321 03:04:41.916908 8469 leader_election.cc:304] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:04:41.917196 11880 raft_consensus.cc:2749] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:04:42.005831 11880 raft_consensus.cc:493] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a97f7dd77cf2444f8fdb441019081f79)
I20260321 03:04:42.005977 11880 raft_consensus.cc:515] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:04:42.006474 11880 leader_election.cc:290] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:04:42.007315 8469 leader_election.cc:343] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: a4a81619964144e9aae068ed1e9eeaff
W20260321 03:04:42.007445 8466 leader_election.cc:343] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: a4a81619964144e9aae068ed1e9eeaff
I20260321 03:04:42.007503 8466 leader_election.cc:304] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:04:42.007648 11880 raft_consensus.cc:2749] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:04:46.400296 10447 master_runner.cc:186] Error getting master registration for 127.7.178.254:38651: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111),
I20260321 03:04:46.400419 10447 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260321 03:04:47.182866 11880 raft_consensus.cc:493] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 70e7666c46844503beb466fdc054a6fc)
I20260321 03:04:47.183043 11880 raft_consensus.cc:515] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:04:47.183635 11880 leader_election.cc:290] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:04:47.184432 8469 leader_election.cc:343] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: ba92d73996f84bbfbab47006dc934c8e
W20260321 03:04:47.184520 8466 leader_election.cc:343] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: ba92d73996f84bbfbab47006dc934c8e
I20260321 03:04:47.184571 8469 leader_election.cc:304] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:04:47.184723 11880 raft_consensus.cc:2749] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:04:49.445051 11880 raft_consensus.cc:493] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a97f7dd77cf2444f8fdb441019081f79)
I20260321 03:04:49.445215 11880 raft_consensus.cc:515] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:04:49.445782 11880 leader_election.cc:290] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:04:49.446745 8469 leader_election.cc:343] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: e55ead2b80354ddf8876a5f8410122a2
W20260321 03:04:49.446837 8466 leader_election.cc:343] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: e55ead2b80354ddf8876a5f8410122a2
I20260321 03:04:49.446934 8466 leader_election.cc:304] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:04:49.447088 11880 raft_consensus.cc:2749] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:04:51.403234 10447 master_runner.cc:186] Error getting master registration for 127.7.178.254:38651: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111),
I20260321 03:04:51.403373 10447 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260321 03:04:55.723519 12049 raft_consensus.cc:493] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a97f7dd77cf2444f8fdb441019081f79)
I20260321 03:04:55.723703 12049 raft_consensus.cc:515] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:04:55.724252 12049 leader_election.cc:290] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:04:55.725284 8466 leader_election.cc:343] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: a4a81619964144e9aae068ed1e9eeaff
W20260321 03:04:55.725394 8469 leader_election.cc:343] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: a4a81619964144e9aae068ed1e9eeaff
I20260321 03:04:55.725461 8469 leader_election.cc:304] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:04:55.725664 12049 raft_consensus.cc:2749] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:04:56.404913 10447 master_runner.cc:186] Error getting master registration for 127.7.178.254:38651: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111),
I20260321 03:04:56.405051 10447 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260321 03:04:56.478699 10468 maintenance_manager.cc:419] P 3df5e4492f3049c1b09fea013b92f863: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033368
I20260321 03:04:56.536724 10467 maintenance_manager.cc:643] P 3df5e4492f3049c1b09fea013b92f863: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.057s user 0.022s sys 0.004s Metrics: {"bytes_written":22526,"cfile_init":1,"dirs.queue_time_us":410,"dirs.run_cpu_time_us":329,"dirs.run_wall_time_us":1300,"drs_written":1,"lbm_read_time_us":103,"lbm_reads_lt_1ms":4,"lbm_write_time_us":532,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":53,"thread_start_us":295,"threads_started":2,"wal-append.queue_time_us":237}
I20260321 03:04:56.538157 10468 maintenance_manager.cc:419] P 3df5e4492f3049c1b09fea013b92f863: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 3489 bytes on disk
I20260321 03:04:56.538879 10467 maintenance_manager.cc:643] P 3df5e4492f3049c1b09fea013b92f863: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":68,"lbm_reads_lt_1ms":4}
I20260321 03:04:56.559559 12091 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260321 03:04:56.559720 12091 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:04:56.560371 12091 leader_election.cc:290] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651), 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595)
W20260321 03:04:56.561404 10465 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260321 03:04:56.562551 10465 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651): Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111)
W20260321 03:04:56.562762 10465 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595): Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
I20260321 03:04:56.562826 10465 leader_election.cc:304] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3df5e4492f3049c1b09fea013b92f863; no voters: 4a187d1fb5804686b4aff01e47fd0284, 7451d7c0a71f4620a6607f74b5a22f2e
I20260321 03:04:56.563069 12091 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260321 03:04:59.805099 12133 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260321 03:04:59.805667 12133 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:04:59.806303 12133 leader_election.cc:290] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651), 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595)
W20260321 03:04:59.808157 10465 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651): Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111)
W20260321 03:04:59.808367 10465 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595): Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
I20260321 03:04:59.808430 10465 leader_election.cc:304] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3df5e4492f3049c1b09fea013b92f863; no voters: 4a187d1fb5804686b4aff01e47fd0284, 7451d7c0a71f4620a6607f74b5a22f2e
I20260321 03:04:59.808663 12133 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260321 03:05:01.406255 10447 master_runner.cc:186] Error getting master registration for 127.7.178.254:38651: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111),
I20260321 03:05:01.406400 10447 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260321 03:05:02.771731 12187 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260321 03:05:02.772043 12187 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:05:02.772976 12187 leader_election.cc:290] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651), 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595)
W20260321 03:05:02.773847 10465 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260321 03:05:02.774874 10465 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651): Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111)
W20260321 03:05:02.775027 10465 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595): Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
I20260321 03:05:02.775103 10465 leader_election.cc:304] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3df5e4492f3049c1b09fea013b92f863; no voters: 4a187d1fb5804686b4aff01e47fd0284, 7451d7c0a71f4620a6607f74b5a22f2e
I20260321 03:05:02.775318 12187 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260321 03:05:03.645756 12206 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260321 03:05:03.645924 12206 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:05:03.646386 12206 leader_election.cc:290] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651), 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595)
W20260321 03:05:03.648275 10465 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651): Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111)
W20260321 03:05:03.648411 10465 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595): Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
I20260321 03:05:03.648450 10465 leader_election.cc:304] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3df5e4492f3049c1b09fea013b92f863; no voters: 4a187d1fb5804686b4aff01e47fd0284, 7451d7c0a71f4620a6607f74b5a22f2e
I20260321 03:05:03.648756 12206 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260321 03:05:04.495252 12049 raft_consensus.cc:493] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 70e7666c46844503beb466fdc054a6fc)
I20260321 03:05:04.495441 12049 raft_consensus.cc:515] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:05:04.496060 12049 leader_election.cc:290] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:05:04.497009 8469 leader_election.cc:343] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: ba92d73996f84bbfbab47006dc934c8e
W20260321 03:05:04.497153 8466 leader_election.cc:343] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: ba92d73996f84bbfbab47006dc934c8e
I20260321 03:05:04.497313 8466 leader_election.cc:304] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:05:04.497503 12049 raft_consensus.cc:2749] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:05:06.407886 10447 master_runner.cc:186] Error getting master registration for 127.7.178.254:38651: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111),
I20260321 03:05:06.408054 10447 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260321 03:05:07.813905 12049 raft_consensus.cc:493] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a97f7dd77cf2444f8fdb441019081f79)
I20260321 03:05:07.814050 12049 raft_consensus.cc:515] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:05:07.814452 12049 leader_election.cc:290] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:05:07.815322 8469 leader_election.cc:343] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: a4a81619964144e9aae068ed1e9eeaff
W20260321 03:05:07.815490 8466 leader_election.cc:343] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: a4a81619964144e9aae068ed1e9eeaff
I20260321 03:05:07.815600 8466 leader_election.cc:304] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:05:07.815812 12049 raft_consensus.cc:2749] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:05:07.898494 12049 raft_consensus.cc:493] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a97f7dd77cf2444f8fdb441019081f79)
I20260321 03:05:07.898658 12049 raft_consensus.cc:515] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:05:07.899232 12049 leader_election.cc:290] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:05:07.900254 8469 leader_election.cc:343] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: e55ead2b80354ddf8876a5f8410122a2
W20260321 03:05:07.900360 8466 leader_election.cc:343] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: e55ead2b80354ddf8876a5f8410122a2
I20260321 03:05:07.900494 8466 leader_election.cc:304] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:05:07.900856 12049 raft_consensus.cc:2749] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:05:08.648836 12049 raft_consensus.cc:493] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 70e7666c46844503beb466fdc054a6fc)
I20260321 03:05:08.649003 12049 raft_consensus.cc:515] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:05:08.649626 12049 leader_election.cc:290] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:05:08.650986 8466 leader_election.cc:343] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: ba92d73996f84bbfbab47006dc934c8e
W20260321 03:05:08.651168 8469 leader_election.cc:343] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: ba92d73996f84bbfbab47006dc934c8e
I20260321 03:05:08.651243 8469 leader_election.cc:304] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:05:08.651450 12049 raft_consensus.cc:2749] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:05:11.409704 10447 master_runner.cc:186] Error getting master registration for 127.7.178.254:38651: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111),
I20260321 03:05:11.409907 10447 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260321 03:05:16.411520 10447 master_runner.cc:186] Error getting master registration for 127.7.178.254:38651: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111),
I20260321 03:05:16.411696 10447 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260321 03:05:16.482973 12049 raft_consensus.cc:493] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a97f7dd77cf2444f8fdb441019081f79)
I20260321 03:05:16.483253 12049 raft_consensus.cc:515] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:05:16.483896 12049 leader_election.cc:290] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:05:16.485004 8469 leader_election.cc:343] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: a4a81619964144e9aae068ed1e9eeaff
W20260321 03:05:16.485141 8466 leader_election.cc:343] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: a4a81619964144e9aae068ed1e9eeaff
I20260321 03:05:16.485338 8466 leader_election.cc:304] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:05:16.485581 12049 raft_consensus.cc:2749] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:05:17.133524 12422 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260321 03:05:17.133764 12422 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:05:17.134400 12422 leader_election.cc:290] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651), 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595)
W20260321 03:05:17.135326 10465 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260321 03:05:17.136226 10465 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651): Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111)
W20260321 03:05:17.136379 10465 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595): Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
I20260321 03:05:17.136412 10465 leader_election.cc:304] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3df5e4492f3049c1b09fea013b92f863; no voters: 4a187d1fb5804686b4aff01e47fd0284, 7451d7c0a71f4620a6607f74b5a22f2e
I20260321 03:05:17.136618 12422 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260321 03:05:19.337430 12049 raft_consensus.cc:493] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a97f7dd77cf2444f8fdb441019081f79)
I20260321 03:05:19.337597 12049 raft_consensus.cc:515] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:05:19.338044 12049 leader_election.cc:290] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:05:19.339462 8469 leader_election.cc:343] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: e55ead2b80354ddf8876a5f8410122a2
W20260321 03:05:19.339694 8466 leader_election.cc:343] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: e55ead2b80354ddf8876a5f8410122a2
I20260321 03:05:19.339809 8466 leader_election.cc:304] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:05:19.340113 12049 raft_consensus.cc:2749] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:05:21.361392 12049 raft_consensus.cc:493] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 70e7666c46844503beb466fdc054a6fc)
I20260321 03:05:21.361564 12049 raft_consensus.cc:515] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:05:21.362277 12049 leader_election.cc:290] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:05:21.363807 8466 leader_election.cc:343] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: ba92d73996f84bbfbab47006dc934c8e
W20260321 03:05:21.363969 8469 leader_election.cc:343] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: ba92d73996f84bbfbab47006dc934c8e
I20260321 03:05:21.364030 8469 leader_election.cc:304] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:05:21.364202 12049 raft_consensus.cc:2749] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:05:21.413102 10447 master_runner.cc:186] Error getting master registration for 127.7.178.254:38651: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111),
I20260321 03:05:21.413371 10447 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260321 03:05:26.415212 10447 master_runner.cc:186] Error getting master registration for 127.7.178.254:38651: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111),
I20260321 03:05:26.415376 10447 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260321 03:05:29.108758 8715 heartbeater.cc:646] Failed to heartbeat to 127.7.178.254:38651 (332 consecutive failures): Network error: Failed to ping master at 127.7.178.254:38651: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111)
W20260321 03:05:29.279858 8580 heartbeater.cc:646] Failed to heartbeat to 127.7.178.254:38651 (340 consecutive failures): Network error: Failed to ping master at 127.7.178.254:38651: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111)
W20260321 03:05:29.430754 8851 heartbeater.cc:646] Failed to heartbeat to 127.7.178.254:38651 (333 consecutive failures): Network error: Failed to ping master at 127.7.178.254:38651: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111)
I20260321 03:05:29.768488 12610 raft_consensus.cc:493] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 70e7666c46844503beb466fdc054a6fc)
I20260321 03:05:29.768649 12610 raft_consensus.cc:515] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:05:29.769129 12610 leader_election.cc:290] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:05:29.770159 8466 leader_election.cc:343] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: ba92d73996f84bbfbab47006dc934c8e
W20260321 03:05:29.770442 8469 leader_election.cc:343] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: ba92d73996f84bbfbab47006dc934c8e
I20260321 03:05:29.770529 8469 leader_election.cc:304] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:05:29.770849 12610 raft_consensus.cc:2749] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:05:30.674135 12610 raft_consensus.cc:493] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a97f7dd77cf2444f8fdb441019081f79)
I20260321 03:05:30.674319 12610 raft_consensus.cc:515] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:05:30.674927 12610 leader_election.cc:290] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:05:30.675813 8466 leader_election.cc:343] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: e55ead2b80354ddf8876a5f8410122a2
W20260321 03:05:30.675951 8469 leader_election.cc:343] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: e55ead2b80354ddf8876a5f8410122a2
I20260321 03:05:30.676178 8469 leader_election.cc:304] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:05:30.676434 12610 raft_consensus.cc:2749] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:05:31.416712 10447 master_runner.cc:186] Error getting master registration for 127.7.178.254:38651: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111),
I20260321 03:05:31.416854 10447 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260321 03:05:31.919540 12610 raft_consensus.cc:493] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a97f7dd77cf2444f8fdb441019081f79)
I20260321 03:05:31.919764 12610 raft_consensus.cc:515] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:05:31.920653 12610 leader_election.cc:290] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:05:31.921715 8469 leader_election.cc:343] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: a4a81619964144e9aae068ed1e9eeaff
W20260321 03:05:31.921880 8466 leader_election.cc:343] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: a4a81619964144e9aae068ed1e9eeaff
I20260321 03:05:31.922036 8466 leader_election.cc:304] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:05:31.922220 12610 raft_consensus.cc:2749] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:05:33.331377 12684 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260321 03:05:33.331524 12684 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:05:33.332226 12684 leader_election.cc:290] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651), 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595)
W20260321 03:05:33.333132 10465 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260321 03:05:33.334112 10465 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651): Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111)
W20260321 03:05:33.334249 10465 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595): Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
I20260321 03:05:33.334306 10465 leader_election.cc:304] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3df5e4492f3049c1b09fea013b92f863; no voters: 4a187d1fb5804686b4aff01e47fd0284, 7451d7c0a71f4620a6607f74b5a22f2e
I20260321 03:05:33.334455 12684 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260321 03:05:34.307561 12610 raft_consensus.cc:493] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a97f7dd77cf2444f8fdb441019081f79)
I20260321 03:05:34.307776 12610 raft_consensus.cc:515] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:05:34.308454 12610 leader_election.cc:290] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:05:34.309589 8466 leader_election.cc:343] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: e55ead2b80354ddf8876a5f8410122a2
W20260321 03:05:34.309695 8469 leader_election.cc:343] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: e55ead2b80354ddf8876a5f8410122a2
I20260321 03:05:34.309864 8469 leader_election.cc:304] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:05:34.310111 12610 raft_consensus.cc:2749] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:05:34.431488 12610 raft_consensus.cc:493] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 70e7666c46844503beb466fdc054a6fc)
I20260321 03:05:34.431704 12610 raft_consensus.cc:515] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:05:34.432395 12610 leader_election.cc:290] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:05:34.433460 8466 leader_election.cc:343] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: ba92d73996f84bbfbab47006dc934c8e
W20260321 03:05:34.433610 8469 leader_election.cc:343] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: ba92d73996f84bbfbab47006dc934c8e
I20260321 03:05:34.433743 8469 leader_election.cc:304] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:05:34.433982 12610 raft_consensus.cc:2749] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:05:36.418248 10447 master_runner.cc:186] Error getting master registration for 127.7.178.254:38651: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111),
I20260321 03:05:36.418424 10447 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260321 03:05:37.955803 12610 raft_consensus.cc:493] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a97f7dd77cf2444f8fdb441019081f79)
I20260321 03:05:37.956070 12610 raft_consensus.cc:515] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:05:37.956841 12610 leader_election.cc:290] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:05:37.957932 8469 leader_election.cc:343] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: e55ead2b80354ddf8876a5f8410122a2
W20260321 03:05:37.958122 8466 leader_election.cc:343] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: e55ead2b80354ddf8876a5f8410122a2
I20260321 03:05:37.958220 8466 leader_election.cc:304] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:05:37.958376 12610 raft_consensus.cc:2749] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:05:40.324342 12610 raft_consensus.cc:493] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a97f7dd77cf2444f8fdb441019081f79)
I20260321 03:05:40.324556 12610 raft_consensus.cc:515] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:05:40.325199 12610 leader_election.cc:290] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:05:40.326292 8466 leader_election.cc:343] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: e55ead2b80354ddf8876a5f8410122a2
W20260321 03:05:40.326398 8469 leader_election.cc:343] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: e55ead2b80354ddf8876a5f8410122a2
I20260321 03:05:40.326560 8469 leader_election.cc:304] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:05:40.326781 12610 raft_consensus.cc:2749] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:05:41.139007 12610 raft_consensus.cc:493] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a97f7dd77cf2444f8fdb441019081f79)
I20260321 03:05:41.139169 12610 raft_consensus.cc:515] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:05:41.139883 12610 leader_election.cc:290] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:05:41.140671 8469 leader_election.cc:343] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: a4a81619964144e9aae068ed1e9eeaff
W20260321 03:05:41.140779 8466 leader_election.cc:343] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: a4a81619964144e9aae068ed1e9eeaff
I20260321 03:05:41.140914 8466 leader_election.cc:304] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:05:41.141099 12610 raft_consensus.cc:2749] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:05:41.419720 10447 master_runner.cc:186] Error getting master registration for 127.7.178.254:38651: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111),
I20260321 03:05:41.419884 10447 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260321 03:05:44.815675 12610 raft_consensus.cc:493] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a97f7dd77cf2444f8fdb441019081f79)
I20260321 03:05:44.815984 12610 raft_consensus.cc:515] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:05:44.816583 12610 leader_election.cc:290] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:05:44.817765 8469 leader_election.cc:343] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: e55ead2b80354ddf8876a5f8410122a2
W20260321 03:05:44.817982 8466 leader_election.cc:343] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: e55ead2b80354ddf8876a5f8410122a2
I20260321 03:05:44.818063 8466 leader_election.cc:304] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:05:44.818249 12610 raft_consensus.cc:2749] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:05:45.530884 12879 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260321 03:05:45.531050 12879 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:05:45.531507 12879 leader_election.cc:290] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651), 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595)
W20260321 03:05:45.532475 10465 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260321 03:05:45.533775 10465 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651): Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111)
W20260321 03:05:45.533939 10465 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595): Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
I20260321 03:05:45.534011 10465 leader_election.cc:304] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3df5e4492f3049c1b09fea013b92f863; no voters: 4a187d1fb5804686b4aff01e47fd0284, 7451d7c0a71f4620a6607f74b5a22f2e
I20260321 03:05:45.534255 12879 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260321 03:05:46.421531 10447 master_runner.cc:186] Error getting master registration for 127.7.178.254:38651: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111),
I20260321 03:05:46.421743 10447 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260321 03:05:47.094107 12909 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260321 03:05:47.094252 12909 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:05:47.094766 12909 leader_election.cc:290] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651), 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595)
W20260321 03:05:47.096459 10465 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651): Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111)
W20260321 03:05:47.096606 10465 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595): Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
I20260321 03:05:47.096659 10465 leader_election.cc:304] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3df5e4492f3049c1b09fea013b92f863; no voters: 4a187d1fb5804686b4aff01e47fd0284, 7451d7c0a71f4620a6607f74b5a22f2e
I20260321 03:05:47.096839 12909 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260321 03:05:50.732569 12950 raft_consensus.cc:493] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 70e7666c46844503beb466fdc054a6fc)
I20260321 03:05:50.732818 12950 raft_consensus.cc:515] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:05:50.733558 12950 leader_election.cc:290] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:05:50.734468 8469 leader_election.cc:343] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: ba92d73996f84bbfbab47006dc934c8e
W20260321 03:05:50.734740 8466 leader_election.cc:343] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: ba92d73996f84bbfbab47006dc934c8e
I20260321 03:05:50.734838 8466 leader_election.cc:304] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:05:50.735203 12950 raft_consensus.cc:2749] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:05:51.423100 10447 master_runner.cc:186] Error getting master registration for 127.7.178.254:38651: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111),
I20260321 03:05:51.423231 10447 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260321 03:05:54.851163 12950 raft_consensus.cc:493] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a97f7dd77cf2444f8fdb441019081f79)
I20260321 03:05:54.851325 12950 raft_consensus.cc:515] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:05:54.851945 12950 leader_election.cc:290] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:05:54.852950 8466 leader_election.cc:343] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: e55ead2b80354ddf8876a5f8410122a2
W20260321 03:05:54.853080 8469 leader_election.cc:343] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: e55ead2b80354ddf8876a5f8410122a2
I20260321 03:05:54.853226 8469 leader_election.cc:304] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:05:54.853549 12950 raft_consensus.cc:2749] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:05:54.984601 13035 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260321 03:05:54.984750 13035 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:05:54.985194 13035 leader_election.cc:290] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651), 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595)
W20260321 03:05:54.985977 10465 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260321 03:05:54.986876 10465 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651): Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111)
W20260321 03:05:54.987004 10465 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595): Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
I20260321 03:05:54.987038 10465 leader_election.cc:304] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3df5e4492f3049c1b09fea013b92f863; no voters: 4a187d1fb5804686b4aff01e47fd0284, 7451d7c0a71f4620a6607f74b5a22f2e
I20260321 03:05:54.987202 13035 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260321 03:05:56.424823 10447 master_runner.cc:186] Error getting master registration for 127.7.178.254:38651: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111),
I20260321 03:05:56.424995 10447 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260321 03:05:57.280135 13057 raft_consensus.cc:493] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a97f7dd77cf2444f8fdb441019081f79)
I20260321 03:05:57.280332 13057 raft_consensus.cc:515] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:05:57.280913 13057 leader_election.cc:290] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:05:57.282066 8469 leader_election.cc:343] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: a4a81619964144e9aae068ed1e9eeaff
W20260321 03:05:57.282168 8466 leader_election.cc:343] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: a4a81619964144e9aae068ed1e9eeaff
I20260321 03:05:57.282327 8466 leader_election.cc:304] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:05:57.282598 13057 raft_consensus.cc:2749] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:06:01.426505 10447 master_runner.cc:186] Error getting master registration for 127.7.178.254:38651: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111),
I20260321 03:06:01.426666 10447 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260321 03:06:04.390007 13118 raft_consensus.cc:493] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a97f7dd77cf2444f8fdb441019081f79)
I20260321 03:06:04.390277 13118 raft_consensus.cc:515] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:06:04.390936 13118 leader_election.cc:290] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:06:04.391990 8466 leader_election.cc:343] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: a4a81619964144e9aae068ed1e9eeaff
W20260321 03:06:04.392184 8469 leader_election.cc:343] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: a4a81619964144e9aae068ed1e9eeaff
I20260321 03:06:04.392283 8469 leader_election.cc:304] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:06:04.392506 13118 raft_consensus.cc:2749] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:06:06.238276 13207 raft_consensus.cc:493] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 70e7666c46844503beb466fdc054a6fc)
I20260321 03:06:06.238440 13207 raft_consensus.cc:515] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:06:06.239019 13207 leader_election.cc:290] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:06:06.239910 8466 leader_election.cc:343] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: ba92d73996f84bbfbab47006dc934c8e
W20260321 03:06:06.239997 8469 leader_election.cc:343] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: ba92d73996f84bbfbab47006dc934c8e
I20260321 03:06:06.240118 8469 leader_election.cc:304] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:06:06.240331 13207 raft_consensus.cc:2749] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:06:06.428180 10447 master_runner.cc:186] Error getting master registration for 127.7.178.254:38651: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111),
I20260321 03:06:06.428359 10447 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260321 03:06:08.343676 13254 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260321 03:06:08.343930 13254 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:06:08.344478 13254 leader_election.cc:290] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651), 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595)
W20260321 03:06:08.345254 10465 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260321 03:06:08.346539 10465 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651): Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111)
W20260321 03:06:08.346691 10465 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595): Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
I20260321 03:06:08.346750 10465 leader_election.cc:304] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3df5e4492f3049c1b09fea013b92f863; no voters: 4a187d1fb5804686b4aff01e47fd0284, 7451d7c0a71f4620a6607f74b5a22f2e
I20260321 03:06:08.346905 13254 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260321 03:06:08.664237 13207 raft_consensus.cc:493] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a97f7dd77cf2444f8fdb441019081f79)
I20260321 03:06:08.664405 13207 raft_consensus.cc:515] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:06:08.664909 13207 leader_election.cc:290] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:06:08.666162 8466 leader_election.cc:343] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: e55ead2b80354ddf8876a5f8410122a2
W20260321 03:06:08.666321 8469 leader_election.cc:343] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: e55ead2b80354ddf8876a5f8410122a2
I20260321 03:06:08.666476 8469 leader_election.cc:304] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:06:08.666838 13207 raft_consensus.cc:2749] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:06:11.224159 13207 raft_consensus.cc:493] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 70e7666c46844503beb466fdc054a6fc)
I20260321 03:06:11.224385 13207 raft_consensus.cc:515] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:06:11.225557 13207 leader_election.cc:290] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:06:11.226676 8469 leader_election.cc:343] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: ba92d73996f84bbfbab47006dc934c8e
W20260321 03:06:11.226940 8466 leader_election.cc:343] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: ba92d73996f84bbfbab47006dc934c8e
I20260321 03:06:11.227092 8466 leader_election.cc:304] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:06:11.227316 13207 raft_consensus.cc:2749] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:06:11.430110 10447 master_runner.cc:186] Error getting master registration for 127.7.178.254:38651: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111),
I20260321 03:06:11.430331 10447 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260321 03:06:16.434489 10447 master_runner.cc:186] Error getting master registration for 127.7.178.254:38651: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111),
I20260321 03:06:16.434676 10447 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260321 03:06:17.161458 13207 raft_consensus.cc:493] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a97f7dd77cf2444f8fdb441019081f79)
I20260321 03:06:17.161701 13207 raft_consensus.cc:515] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:06:17.162611 13207 leader_election.cc:290] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:06:17.163898 8466 leader_election.cc:343] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: e55ead2b80354ddf8876a5f8410122a2
W20260321 03:06:17.164052 8469 leader_election.cc:343] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: e55ead2b80354ddf8876a5f8410122a2
I20260321 03:06:17.164239 8469 leader_election.cc:304] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:06:17.164613 13207 raft_consensus.cc:2749] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:06:17.964110 13207 raft_consensus.cc:493] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 70e7666c46844503beb466fdc054a6fc)
I20260321 03:06:17.964282 13207 raft_consensus.cc:515] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:06:17.964954 13207 leader_election.cc:290] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:06:17.966167 8469 leader_election.cc:343] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: ba92d73996f84bbfbab47006dc934c8e
W20260321 03:06:17.966359 8466 leader_election.cc:343] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: ba92d73996f84bbfbab47006dc934c8e
I20260321 03:06:17.966434 8466 leader_election.cc:304] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:06:17.966735 13207 raft_consensus.cc:2749] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:06:18.213411 13409 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260321 03:06:18.213861 13409 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:06:18.214558 13409 leader_election.cc:290] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651), 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595)
W20260321 03:06:18.215723 10465 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260321 03:06:18.216944 10465 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651): Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111)
W20260321 03:06:18.217250 10465 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595): Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
I20260321 03:06:18.217382 10465 leader_election.cc:304] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3df5e4492f3049c1b09fea013b92f863; no voters: 4a187d1fb5804686b4aff01e47fd0284, 7451d7c0a71f4620a6607f74b5a22f2e
I20260321 03:06:18.217664 13409 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260321 03:06:21.301131 13207 raft_consensus.cc:493] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a97f7dd77cf2444f8fdb441019081f79)
I20260321 03:06:21.301393 13207 raft_consensus.cc:515] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:06:21.302933 13207 leader_election.cc:290] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:06:21.304895 8469 leader_election.cc:343] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: a4a81619964144e9aae068ed1e9eeaff
W20260321 03:06:21.305073 8466 leader_election.cc:343] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: a4a81619964144e9aae068ed1e9eeaff
I20260321 03:06:21.305191 8466 leader_election.cc:304] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:06:21.305497 13207 raft_consensus.cc:2749] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:06:21.436012 10447 master_runner.cc:186] Error getting master registration for 127.7.178.254:38651: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111),
I20260321 03:06:21.436144 10447 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260321 03:06:23.304070 13207 raft_consensus.cc:493] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 70e7666c46844503beb466fdc054a6fc)
I20260321 03:06:23.304226 13207 raft_consensus.cc:515] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:06:23.304739 13207 leader_election.cc:290] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:06:23.305650 8466 leader_election.cc:343] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: ba92d73996f84bbfbab47006dc934c8e
W20260321 03:06:23.305948 8469 leader_election.cc:343] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: ba92d73996f84bbfbab47006dc934c8e
I20260321 03:06:23.306049 8469 leader_election.cc:304] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:06:23.306272 13207 raft_consensus.cc:2749] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:06:24.572386 13207 raft_consensus.cc:493] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a97f7dd77cf2444f8fdb441019081f79)
I20260321 03:06:24.572628 13207 raft_consensus.cc:515] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:06:24.573295 13207 leader_election.cc:290] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:06:24.574570 8466 leader_election.cc:343] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: a4a81619964144e9aae068ed1e9eeaff
W20260321 03:06:24.574882 8469 leader_election.cc:343] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: a4a81619964144e9aae068ed1e9eeaff
I20260321 03:06:24.575058 8469 leader_election.cc:304] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:06:24.575484 13207 raft_consensus.cc:2749] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:06:26.437391 10447 master_runner.cc:186] Error getting master registration for 127.7.178.254:38651: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111),
I20260321 03:06:26.437526 10447 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260321 03:06:29.283964 8715 heartbeater.cc:646] Failed to heartbeat to 127.7.178.254:38651 (452 consecutive failures): Network error: Failed to ping master at 127.7.178.254:38651: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111)
W20260321 03:06:29.448802 8581 heartbeater.cc:646] Failed to heartbeat to 127.7.178.253:46595 (438 consecutive failures): Network error: Failed to ping master at 127.7.178.253:46595: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
W20260321 03:06:29.602535 8851 heartbeater.cc:646] Failed to heartbeat to 127.7.178.254:38651 (453 consecutive failures): Network error: Failed to ping master at 127.7.178.254:38651: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111)
I20260321 03:06:31.303783 13611 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260321 03:06:31.303987 13611 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:06:31.304625 13611 leader_election.cc:290] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651), 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595)
W20260321 03:06:31.305786 10465 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260321 03:06:31.307112 10465 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651): Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111)
W20260321 03:06:31.307265 10465 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595): Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
I20260321 03:06:31.307317 10465 leader_election.cc:304] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3df5e4492f3049c1b09fea013b92f863; no voters: 4a187d1fb5804686b4aff01e47fd0284, 7451d7c0a71f4620a6607f74b5a22f2e
I20260321 03:06:31.307538 13611 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260321 03:06:31.438989 10447 master_runner.cc:186] Error getting master registration for 127.7.178.254:38651: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111),
I20260321 03:06:31.439193 10447 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260321 03:06:36.440757 10447 master_runner.cc:186] Error getting master registration for 127.7.178.254:38651: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111),
I20260321 03:06:36.440951 10447 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260321 03:06:36.940737 13628 raft_consensus.cc:493] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a97f7dd77cf2444f8fdb441019081f79)
I20260321 03:06:36.940905 13628 raft_consensus.cc:515] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:06:36.941612 13628 leader_election.cc:290] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:06:36.942446 8466 leader_election.cc:343] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: e55ead2b80354ddf8876a5f8410122a2
W20260321 03:06:36.942546 8469 leader_election.cc:343] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: e55ead2b80354ddf8876a5f8410122a2
I20260321 03:06:36.942664 8469 leader_election.cc:304] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:06:36.942873 13628 raft_consensus.cc:2749] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:06:39.309538 13628 raft_consensus.cc:493] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 70e7666c46844503beb466fdc054a6fc)
I20260321 03:06:39.309716 13628 raft_consensus.cc:515] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:06:39.310197 13628 leader_election.cc:290] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:06:39.311514 8469 leader_election.cc:343] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: ba92d73996f84bbfbab47006dc934c8e
W20260321 03:06:39.312387 8466 leader_election.cc:343] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: ba92d73996f84bbfbab47006dc934c8e
I20260321 03:06:39.312497 8466 leader_election.cc:304] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:06:39.312752 13628 raft_consensus.cc:2749] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:06:41.442478 10447 master_runner.cc:186] Error getting master registration for 127.7.178.254:38651: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111),
I20260321 03:06:41.442631 10447 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260321 03:06:43.841115 13628 raft_consensus.cc:493] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a97f7dd77cf2444f8fdb441019081f79)
I20260321 03:06:43.841408 13628 raft_consensus.cc:515] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:06:43.842265 13628 leader_election.cc:290] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:06:43.843540 8466 leader_election.cc:343] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: a4a81619964144e9aae068ed1e9eeaff
W20260321 03:06:43.843803 8469 leader_election.cc:343] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: a4a81619964144e9aae068ed1e9eeaff
I20260321 03:06:43.843910 8469 leader_election.cc:304] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:06:43.844116 13628 raft_consensus.cc:2749] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:06:46.444216 10447 master_runner.cc:186] Error getting master registration for 127.7.178.254:38651: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111),
I20260321 03:06:46.444379 10447 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260321 03:06:46.814589 13628 raft_consensus.cc:493] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a97f7dd77cf2444f8fdb441019081f79)
I20260321 03:06:46.814888 13628 raft_consensus.cc:515] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:06:46.815510 13628 leader_election.cc:290] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:06:46.816803 8469 leader_election.cc:343] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: e55ead2b80354ddf8876a5f8410122a2
W20260321 03:06:46.817026 8466 leader_election.cc:343] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: e55ead2b80354ddf8876a5f8410122a2
I20260321 03:06:46.817102 8466 leader_election.cc:304] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:06:46.817377 13628 raft_consensus.cc:2749] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:06:47.813002 13628 raft_consensus.cc:493] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 70e7666c46844503beb466fdc054a6fc)
I20260321 03:06:47.813190 13628 raft_consensus.cc:515] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:06:47.813766 13628 leader_election.cc:290] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:06:47.814615 8466 leader_election.cc:343] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: ba92d73996f84bbfbab47006dc934c8e
W20260321 03:06:47.814703 8469 leader_election.cc:343] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: ba92d73996f84bbfbab47006dc934c8e
I20260321 03:06:47.814888 8469 leader_election.cc:304] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:06:47.815091 13628 raft_consensus.cc:2749] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:06:48.148912 13873 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260321 03:06:48.149096 13873 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:06:48.149809 13873 leader_election.cc:290] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651), 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595)
W20260321 03:06:48.150606 10465 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260321 03:06:48.151412 10465 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651): Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111)
W20260321 03:06:48.151548 10465 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595): Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
I20260321 03:06:48.151584 10465 leader_election.cc:304] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3df5e4492f3049c1b09fea013b92f863; no voters: 4a187d1fb5804686b4aff01e47fd0284, 7451d7c0a71f4620a6607f74b5a22f2e
I20260321 03:06:48.151738 13873 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260321 03:06:48.912870 13628 raft_consensus.cc:493] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a97f7dd77cf2444f8fdb441019081f79)
I20260321 03:06:48.913033 13628 raft_consensus.cc:515] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:06:48.913555 13628 leader_election.cc:290] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:06:48.914445 8469 leader_election.cc:343] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: e55ead2b80354ddf8876a5f8410122a2
W20260321 03:06:48.914577 8466 leader_election.cc:343] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: e55ead2b80354ddf8876a5f8410122a2
I20260321 03:06:48.914678 8466 leader_election.cc:304] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:06:48.915019 13628 raft_consensus.cc:2749] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:06:49.191087 13891 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260321 03:06:49.191237 13891 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:06:49.191641 13891 leader_election.cc:290] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651), 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595)
W20260321 03:06:49.193164 10465 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651): Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111)
W20260321 03:06:49.193406 10465 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595): Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
I20260321 03:06:49.193490 10465 leader_election.cc:304] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3df5e4492f3049c1b09fea013b92f863; no voters: 4a187d1fb5804686b4aff01e47fd0284, 7451d7c0a71f4620a6607f74b5a22f2e
I20260321 03:06:49.193689 13891 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260321 03:06:51.445590 10447 master_runner.cc:186] Error getting master registration for 127.7.178.254:38651: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111),
I20260321 03:06:51.445736 10447 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260321 03:06:53.901757 13968 raft_consensus.cc:493] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a97f7dd77cf2444f8fdb441019081f79)
I20260321 03:06:53.901957 13968 raft_consensus.cc:515] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:06:53.902686 13968 leader_election.cc:290] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:06:53.903311 8469 leader_election.cc:343] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: a4a81619964144e9aae068ed1e9eeaff
W20260321 03:06:53.903486 8466 leader_election.cc:343] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: a4a81619964144e9aae068ed1e9eeaff
I20260321 03:06:53.903594 8466 leader_election.cc:304] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:06:53.903769 13968 raft_consensus.cc:2749] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:06:53.955976 13968 raft_consensus.cc:493] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 70e7666c46844503beb466fdc054a6fc)
I20260321 03:06:53.956166 13968 raft_consensus.cc:515] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:06:53.956753 13968 leader_election.cc:290] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:06:53.957700 8466 leader_election.cc:343] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: ba92d73996f84bbfbab47006dc934c8e
W20260321 03:06:53.957921 8469 leader_election.cc:343] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: ba92d73996f84bbfbab47006dc934c8e
I20260321 03:06:53.958038 8469 leader_election.cc:304] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:06:53.958279 13968 raft_consensus.cc:2749] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:06:55.718603 13968 raft_consensus.cc:493] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a97f7dd77cf2444f8fdb441019081f79)
I20260321 03:06:55.718906 13968 raft_consensus.cc:515] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:06:55.719471 13968 leader_election.cc:290] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:06:55.720937 8466 leader_election.cc:343] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: e55ead2b80354ddf8876a5f8410122a2
W20260321 03:06:55.721108 8469 leader_election.cc:343] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: e55ead2b80354ddf8876a5f8410122a2
I20260321 03:06:55.721308 8469 leader_election.cc:304] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:06:55.721629 13968 raft_consensus.cc:2749] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:06:56.447396 10447 master_runner.cc:186] Error getting master registration for 127.7.178.254:38651: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111),
I20260321 03:06:56.447604 10447 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260321 03:07:01.449051 10447 master_runner.cc:186] Error getting master registration for 127.7.178.254:38651: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111),
I20260321 03:07:01.449218 10447 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260321 03:07:03.088160 13968 raft_consensus.cc:493] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a97f7dd77cf2444f8fdb441019081f79)
I20260321 03:07:03.088328 13968 raft_consensus.cc:515] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:07:03.089022 13968 leader_election.cc:290] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:07:03.089836 8469 leader_election.cc:343] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: a4a81619964144e9aae068ed1e9eeaff
W20260321 03:07:03.089929 8466 leader_election.cc:343] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: a4a81619964144e9aae068ed1e9eeaff
I20260321 03:07:03.089998 8466 leader_election.cc:304] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:07:03.090170 13968 raft_consensus.cc:2749] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:07:05.132979 14135 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260321 03:07:05.133181 14135 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:07:05.134039 14135 leader_election.cc:290] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651), 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595)
W20260321 03:07:05.134771 10465 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260321 03:07:05.135622 10465 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651): Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111)
W20260321 03:07:05.135772 10465 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595): Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
I20260321 03:07:05.135805 10465 leader_election.cc:304] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3df5e4492f3049c1b09fea013b92f863; no voters: 4a187d1fb5804686b4aff01e47fd0284, 7451d7c0a71f4620a6607f74b5a22f2e
I20260321 03:07:05.135955 14135 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260321 03:07:06.451056 10447 master_runner.cc:186] Error getting master registration for 127.7.178.254:38651: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111),
I20260321 03:07:06.451256 10447 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260321 03:07:07.085487 13968 raft_consensus.cc:493] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a97f7dd77cf2444f8fdb441019081f79)
I20260321 03:07:07.085686 13968 raft_consensus.cc:515] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:07:07.086277 13968 leader_election.cc:290] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:07:07.086898 8466 leader_election.cc:343] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: e55ead2b80354ddf8876a5f8410122a2
W20260321 03:07:07.086992 8469 leader_election.cc:343] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: e55ead2b80354ddf8876a5f8410122a2
I20260321 03:07:07.087055 8469 leader_election.cc:304] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:07:07.087188 13968 raft_consensus.cc:2749] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:07:10.927314 13968 raft_consensus.cc:493] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a97f7dd77cf2444f8fdb441019081f79)
I20260321 03:07:10.927551 13968 raft_consensus.cc:515] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:07:10.928295 13968 leader_election.cc:290] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:07:10.929386 8469 leader_election.cc:343] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: a4a81619964144e9aae068ed1e9eeaff
W20260321 03:07:10.929495 8466 leader_election.cc:343] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: a4a81619964144e9aae068ed1e9eeaff
I20260321 03:07:10.929664 8466 leader_election.cc:304] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:07:10.929914 13968 raft_consensus.cc:2749] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:07:11.452821 10447 master_runner.cc:186] Error getting master registration for 127.7.178.254:38651: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111),
I20260321 03:07:11.453006 10447 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260321 03:07:13.560541 14250 raft_consensus.cc:493] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 70e7666c46844503beb466fdc054a6fc)
I20260321 03:07:13.560719 14250 raft_consensus.cc:515] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:07:13.561380 14250 leader_election.cc:290] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:07:13.562537 8469 leader_election.cc:343] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: ba92d73996f84bbfbab47006dc934c8e
W20260321 03:07:13.562659 8466 leader_election.cc:343] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: ba92d73996f84bbfbab47006dc934c8e
I20260321 03:07:13.562718 8466 leader_election.cc:304] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:07:13.562929 14250 raft_consensus.cc:2749] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:07:16.454836 10447 master_runner.cc:186] Error getting master registration for 127.7.178.254:38651: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111),
I20260321 03:07:16.455040 10447 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260321 03:07:20.302366 14356 raft_consensus.cc:493] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a97f7dd77cf2444f8fdb441019081f79)
I20260321 03:07:20.302560 14356 raft_consensus.cc:515] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:07:20.303043 14356 leader_election.cc:290] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:07:20.304250 8469 leader_election.cc:343] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: e55ead2b80354ddf8876a5f8410122a2
W20260321 03:07:20.304411 8466 leader_election.cc:343] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: e55ead2b80354ddf8876a5f8410122a2
I20260321 03:07:20.304570 8466 leader_election.cc:304] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:07:20.304854 14356 raft_consensus.cc:2749] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:07:21.456769 10447 master_runner.cc:186] Error getting master registration for 127.7.178.254:38651: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111),
I20260321 03:07:21.456983 10447 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260321 03:07:21.938571 14356 raft_consensus.cc:493] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a97f7dd77cf2444f8fdb441019081f79)
I20260321 03:07:21.938884 14356 raft_consensus.cc:515] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:07:21.939481 14356 leader_election.cc:290] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:07:21.940326 8469 leader_election.cc:343] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: e55ead2b80354ddf8876a5f8410122a2
W20260321 03:07:21.940471 8466 leader_election.cc:343] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: e55ead2b80354ddf8876a5f8410122a2
I20260321 03:07:21.940629 8466 leader_election.cc:304] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:07:21.940804 14356 raft_consensus.cc:2749] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:07:22.266499 14398 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260321 03:07:22.266659 14398 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:07:22.267318 14398 leader_election.cc:290] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651), 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595)
W20260321 03:07:22.268319 10465 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260321 03:07:22.269518 10465 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651): Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111)
W20260321 03:07:22.269709 10465 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595): Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
I20260321 03:07:22.269824 10465 leader_election.cc:304] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3df5e4492f3049c1b09fea013b92f863; no voters: 4a187d1fb5804686b4aff01e47fd0284, 7451d7c0a71f4620a6607f74b5a22f2e
I20260321 03:07:22.270123 14398 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260321 03:07:22.757352 14356 raft_consensus.cc:493] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a97f7dd77cf2444f8fdb441019081f79)
I20260321 03:07:22.757526 14356 raft_consensus.cc:515] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:07:22.758073 14356 leader_election.cc:290] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:07:22.758975 8469 leader_election.cc:343] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: a4a81619964144e9aae068ed1e9eeaff
W20260321 03:07:22.759068 8466 leader_election.cc:343] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: a4a81619964144e9aae068ed1e9eeaff
I20260321 03:07:22.759158 8466 leader_election.cc:304] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:07:22.759330 14356 raft_consensus.cc:2749] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:07:26.458489 10447 master_runner.cc:186] Error getting master registration for 127.7.178.254:38651: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111),
I20260321 03:07:26.458640 10447 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260321 03:07:29.449483 8715 heartbeater.cc:646] Failed to heartbeat to 127.7.178.254:38651 (572 consecutive failures): Network error: Failed to ping master at 127.7.178.254:38651: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111)
W20260321 03:07:29.623711 8580 heartbeater.cc:646] Failed to heartbeat to 127.7.178.254:38651 (580 consecutive failures): Network error: Failed to ping master at 127.7.178.254:38651: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111)
I20260321 03:07:29.633119 14356 raft_consensus.cc:493] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a97f7dd77cf2444f8fdb441019081f79)
I20260321 03:07:29.633301 14356 raft_consensus.cc:515] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:07:29.633917 14356 leader_election.cc:290] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:07:29.634711 8466 leader_election.cc:343] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: e55ead2b80354ddf8876a5f8410122a2
W20260321 03:07:29.634835 8469 leader_election.cc:343] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: e55ead2b80354ddf8876a5f8410122a2
I20260321 03:07:29.634929 8469 leader_election.cc:304] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:07:29.635161 14356 raft_consensus.cc:2749] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260321 03:07:29.773303 8851 heartbeater.cc:646] Failed to heartbeat to 127.7.178.254:38651 (573 consecutive failures): Network error: Failed to ping master at 127.7.178.254:38651: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111)
W20260321 03:07:29.773303 8852 heartbeater.cc:646] Failed to heartbeat to 127.7.178.253:46595 (560 consecutive failures): Network error: Failed to ping master at 127.7.178.253:46595: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
I20260321 03:07:31.459774 10447 master_runner.cc:186] Error getting master registration for 127.7.178.254:38651: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111),
I20260321 03:07:31.459981 10447 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260321 03:07:32.490674 14518 raft_consensus.cc:493] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 70e7666c46844503beb466fdc054a6fc)
I20260321 03:07:32.490842 14518 raft_consensus.cc:515] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:07:32.491343 14518 leader_election.cc:290] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:07:32.492313 8466 leader_election.cc:343] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: ba92d73996f84bbfbab47006dc934c8e
W20260321 03:07:32.492398 8469 leader_election.cc:343] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: ba92d73996f84bbfbab47006dc934c8e
I20260321 03:07:32.492518 8469 leader_election.cc:304] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:07:32.492735 14518 raft_consensus.cc:2749] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:07:34.288194 14518 raft_consensus.cc:493] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a97f7dd77cf2444f8fdb441019081f79)
I20260321 03:07:34.288339 14518 raft_consensus.cc:515] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:07:34.288828 14518 leader_election.cc:290] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:07:34.289665 8466 leader_election.cc:343] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: a4a81619964144e9aae068ed1e9eeaff
W20260321 03:07:34.289752 8469 leader_election.cc:343] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: a4a81619964144e9aae068ed1e9eeaff
I20260321 03:07:34.289855 8469 leader_election.cc:304] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:07:34.290019 14518 raft_consensus.cc:2749] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:07:36.461318 10447 master_runner.cc:186] Error getting master registration for 127.7.178.254:38651: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111),
I20260321 03:07:36.461513 10447 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260321 03:07:37.835587 14518 raft_consensus.cc:493] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a97f7dd77cf2444f8fdb441019081f79)
I20260321 03:07:37.835819 14518 raft_consensus.cc:515] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:07:37.836541 14518 leader_election.cc:290] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:07:37.837627 8466 leader_election.cc:343] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: a4a81619964144e9aae068ed1e9eeaff
W20260321 03:07:37.837920 8469 leader_election.cc:343] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: a4a81619964144e9aae068ed1e9eeaff
I20260321 03:07:37.838053 8469 leader_election.cc:304] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:07:37.838322 14518 raft_consensus.cc:2749] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:07:39.662571 14659 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260321 03:07:39.662714 14659 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:07:39.663326 14659 leader_election.cc:290] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651), 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595)
W20260321 03:07:39.664108 10465 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260321 03:07:39.664877 10465 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651): Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111)
W20260321 03:07:39.665009 10465 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595): Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
I20260321 03:07:39.665071 10465 leader_election.cc:304] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3df5e4492f3049c1b09fea013b92f863; no voters: 4a187d1fb5804686b4aff01e47fd0284, 7451d7c0a71f4620a6607f74b5a22f2e
I20260321 03:07:39.665236 14659 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260321 03:07:40.647979 14518 raft_consensus.cc:493] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 70e7666c46844503beb466fdc054a6fc)
I20260321 03:07:40.648231 14518 raft_consensus.cc:515] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:07:40.648905 14518 leader_election.cc:290] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:07:40.650172 8466 leader_election.cc:343] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: ba92d73996f84bbfbab47006dc934c8e
W20260321 03:07:40.650373 8469 leader_election.cc:343] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: ba92d73996f84bbfbab47006dc934c8e
I20260321 03:07:40.650743 8469 leader_election.cc:304] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:07:40.650987 14518 raft_consensus.cc:2749] T ba92d73996f84bbfbab47006dc934c8e P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:07:41.462621 10447 master_runner.cc:186] Error getting master registration for 127.7.178.254:38651: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111),
I20260321 03:07:41.462746 10447 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260321 03:07:46.464264 10447 master_runner.cc:186] Error getting master registration for 127.7.178.254:38651: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111),
I20260321 03:07:46.464426 10447 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260321 03:07:47.605525 14776 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260321 03:07:47.605718 14776 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a187d1fb5804686b4aff01e47fd0284" member_type: VOTER last_known_addr { host: "127.7.178.254" port: 38651 } } peers { permanent_uuid: "7451d7c0a71f4620a6607f74b5a22f2e" member_type: VOTER last_known_addr { host: "127.7.178.253" port: 46595 } } peers { permanent_uuid: "3df5e4492f3049c1b09fea013b92f863" member_type: VOTER last_known_addr { host: "127.7.178.252" port: 45145 } }
I20260321 03:07:47.606405 14776 leader_election.cc:290] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651), 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595)
W20260321 03:07:47.607180 10465 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260321 03:07:47.608050 10465 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 4a187d1fb5804686b4aff01e47fd0284 (127.7.178.254:38651): Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111)
W20260321 03:07:47.608196 10465 leader_election.cc:336] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7451d7c0a71f4620a6607f74b5a22f2e (127.7.178.253:46595): Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
I20260321 03:07:47.608253 10465 leader_election.cc:304] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3df5e4492f3049c1b09fea013b92f863; no voters: 4a187d1fb5804686b4aff01e47fd0284, 7451d7c0a71f4620a6607f74b5a22f2e
I20260321 03:07:47.608457 14776 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 3df5e4492f3049c1b09fea013b92f863 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260321 03:07:49.474009 14518 raft_consensus.cc:493] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a97f7dd77cf2444f8fdb441019081f79)
I20260321 03:07:49.474182 14518 raft_consensus.cc:515] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:07:49.474860 14518 leader_election.cc:290] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:07:49.476179 8469 leader_election.cc:343] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: e55ead2b80354ddf8876a5f8410122a2
W20260321 03:07:49.476375 8466 leader_election.cc:343] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: e55ead2b80354ddf8876a5f8410122a2
I20260321 03:07:49.476459 8466 leader_election.cc:304] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:07:49.476671 14518 raft_consensus.cc:2749] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:07:51.465998 10447 master_runner.cc:186] Error getting master registration for 127.7.178.254:38651: Network error: Client connection negotiation failed: client connection to 127.7.178.254:38651: connect: Connection refused (error 111),
I20260321 03:07:51.466241 10447 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260321 03:07:51.478005 14518 raft_consensus.cc:493] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a97f7dd77cf2444f8fdb441019081f79)
I20260321 03:07:51.478169 14518 raft_consensus.cc:515] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:07:51.478668 14518 leader_election.cc:290] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:07:51.479605 8469 leader_election.cc:343] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: e55ead2b80354ddf8876a5f8410122a2
W20260321 03:07:51.479995 8466 leader_election.cc:343] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: e55ead2b80354ddf8876a5f8410122a2
I20260321 03:07:51.480135 8466 leader_election.cc:304] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:07:51.480405 14518 raft_consensus.cc:2749] T e55ead2b80354ddf8876a5f8410122a2 P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:07:53.319512 14518 raft_consensus.cc:493] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a97f7dd77cf2444f8fdb441019081f79)
I20260321 03:07:53.319669 14518 raft_consensus.cc:515] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4532b54a008a4a39b663112e6d0aacc0" member_type: VOTER last_known_addr { host: "127.7.178.193" port: 46171 } } peers { permanent_uuid: "70e7666c46844503beb466fdc054a6fc" member_type: VOTER last_known_addr { host: "127.7.178.194" port: 44713 } } peers { permanent_uuid: "a97f7dd77cf2444f8fdb441019081f79" member_type: VOTER last_known_addr { host: "127.7.178.195" port: 42091 } }
I20260321 03:07:53.320101 14518 leader_election.cc:290] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713), a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091)
W20260321 03:07:53.321065 8466 leader_election.cc:343] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 70e7666c46844503beb466fdc054a6fc (127.7.178.194:44713): Not found: Tablet not found: a4a81619964144e9aae068ed1e9eeaff
W20260321 03:07:53.321223 8469 leader_election.cc:343] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a97f7dd77cf2444f8fdb441019081f79 (127.7.178.195:42091): Not found: Tablet not found: a4a81619964144e9aae068ed1e9eeaff
I20260321 03:07:53.321341 8469 leader_election.cc:304] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4532b54a008a4a39b663112e6d0aacc0; no voters: 70e7666c46844503beb466fdc054a6fc, a97f7dd77cf2444f8fdb441019081f79
I20260321 03:07:53.321595 14518 raft_consensus.cc:2749] T a4a81619964144e9aae068ed1e9eeaff P 4532b54a008a4a39b663112e6d0aacc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260321 03:07:53.370865 10468 maintenance_manager.cc:419] P 3df5e4492f3049c1b09fea013b92f863: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 3489 bytes on disk
I20260321 03:07:53.374270 10467 maintenance_manager.cc:643] P 3df5e4492f3049c1b09fea013b92f863: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.003s user 0.003s sys 0.000s Metrics: {"dirs.queue_time_us":158,"thread_start_us":193,"threads_started":2,"wal-append.queue_time_us":205}
W20260321 03:07:53.651247 8857 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
W20260321 03:07:53.651530 8857 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
W20260321 03:07:53.651602 8857 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
W20260321 03:07:53.651654 8857 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
F20260321 03:07:53.662348 8864 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_bda6f16160c04b1190bb1866f63d3af2 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260321 03:07:53.662348 8864 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_bda6f16160c04b1190bb1866f63d3af2 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.662310 8880 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260321 03:07:53.662276 8886 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
*** Aborted at 1774062473 (unix time) try "date -d @1774062473" if you are using GNU date ***
*** Check failure stack trace: ***
F20260321 03:07:53.662348 8864 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_bda6f16160c04b1190bb1866f63d3af2 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.662310 8880 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.662276 8883 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260321 03:07:53.662348 8864 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_bda6f16160c04b1190bb1866f63d3af2 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.662310 8880 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.662276 8883 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.663553 8889 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260321 03:07:53.662348 8864 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_bda6f16160c04b1190bb1866f63d3af2 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.662310 8880 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.662276 8883 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.663553 8889 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.663798 8871 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_492554e7d97c4920bdf854ca950c0179 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260321 03:07:53.662348 8864 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_bda6f16160c04b1190bb1866f63d3af2 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.662310 8880 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.662276 8883 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.663553 8889 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.663798 8871 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_492554e7d97c4920bdf854ca950c0179 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.664939 8867 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ba8bb11787c9433093d74640a71395f2 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260321 03:07:53.662348 8864 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_bda6f16160c04b1190bb1866f63d3af2 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.662310 8880 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.662276 8883 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.663553 8889 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.663798 8871 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_492554e7d97c4920bdf854ca950c0179 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.664939 8867 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ba8bb11787c9433093d74640a71395f2 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.665133 8879 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260321 03:07:53.662348 8864 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_bda6f16160c04b1190bb1866f63d3af2 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.662310 8880 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.662276 8883 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.663553 8889 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.663798 8871 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_492554e7d97c4920bdf854ca950c0179 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.664939 8867 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ba8bb11787c9433093d74640a71395f2 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.665133 8879 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.666196 8877 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260321 03:07:53.662348 8864 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_bda6f16160c04b1190bb1866f63d3af2 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.662310 8880 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.662276 8883 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.663553 8889 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.663798 8871 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_492554e7d97c4920bdf854ca950c0179 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.664939 8867 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ba8bb11787c9433093d74640a71395f2 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.665133 8879 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.666196 8877 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.666220 8865 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_a8ad6a72849a42ab9d21634ee3041396 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260321 03:07:53.662348 8864 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_bda6f16160c04b1190bb1866f63d3af2 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.662310 8880 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.662276 8883 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.663553 8889 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.663798 8871 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_492554e7d97c4920bdf854ca950c0179 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.664939 8867 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ba8bb11787c9433093d74640a71395f2 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.665133 8879 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.666196 8877 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.666220 8865 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_a8ad6a72849a42ab9d21634ee3041396 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.667428 8873 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_9017f1e107c846008985a821415447b8 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
*** Check failure stack trace: ***
PC: @ 0x0 (unknown)
*** SIGABRT (@0x3e800001ecb) received by PID 7883 (TID 0x7f14f9497700) from PID 7883; stack trace: ***
F20260321 03:07:53.662348 8864 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_bda6f16160c04b1190bb1866f63d3af2 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.662310 8880 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.662276 8883 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.663553 8889 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.663798 8871 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_492554e7d97c4920bdf854ca950c0179 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.664939 8867 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ba8bb11787c9433093d74640a71395f2 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.665133 8879 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.666196 8877 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.666220 8865 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_a8ad6a72849a42ab9d21634ee3041396 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.667428 8873 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_9017f1e107c846008985a821415447b8 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.668628 8885 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F*** Check failure stack trace: ***
F20260321 03:07:53.662348 8864 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_bda6f16160c04b1190bb1866f63d3af2 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.662310 8880 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.662276 8883 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.663553 8889 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.663798 8871 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_492554e7d97c4920bdf854ca950c0179 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.664939 8867 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ba8bb11787c9433093d74640a71395f2 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.665133 8879 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.666196 8877 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.666220 8865 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_a8ad6a72849a42ab9d21634ee3041396 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.667428 8873 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_9017f1e107c846008985a821415447b8 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.668628 8885 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.668669 8884 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260321 03:07:53.662348 8864 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_bda6f16160c04b1190bb1866f63d3af2 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.662310 8880 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.662276 8883 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.663553 8889 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.663798 8871 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_492554e7d97c4920bdf854ca950c0179 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.664939 8867 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ba8bb11787c9433093d74640a71395f2 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.665133 8879 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.666196 8877 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.666220 8865 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_a8ad6a72849a42ab9d21634ee3041396 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.667428 8873 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_9017f1e107c846008985a821415447b8 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.668628 8885 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.668669 8884 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.668682 8869 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_9b16e83d2d334faaa3ccd9aaae03ccf7 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260321 03:07:53.662348 8864 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_bda6f16160c04b1190bb1866f63d3af2 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.662310 8880 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.662276 8883 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.663553 8889 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.663798 8871 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_492554e7d97c4920bdf854ca950c0179 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.664939 8867 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ba8bb11787c9433093d74640a71395f2 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.665133 8879 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.666196 8877 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.666220 8865 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_a8ad6a72849a42ab9d21634ee3041396 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.667428 8873 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_9017f1e107c846008985a821415447b8 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.668628 8885 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.668669 8884 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.668682 8869 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_9b16e83d2d334faaa3ccd9aaae03ccf7 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.668630 8881 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260321 03:07:53.662348 8864 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_bda6f16160c04b1190bb1866f63d3af2 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.662310 8880 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.662276 8883 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.663553 8889 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.663798 8871 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_492554e7d97c4920bdf854ca950c0179 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.664939 8867 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ba8bb11787c9433093d74640a71395f2 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.665133 8879 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.666196 8877 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.666220 8865 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_a8ad6a72849a42ab9d21634ee3041396 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.667428 8873 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_9017f1e107c846008985a821415447b8 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.668628 8885 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.668669 8884 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.668682 8869 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_9b16e83d2d334faaa3ccd9aaae03ccf7 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.668630 8881 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.669879 8888 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260321 03:07:53.662348 8864 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_bda6f16160c04b1190bb1866f63d3af2 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.662310 8880 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.662276 8883 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.663553 8889 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.663798 8871 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_492554e7d97c4920bdf854ca950c0179 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.664939 8867 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ba8bb11787c9433093d74640a71395f2 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.665133 8879 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.666196 8877 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.666220 8865 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_a8ad6a72849a42ab9d21634ee3041396 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.667428 8873 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_9017f1e107c846008985a821415447b8 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.668628 8885 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.668669 8884 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.668682 8869 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_9b16e83d2d334faaa3ccd9aaae03ccf7 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.668630 8881 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.669879 8888 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.669926 8887 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260321 03:07:53.662348 8864 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_bda6f16160c04b1190bb1866f63d3af2 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.662310 8880 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.662276 8883 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.663553 8889 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.663798 8871 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_492554e7d97c4920bdf854ca950c0179 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.664939 8867 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ba8bb11787c9433093d74640a71395f2 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.665133 8879 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.666196 8877 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.666220 8865 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_a8ad6a72849a42ab9d21634ee3041396 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.667428 8873 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_9017f1e107c846008985a821415447b8 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.668628 8885 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.668669 8884 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.668682 8869 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_9b16e83d2d334faaa3ccd9aaae03ccf7 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.668630 8881 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.669879 8888 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.669926 8887 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.670079 8874 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_a6ce605126a947cfa6a44f2124f15087 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260321 03:07:53.662348 8864 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_bda6f16160c04b1190bb1866f63d3af2 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.662310 8880 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.662276 8883 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.663553 8889 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.663798 8871 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_492554e7d97c4920bdf854ca950c0179 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.664939 8867 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ba8bb11787c9433093d74640a71395f2 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.665133 8879 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.666196 8877 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.666220 8865 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_a8ad6a72849a42ab9d21634ee3041396 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.667428 8873 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_9017f1e107c846008985a821415447b8 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.668628 8885 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.668669 8884 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.668682 8869 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_9b16e83d2d334faaa3ccd9aaae03ccf7 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.668630 8881 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.669879 8888 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.669926 8887 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.670079 8874 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_a6ce605126a947cfa6a44f2124f15087 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.670222 8872 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_79533ce61645417d9d18b6b2820ee1af on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
*** Check failure stack trace: ***
@ 0x7f150d2e1980 (unknown) at ??:0
F20260321 03:07:53.662348 8864 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_bda6f16160c04b1190bb1866f63d3af2 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.662310 8880 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.662276 8883 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.663553 8889 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.663798 8871 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_492554e7d97c4920bdf854ca950c0179 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.664939 8867 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ba8bb11787c9433093d74640a71395f2 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.665133 8879 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.666196 8877 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.666220 8865 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_a8ad6a72849a42ab9d21634ee3041396 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.667428 8873 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_9017f1e107c846008985a821415447b8 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.668628 8885 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.668669 8884 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.668682 8869 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_9b16e83d2d334faaa3ccd9aaae03ccf7 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.668630 8881 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.669879 8888 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.669926 8887 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.670079 8874 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_a6ce605126a947cfa6a44f2124f15087 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.670222 8872 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_79533ce61645417d9d18b6b2820ee1af on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.671219 8875 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260321 03:07:53.662348 8864 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_bda6f16160c04b1190bb1866f63d3af2 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.662310 8880 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.662276 8883 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.663553 8889 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.663798 8871 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_492554e7d97c4920bdf854ca950c0179 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.664939 8867 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ba8bb11787c9433093d74640a71395f2 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.665133 8879 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.666196 8877 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.666220 8865 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_a8ad6a72849a42ab9d21634ee3041396 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.667428 8873 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_9017f1e107c846008985a821415447b8 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.668628 8885 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.668669 8884 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.668682 8869 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_9b16e83d2d334faaa3ccd9aaae03ccf7 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.668630 8881 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.669879 8888 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.669926 8887 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.670079 8874 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_a6ce605126a947cfa6a44f2124f15087 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.670222 8872 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_79533ce61645417d9d18b6b2820ee1af on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.671219 8875 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.671250 8870 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_d2585fcc892d4f4882c0a068ce656fee on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260321 03:07:53.662348 8864 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_bda6f16160c04b1190bb1866f63d3af2 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.662310 8880 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.662276 8883 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.663553 8889 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.663798 8871 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_492554e7d97c4920bdf854ca950c0179 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.664939 8867 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ba8bb11787c9433093d74640a71395f2 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.665133 8879 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.666196 8877 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.666220 8865 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_a8ad6a72849a42ab9d21634ee3041396 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.667428 8873 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_9017f1e107c846008985a821415447b8 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.668628 8885 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.668669 8884 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.668682 8869 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_9b16e83d2d334faaa3ccd9aaae03ccf7 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.668630 8881 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.669879 8888 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.669926 8887 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.670079 8874 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_a6ce605126a947cfa6a44f2124f15087 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.670222 8872 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_79533ce61645417d9d18b6b2820ee1af on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.671219 8875 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.671250 8870 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_d2585fcc892d4f4882c0a068ce656fee on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.671350 8868 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_01a908196f6d4a1ba499b382b6932d90 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260321 03:07:53.662348 8864 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_bda6f16160c04b1190bb1866f63d3af2 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.662310 8880 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.662276 8883 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.663553 8889 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.663798 8871 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_492554e7d97c4920bdf854ca950c0179 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.664939 8867 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ba8bb11787c9433093d74640a71395f2 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.665133 8879 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.666196 8877 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.666220 8865 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_a8ad6a72849a42ab9d21634ee3041396 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.667428 8873 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_9017f1e107c846008985a821415447b8 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.668628 8885 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.668669 8884 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.668682 8869 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_9b16e83d2d334faaa3ccd9aaae03ccf7 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.668630 8881 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.669879 8888 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.669926 8887 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.670079 8874 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_a6ce605126a947cfa6a44f2124f15087 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.670222 8872 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_79533ce61645417d9d18b6b2820ee1af on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.671219 8875 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.671250 8870 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_d2585fcc892d4f4882c0a068ce656fee on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.671350 8868 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_01a908196f6d4a1ba499b382b6932d90 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)F20260321 03:07:53.671433 8876 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.178.254:38651,127.7.178.253:46595,127.7.178.252:45145, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.178.253:46595: connect: Connection refused (error 111)
*** Check failure stack trace: ***
@ 0x7f150ae5fe87 gsignal at ??:0
@ 0x7f150ae617f1 abort at ??:0
@ 0x7f150bcc8dcd google::LogMessage::Fail() at ??:0
@ 0x7f150bcccb93 google::LogMessage::SendToLog() at ??:0
@ 0x7f150bcc87cc google::LogMessage::Flush() at ??:0
@ 0x7f150bcc9f59 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x563b855f09bd kudu::MasterStressTest::CreateTableThread() at ??:0
@ 0x563b856036fc std::__invoke_impl<>() at ??:0
@ 0x563b85601438 std::__invoke<>() at ??:0
@ 0x563b85608a89 _ZNSt6thread8_InvokerISt5tupleIJMN4kudu16MasterStressTestEFvvEPNS2_26MasterStressTest_Test_TestEEEE9_M_invokeIJLm0ELm1EEEEDTcl8__invokespcl10_S_declvalIXT_EEEEESt12_Index_tupleIJXspT_EEE at ??:0
@ 0x563b85607a8d std::thread::_Invoker<>::operator()() at ??:0
@ 0x563b8560680a std::thread::_State_impl<>::_M_run() at ??:0
@ 0x7f150b4e76df (unknown) at ??:0
@ 0x7f150d2d66db start_thread at ??:0
@ 0x7f150af4261f clone at ??:0