Note: This is test shard 3 of 3.
[==========] Running 1 test from 1 test suite.
[----------] Global test environment set-up.
[----------] 1 test from CatalogManagerConfigurations/MasterStressTest
[ RUN ] CatalogManagerConfigurations/MasterStressTest.Test/2
2026-02-03T21:10:10Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-02-03T21:10:10Z Disabled control of system clock
Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/derby.log -Djava.security.properties=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/security.properties
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/tmp/dist-test-task0vmSZW/thirdparty/src/hive-3.1.2/lib/log4j-slf4j-impl-2.10.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/tmp/dist-test-task0vmSZW/thirdparty/src/hadoop-3.4.1/share/hadoop/common/lib/slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
Metastore connection URL: jdbc:derby:/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/metadb;create=true
Metastore Connection Driver : org.apache.derby.jdbc.EmbeddedDriver
Metastore connection User: APP
Starting metastore schema initialization to 3.1.0
Initialization script hive-schema-3.1.0.derby.sql
Initialization script completed
schemaTool completed
Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/derby.log -Djava.security.properties=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/security.properties
2026-02-03 21:10:16: Starting Hive Metastore Server
Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/derby.log -Djava.security.properties=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/security.properties
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/tmp/dist-test-task0vmSZW/thirdparty/src/hive-3.1.2/lib/log4j-slf4j-impl-2.10.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/tmp/dist-test-task0vmSZW/thirdparty/src/hadoop-3.4.1/share/hadoop/common/lib/slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
Starting hive metastore on port 0
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260203 21:10:25.049373 2178 external_mini_cluster.cc:1366] Running /tmp/dist-test-task0vmSZW/build/debug/bin/kudu
/tmp/dist-test-task0vmSZW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.32.190:35419
--webserver_interface=127.2.32.190
--webserver_port=0
--builtin_ntp_servers=127.2.32.148:39497
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665
--hive_metastore_uris=thrift://127.0.0.1:33779
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260203 21:10:25.152128 2421 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260203 21:10:25.152367 2421 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260203 21:10:25.152413 2421 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260203 21:10:25.155699 2421 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260203 21:10:25.155758 2421 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260203 21:10:25.155777 2421 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260203 21:10:25.155795 2421 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260203 21:10:25.159606 2421 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.32.148:39497
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-0/wal
--hive_metastore_uris=thrift://127.0.0.1:33779
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.32.190:35419
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.32.190
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.2421
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 0efbebd487e7d0c7f21ab0d5a91e0fa70046af83
build type DEBUG
built by None at 03 Feb 2026 20:50:43 UTC on 24a791456cd2
build id 10330
I20260203 21:10:25.160684 2421 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260203 21:10:25.161744 2421 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260203 21:10:25.166944 2429 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260203 21:10:25.166961 2426 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260203 21:10:25.166960 2427 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260203 21:10:25.167158 2421 server_base.cc:1060] running on GCE node
I20260203 21:10:25.167625 2421 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260203 21:10:25.168468 2421 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260203 21:10:25.169610 2421 hybrid_clock.cc:648] HybridClock initialized: now 1770153025169600 us; error 25 us; skew 500 ppm
I20260203 21:10:25.171172 2421 webserver.cc:492] Webserver started at http://127.2.32.190:46853/ using document root <none> and password file <none>
I20260203 21:10:25.171751 2421 fs_manager.cc:362] Metadata directory not provided
I20260203 21:10:25.171811 2421 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260203 21:10:25.171988 2421 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260203 21:10:25.173573 2421 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-0/data/instance:
uuid: "7344d7cd8dea4fa2ae705320daacaf49"
format_stamp: "Formatted at 2026-02-03 21:10:25 on dist-test-slave-npns"
I20260203 21:10:25.174073 2421 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-0/wal/instance:
uuid: "7344d7cd8dea4fa2ae705320daacaf49"
format_stamp: "Formatted at 2026-02-03 21:10:25 on dist-test-slave-npns"
I20260203 21:10:25.177234 2421 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260203 21:10:25.179237 2435 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260203 21:10:25.180194 2421 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260203 21:10:25.180300 2421 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-0/data,/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-0/wal
uuid: "7344d7cd8dea4fa2ae705320daacaf49"
format_stamp: "Formatted at 2026-02-03 21:10:25 on dist-test-slave-npns"
I20260203 21:10:25.180379 2421 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260203 21:10:25.205406 2421 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260203 21:10:25.206074 2421 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260203 21:10:25.206241 2421 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260203 21:10:25.212929 2487 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.32.190:35419 every 8 connection(s)
I20260203 21:10:25.212929 2421 rpc_server.cc:307] RPC server started. Bound to: 127.2.32.190:35419
I20260203 21:10:25.213897 2421 server_base.cc:1192] Dumped server information to /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-0/data/info.pb
I20260203 21:10:25.214824 2178 external_mini_cluster.cc:1428] Started /tmp/dist-test-task0vmSZW/build/debug/bin/kudu as pid 2421
I20260203 21:10:25.214951 2178 external_mini_cluster.cc:1442] Reading /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-0/wal/instance
I20260203 21:10:25.216280 2178 external_mini_cluster.cc:1366] Running /tmp/dist-test-task0vmSZW/build/debug/bin/kudu
/tmp/dist-test-task0vmSZW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.32.189:42681
--webserver_interface=127.2.32.189
--webserver_port=0
--builtin_ntp_servers=127.2.32.148:39497
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665
--hive_metastore_uris=thrift://127.0.0.1:33779
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260203 21:10:25.216616 2488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:25.219790 2488 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } has no permanent_uuid. Determining permanent_uuid...
I20260203 21:10:25.232733 2488 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } has no permanent_uuid. Determining permanent_uuid...
W20260203 21:10:25.233385 2438 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)
W20260203 21:10:25.234084 2488 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.32.189:42681: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)
I20260203 21:10:25.283311 2488 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } attempt: 1
W20260203 21:10:25.284570 2488 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.32.189:42681: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)
W20260203 21:10:25.316422 2489 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260203 21:10:25.316609 2489 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260203 21:10:25.316665 2489 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260203 21:10:25.319797 2489 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260203 21:10:25.319844 2489 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260203 21:10:25.319880 2489 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260203 21:10:25.319909 2489 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260203 21:10:25.323581 2489 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.32.148:39497
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-1/wal
--hive_metastore_uris=thrift://127.0.0.1:33779
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.32.189:42681
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.2.32.189
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.2489
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 0efbebd487e7d0c7f21ab0d5a91e0fa70046af83
build type DEBUG
built by None at 03 Feb 2026 20:50:43 UTC on 24a791456cd2
build id 10330
I20260203 21:10:25.324554 2489 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260203 21:10:25.325563 2489 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260203 21:10:25.330472 2497 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260203 21:10:25.330528 2498 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260203 21:10:25.330485 2500 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260203 21:10:25.330715 2489 server_base.cc:1060] running on GCE node
I20260203 21:10:25.331202 2489 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260203 21:10:25.332042 2489 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260203 21:10:25.333180 2489 hybrid_clock.cc:648] HybridClock initialized: now 1770153025333167 us; error 26 us; skew 500 ppm
I20260203 21:10:25.334650 2489 webserver.cc:492] Webserver started at http://127.2.32.189:35415/ using document root <none> and password file <none>
I20260203 21:10:25.335144 2489 fs_manager.cc:362] Metadata directory not provided
I20260203 21:10:25.335193 2489 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260203 21:10:25.335359 2489 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260203 21:10:25.336767 2489 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-1/data/instance:
uuid: "35397be7e61f4b27a49e9449b9fdf085"
format_stamp: "Formatted at 2026-02-03 21:10:25 on dist-test-slave-npns"
I20260203 21:10:25.337174 2489 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-1/wal/instance:
uuid: "35397be7e61f4b27a49e9449b9fdf085"
format_stamp: "Formatted at 2026-02-03 21:10:25 on dist-test-slave-npns"
I20260203 21:10:25.340124 2489 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.001s sys 0.002s
I20260203 21:10:25.341980 2506 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260203 21:10:25.342842 2489 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260203 21:10:25.342936 2489 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-1/data,/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-1/wal
uuid: "35397be7e61f4b27a49e9449b9fdf085"
format_stamp: "Formatted at 2026-02-03 21:10:25 on dist-test-slave-npns"
I20260203 21:10:25.343004 2489 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260203 21:10:25.352727 2488 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } attempt: 2
W20260203 21:10:25.353866 2488 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.32.189:42681: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)
I20260203 21:10:25.356740 2489 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260203 21:10:25.357239 2489 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260203 21:10:25.357364 2489 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260203 21:10:25.363595 2489 rpc_server.cc:307] RPC server started. Bound to: 127.2.32.189:42681
I20260203 21:10:25.363593 2558 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.32.189:42681 every 8 connection(s)
I20260203 21:10:25.364488 2489 server_base.cc:1192] Dumped server information to /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-1/data/info.pb
I20260203 21:10:25.367149 2559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:25.370321 2559 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } has no permanent_uuid. Determining permanent_uuid...
I20260203 21:10:25.370779 2178 external_mini_cluster.cc:1428] Started /tmp/dist-test-task0vmSZW/build/debug/bin/kudu as pid 2489
I20260203 21:10:25.370867 2178 external_mini_cluster.cc:1442] Reading /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-1/wal/instance
I20260203 21:10:25.371445 2178 external_mini_cluster.cc:1366] Running /tmp/dist-test-task0vmSZW/build/debug/bin/kudu
/tmp/dist-test-task0vmSZW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.32.188:33665
--webserver_interface=127.2.32.188
--webserver_port=0
--builtin_ntp_servers=127.2.32.148:39497
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665
--hive_metastore_uris=thrift://127.0.0.1:33779
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260203 21:10:25.379334 2559 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } has no permanent_uuid. Determining permanent_uuid...
I20260203 21:10:25.384645 2559 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } has no permanent_uuid. Determining permanent_uuid...
W20260203 21:10:25.385273 2507 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.32.188:33665: connect: Connection refused (error 111)
W20260203 21:10:25.385982 2559 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.32.188:33665: Network error: Client connection negotiation failed: client connection to 127.2.32.188:33665: connect: Connection refused (error 111)
I20260203 21:10:25.435227 2559 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } attempt: 1
W20260203 21:10:25.436656 2559 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.32.188:33665: Network error: Client connection negotiation failed: client connection to 127.2.32.188:33665: connect: Connection refused (error 111)
I20260203 21:10:25.445019 2488 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } attempt: 3
I20260203 21:10:25.449270 2488 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } has no permanent_uuid. Determining permanent_uuid...
W20260203 21:10:25.450354 2488 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.32.188:33665: Network error: Client connection negotiation failed: client connection to 127.2.32.188:33665: connect: Connection refused (error 111)
W20260203 21:10:25.473796 2561 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260203 21:10:25.473980 2561 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260203 21:10:25.474021 2561 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260203 21:10:25.477216 2561 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260203 21:10:25.477276 2561 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260203 21:10:25.477303 2561 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260203 21:10:25.477332 2561 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260203 21:10:25.480969 2561 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.32.148:39497
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-2/wal
--hive_metastore_uris=thrift://127.0.0.1:33779
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.32.188:33665
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.2.32.188
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.2561
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 0efbebd487e7d0c7f21ab0d5a91e0fa70046af83
build type DEBUG
built by None at 03 Feb 2026 20:50:43 UTC on 24a791456cd2
build id 10330
I20260203 21:10:25.481487 2488 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } attempt: 1
I20260203 21:10:25.481971 2561 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
W20260203 21:10:25.482705 2488 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.32.188:33665: Network error: Client connection negotiation failed: client connection to 127.2.32.188:33665: connect: Connection refused (error 111)
I20260203 21:10:25.483191 2561 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260203 21:10:25.488142 2571 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260203 21:10:25.488139 2568 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260203 21:10:25.488375 2561 server_base.cc:1060] running on GCE node
W20260203 21:10:25.488422 2569 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260203 21:10:25.488828 2561 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260203 21:10:25.489615 2561 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260203 21:10:25.490756 2561 hybrid_clock.cc:648] HybridClock initialized: now 1770153025490740 us; error 26 us; skew 500 ppm
I20260203 21:10:25.492302 2561 webserver.cc:492] Webserver started at http://127.2.32.188:39751/ using document root <none> and password file <none>
I20260203 21:10:25.492796 2561 fs_manager.cc:362] Metadata directory not provided
I20260203 21:10:25.492851 2561 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260203 21:10:25.493006 2561 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260203 21:10:25.494442 2561 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-2/data/instance:
uuid: "8a7e51013f5041898fe34f4b64a59260"
format_stamp: "Formatted at 2026-02-03 21:10:25 on dist-test-slave-npns"
I20260203 21:10:25.494863 2561 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-2/wal/instance:
uuid: "8a7e51013f5041898fe34f4b64a59260"
format_stamp: "Formatted at 2026-02-03 21:10:25 on dist-test-slave-npns"
I20260203 21:10:25.497851 2561 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.001s sys 0.004s
I20260203 21:10:25.499723 2577 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260203 21:10:25.500605 2561 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260203 21:10:25.500700 2561 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-2/data,/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-2/wal
uuid: "8a7e51013f5041898fe34f4b64a59260"
format_stamp: "Formatted at 2026-02-03 21:10:25 on dist-test-slave-npns"
I20260203 21:10:25.500773 2561 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260203 21:10:25.504832 2559 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } attempt: 2
W20260203 21:10:25.505967 2559 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.32.188:33665: Network error: Client connection negotiation failed: client connection to 127.2.32.188:33665: connect: Connection refused (error 111)
I20260203 21:10:25.511519 2561 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260203 21:10:25.512072 2561 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260203 21:10:25.512212 2561 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260203 21:10:25.518589 2629 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.32.188:33665 every 8 connection(s)
I20260203 21:10:25.518590 2561 rpc_server.cc:307] RPC server started. Bound to: 127.2.32.188:33665
I20260203 21:10:25.519537 2561 server_base.cc:1192] Dumped server information to /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-2/data/info.pb
I20260203 21:10:25.522208 2630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:25.525491 2630 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } has no permanent_uuid. Determining permanent_uuid...
I20260203 21:10:25.526830 2178 external_mini_cluster.cc:1428] Started /tmp/dist-test-task0vmSZW/build/debug/bin/kudu as pid 2561
I20260203 21:10:25.526933 2178 external_mini_cluster.cc:1442] Reading /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-2/wal/instance
I20260203 21:10:25.533846 2630 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } has no permanent_uuid. Determining permanent_uuid...
I20260203 21:10:25.537406 2630 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } has no permanent_uuid. Determining permanent_uuid...
I20260203 21:10:25.544203 2630 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260: Bootstrap starting.
I20260203 21:10:25.546367 2630 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:25.547012 2630 log.cc:826] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260: Log is configured to *not* fsync() on all Append() calls
I20260203 21:10:25.548609 2630 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260: No bootstrap required, opened a new log
I20260203 21:10:25.551282 2630 raft_consensus.cc:359] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:10:25.551440 2630 raft_consensus.cc:385] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:25.551492 2630 raft_consensus.cc:740] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a7e51013f5041898fe34f4b64a59260, State: Initialized, Role: FOLLOWER
I20260203 21:10:25.551874 2630 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:10:25.552237 2638 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } } }
I20260203 21:10:25.552336 2638 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [sys.catalog]: This master's current role is: FOLLOWER
I20260203 21:10:25.552973 2630 sys_catalog.cc:565] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [sys.catalog]: configured and running, proceeding with master startup.
I20260203 21:10:25.556598 2561 master_runner.cc:186] Error getting master registration for 127.2.32.190:35419: OK, instance_id { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" instance_seqno: 1770153025211077 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260203 21:10:25.558650 2561 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260203 21:10:25.558715 2488 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } attempt: 2
W20260203 21:10:25.560184 2652 catalog_manager.cc:1568] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260203 21:10:25.560310 2652 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260203 21:10:25.565110 2488 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49: Bootstrap starting.
I20260203 21:10:25.567122 2488 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:25.567785 2488 log.cc:826] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49: Log is configured to *not* fsync() on all Append() calls
I20260203 21:10:25.569514 2488 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49: No bootstrap required, opened a new log
I20260203 21:10:25.572934 2488 raft_consensus.cc:359] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:10:25.573108 2488 raft_consensus.cc:385] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:25.573215 2488 raft_consensus.cc:740] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7344d7cd8dea4fa2ae705320daacaf49, State: Initialized, Role: FOLLOWER
I20260203 21:10:25.573673 2488 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:10:25.574870 2488 sys_catalog.cc:565] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49 [sys.catalog]: configured and running, proceeding with master startup.
I20260203 21:10:25.575331 2656 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } } }
I20260203 21:10:25.575506 2656 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49 [sys.catalog]: This master's current role is: FOLLOWER
I20260203 21:10:25.580066 2421 master_runner.cc:186] Error getting master registration for 127.2.32.189:42681: OK, instance_id { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" instance_seqno: 1770153025361839 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260203 21:10:25.582135 2421 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260203 21:10:25.583253 2670 catalog_manager.cc:1568] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260203 21:10:25.583312 2670 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260203 21:10:25.597111 2559 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } attempt: 3
I20260203 21:10:25.604283 2559 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085: Bootstrap starting.
I20260203 21:10:25.606871 2559 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:25.607704 2559 log.cc:826] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085: Log is configured to *not* fsync() on all Append() calls
I20260203 21:10:25.609639 2559 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085: No bootstrap required, opened a new log
I20260203 21:10:25.613653 2559 raft_consensus.cc:359] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:10:25.613885 2559 raft_consensus.cc:385] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:25.613968 2559 raft_consensus.cc:740] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35397be7e61f4b27a49e9449b9fdf085, State: Initialized, Role: FOLLOWER
I20260203 21:10:25.614495 2559 consensus_queue.cc:260] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:10:25.615736 2559 sys_catalog.cc:565] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [sys.catalog]: configured and running, proceeding with master startup.
I20260203 21:10:25.626791 2489 master_runner.cc:263] No leader master found from master 35397be7e61f4b27a49e9449b9fdf085
I20260203 21:10:25.626865 2489 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260203 21:10:25.629896 2688 catalog_manager.cc:1568] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260203 21:10:25.630060 2688 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260203 21:10:25.639189 2674 sys_catalog.cc:455] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } } }
I20260203 21:10:25.639431 2674 sys_catalog.cc:458] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [sys.catalog]: This master's current role is: FOLLOWER
W20260203 21:10:25.707620 2441 tablet.cc:2378] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260203 21:10:25.763264 2583 tablet.cc:2378] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260203 21:10:25.846662 2638 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 21:10:25.846858 2638 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:10:25.847838 2638 leader_election.cc:290] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419), 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681)
I20260203 21:10:25.848347 2462 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8a7e51013f5041898fe34f4b64a59260" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7344d7cd8dea4fa2ae705320daacaf49" is_pre_election: true
I20260203 21:10:25.848351 2533 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8a7e51013f5041898fe34f4b64a59260" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35397be7e61f4b27a49e9449b9fdf085" is_pre_election: true
I20260203 21:10:25.848609 2533 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a7e51013f5041898fe34f4b64a59260 in term 0.
I20260203 21:10:25.848609 2462 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a7e51013f5041898fe34f4b64a59260 in term 0.
I20260203 21:10:25.849013 2580 leader_election.cc:304] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 35397be7e61f4b27a49e9449b9fdf085, 7344d7cd8dea4fa2ae705320daacaf49, 8a7e51013f5041898fe34f4b64a59260; no voters:
I20260203 21:10:25.849243 2638 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 21:10:25.849313 2638 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 21:10:25.849356 2638 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:25.850206 2638 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:10:25.850517 2638 leader_election.cc:290] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 1 election: Requested vote from peers 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419), 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681)
I20260203 21:10:25.850859 2533 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8a7e51013f5041898fe34f4b64a59260" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35397be7e61f4b27a49e9449b9fdf085"
I20260203 21:10:25.850883 2462 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8a7e51013f5041898fe34f4b64a59260" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7344d7cd8dea4fa2ae705320daacaf49"
I20260203 21:10:25.850965 2533 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:25.851013 2462 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49 [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:25.851824 2533 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a7e51013f5041898fe34f4b64a59260 in term 1.
I20260203 21:10:25.852077 2580 leader_election.cc:304] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35397be7e61f4b27a49e9449b9fdf085, 8a7e51013f5041898fe34f4b64a59260; no voters:
I20260203 21:10:25.852133 2462 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a7e51013f5041898fe34f4b64a59260 in term 1.
I20260203 21:10:25.852233 2638 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 1 FOLLOWER]: Leader election won for term 1
I20260203 21:10:25.852440 2638 raft_consensus.cc:697] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 1 LEADER]: Becoming Leader. State: Replica: 8a7e51013f5041898fe34f4b64a59260, State: Running, Role: LEADER
I20260203 21:10:25.852746 2638 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:10:25.854110 2638 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8a7e51013f5041898fe34f4b64a59260. Latest consensus state: current_term: 1 leader_uuid: "8a7e51013f5041898fe34f4b64a59260" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } } }
I20260203 21:10:25.854209 2638 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [sys.catalog]: This master's current role is: LEADER
I20260203 21:10:25.854564 2693 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260203 21:10:25.855443 2693 catalog_manager.cc:1494] Initializing Kudu cluster ID...
W20260203 21:10:25.858485 2512 tablet.cc:2378] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260203 21:10:25.860126 2462 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49 [term 1 FOLLOWER]: Refusing update from remote peer 8a7e51013f5041898fe34f4b64a59260: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260203 21:10:25.860124 2533 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [term 1 FOLLOWER]: Refusing update from remote peer 8a7e51013f5041898fe34f4b64a59260: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260203 21:10:25.860688 2638 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 21:10:25.861027 2638 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 21:10:25.864243 2674 sys_catalog.cc:455] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8a7e51013f5041898fe34f4b64a59260. Latest consensus state: current_term: 1 leader_uuid: "8a7e51013f5041898fe34f4b64a59260" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } } }
I20260203 21:10:25.864241 2656 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8a7e51013f5041898fe34f4b64a59260. Latest consensus state: current_term: 1 leader_uuid: "8a7e51013f5041898fe34f4b64a59260" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } } }
I20260203 21:10:25.864342 2656 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49 [sys.catalog]: This master's current role is: FOLLOWER
I20260203 21:10:25.864343 2674 sys_catalog.cc:458] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [sys.catalog]: This master's current role is: FOLLOWER
I20260203 21:10:25.866326 2638 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "8a7e51013f5041898fe34f4b64a59260" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } } }
I20260203 21:10:25.866430 2638 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [sys.catalog]: This master's current role is: LEADER
I20260203 21:10:25.867419 2674 sys_catalog.cc:455] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "8a7e51013f5041898fe34f4b64a59260" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } } }
I20260203 21:10:25.867522 2674 sys_catalog.cc:458] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [sys.catalog]: This master's current role is: FOLLOWER
I20260203 21:10:25.867574 2693 catalog_manager.cc:1357] Generated new cluster ID: f46367a11713484f92c1d2be2585f5a6
I20260203 21:10:25.867628 2693 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260203 21:10:25.868003 2695 mvcc.cc:204] Tried to move back new op lower bound from 7250546793916780544 to 7250546793895071744. Current Snapshot: MvccSnapshot[applied={T|T < 7250546793916780544}]
I20260203 21:10:25.873301 2691 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "8a7e51013f5041898fe34f4b64a59260" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } } }
I20260203 21:10:25.873399 2691 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [sys.catalog]: This master's current role is: LEADER
I20260203 21:10:25.874186 2656 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "8a7e51013f5041898fe34f4b64a59260" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } } }
I20260203 21:10:25.874291 2656 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49 [sys.catalog]: This master's current role is: FOLLOWER
I20260203 21:10:25.898440 2693 catalog_manager.cc:1380] Generated new certificate authority record
I20260203 21:10:25.899688 2693 catalog_manager.cc:1514] Loading token signing keys...
I20260203 21:10:25.909503 2693 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260: Generated new TSK 0
I20260203 21:10:25.910337 2693 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260203 21:10:25.910806 2693 catalog_manager.cc:1537] Loading latest processed Hive Metastore notification log event ID...
I20260203 21:10:25.911134 2693 catalog_manager.cc:5876] Last processed Hive Metastore notification event ID: -1
I20260203 21:10:25.936379 2178 external_mini_cluster.cc:1366] Running /tmp/dist-test-task0vmSZW/build/debug/bin/kudu
/tmp/dist-test-task0vmSZW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.32.129:0
--local_ip_for_outbound_sockets=127.2.32.129
--webserver_interface=127.2.32.129
--webserver_port=0
--tserver_master_addrs=127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665
--builtin_ntp_servers=127.2.32.148:39497
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
W20260203 21:10:26.036967 2703 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260203 21:10:26.037190 2703 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260203 21:10:26.037271 2703 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260203 21:10:26.040438 2703 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260203 21:10:26.040539 2703 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.32.129
I20260203 21:10:26.044188 2703 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.32.148:39497
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--fs_data_dirs=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.32.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.2.32.129
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665
--never_fsync=true
--heap_profile_path=/tmp/kudu.2703
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.32.129
--log_dir=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 0efbebd487e7d0c7f21ab0d5a91e0fa70046af83
build type DEBUG
built by None at 03 Feb 2026 20:50:43 UTC on 24a791456cd2
build id 10330
I20260203 21:10:26.045135 2703 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260203 21:10:26.046159 2703 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260203 21:10:26.052134 2709 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260203 21:10:26.052213 2703 server_base.cc:1060] running on GCE node
W20260203 21:10:26.052325 2711 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260203 21:10:26.052155 2708 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260203 21:10:26.052719 2703 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260203 21:10:26.053172 2703 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260203 21:10:26.054307 2703 hybrid_clock.cc:648] HybridClock initialized: now 1770153026054287 us; error 34 us; skew 500 ppm
I20260203 21:10:26.055857 2703 webserver.cc:492] Webserver started at http://127.2.32.129:43043/ using document root <none> and password file <none>
I20260203 21:10:26.056351 2703 fs_manager.cc:362] Metadata directory not provided
I20260203 21:10:26.056402 2703 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260203 21:10:26.056573 2703 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260203 21:10:26.057988 2703 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-0/data/instance:
uuid: "02bdf326542e474cbe62434dd59087dc"
format_stamp: "Formatted at 2026-02-03 21:10:26 on dist-test-slave-npns"
I20260203 21:10:26.058415 2703 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-0/wal/instance:
uuid: "02bdf326542e474cbe62434dd59087dc"
format_stamp: "Formatted at 2026-02-03 21:10:26 on dist-test-slave-npns"
I20260203 21:10:26.061453 2703 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.001s sys 0.004s
I20260203 21:10:26.063508 2717 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260203 21:10:26.064462 2703 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260203 21:10:26.064550 2703 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-0/data,/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-0/wal
uuid: "02bdf326542e474cbe62434dd59087dc"
format_stamp: "Formatted at 2026-02-03 21:10:26 on dist-test-slave-npns"
I20260203 21:10:26.064633 2703 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260203 21:10:26.105295 2703 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260203 21:10:26.105944 2703 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260203 21:10:26.106108 2703 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260203 21:10:26.106630 2703 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260203 21:10:26.107591 2703 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260203 21:10:26.107638 2703 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260203 21:10:26.107713 2703 ts_tablet_manager.cc:616] Registered 0 tablets
I20260203 21:10:26.107743 2703 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260203 21:10:26.116621 2703 rpc_server.cc:307] RPC server started. Bound to: 127.2.32.129:34335
I20260203 21:10:26.116694 2830 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.32.129:34335 every 8 connection(s)
I20260203 21:10:26.117545 2703 server_base.cc:1192] Dumped server information to /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-0/data/info.pb
I20260203 21:10:26.121286 2178 external_mini_cluster.cc:1428] Started /tmp/dist-test-task0vmSZW/build/debug/bin/kudu as pid 2703
I20260203 21:10:26.121385 2178 external_mini_cluster.cc:1442] Reading /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-0/wal/instance
I20260203 21:10:26.125221 2178 external_mini_cluster.cc:1366] Running /tmp/dist-test-task0vmSZW/build/debug/bin/kudu
/tmp/dist-test-task0vmSZW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.32.130:0
--local_ip_for_outbound_sockets=127.2.32.130
--webserver_interface=127.2.32.130
--webserver_port=0
--tserver_master_addrs=127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665
--builtin_ntp_servers=127.2.32.148:39497
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260203 21:10:26.127000 2831 heartbeater.cc:344] Connected to a master server at 127.2.32.188:33665
I20260203 21:10:26.126984 2833 heartbeater.cc:344] Connected to a master server at 127.2.32.189:42681
I20260203 21:10:26.127213 2833 heartbeater.cc:461] Registering TS with master...
I20260203 21:10:26.127213 2831 heartbeater.cc:461] Registering TS with master...
I20260203 21:10:26.126984 2832 heartbeater.cc:344] Connected to a master server at 127.2.32.190:35419
I20260203 21:10:26.127764 2833 heartbeater.cc:507] Master 127.2.32.189:42681 requested a full tablet report, sending...
I20260203 21:10:26.127766 2831 heartbeater.cc:507] Master 127.2.32.188:33665 requested a full tablet report, sending...
I20260203 21:10:26.127795 2832 heartbeater.cc:461] Registering TS with master...
I20260203 21:10:26.128327 2832 heartbeater.cc:507] Master 127.2.32.190:35419 requested a full tablet report, sending...
I20260203 21:10:26.128968 2523 ts_manager.cc:194] Registered new tserver with Master: 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335)
I20260203 21:10:26.129087 2594 ts_manager.cc:194] Registered new tserver with Master: 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335)
I20260203 21:10:26.130584 2594 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.2.32.129:45853
I20260203 21:10:26.131937 2452 ts_manager.cc:194] Registered new tserver with Master: 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335)
W20260203 21:10:26.234320 2841 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260203 21:10:26.234557 2841 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260203 21:10:26.234627 2841 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260203 21:10:26.237941 2841 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260203 21:10:26.238085 2841 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.32.130
I20260203 21:10:26.241868 2841 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.32.148:39497
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--fs_data_dirs=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.32.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.2.32.130
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665
--never_fsync=true
--heap_profile_path=/tmp/kudu.2841
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.32.130
--log_dir=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 0efbebd487e7d0c7f21ab0d5a91e0fa70046af83
build type DEBUG
built by None at 03 Feb 2026 20:50:43 UTC on 24a791456cd2
build id 10330
I20260203 21:10:26.242951 2841 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260203 21:10:26.244056 2841 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260203 21:10:26.250232 2849 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260203 21:10:26.250277 2846 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260203 21:10:26.250232 2847 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260203 21:10:26.250381 2841 server_base.cc:1060] running on GCE node
I20260203 21:10:26.250813 2841 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260203 21:10:26.251314 2841 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260203 21:10:26.252453 2841 hybrid_clock.cc:648] HybridClock initialized: now 1770153026252443 us; error 28 us; skew 500 ppm
I20260203 21:10:26.254102 2841 webserver.cc:492] Webserver started at http://127.2.32.130:42315/ using document root <none> and password file <none>
I20260203 21:10:26.254658 2841 fs_manager.cc:362] Metadata directory not provided
I20260203 21:10:26.254724 2841 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260203 21:10:26.254889 2841 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260203 21:10:26.256390 2841 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-1/data/instance:
uuid: "6d9e0cecab784cc0acc050ca1c89c5be"
format_stamp: "Formatted at 2026-02-03 21:10:26 on dist-test-slave-npns"
I20260203 21:10:26.256845 2841 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-1/wal/instance:
uuid: "6d9e0cecab784cc0acc050ca1c89c5be"
format_stamp: "Formatted at 2026-02-03 21:10:26 on dist-test-slave-npns"
I20260203 21:10:26.259869 2841 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260203 21:10:26.261951 2855 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260203 21:10:26.262888 2841 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260203 21:10:26.262984 2841 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-1/data,/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-1/wal
uuid: "6d9e0cecab784cc0acc050ca1c89c5be"
format_stamp: "Formatted at 2026-02-03 21:10:26 on dist-test-slave-npns"
I20260203 21:10:26.263063 2841 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260203 21:10:26.281282 2841 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260203 21:10:26.281914 2841 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260203 21:10:26.282068 2841 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260203 21:10:26.282575 2841 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260203 21:10:26.283527 2841 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260203 21:10:26.283574 2841 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260203 21:10:26.283625 2841 ts_tablet_manager.cc:616] Registered 0 tablets
I20260203 21:10:26.283653 2841 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260203 21:10:26.292016 2841 rpc_server.cc:307] RPC server started. Bound to: 127.2.32.130:38897
I20260203 21:10:26.292049 2968 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.32.130:38897 every 8 connection(s)
I20260203 21:10:26.292879 2841 server_base.cc:1192] Dumped server information to /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-1/data/info.pb
I20260203 21:10:26.301321 2178 external_mini_cluster.cc:1428] Started /tmp/dist-test-task0vmSZW/build/debug/bin/kudu as pid 2841
I20260203 21:10:26.301443 2178 external_mini_cluster.cc:1442] Reading /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-1/wal/instance
I20260203 21:10:26.301481 2970 heartbeater.cc:344] Connected to a master server at 127.2.32.190:35419
I20260203 21:10:26.301482 2969 heartbeater.cc:344] Connected to a master server at 127.2.32.188:33665
I20260203 21:10:26.301698 2969 heartbeater.cc:461] Registering TS with master...
I20260203 21:10:26.301721 2971 heartbeater.cc:344] Connected to a master server at 127.2.32.189:42681
I20260203 21:10:26.301776 2971 heartbeater.cc:461] Registering TS with master...
I20260203 21:10:26.301700 2970 heartbeater.cc:461] Registering TS with master...
I20260203 21:10:26.302227 2969 heartbeater.cc:507] Master 127.2.32.188:33665 requested a full tablet report, sending...
I20260203 21:10:26.302423 2970 heartbeater.cc:507] Master 127.2.32.190:35419 requested a full tablet report, sending...
I20260203 21:10:26.302228 2971 heartbeater.cc:507] Master 127.2.32.189:42681 requested a full tablet report, sending...
I20260203 21:10:26.303355 2594 ts_manager.cc:194] Registered new tserver with Master: 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897)
I20260203 21:10:26.303624 2452 ts_manager.cc:194] Registered new tserver with Master: 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897)
I20260203 21:10:26.303980 2523 ts_manager.cc:194] Registered new tserver with Master: 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897)
I20260203 21:10:26.304005 2594 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.2.32.130:53369
I20260203 21:10:26.304838 2178 external_mini_cluster.cc:1366] Running /tmp/dist-test-task0vmSZW/build/debug/bin/kudu
/tmp/dist-test-task0vmSZW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.32.131:0
--local_ip_for_outbound_sockets=127.2.32.131
--webserver_interface=127.2.32.131
--webserver_port=0
--tserver_master_addrs=127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665
--builtin_ntp_servers=127.2.32.148:39497
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260203 21:10:26.410517 2980 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a7e51013f5041898fe34f4b64a59260)
I20260203 21:10:26.410655 2980 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:10:26.411569 2980 leader_election.cc:290] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681), 8a7e51013f5041898fe34f4b64a59260 (127.2.32.188:33665)
I20260203 21:10:26.412016 2533 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7344d7cd8dea4fa2ae705320daacaf49" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35397be7e61f4b27a49e9449b9fdf085" is_pre_election: true
I20260203 21:10:26.412079 2604 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7344d7cd8dea4fa2ae705320daacaf49" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8a7e51013f5041898fe34f4b64a59260" is_pre_election: true
W20260203 21:10:26.411983 2976 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260203 21:10:26.412232 2976 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260203 21:10:26.412307 2976 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260203 21:10:26.412595 2436 leader_election.cc:304] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7344d7cd8dea4fa2ae705320daacaf49; no voters: 35397be7e61f4b27a49e9449b9fdf085, 8a7e51013f5041898fe34f4b64a59260
I20260203 21:10:26.412802 2980 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260203 21:10:26.415879 2976 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260203 21:10:26.416009 2976 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.32.131
I20260203 21:10:26.419946 2976 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.32.148:39497
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--fs_data_dirs=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.32.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.2.32.131
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665
--never_fsync=true
--heap_profile_path=/tmp/kudu.2976
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.32.131
--log_dir=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 0efbebd487e7d0c7f21ab0d5a91e0fa70046af83
build type DEBUG
built by None at 03 Feb 2026 20:50:43 UTC on 24a791456cd2
build id 10330
I20260203 21:10:26.421039 2976 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260203 21:10:26.422138 2976 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260203 21:10:26.428416 2982 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260203 21:10:26.428364 2983 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260203 21:10:26.428539 2976 server_base.cc:1060] running on GCE node
W20260203 21:10:26.428362 2985 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260203 21:10:26.428937 2976 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260203 21:10:26.429455 2976 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260203 21:10:26.430600 2976 hybrid_clock.cc:648] HybridClock initialized: now 1770153026430578 us; error 37 us; skew 500 ppm
I20260203 21:10:26.432273 2976 webserver.cc:492] Webserver started at http://127.2.32.131:45331/ using document root <none> and password file <none>
I20260203 21:10:26.432917 2976 fs_manager.cc:362] Metadata directory not provided
I20260203 21:10:26.432978 2976 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260203 21:10:26.433137 2976 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260203 21:10:26.434646 2976 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-2/data/instance:
uuid: "185c63f61a2645928eeb807d145026b1"
format_stamp: "Formatted at 2026-02-03 21:10:26 on dist-test-slave-npns"
I20260203 21:10:26.435070 2976 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-2/wal/instance:
uuid: "185c63f61a2645928eeb807d145026b1"
format_stamp: "Formatted at 2026-02-03 21:10:26 on dist-test-slave-npns"
I20260203 21:10:26.438336 2976 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260203 21:10:26.440620 2991 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260203 21:10:26.441597 2976 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260203 21:10:26.441704 2976 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-2/data,/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-2/wal
uuid: "185c63f61a2645928eeb807d145026b1"
format_stamp: "Formatted at 2026-02-03 21:10:26 on dist-test-slave-npns"
I20260203 21:10:26.441793 2976 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260203 21:10:26.465600 2976 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260203 21:10:26.466305 2976 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260203 21:10:26.466483 2976 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260203 21:10:26.467087 2976 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260203 21:10:26.468128 2976 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260203 21:10:26.468178 2976 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260203 21:10:26.468230 2976 ts_tablet_manager.cc:616] Registered 0 tablets
I20260203 21:10:26.468254 2976 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260203 21:10:26.476882 2976 rpc_server.cc:307] RPC server started. Bound to: 127.2.32.131:40223
I20260203 21:10:26.476922 3104 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.32.131:40223 every 8 connection(s)
I20260203 21:10:26.477898 2976 server_base.cc:1192] Dumped server information to /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-2/data/info.pb
I20260203 21:10:26.480103 2178 external_mini_cluster.cc:1428] Started /tmp/dist-test-task0vmSZW/build/debug/bin/kudu as pid 2976
I20260203 21:10:26.480209 2178 external_mini_cluster.cc:1442] Reading /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-2/wal/instance
I20260203 21:10:26.488804 3105 heartbeater.cc:344] Connected to a master server at 127.2.32.188:33665
I20260203 21:10:26.489045 3107 heartbeater.cc:344] Connected to a master server at 127.2.32.189:42681
I20260203 21:10:26.489104 3106 heartbeater.cc:344] Connected to a master server at 127.2.32.190:35419
I20260203 21:10:26.489125 3107 heartbeater.cc:461] Registering TS with master...
I20260203 21:10:26.489213 3106 heartbeater.cc:461] Registering TS with master...
I20260203 21:10:26.489748 3107 heartbeater.cc:507] Master 127.2.32.189:42681 requested a full tablet report, sending...
I20260203 21:10:26.489748 3106 heartbeater.cc:507] Master 127.2.32.190:35419 requested a full tablet report, sending...
I20260203 21:10:26.489071 3105 heartbeater.cc:461] Registering TS with master...
I20260203 21:10:26.490357 3105 heartbeater.cc:507] Master 127.2.32.188:33665 requested a full tablet report, sending...
I20260203 21:10:26.490819 2523 ts_manager.cc:194] Registered new tserver with Master: 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
I20260203 21:10:26.490835 2452 ts_manager.cc:194] Registered new tserver with Master: 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
I20260203 21:10:26.490962 2594 ts_manager.cc:194] Registered new tserver with Master: 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
I20260203 21:10:26.491622 2594 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.2.32.131:46399
I20260203 21:10:26.501101 2178 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
I20260203 21:10:26.515372 2178 external_mini_cluster.cc:1658] Killing /tmp/dist-test-task0vmSZW/build/debug/bin/kudu with pid 2561
W20260203 21:10:26.520829 3112 connection.cc:537] client connection to 127.2.32.188:33665 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260203 21:10:26.521346 3112 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.2.32.188:33665)
I20260203 21:10:26.584525 2670 catalog_manager.cc:1269] Loaded cluster ID: f46367a11713484f92c1d2be2585f5a6
I20260203 21:10:26.584600 2670 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49: loading cluster ID for follower catalog manager: success
I20260203 21:10:26.586364 2670 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49: acquiring CA information for follower catalog manager: success
I20260203 21:10:26.587534 2670 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260203 21:10:26.631470 2688 catalog_manager.cc:1269] Loaded cluster ID: f46367a11713484f92c1d2be2585f5a6
I20260203 21:10:26.631546 2688 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085: loading cluster ID for follower catalog manager: success
I20260203 21:10:26.632572 2831 heartbeater.cc:499] Master 127.2.32.188:33665 was elected leader, sending a full tablet report...
W20260203 21:10:26.633423 2831 heartbeater.cc:646] Failed to heartbeat to 127.2.32.188:33665 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.2.32.188:33665: connect: Connection refused (error 111)
I20260203 21:10:26.633715 2688 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085: acquiring CA information for follower catalog manager: success
I20260203 21:10:26.635154 2688 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260203 21:10:26.805702 2969 heartbeater.cc:499] Master 127.2.32.188:33665 was elected leader, sending a full tablet report...
W20260203 21:10:26.806524 2969 heartbeater.cc:646] Failed to heartbeat to 127.2.32.188:33665 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.2.32.188:33665: connect: Connection refused (error 111)
I20260203 21:10:26.825834 3152 raft_consensus.cc:493] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a7e51013f5041898fe34f4b64a59260)
I20260203 21:10:26.825985 3152 raft_consensus.cc:515] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:10:26.826850 3152 leader_election.cc:290] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419), 8a7e51013f5041898fe34f4b64a59260 (127.2.32.188:33665)
I20260203 21:10:26.827209 2462 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "35397be7e61f4b27a49e9449b9fdf085" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7344d7cd8dea4fa2ae705320daacaf49" is_pre_election: true
W20260203 21:10:26.828126 2507 leader_election.cc:336] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 8a7e51013f5041898fe34f4b64a59260 (127.2.32.188:33665): Network error: Client connection negotiation failed: client connection to 127.2.32.188:33665: connect: Connection refused (error 111)
I20260203 21:10:26.828194 2507 leader_election.cc:304] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35397be7e61f4b27a49e9449b9fdf085; no voters: 7344d7cd8dea4fa2ae705320daacaf49, 8a7e51013f5041898fe34f4b64a59260
I20260203 21:10:26.828365 3152 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:10:26.989539 3155 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a7e51013f5041898fe34f4b64a59260)
I20260203 21:10:26.989666 3155 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:10:26.990057 3155 leader_election.cc:290] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681), 8a7e51013f5041898fe34f4b64a59260 (127.2.32.188:33665)
I20260203 21:10:26.990381 2533 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7344d7cd8dea4fa2ae705320daacaf49" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35397be7e61f4b27a49e9449b9fdf085" is_pre_election: true
I20260203 21:10:26.990516 2533 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7344d7cd8dea4fa2ae705320daacaf49 in term 1.
I20260203 21:10:26.990842 2438 leader_election.cc:304] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35397be7e61f4b27a49e9449b9fdf085, 7344d7cd8dea4fa2ae705320daacaf49; no voters:
I20260203 21:10:26.990995 3155 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260203 21:10:26.991057 3155 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8a7e51013f5041898fe34f4b64a59260)
I20260203 21:10:26.991096 3155 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49 [term 1 FOLLOWER]: Advancing to term 2
W20260203 21:10:26.991150 2436 leader_election.cc:336] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 8a7e51013f5041898fe34f4b64a59260 (127.2.32.188:33665): Network error: Client connection negotiation failed: client connection to 127.2.32.188:33665: connect: Connection refused (error 111)
I20260203 21:10:26.992035 3155 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:10:26.992393 3155 leader_election.cc:290] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49 [CANDIDATE]: Term 2 election: Requested vote from peers 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681), 8a7e51013f5041898fe34f4b64a59260 (127.2.32.188:33665)
I20260203 21:10:26.992861 2533 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7344d7cd8dea4fa2ae705320daacaf49" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35397be7e61f4b27a49e9449b9fdf085"
I20260203 21:10:26.992955 2533 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [term 1 FOLLOWER]: Advancing to term 2
I20260203 21:10:26.993175 3105 heartbeater.cc:499] Master 127.2.32.188:33665 was elected leader, sending a full tablet report...
W20260203 21:10:26.993391 2436 leader_election.cc:336] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 8a7e51013f5041898fe34f4b64a59260 (127.2.32.188:33665): Network error: Client connection negotiation failed: client connection to 127.2.32.188:33665: connect: Connection refused (error 111)
I20260203 21:10:26.993953 2533 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7344d7cd8dea4fa2ae705320daacaf49 in term 2.
W20260203 21:10:26.993989 3105 heartbeater.cc:646] Failed to heartbeat to 127.2.32.188:33665 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.2.32.188:33665: connect: Connection refused (error 111)
I20260203 21:10:26.994184 2438 leader_election.cc:304] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35397be7e61f4b27a49e9449b9fdf085, 7344d7cd8dea4fa2ae705320daacaf49; no voters: 8a7e51013f5041898fe34f4b64a59260
I20260203 21:10:26.994318 3155 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49 [term 2 FOLLOWER]: Leader election won for term 2
I20260203 21:10:26.994478 3155 raft_consensus.cc:697] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49 [term 2 LEADER]: Becoming Leader. State: Replica: 7344d7cd8dea4fa2ae705320daacaf49, State: Running, Role: LEADER
I20260203 21:10:26.994755 3155 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:10:26.995705 3159 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7344d7cd8dea4fa2ae705320daacaf49. Latest consensus state: current_term: 2 leader_uuid: "7344d7cd8dea4fa2ae705320daacaf49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } } }
I20260203 21:10:26.995810 3159 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49 [sys.catalog]: This master's current role is: LEADER
I20260203 21:10:26.996093 3161 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260203 21:10:26.996896 3161 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260203 21:10:26.997238 3161 catalog_manager.cc:1269] Loaded cluster ID: f46367a11713484f92c1d2be2585f5a6
I20260203 21:10:26.997285 3161 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260203 21:10:26.997812 3161 catalog_manager.cc:1514] Loading token signing keys...
I20260203 21:10:26.998155 3161 catalog_manager.cc:6038] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49: Loaded TSK: 0
I20260203 21:10:26.998822 3161 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260203 21:10:26.999167 3161 catalog_manager.cc:1537] Loading latest processed Hive Metastore notification log event ID...
I20260203 21:10:26.999470 3161 catalog_manager.cc:5876] Last processed Hive Metastore notification event ID: -1
I20260203 21:10:27.018076 2452 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57540:
name: "default.Table_1d3ace06028643bba1fbb9d430213ff5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260203 21:10:27.018193 2448 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57540:
name: "default.Table_c2985ddec2e045cba153900329fe9331"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260203 21:10:27.018299 2449 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57540:
name: "default.Table_8276b49c70934289816f902b52d97652"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260203 21:10:27.018450 2445 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57540:
name: "default.Table_dde2cdf1f5254cb49f3053855a83891e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260203 21:10:27.018654 2444 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57540:
name: "default.Table_ae3f050e71c94082b0e88a08167c762f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260203 21:10:27.018105 2451 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57540:
name: "default.Table_42d2deb9edf04a3b8ce372f18fff2cf1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260203 21:10:27.018210 2447 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57540:
name: "default.Table_8695f3c31a784599917744b6d57e2a18"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260203 21:10:27.018114 2450 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57540:
name: "default.Table_09e62d0aaa0f48ad9ed818ba967be542"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260203 21:10:27.018673 2443 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57540:
name: "default.Table_bdb9340290f84eada371f9d8304fcd67"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260203 21:10:27.018846 2446 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57540:
name: "default.Table_66c508c8dbdd4e7ea9283cabe65b62c0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260203 21:10:27.046111 2178 external_mini_cluster.cc:1366] Running /tmp/dist-test-task0vmSZW/build/debug/bin/kudu
/tmp/dist-test-task0vmSZW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.32.188:33665
--webserver_interface=127.2.32.188
--webserver_port=39751
--builtin_ntp_servers=127.2.32.148:39497
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665
--hive_metastore_uris=thrift://127.0.0.1:33779
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260203 21:10:27.059262 2452 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_1d3ace06028643bba1fbb9d430213ff5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260203 21:10:27.182288 3162 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260203 21:10:27.182737 3162 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260203 21:10:27.182839 3162 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260203 21:10:27.187680 3162 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260203 21:10:27.187835 3162 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260203 21:10:27.187904 3162 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260203 21:10:27.187963 3162 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260203 21:10:27.193730 3162 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.32.148:39497
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-2/wal
--hive_metastore_uris=thrift://127.0.0.1:33779
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.32.188:33665
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.2.32.188
--webserver_port=39751
--never_fsync=true
--heap_profile_path=/tmp/kudu.3162
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 0efbebd487e7d0c7f21ab0d5a91e0fa70046af83
build type DEBUG
built by None at 03 Feb 2026 20:50:43 UTC on 24a791456cd2
build id 10330
I20260203 21:10:27.195231 3162 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260203 21:10:27.196820 3162 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260203 21:10:27.203821 3171 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260203 21:10:27.204710 3169 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260203 21:10:27.205704 3162 server_base.cc:1060] running on GCE node
W20260203 21:10:27.205940 3168 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260203 21:10:27.206533 3162 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260203 21:10:27.207727 3162 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260203 21:10:27.208931 3162 hybrid_clock.cc:648] HybridClock initialized: now 1770153027208902 us; error 48 us; skew 500 ppm
I20260203 21:10:27.211100 3162 webserver.cc:492] Webserver started at http://127.2.32.188:39751/ using document root <none> and password file <none>
I20260203 21:10:27.211828 3162 fs_manager.cc:362] Metadata directory not provided
I20260203 21:10:27.211923 3162 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260203 21:10:27.216439 3162 fs_manager.cc:714] Time spent opening directory manager: real 0.003s user 0.002s sys 0.001s
I20260203 21:10:27.218847 3177 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260203 21:10:27.220058 3162 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260203 21:10:27.220160 3162 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-2/data,/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-2/wal
uuid: "8a7e51013f5041898fe34f4b64a59260"
format_stamp: "Formatted at 2026-02-03 21:10:25 on dist-test-slave-npns"
I20260203 21:10:27.220599 3162 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260203 21:10:27.259361 3162 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260203 21:10:27.260260 3162 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260203 21:10:27.260447 3162 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260203 21:10:27.271262 3162 rpc_server.cc:307] RPC server started. Bound to: 127.2.32.188:33665
I20260203 21:10:27.272814 3162 server_base.cc:1192] Dumped server information to /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-2/data/info.pb
I20260203 21:10:27.273069 3229 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.32.188:33665 every 8 connection(s)
I20260203 21:10:27.274034 2178 external_mini_cluster.cc:1428] Started /tmp/dist-test-task0vmSZW/build/debug/bin/kudu as pid 3162
I20260203 21:10:27.279723 3230 sys_catalog.cc:263] Verifying existing consensus state
I20260203 21:10:27.282094 3230 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260: Bootstrap starting.
I20260203 21:10:27.292562 3230 log.cc:826] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260: Log is configured to *not* fsync() on all Append() calls
I20260203 21:10:27.299021 3230 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260203 21:10:27.299467 3230 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260: Bootstrap complete.
I20260203 21:10:27.303140 3230 raft_consensus.cc:359] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:10:27.303582 3230 raft_consensus.cc:740] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a7e51013f5041898fe34f4b64a59260, State: Initialized, Role: FOLLOWER
I20260203 21:10:27.304112 3230 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:10:27.305328 3230 sys_catalog.cc:565] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [sys.catalog]: configured and running, proceeding with master startup.
I20260203 21:10:27.309827 3234 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } } }
I20260203 21:10:27.310047 3234 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [sys.catalog]: This master's current role is: FOLLOWER
I20260203 21:10:27.318136 3249 catalog_manager.cc:1269] Loaded cluster ID: f46367a11713484f92c1d2be2585f5a6
I20260203 21:10:27.318192 3249 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260: loading cluster ID for follower catalog manager: success
I20260203 21:10:27.320165 3249 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260: acquiring CA information for follower catalog manager: success
I20260203 21:10:27.320230 2969 heartbeater.cc:344] Connected to a master server at 127.2.32.188:33665
I20260203 21:10:27.320361 2969 heartbeater.cc:499] Master 127.2.32.188:33665 was elected leader, sending a full tablet report...
I20260203 21:10:27.321359 3249 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260203 21:10:27.321451 3194 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" instance_seqno: 1770153026289802) as {username='slave'} at 127.2.32.130:59101; Asking this server to re-register.
I20260203 21:10:27.322041 2969 heartbeater.cc:461] Registering TS with master...
I20260203 21:10:27.323167 3194 ts_manager.cc:194] Registered new tserver with Master: 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897)
I20260203 21:10:27.510527 3105 heartbeater.cc:344] Connected to a master server at 127.2.32.188:33665
I20260203 21:10:27.510702 3105 heartbeater.cc:499] Master 127.2.32.188:33665 was elected leader, sending a full tablet report...
I20260203 21:10:27.511538 3194 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "185c63f61a2645928eeb807d145026b1" instance_seqno: 1770153026474418) as {username='slave'} at 127.2.32.131:51293; Asking this server to re-register.
I20260203 21:10:27.512089 3105 heartbeater.cc:461] Registering TS with master...
I20260203 21:10:27.512938 3194 ts_manager.cc:194] Registered new tserver with Master: 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
I20260203 21:10:27.535019 2452 catalog_manager.cc:2174] created HMS catalog entry for table [id=a995c742bb2942838a2385b05a4d4d57]
W20260203 21:10:27.538726 2449 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_8276b49c70934289816f902b52d97652 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260203 21:10:27.538914 2445 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_dde2cdf1f5254cb49f3053855a83891e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260203 21:10:27.538970 2444 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_ae3f050e71c94082b0e88a08167c762f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260203 21:10:27.539506 2451 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_42d2deb9edf04a3b8ce372f18fff2cf1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260203 21:10:27.539654 2447 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_8695f3c31a784599917744b6d57e2a18 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260203 21:10:27.539888 2443 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_bdb9340290f84eada371f9d8304fcd67 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260203 21:10:27.538726 2448 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_c2985ddec2e045cba153900329fe9331 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260203 21:10:27.539709 2446 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_66c508c8dbdd4e7ea9283cabe65b62c0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260203 21:10:27.541180 2533 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [term 2 FOLLOWER]: Refusing update from remote peer 7344d7cd8dea4fa2ae705320daacaf49: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 6. (index mismatch)
W20260203 21:10:27.539506 2450 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_09e62d0aaa0f48ad9ed818ba967be542 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260203 21:10:27.541813 3255 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260203 21:10:27.547802 3259 sys_catalog.cc:455] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7344d7cd8dea4fa2ae705320daacaf49. Latest consensus state: current_term: 2 leader_uuid: "7344d7cd8dea4fa2ae705320daacaf49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } } }
I20260203 21:10:27.548029 3259 sys_catalog.cc:458] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [sys.catalog]: This master's current role is: FOLLOWER
I20260203 21:10:27.553633 3259 sys_catalog.cc:455] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "7344d7cd8dea4fa2ae705320daacaf49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } } }
I20260203 21:10:27.553836 3259 sys_catalog.cc:458] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [sys.catalog]: This master's current role is: FOLLOWER
I20260203 21:10:27.554569 3258 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "7344d7cd8dea4fa2ae705320daacaf49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } } }
I20260203 21:10:27.554653 3257 mvcc.cc:204] Tried to move back new op lower bound from 7250546800789184512 to 7250546798572507136. Current Snapshot: MvccSnapshot[applied={T|T < 7250546800789184512}]
I20260203 21:10:27.554678 3258 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49 [sys.catalog]: This master's current role is: LEADER
I20260203 21:10:27.563691 3195 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 1 FOLLOWER]: Advancing to term 2
I20260203 21:10:27.566103 3195 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 2 FOLLOWER]: Refusing update from remote peer 7344d7cd8dea4fa2ae705320daacaf49: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260203 21:10:27.566718 3258 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260203 21:10:27.570592 3234 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7344d7cd8dea4fa2ae705320daacaf49. Latest consensus state: current_term: 2 leader_uuid: "7344d7cd8dea4fa2ae705320daacaf49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } } }
I20260203 21:10:27.570711 3234 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [sys.catalog]: This master's current role is: FOLLOWER
I20260203 21:10:27.570801 3234 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "7344d7cd8dea4fa2ae705320daacaf49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } } }
I20260203 21:10:27.570863 3234 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [sys.catalog]: This master's current role is: FOLLOWER
I20260203 21:10:27.575039 2452 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57540:
table { table_name: "default.Table_1d3ace06028643bba1fbb9d430213ff5" } new_table_name: "default.Table_800a192f4e9e4ca5806a324b36234706" modify_external_catalogs: true
I20260203 21:10:27.575562 2449 catalog_manager.cc:2174] created HMS catalog entry for table [id=333213fed7234610bc20c7d92124182b]
I20260203 21:10:27.576279 3266 mvcc.cc:204] Tried to move back new op lower bound from 7250546800789184512 to 7250546798572507136. Current Snapshot: MvccSnapshot[applied={T|T < 7250546800789184512}]
I20260203 21:10:27.583264 2449 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57540:
table { table_name: "default.Table_8276b49c70934289816f902b52d97652" } new_table_name: "default.Table_547d99db0d3043499a26ee8c6df4c443" modify_external_catalogs: true
I20260203 21:10:27.585330 3258 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "7344d7cd8dea4fa2ae705320daacaf49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } } }
I20260203 21:10:27.585444 3258 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49 [sys.catalog]: This master's current role is: LEADER
I20260203 21:10:27.599314 2765 tablet_service.cc:1505] Processing CreateTablet for tablet e3680015777647ba80d0b63661afdd8c (DEFAULT_TABLE table=default.table_1d3ace06028643bba1fbb9d430213ff5 [id=a995c742bb2942838a2385b05a4d4d57]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:27.600517 2764 tablet_service.cc:1505] Processing CreateTablet for tablet ed7afe0e6dcf4431a60def7298184187 (DEFAULT_TABLE table=default.table_8276b49c70934289816f902b52d97652 [id=333213fed7234610bc20c7d92124182b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:27.600939 2765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3680015777647ba80d0b63661afdd8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:27.601864 2764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed7afe0e6dcf4431a60def7298184187. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:27.607118 2903 tablet_service.cc:1505] Processing CreateTablet for tablet e3680015777647ba80d0b63661afdd8c (DEFAULT_TABLE table=default.table_1d3ace06028643bba1fbb9d430213ff5 [id=a995c742bb2942838a2385b05a4d4d57]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:27.607910 2902 tablet_service.cc:1505] Processing CreateTablet for tablet ed7afe0e6dcf4431a60def7298184187 (DEFAULT_TABLE table=default.table_8276b49c70934289816f902b52d97652 [id=333213fed7234610bc20c7d92124182b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:27.608537 2902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed7afe0e6dcf4431a60def7298184187. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:27.610145 3039 tablet_service.cc:1505] Processing CreateTablet for tablet e3680015777647ba80d0b63661afdd8c (DEFAULT_TABLE table=default.table_1d3ace06028643bba1fbb9d430213ff5 [id=a995c742bb2942838a2385b05a4d4d57]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:27.610548 2444 catalog_manager.cc:2174] created HMS catalog entry for table [id=73eae179f2ad481d932a5b3c95b1a4ab]
I20260203 21:10:27.610599 3278 tablet_bootstrap.cc:492] T ed7afe0e6dcf4431a60def7298184187 P 02bdf326542e474cbe62434dd59087dc: Bootstrap starting.
I20260203 21:10:27.611068 3039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3680015777647ba80d0b63661afdd8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:27.611780 3038 tablet_service.cc:1505] Processing CreateTablet for tablet ed7afe0e6dcf4431a60def7298184187 (DEFAULT_TABLE table=default.table_8276b49c70934289816f902b52d97652 [id=333213fed7234610bc20c7d92124182b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:27.612015 3038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed7afe0e6dcf4431a60def7298184187. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:27.612856 3278 tablet_bootstrap.cc:654] T ed7afe0e6dcf4431a60def7298184187 P 02bdf326542e474cbe62434dd59087dc: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:27.613682 3278 log.cc:826] T ed7afe0e6dcf4431a60def7298184187 P 02bdf326542e474cbe62434dd59087dc: Log is configured to *not* fsync() on all Append() calls
I20260203 21:10:27.615386 3278 tablet_bootstrap.cc:492] T ed7afe0e6dcf4431a60def7298184187 P 02bdf326542e474cbe62434dd59087dc: No bootstrap required, opened a new log
I20260203 21:10:27.615563 3278 ts_tablet_manager.cc:1403] T ed7afe0e6dcf4431a60def7298184187 P 02bdf326542e474cbe62434dd59087dc: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260203 21:10:27.615733 2903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3680015777647ba80d0b63661afdd8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:27.615752 3280 tablet_bootstrap.cc:492] T ed7afe0e6dcf4431a60def7298184187 P 6d9e0cecab784cc0acc050ca1c89c5be: Bootstrap starting.
I20260203 21:10:27.619072 3278 raft_consensus.cc:359] T ed7afe0e6dcf4431a60def7298184187 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:27.619357 3278 raft_consensus.cc:385] T ed7afe0e6dcf4431a60def7298184187 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:27.619454 3278 raft_consensus.cc:740] T ed7afe0e6dcf4431a60def7298184187 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02bdf326542e474cbe62434dd59087dc, State: Initialized, Role: FOLLOWER
I20260203 21:10:27.620007 3278 consensus_queue.cc:260] T ed7afe0e6dcf4431a60def7298184187 P 02bdf326542e474cbe62434dd59087dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:27.620975 3278 ts_tablet_manager.cc:1434] T ed7afe0e6dcf4431a60def7298184187 P 02bdf326542e474cbe62434dd59087dc: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260203 21:10:27.621249 3280 tablet_bootstrap.cc:654] T ed7afe0e6dcf4431a60def7298184187 P 6d9e0cecab784cc0acc050ca1c89c5be: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:27.622175 2832 heartbeater.cc:499] Master 127.2.32.190:35419 was elected leader, sending a full tablet report...
I20260203 21:10:27.622596 3280 log.cc:826] T ed7afe0e6dcf4431a60def7298184187 P 6d9e0cecab784cc0acc050ca1c89c5be: Log is configured to *not* fsync() on all Append() calls
I20260203 21:10:27.623777 2444 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57540:
table { table_name: "default.Table_ae3f050e71c94082b0e88a08167c762f" } new_table_name: "default.Table_a029ba95c22e421585ca4ce640aa9658" modify_external_catalogs: true
I20260203 21:10:27.624158 3280 tablet_bootstrap.cc:492] T ed7afe0e6dcf4431a60def7298184187 P 6d9e0cecab784cc0acc050ca1c89c5be: No bootstrap required, opened a new log
I20260203 21:10:27.624316 3280 ts_tablet_manager.cc:1403] T ed7afe0e6dcf4431a60def7298184187 P 6d9e0cecab784cc0acc050ca1c89c5be: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.000s
I20260203 21:10:27.627292 3280 raft_consensus.cc:359] T ed7afe0e6dcf4431a60def7298184187 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:27.627775 3280 raft_consensus.cc:385] T ed7afe0e6dcf4431a60def7298184187 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:27.627975 3280 raft_consensus.cc:740] T ed7afe0e6dcf4431a60def7298184187 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d9e0cecab784cc0acc050ca1c89c5be, State: Initialized, Role: FOLLOWER
I20260203 21:10:27.628468 3280 consensus_queue.cc:260] T ed7afe0e6dcf4431a60def7298184187 P 6d9e0cecab784cc0acc050ca1c89c5be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:27.630301 3280 ts_tablet_manager.cc:1434] T ed7afe0e6dcf4431a60def7298184187 P 6d9e0cecab784cc0acc050ca1c89c5be: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260203 21:10:27.636010 2970 heartbeater.cc:499] Master 127.2.32.190:35419 was elected leader, sending a full tablet report...
I20260203 21:10:27.636019 3281 tablet_bootstrap.cc:492] T ed7afe0e6dcf4431a60def7298184187 P 185c63f61a2645928eeb807d145026b1: Bootstrap starting.
I20260203 21:10:27.636036 2765 tablet_service.cc:1505] Processing CreateTablet for tablet 104fa933dbce4d8a934e827601c899a0 (DEFAULT_TABLE table=default.table_ae3f050e71c94082b0e88a08167c762f [id=73eae179f2ad481d932a5b3c95b1a4ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:27.636323 2765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 104fa933dbce4d8a934e827601c899a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:27.637821 3280 tablet_bootstrap.cc:492] T e3680015777647ba80d0b63661afdd8c P 6d9e0cecab784cc0acc050ca1c89c5be: Bootstrap starting.
I20260203 21:10:27.638226 3281 tablet_bootstrap.cc:654] T ed7afe0e6dcf4431a60def7298184187 P 185c63f61a2645928eeb807d145026b1: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:27.638866 3280 tablet_bootstrap.cc:654] T e3680015777647ba80d0b63661afdd8c P 6d9e0cecab784cc0acc050ca1c89c5be: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:27.638877 2831 heartbeater.cc:344] Connected to a master server at 127.2.32.188:33665
I20260203 21:10:27.638978 2831 heartbeater.cc:499] Master 127.2.32.188:33665 was elected leader, sending a full tablet report...
I20260203 21:10:27.639057 3281 log.cc:826] T ed7afe0e6dcf4431a60def7298184187 P 185c63f61a2645928eeb807d145026b1: Log is configured to *not* fsync() on all Append() calls
I20260203 21:10:27.639834 3194 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "02bdf326542e474cbe62434dd59087dc" instance_seqno: 1770153026114330) as {username='slave'} at 127.2.32.129:53067; Asking this server to re-register.
I20260203 21:10:27.639971 3039 tablet_service.cc:1505] Processing CreateTablet for tablet 104fa933dbce4d8a934e827601c899a0 (DEFAULT_TABLE table=default.table_ae3f050e71c94082b0e88a08167c762f [id=73eae179f2ad481d932a5b3c95b1a4ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:27.640233 3039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 104fa933dbce4d8a934e827601c899a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:27.642606 2831 heartbeater.cc:461] Registering TS with master...
I20260203 21:10:27.643481 2902 tablet_service.cc:1505] Processing CreateTablet for tablet 104fa933dbce4d8a934e827601c899a0 (DEFAULT_TABLE table=default.table_ae3f050e71c94082b0e88a08167c762f [id=73eae179f2ad481d932a5b3c95b1a4ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:27.643743 2902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 104fa933dbce4d8a934e827601c899a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:27.644047 3194 ts_manager.cc:194] Registered new tserver with Master: 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335)
I20260203 21:10:27.644922 3280 tablet_bootstrap.cc:492] T e3680015777647ba80d0b63661afdd8c P 6d9e0cecab784cc0acc050ca1c89c5be: No bootstrap required, opened a new log
I20260203 21:10:27.644999 3280 ts_tablet_manager.cc:1403] T e3680015777647ba80d0b63661afdd8c P 6d9e0cecab784cc0acc050ca1c89c5be: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260203 21:10:27.645726 3280 raft_consensus.cc:359] T e3680015777647ba80d0b63661afdd8c P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:27.645829 3280 raft_consensus.cc:385] T e3680015777647ba80d0b63661afdd8c P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:27.645859 3280 raft_consensus.cc:740] T e3680015777647ba80d0b63661afdd8c P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d9e0cecab784cc0acc050ca1c89c5be, State: Initialized, Role: FOLLOWER
I20260203 21:10:27.646049 3280 consensus_queue.cc:260] T e3680015777647ba80d0b63661afdd8c P 6d9e0cecab784cc0acc050ca1c89c5be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:27.646365 3280 ts_tablet_manager.cc:1434] T e3680015777647ba80d0b63661afdd8c P 6d9e0cecab784cc0acc050ca1c89c5be: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260203 21:10:27.648039 3278 tablet_bootstrap.cc:492] T e3680015777647ba80d0b63661afdd8c P 02bdf326542e474cbe62434dd59087dc: Bootstrap starting.
I20260203 21:10:27.649029 3278 tablet_bootstrap.cc:654] T e3680015777647ba80d0b63661afdd8c P 02bdf326542e474cbe62434dd59087dc: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:27.649269 3280 tablet_bootstrap.cc:492] T 104fa933dbce4d8a934e827601c899a0 P 6d9e0cecab784cc0acc050ca1c89c5be: Bootstrap starting.
I20260203 21:10:27.650189 3280 tablet_bootstrap.cc:654] T 104fa933dbce4d8a934e827601c899a0 P 6d9e0cecab784cc0acc050ca1c89c5be: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:27.655185 3280 tablet_bootstrap.cc:492] T 104fa933dbce4d8a934e827601c899a0 P 6d9e0cecab784cc0acc050ca1c89c5be: No bootstrap required, opened a new log
I20260203 21:10:27.655319 3280 ts_tablet_manager.cc:1403] T 104fa933dbce4d8a934e827601c899a0 P 6d9e0cecab784cc0acc050ca1c89c5be: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260203 21:10:27.655716 3281 tablet_bootstrap.cc:492] T ed7afe0e6dcf4431a60def7298184187 P 185c63f61a2645928eeb807d145026b1: No bootstrap required, opened a new log
I20260203 21:10:27.655923 3281 ts_tablet_manager.cc:1403] T ed7afe0e6dcf4431a60def7298184187 P 185c63f61a2645928eeb807d145026b1: Time spent bootstrapping tablet: real 0.020s user 0.005s sys 0.000s
I20260203 21:10:27.655880 3280 raft_consensus.cc:359] T 104fa933dbce4d8a934e827601c899a0 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:27.655967 3280 raft_consensus.cc:385] T 104fa933dbce4d8a934e827601c899a0 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:27.655994 3280 raft_consensus.cc:740] T 104fa933dbce4d8a934e827601c899a0 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d9e0cecab784cc0acc050ca1c89c5be, State: Initialized, Role: FOLLOWER
I20260203 21:10:27.656140 3280 consensus_queue.cc:260] T 104fa933dbce4d8a934e827601c899a0 P 6d9e0cecab784cc0acc050ca1c89c5be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:27.656388 3280 ts_tablet_manager.cc:1434] T 104fa933dbce4d8a934e827601c899a0 P 6d9e0cecab784cc0acc050ca1c89c5be: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260203 21:10:27.659698 3281 raft_consensus.cc:359] T ed7afe0e6dcf4431a60def7298184187 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:27.659925 3278 tablet_bootstrap.cc:492] T e3680015777647ba80d0b63661afdd8c P 02bdf326542e474cbe62434dd59087dc: No bootstrap required, opened a new log
I20260203 21:10:27.659976 3281 raft_consensus.cc:385] T ed7afe0e6dcf4431a60def7298184187 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:27.660048 3278 ts_tablet_manager.cc:1403] T e3680015777647ba80d0b63661afdd8c P 02bdf326542e474cbe62434dd59087dc: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.000s
I20260203 21:10:27.660079 3281 raft_consensus.cc:740] T ed7afe0e6dcf4431a60def7298184187 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 185c63f61a2645928eeb807d145026b1, State: Initialized, Role: FOLLOWER
I20260203 21:10:27.660626 3278 raft_consensus.cc:359] T e3680015777647ba80d0b63661afdd8c P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:27.660619 3281 consensus_queue.cc:260] T ed7afe0e6dcf4431a60def7298184187 P 185c63f61a2645928eeb807d145026b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:27.660760 3278 raft_consensus.cc:385] T e3680015777647ba80d0b63661afdd8c P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:27.660818 3278 raft_consensus.cc:740] T e3680015777647ba80d0b63661afdd8c P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02bdf326542e474cbe62434dd59087dc, State: Initialized, Role: FOLLOWER
I20260203 21:10:27.660969 3278 consensus_queue.cc:260] T e3680015777647ba80d0b63661afdd8c P 02bdf326542e474cbe62434dd59087dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:27.661816 3281 ts_tablet_manager.cc:1434] T ed7afe0e6dcf4431a60def7298184187 P 185c63f61a2645928eeb807d145026b1: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260203 21:10:27.662184 3281 tablet_bootstrap.cc:492] T e3680015777647ba80d0b63661afdd8c P 185c63f61a2645928eeb807d145026b1: Bootstrap starting.
I20260203 21:10:27.662914 3278 ts_tablet_manager.cc:1434] T e3680015777647ba80d0b63661afdd8c P 02bdf326542e474cbe62434dd59087dc: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
I20260203 21:10:27.663223 3281 tablet_bootstrap.cc:654] T e3680015777647ba80d0b63661afdd8c P 185c63f61a2645928eeb807d145026b1: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:27.663231 3106 heartbeater.cc:499] Master 127.2.32.190:35419 was elected leader, sending a full tablet report...
I20260203 21:10:27.663993 3278 tablet_bootstrap.cc:492] T 104fa933dbce4d8a934e827601c899a0 P 02bdf326542e474cbe62434dd59087dc: Bootstrap starting.
I20260203 21:10:27.664980 3278 tablet_bootstrap.cc:654] T 104fa933dbce4d8a934e827601c899a0 P 02bdf326542e474cbe62434dd59087dc: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:27.666585 3278 tablet_bootstrap.cc:492] T 104fa933dbce4d8a934e827601c899a0 P 02bdf326542e474cbe62434dd59087dc: No bootstrap required, opened a new log
I20260203 21:10:27.666718 3278 ts_tablet_manager.cc:1403] T 104fa933dbce4d8a934e827601c899a0 P 02bdf326542e474cbe62434dd59087dc: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260203 21:10:27.667523 3278 raft_consensus.cc:359] T 104fa933dbce4d8a934e827601c899a0 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:27.667706 3278 raft_consensus.cc:385] T 104fa933dbce4d8a934e827601c899a0 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:27.667789 3278 raft_consensus.cc:740] T 104fa933dbce4d8a934e827601c899a0 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02bdf326542e474cbe62434dd59087dc, State: Initialized, Role: FOLLOWER
I20260203 21:10:27.667979 3278 consensus_queue.cc:260] T 104fa933dbce4d8a934e827601c899a0 P 02bdf326542e474cbe62434dd59087dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:27.670022 2451 catalog_manager.cc:2174] created HMS catalog entry for table [id=cc496c5ba7e8461b8020f3ab100304c8]
I20260203 21:10:27.669867 3278 ts_tablet_manager.cc:1434] T 104fa933dbce4d8a934e827601c899a0 P 02bdf326542e474cbe62434dd59087dc: Time spent starting tablet: real 0.003s user 0.000s sys 0.000s
I20260203 21:10:27.674106 3281 tablet_bootstrap.cc:492] T e3680015777647ba80d0b63661afdd8c P 185c63f61a2645928eeb807d145026b1: No bootstrap required, opened a new log
I20260203 21:10:27.674194 3281 ts_tablet_manager.cc:1403] T e3680015777647ba80d0b63661afdd8c P 185c63f61a2645928eeb807d145026b1: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.002s
I20260203 21:10:27.674759 3281 raft_consensus.cc:359] T e3680015777647ba80d0b63661afdd8c P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:27.674857 3281 raft_consensus.cc:385] T e3680015777647ba80d0b63661afdd8c P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:27.674888 3281 raft_consensus.cc:740] T e3680015777647ba80d0b63661afdd8c P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 185c63f61a2645928eeb807d145026b1, State: Initialized, Role: FOLLOWER
I20260203 21:10:27.675127 3281 consensus_queue.cc:260] T e3680015777647ba80d0b63661afdd8c P 185c63f61a2645928eeb807d145026b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:27.675441 3281 ts_tablet_manager.cc:1434] T e3680015777647ba80d0b63661afdd8c P 185c63f61a2645928eeb807d145026b1: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260203 21:10:27.677781 3281 tablet_bootstrap.cc:492] T 104fa933dbce4d8a934e827601c899a0 P 185c63f61a2645928eeb807d145026b1: Bootstrap starting.
I20260203 21:10:27.678753 3281 tablet_bootstrap.cc:654] T 104fa933dbce4d8a934e827601c899a0 P 185c63f61a2645928eeb807d145026b1: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:27.680438 2765 tablet_service.cc:1505] Processing CreateTablet for tablet c45683f20a454401bfb90b41570b5125 (DEFAULT_TABLE table=default.table_42d2deb9edf04a3b8ce372f18fff2cf1 [id=cc496c5ba7e8461b8020f3ab100304c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:27.680696 2765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c45683f20a454401bfb90b41570b5125. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:27.683398 2902 tablet_service.cc:1505] Processing CreateTablet for tablet c45683f20a454401bfb90b41570b5125 (DEFAULT_TABLE table=default.table_42d2deb9edf04a3b8ce372f18fff2cf1 [id=cc496c5ba7e8461b8020f3ab100304c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:27.683501 2451 master_service.cc:954] ReplaceTablet: received request to replace tablet 104fa933dbce4d8a934e827601c899a0 from {username='slave'} at 127.0.0.1:57540
I20260203 21:10:27.683684 2902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c45683f20a454401bfb90b41570b5125. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:27.685860 3280 tablet_bootstrap.cc:492] T c45683f20a454401bfb90b41570b5125 P 6d9e0cecab784cc0acc050ca1c89c5be: Bootstrap starting.
I20260203 21:10:27.686877 3280 tablet_bootstrap.cc:654] T c45683f20a454401bfb90b41570b5125 P 6d9e0cecab784cc0acc050ca1c89c5be: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:27.687513 3284 raft_consensus.cc:493] T e3680015777647ba80d0b63661afdd8c P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 21:10:27.687650 3284 raft_consensus.cc:515] T e3680015777647ba80d0b63661afdd8c P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:27.688925 3284 leader_election.cc:290] T e3680015777647ba80d0b63661afdd8c P 6d9e0cecab784cc0acc050ca1c89c5be [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223), 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335)
I20260203 21:10:27.689669 3039 tablet_service.cc:1505] Processing CreateTablet for tablet c45683f20a454401bfb90b41570b5125 (DEFAULT_TABLE table=default.table_42d2deb9edf04a3b8ce372f18fff2cf1 [id=cc496c5ba7e8461b8020f3ab100304c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:27.689924 3039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c45683f20a454401bfb90b41570b5125. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:27.690985 3281 tablet_bootstrap.cc:492] T 104fa933dbce4d8a934e827601c899a0 P 185c63f61a2645928eeb807d145026b1: No bootstrap required, opened a new log
I20260203 21:10:27.691066 3281 ts_tablet_manager.cc:1403] T 104fa933dbce4d8a934e827601c899a0 P 185c63f61a2645928eeb807d145026b1: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.002s
I20260203 21:10:27.691624 3281 raft_consensus.cc:359] T 104fa933dbce4d8a934e827601c899a0 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:27.691736 3281 raft_consensus.cc:385] T 104fa933dbce4d8a934e827601c899a0 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:27.691771 3281 raft_consensus.cc:740] T 104fa933dbce4d8a934e827601c899a0 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 185c63f61a2645928eeb807d145026b1, State: Initialized, Role: FOLLOWER
I20260203 21:10:27.691901 3281 consensus_queue.cc:260] T 104fa933dbce4d8a934e827601c899a0 P 185c63f61a2645928eeb807d145026b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:27.692154 3281 ts_tablet_manager.cc:1434] T 104fa933dbce4d8a934e827601c899a0 P 185c63f61a2645928eeb807d145026b1: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260203 21:10:27.693984 2451 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49: Sending DeleteTablet for 3 replicas of tablet 104fa933dbce4d8a934e827601c899a0
I20260203 21:10:27.696039 3038 tablet_service.cc:1552] Processing DeleteTablet for tablet 104fa933dbce4d8a934e827601c899a0 with delete_type TABLET_DATA_DELETED (replaced by tablet d019bac79b874559b718570d502c5a13) from {username='slave'} at 127.0.0.1:59498
I20260203 21:10:27.697510 2765 tablet_service.cc:1552] Processing DeleteTablet for tablet 104fa933dbce4d8a934e827601c899a0 with delete_type TABLET_DATA_DELETED (replaced by tablet d019bac79b874559b718570d502c5a13) from {username='slave'} at 127.0.0.1:59638
I20260203 21:10:27.698064 2902 tablet_service.cc:1552] Processing DeleteTablet for tablet 104fa933dbce4d8a934e827601c899a0 with delete_type TABLET_DATA_DELETED (replaced by tablet d019bac79b874559b718570d502c5a13) from {username='slave'} at 127.0.0.1:51086
I20260203 21:10:27.699550 2451 catalog_manager.cc:6724] ReplaceTablet: tablet 104fa933dbce4d8a934e827601c899a0 deleted and replaced by tablet d019bac79b874559b718570d502c5a13
I20260203 21:10:27.701684 3038 tablet_service.cc:1505] Processing CreateTablet for tablet d019bac79b874559b718570d502c5a13 (DEFAULT_TABLE table=default.table_ae3f050e71c94082b0e88a08167c762f [id=73eae179f2ad481d932a5b3c95b1a4ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:27.701941 3038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d019bac79b874559b718570d502c5a13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:27.702513 2451 master_service.cc:954] ReplaceTablet: received request to replace tablet ed7afe0e6dcf4431a60def7298184187 from {username='slave'} at 127.0.0.1:57540
I20260203 21:10:27.705866 2902 tablet_service.cc:1505] Processing CreateTablet for tablet d019bac79b874559b718570d502c5a13 (DEFAULT_TABLE table=default.table_ae3f050e71c94082b0e88a08167c762f [id=73eae179f2ad481d932a5b3c95b1a4ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:27.706125 2902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d019bac79b874559b718570d502c5a13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:27.706728 2451 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49: Sending DeleteTablet for 3 replicas of tablet ed7afe0e6dcf4431a60def7298184187
I20260203 21:10:27.707129 2764 tablet_service.cc:1552] Processing DeleteTablet for tablet ed7afe0e6dcf4431a60def7298184187 with delete_type TABLET_DATA_DELETED (replaced by tablet 20fec52d63a34162bb79805433de62c0) from {username='slave'} at 127.0.0.1:59638
I20260203 21:10:27.707542 2903 tablet_service.cc:1552] Processing DeleteTablet for tablet ed7afe0e6dcf4431a60def7298184187 with delete_type TABLET_DATA_DELETED (replaced by tablet 20fec52d63a34162bb79805433de62c0) from {username='slave'} at 127.0.0.1:51086
I20260203 21:10:27.708184 3037 tablet_service.cc:1552] Processing DeleteTablet for tablet ed7afe0e6dcf4431a60def7298184187 with delete_type TABLET_DATA_DELETED (replaced by tablet 20fec52d63a34162bb79805433de62c0) from {username='slave'} at 127.0.0.1:59498
I20260203 21:10:27.708825 2765 tablet_service.cc:1505] Processing CreateTablet for tablet d019bac79b874559b718570d502c5a13 (DEFAULT_TABLE table=default.table_ae3f050e71c94082b0e88a08167c762f [id=73eae179f2ad481d932a5b3c95b1a4ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:27.709074 2765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d019bac79b874559b718570d502c5a13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:27.712689 2785 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e3680015777647ba80d0b63661afdd8c" candidate_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02bdf326542e474cbe62434dd59087dc" is_pre_election: true
I20260203 21:10:27.712729 2903 tablet_service.cc:1505] Processing CreateTablet for tablet 20fec52d63a34162bb79805433de62c0 (DEFAULT_TABLE table=default.table_8276b49c70934289816f902b52d97652 [id=333213fed7234610bc20c7d92124182b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:27.712973 2903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20fec52d63a34162bb79805433de62c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:27.712970 2785 raft_consensus.cc:2468] T e3680015777647ba80d0b63661afdd8c P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d9e0cecab784cc0acc050ca1c89c5be in term 0.
I20260203 21:10:27.713398 2857 leader_election.cc:304] T e3680015777647ba80d0b63661afdd8c P 6d9e0cecab784cc0acc050ca1c89c5be [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc, 6d9e0cecab784cc0acc050ca1c89c5be; no voters:
I20260203 21:10:27.713418 2764 tablet_service.cc:1505] Processing CreateTablet for tablet 20fec52d63a34162bb79805433de62c0 (DEFAULT_TABLE table=default.table_8276b49c70934289816f902b52d97652 [id=333213fed7234610bc20c7d92124182b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:27.713629 2764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20fec52d63a34162bb79805433de62c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:27.713680 3284 raft_consensus.cc:2804] T e3680015777647ba80d0b63661afdd8c P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 21:10:27.713737 3284 raft_consensus.cc:493] T e3680015777647ba80d0b63661afdd8c P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 21:10:27.713773 3284 raft_consensus.cc:3060] T e3680015777647ba80d0b63661afdd8c P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:27.714962 3284 raft_consensus.cc:515] T e3680015777647ba80d0b63661afdd8c P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:27.715324 3284 leader_election.cc:290] T e3680015777647ba80d0b63661afdd8c P 6d9e0cecab784cc0acc050ca1c89c5be [CANDIDATE]: Term 1 election: Requested vote from peers 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223), 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335)
I20260203 21:10:27.715827 3289 raft_consensus.cc:493] T e3680015777647ba80d0b63661afdd8c P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 21:10:27.715962 3289 raft_consensus.cc:515] T e3680015777647ba80d0b63661afdd8c P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:27.715999 2785 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e3680015777647ba80d0b63661afdd8c" candidate_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02bdf326542e474cbe62434dd59087dc"
I20260203 21:10:27.716012 3037 tablet_service.cc:1505] Processing CreateTablet for tablet 20fec52d63a34162bb79805433de62c0 (DEFAULT_TABLE table=default.table_8276b49c70934289816f902b52d97652 [id=333213fed7234610bc20c7d92124182b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:27.716104 2785 raft_consensus.cc:3060] T e3680015777647ba80d0b63661afdd8c P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:27.716244 3037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20fec52d63a34162bb79805433de62c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:27.716446 2451 catalog_manager.cc:6724] ReplaceTablet: tablet ed7afe0e6dcf4431a60def7298184187 deleted and replaced by tablet 20fec52d63a34162bb79805433de62c0
I20260203 21:10:27.717056 2785 raft_consensus.cc:2468] T e3680015777647ba80d0b63661afdd8c P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d9e0cecab784cc0acc050ca1c89c5be in term 1.
I20260203 21:10:27.717463 3289 leader_election.cc:290] T e3680015777647ba80d0b63661afdd8c P 185c63f61a2645928eeb807d145026b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335)
I20260203 21:10:27.717738 2857 leader_election.cc:304] T e3680015777647ba80d0b63661afdd8c P 6d9e0cecab784cc0acc050ca1c89c5be [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc, 6d9e0cecab784cc0acc050ca1c89c5be; no voters:
I20260203 21:10:27.718004 3284 raft_consensus.cc:2804] T e3680015777647ba80d0b63661afdd8c P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 FOLLOWER]: Leader election won for term 1
I20260203 21:10:27.718137 2451 master_service.cc:954] ReplaceTablet: received request to replace tablet ed7afe0e6dcf4431a60def7298184187 from {username='slave'} at 127.0.0.1:57540
I20260203 21:10:27.718199 3284 raft_consensus.cc:697] T e3680015777647ba80d0b63661afdd8c P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 LEADER]: Becoming Leader. State: Replica: 6d9e0cecab784cc0acc050ca1c89c5be, State: Running, Role: LEADER
I20260203 21:10:27.718286 3281 tablet_bootstrap.cc:492] T 20fec52d63a34162bb79805433de62c0 P 185c63f61a2645928eeb807d145026b1: Bootstrap starting.
I20260203 21:10:27.718490 3284 consensus_queue.cc:237] T e3680015777647ba80d0b63661afdd8c P 6d9e0cecab784cc0acc050ca1c89c5be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:27.718752 2451 master_service.cc:954] ReplaceTablet: received request to replace tablet e3680015777647ba80d0b63661afdd8c from {username='slave'} at 127.0.0.1:57540
I20260203 21:10:27.719213 3281 tablet_bootstrap.cc:654] T 20fec52d63a34162bb79805433de62c0 P 185c63f61a2645928eeb807d145026b1: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:27.722115 3280 tablet_bootstrap.cc:492] T c45683f20a454401bfb90b41570b5125 P 6d9e0cecab784cc0acc050ca1c89c5be: No bootstrap required, opened a new log
I20260203 21:10:27.722201 3280 ts_tablet_manager.cc:1403] T c45683f20a454401bfb90b41570b5125 P 6d9e0cecab784cc0acc050ca1c89c5be: Time spent bootstrapping tablet: real 0.036s user 0.002s sys 0.000s
I20260203 21:10:27.722630 3280 raft_consensus.cc:359] T c45683f20a454401bfb90b41570b5125 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:27.722723 3280 raft_consensus.cc:385] T c45683f20a454401bfb90b41570b5125 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:27.722767 3280 raft_consensus.cc:740] T c45683f20a454401bfb90b41570b5125 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d9e0cecab784cc0acc050ca1c89c5be, State: Initialized, Role: FOLLOWER
I20260203 21:10:27.722869 3280 consensus_queue.cc:260] T c45683f20a454401bfb90b41570b5125 P 6d9e0cecab784cc0acc050ca1c89c5be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:27.723114 3280 ts_tablet_manager.cc:1434] T c45683f20a454401bfb90b41570b5125 P 6d9e0cecab784cc0acc050ca1c89c5be: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260203 21:10:27.723274 3280 tablet_bootstrap.cc:492] T 20fec52d63a34162bb79805433de62c0 P 6d9e0cecab784cc0acc050ca1c89c5be: Bootstrap starting.
I20260203 21:10:27.724248 3280 tablet_bootstrap.cc:654] T 20fec52d63a34162bb79805433de62c0 P 6d9e0cecab784cc0acc050ca1c89c5be: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:27.725723 3297 tablet_replica.cc:333] T 104fa933dbce4d8a934e827601c899a0 P 6d9e0cecab784cc0acc050ca1c89c5be: stopping tablet replica
I20260203 21:10:27.726035 3297 raft_consensus.cc:2243] T 104fa933dbce4d8a934e827601c899a0 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Raft consensus shutting down.
I20260203 21:10:27.727435 3281 tablet_bootstrap.cc:492] T 20fec52d63a34162bb79805433de62c0 P 185c63f61a2645928eeb807d145026b1: No bootstrap required, opened a new log
I20260203 21:10:27.727535 3281 ts_tablet_manager.cc:1403] T 20fec52d63a34162bb79805433de62c0 P 185c63f61a2645928eeb807d145026b1: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.002s
I20260203 21:10:27.728004 3281 raft_consensus.cc:359] T 20fec52d63a34162bb79805433de62c0 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:27.728099 3281 raft_consensus.cc:385] T 20fec52d63a34162bb79805433de62c0 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:27.728129 3281 raft_consensus.cc:740] T 20fec52d63a34162bb79805433de62c0 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 185c63f61a2645928eeb807d145026b1, State: Initialized, Role: FOLLOWER
I20260203 21:10:27.728243 3281 consensus_queue.cc:260] T 20fec52d63a34162bb79805433de62c0 P 185c63f61a2645928eeb807d145026b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:27.728281 3297 raft_consensus.cc:2272] T 104fa933dbce4d8a934e827601c899a0 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Raft consensus is shut down!
I20260203 21:10:27.728533 3281 ts_tablet_manager.cc:1434] T 20fec52d63a34162bb79805433de62c0 P 185c63f61a2645928eeb807d145026b1: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260203 21:10:27.729152 3281 tablet_bootstrap.cc:492] T c45683f20a454401bfb90b41570b5125 P 185c63f61a2645928eeb807d145026b1: Bootstrap starting.
I20260203 21:10:27.727310 2923 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e3680015777647ba80d0b63661afdd8c" candidate_uuid: "185c63f61a2645928eeb807d145026b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" is_pre_election: true
W20260203 21:10:27.729918 3108 tablet.cc:2378] T 104fa933dbce4d8a934e827601c899a0 P 185c63f61a2645928eeb807d145026b1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260203 21:10:27.730960 3281 tablet_bootstrap.cc:654] T c45683f20a454401bfb90b41570b5125 P 185c63f61a2645928eeb807d145026b1: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:27.731245 3297 ts_tablet_manager.cc:1916] T 104fa933dbce4d8a934e827601c899a0 P 6d9e0cecab784cc0acc050ca1c89c5be: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260203 21:10:27.732228 3059 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e3680015777647ba80d0b63661afdd8c" candidate_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "185c63f61a2645928eeb807d145026b1" is_pre_election: true
I20260203 21:10:27.732395 3059 raft_consensus.cc:2468] T e3680015777647ba80d0b63661afdd8c P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d9e0cecab784cc0acc050ca1c89c5be in term 0.
I20260203 21:10:27.732635 3058 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e3680015777647ba80d0b63661afdd8c" candidate_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "185c63f61a2645928eeb807d145026b1"
I20260203 21:10:27.732728 3058 raft_consensus.cc:3060] T e3680015777647ba80d0b63661afdd8c P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:27.733877 3058 raft_consensus.cc:2468] T e3680015777647ba80d0b63661afdd8c P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d9e0cecab784cc0acc050ca1c89c5be in term 1.
I20260203 21:10:27.734946 3297 ts_tablet_manager.cc:1929] T 104fa933dbce4d8a934e827601c899a0 P 6d9e0cecab784cc0acc050ca1c89c5be: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260203 21:10:27.735069 3297 log.cc:1199] T 104fa933dbce4d8a934e827601c899a0 P 6d9e0cecab784cc0acc050ca1c89c5be: Deleting WAL directory at /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-1/wal/wals/104fa933dbce4d8a934e827601c899a0
I20260203 21:10:27.735364 3297 ts_tablet_manager.cc:1950] T 104fa933dbce4d8a934e827601c899a0 P 6d9e0cecab784cc0acc050ca1c89c5be: Deleting consensus metadata
I20260203 21:10:27.735455 2785 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e3680015777647ba80d0b63661afdd8c" candidate_uuid: "185c63f61a2645928eeb807d145026b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02bdf326542e474cbe62434dd59087dc" is_pre_election: true
I20260203 21:10:27.735675 2785 raft_consensus.cc:2393] T e3680015777647ba80d0b63661afdd8c P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 185c63f61a2645928eeb807d145026b1 in current term 1: Already voted for candidate 6d9e0cecab784cc0acc050ca1c89c5be in this term.
I20260203 21:10:27.736127 3278 tablet_bootstrap.cc:492] T c45683f20a454401bfb90b41570b5125 P 02bdf326542e474cbe62434dd59087dc: Bootstrap starting.
I20260203 21:10:27.736271 2993 leader_election.cc:304] T e3680015777647ba80d0b63661afdd8c P 185c63f61a2645928eeb807d145026b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 185c63f61a2645928eeb807d145026b1; no voters: 02bdf326542e474cbe62434dd59087dc, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:10:27.736488 3297 tablet_replica.cc:333] T ed7afe0e6dcf4431a60def7298184187 P 6d9e0cecab784cc0acc050ca1c89c5be: stopping tablet replica
I20260203 21:10:27.736596 3297 raft_consensus.cc:2243] T ed7afe0e6dcf4431a60def7298184187 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Raft consensus shutting down.
I20260203 21:10:27.736673 3297 raft_consensus.cc:2272] T ed7afe0e6dcf4431a60def7298184187 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Raft consensus is shut down!
I20260203 21:10:27.736790 2439 catalog_manager.cc:4985] TS 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): tablet 104fa933dbce4d8a934e827601c899a0 (table default.table_ae3f050e71c94082b0e88a08167c762f [id=73eae179f2ad481d932a5b3c95b1a4ab]) successfully deleted
I20260203 21:10:27.737027 3289 raft_consensus.cc:2749] T e3680015777647ba80d0b63661afdd8c P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 21:10:27.737051 3297 ts_tablet_manager.cc:1916] T ed7afe0e6dcf4431a60def7298184187 P 6d9e0cecab784cc0acc050ca1c89c5be: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260203 21:10:27.737151 3278 tablet_bootstrap.cc:654] T c45683f20a454401bfb90b41570b5125 P 02bdf326542e474cbe62434dd59087dc: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:27.737922 2451 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49: Sending DeleteTablet for 3 replicas of tablet e3680015777647ba80d0b63661afdd8c
I20260203 21:10:27.738452 3038 tablet_service.cc:1552] Processing DeleteTablet for tablet e3680015777647ba80d0b63661afdd8c with delete_type TABLET_DATA_DELETED (replaced by tablet 7786ef435bbd44daae12d3ee4728efb9) from {username='slave'} at 127.0.0.1:59498
I20260203 21:10:27.738600 3280 tablet_bootstrap.cc:492] T 20fec52d63a34162bb79805433de62c0 P 6d9e0cecab784cc0acc050ca1c89c5be: No bootstrap required, opened a new log
I20260203 21:10:27.738672 3280 ts_tablet_manager.cc:1403] T 20fec52d63a34162bb79805433de62c0 P 6d9e0cecab784cc0acc050ca1c89c5be: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.000s
I20260203 21:10:27.738885 3297 ts_tablet_manager.cc:1929] T ed7afe0e6dcf4431a60def7298184187 P 6d9e0cecab784cc0acc050ca1c89c5be: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260203 21:10:27.738945 3297 log.cc:1199] T ed7afe0e6dcf4431a60def7298184187 P 6d9e0cecab784cc0acc050ca1c89c5be: Deleting WAL directory at /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-1/wal/wals/ed7afe0e6dcf4431a60def7298184187
I20260203 21:10:27.739063 2765 tablet_service.cc:1552] Processing DeleteTablet for tablet e3680015777647ba80d0b63661afdd8c with delete_type TABLET_DATA_DELETED (replaced by tablet 7786ef435bbd44daae12d3ee4728efb9) from {username='slave'} at 127.0.0.1:59638
I20260203 21:10:27.739123 3297 ts_tablet_manager.cc:1950] T ed7afe0e6dcf4431a60def7298184187 P 6d9e0cecab784cc0acc050ca1c89c5be: Deleting consensus metadata
I20260203 21:10:27.739097 3280 raft_consensus.cc:359] T 20fec52d63a34162bb79805433de62c0 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:27.739179 3280 raft_consensus.cc:385] T 20fec52d63a34162bb79805433de62c0 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:27.739194 2451 catalog_manager.cc:6724] ReplaceTablet: tablet e3680015777647ba80d0b63661afdd8c deleted and replaced by tablet 7786ef435bbd44daae12d3ee4728efb9
I20260203 21:10:27.739208 3280 raft_consensus.cc:740] T 20fec52d63a34162bb79805433de62c0 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d9e0cecab784cc0acc050ca1c89c5be, State: Initialized, Role: FOLLOWER
I20260203 21:10:27.739313 3280 consensus_queue.cc:260] T 20fec52d63a34162bb79805433de62c0 P 6d9e0cecab784cc0acc050ca1c89c5be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:27.739594 3280 ts_tablet_manager.cc:1434] T 20fec52d63a34162bb79805433de62c0 P 6d9e0cecab784cc0acc050ca1c89c5be: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260203 21:10:27.739817 3280 tablet_bootstrap.cc:492] T d019bac79b874559b718570d502c5a13 P 6d9e0cecab784cc0acc050ca1c89c5be: Bootstrap starting.
I20260203 21:10:27.740758 3280 tablet_bootstrap.cc:654] T d019bac79b874559b718570d502c5a13 P 6d9e0cecab784cc0acc050ca1c89c5be: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:27.740893 2451 master_service.cc:954] ReplaceTablet: received request to replace tablet ed7afe0e6dcf4431a60def7298184187 from {username='slave'} at 127.0.0.1:57540
I20260203 21:10:27.741451 2902 tablet_service.cc:1552] Processing DeleteTablet for tablet e3680015777647ba80d0b63661afdd8c with delete_type TABLET_DATA_DELETED (replaced by tablet 7786ef435bbd44daae12d3ee4728efb9) from {username='slave'} at 127.0.0.1:51086
I20260203 21:10:27.743716 3281 tablet_bootstrap.cc:492] T c45683f20a454401bfb90b41570b5125 P 185c63f61a2645928eeb807d145026b1: No bootstrap required, opened a new log
I20260203 21:10:27.743794 3281 ts_tablet_manager.cc:1403] T c45683f20a454401bfb90b41570b5125 P 185c63f61a2645928eeb807d145026b1: Time spent bootstrapping tablet: real 0.015s user 0.000s sys 0.002s
I20260203 21:10:27.744208 3281 raft_consensus.cc:359] T c45683f20a454401bfb90b41570b5125 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:27.744294 3281 raft_consensus.cc:385] T c45683f20a454401bfb90b41570b5125 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:27.744321 3281 raft_consensus.cc:740] T c45683f20a454401bfb90b41570b5125 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 185c63f61a2645928eeb807d145026b1, State: Initialized, Role: FOLLOWER
I20260203 21:10:27.744414 3281 consensus_queue.cc:260] T c45683f20a454401bfb90b41570b5125 P 185c63f61a2645928eeb807d145026b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:27.745767 3038 tablet_service.cc:1505] Processing CreateTablet for tablet 7786ef435bbd44daae12d3ee4728efb9 (DEFAULT_TABLE table=default.table_1d3ace06028643bba1fbb9d430213ff5 [id=a995c742bb2942838a2385b05a4d4d57]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:27.746006 3038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7786ef435bbd44daae12d3ee4728efb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:27.746613 3281 ts_tablet_manager.cc:1434] T c45683f20a454401bfb90b41570b5125 P 185c63f61a2645928eeb807d145026b1: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
I20260203 21:10:27.747689 2447 catalog_manager.cc:2174] created HMS catalog entry for table [id=d3ee372fbea0402796f488b9f48638b9]
I20260203 21:10:27.747800 3281 tablet_bootstrap.cc:492] T d019bac79b874559b718570d502c5a13 P 185c63f61a2645928eeb807d145026b1: Bootstrap starting.
I20260203 21:10:27.748584 2902 tablet_service.cc:1505] Processing CreateTablet for tablet 7786ef435bbd44daae12d3ee4728efb9 (DEFAULT_TABLE table=default.table_1d3ace06028643bba1fbb9d430213ff5 [id=a995c742bb2942838a2385b05a4d4d57]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:27.748739 3281 tablet_bootstrap.cc:654] T d019bac79b874559b718570d502c5a13 P 185c63f61a2645928eeb807d145026b1: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:27.748850 2902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7786ef435bbd44daae12d3ee4728efb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:27.749399 3295 tablet_replica.cc:333] T 104fa933dbce4d8a934e827601c899a0 P 185c63f61a2645928eeb807d145026b1: stopping tablet replica
I20260203 21:10:27.749904 3295 raft_consensus.cc:2243] T 104fa933dbce4d8a934e827601c899a0 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260203 21:10:27.750305 3280 tablet_bootstrap.cc:492] T d019bac79b874559b718570d502c5a13 P 6d9e0cecab784cc0acc050ca1c89c5be: No bootstrap required, opened a new log
I20260203 21:10:27.750382 3280 ts_tablet_manager.cc:1403] T d019bac79b874559b718570d502c5a13 P 6d9e0cecab784cc0acc050ca1c89c5be: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.000s
I20260203 21:10:27.750983 2765 tablet_service.cc:1505] Processing CreateTablet for tablet 7786ef435bbd44daae12d3ee4728efb9 (DEFAULT_TABLE table=default.table_1d3ace06028643bba1fbb9d430213ff5 [id=a995c742bb2942838a2385b05a4d4d57]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:27.751029 3280 raft_consensus.cc:359] T d019bac79b874559b718570d502c5a13 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:27.751129 3280 raft_consensus.cc:385] T d019bac79b874559b718570d502c5a13 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:27.751158 3280 raft_consensus.cc:740] T d019bac79b874559b718570d502c5a13 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d9e0cecab784cc0acc050ca1c89c5be, State: Initialized, Role: FOLLOWER
I20260203 21:10:27.751240 2765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7786ef435bbd44daae12d3ee4728efb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:27.751262 3280 consensus_queue.cc:260] T d019bac79b874559b718570d502c5a13 P 6d9e0cecab784cc0acc050ca1c89c5be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:27.751489 3280 ts_tablet_manager.cc:1434] T d019bac79b874559b718570d502c5a13 P 6d9e0cecab784cc0acc050ca1c89c5be: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260203 21:10:27.751678 3280 tablet_bootstrap.cc:492] T 7786ef435bbd44daae12d3ee4728efb9 P 6d9e0cecab784cc0acc050ca1c89c5be: Bootstrap starting.
I20260203 21:10:27.752540 3280 tablet_bootstrap.cc:654] T 7786ef435bbd44daae12d3ee4728efb9 P 6d9e0cecab784cc0acc050ca1c89c5be: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:27.753057 2447 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57540:
table { table_name: "default.Table_42d2deb9edf04a3b8ce372f18fff2cf1" } modify_external_catalogs: true
I20260203 21:10:27.753177 2447 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57540:
table { table_name: "default.Table_42d2deb9edf04a3b8ce372f18fff2cf1" } modify_external_catalogs: true
I20260203 21:10:27.755556 3296 tablet_replica.cc:333] T 104fa933dbce4d8a934e827601c899a0 P 02bdf326542e474cbe62434dd59087dc: stopping tablet replica
I20260203 21:10:27.755868 3295 raft_consensus.cc:2272] T 104fa933dbce4d8a934e827601c899a0 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260203 21:10:27.756201 3296 raft_consensus.cc:2243] T 104fa933dbce4d8a934e827601c899a0 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Raft consensus shutting down.
I20260203 21:10:27.756675 3296 raft_consensus.cc:2272] T 104fa933dbce4d8a934e827601c899a0 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Raft consensus is shut down!
I20260203 21:10:27.757644 3295 ts_tablet_manager.cc:1916] T 104fa933dbce4d8a934e827601c899a0 P 185c63f61a2645928eeb807d145026b1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260203 21:10:27.758245 3278 tablet_bootstrap.cc:492] T c45683f20a454401bfb90b41570b5125 P 02bdf326542e474cbe62434dd59087dc: No bootstrap required, opened a new log
I20260203 21:10:27.758517 3278 ts_tablet_manager.cc:1403] T c45683f20a454401bfb90b41570b5125 P 02bdf326542e474cbe62434dd59087dc: Time spent bootstrapping tablet: real 0.022s user 0.001s sys 0.000s
I20260203 21:10:27.758993 3278 raft_consensus.cc:359] T c45683f20a454401bfb90b41570b5125 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:27.759146 3278 raft_consensus.cc:385] T c45683f20a454401bfb90b41570b5125 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:27.759222 3278 raft_consensus.cc:740] T c45683f20a454401bfb90b41570b5125 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02bdf326542e474cbe62434dd59087dc, State: Initialized, Role: FOLLOWER
I20260203 21:10:27.759485 3278 consensus_queue.cc:260] T c45683f20a454401bfb90b41570b5125 P 02bdf326542e474cbe62434dd59087dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:27.761802 3278 ts_tablet_manager.cc:1434] T c45683f20a454401bfb90b41570b5125 P 02bdf326542e474cbe62434dd59087dc: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260203 21:10:27.762665 2902 tablet_service.cc:1505] Processing CreateTablet for tablet 930cb06bcbca41e08ac12d60a0d3b6cb (DEFAULT_TABLE table=default.table_8695f3c31a784599917744b6d57e2a18 [id=d3ee372fbea0402796f488b9f48638b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:27.762946 2902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 930cb06bcbca41e08ac12d60a0d3b6cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:27.763197 2765 tablet_service.cc:1505] Processing CreateTablet for tablet 930cb06bcbca41e08ac12d60a0d3b6cb (DEFAULT_TABLE table=default.table_8695f3c31a784599917744b6d57e2a18 [id=d3ee372fbea0402796f488b9f48638b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:27.764109 3297 tablet_replica.cc:333] T e3680015777647ba80d0b63661afdd8c P 6d9e0cecab784cc0acc050ca1c89c5be: stopping tablet replica
I20260203 21:10:27.764216 3297 raft_consensus.cc:2243] T e3680015777647ba80d0b63661afdd8c P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 LEADER]: Raft consensus shutting down.
I20260203 21:10:27.764267 2439 catalog_manager.cc:4985] TS 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): tablet ed7afe0e6dcf4431a60def7298184187 (table default.table_8276b49c70934289816f902b52d97652 [id=333213fed7234610bc20c7d92124182b]) successfully deleted
I20260203 21:10:27.764413 3297 pending_rounds.cc:70] T e3680015777647ba80d0b63661afdd8c P 6d9e0cecab784cc0acc050ca1c89c5be: Trying to abort 1 pending ops.
I20260203 21:10:27.763417 3278 tablet_bootstrap.cc:492] T d019bac79b874559b718570d502c5a13 P 02bdf326542e474cbe62434dd59087dc: Bootstrap starting.
I20260203 21:10:27.764567 2765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 930cb06bcbca41e08ac12d60a0d3b6cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:27.765362 3297 pending_rounds.cc:77] T e3680015777647ba80d0b63661afdd8c P 6d9e0cecab784cc0acc050ca1c89c5be: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7250546801537531904 op_type: NO_OP noop_request { }
I20260203 21:10:27.765511 3297 raft_consensus.cc:2889] T e3680015777647ba80d0b63661afdd8c P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260203 21:10:27.765864 3278 tablet_bootstrap.cc:654] T d019bac79b874559b718570d502c5a13 P 02bdf326542e474cbe62434dd59087dc: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:27.762404 3039 tablet_service.cc:1505] Processing CreateTablet for tablet 930cb06bcbca41e08ac12d60a0d3b6cb (DEFAULT_TABLE table=default.table_8695f3c31a784599917744b6d57e2a18 [id=d3ee372fbea0402796f488b9f48638b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:27.766571 3039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 930cb06bcbca41e08ac12d60a0d3b6cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:27.767393 3297 raft_consensus.cc:2272] T e3680015777647ba80d0b63661afdd8c P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 21:10:27.766471 3298 raft_consensus.cc:493] T c45683f20a454401bfb90b41570b5125 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 21:10:27.767537 3298 raft_consensus.cc:515] T c45683f20a454401bfb90b41570b5125 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:27.765005 3281 tablet_bootstrap.cc:492] T d019bac79b874559b718570d502c5a13 P 185c63f61a2645928eeb807d145026b1: No bootstrap required, opened a new log
I20260203 21:10:27.768177 2785 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c45683f20a454401bfb90b41570b5125" candidate_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02bdf326542e474cbe62434dd59087dc" is_pre_election: true
I20260203 21:10:27.768282 3281 ts_tablet_manager.cc:1403] T d019bac79b874559b718570d502c5a13 P 185c63f61a2645928eeb807d145026b1: Time spent bootstrapping tablet: real 0.021s user 0.000s sys 0.002s
I20260203 21:10:27.768298 2785 raft_consensus.cc:2468] T c45683f20a454401bfb90b41570b5125 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d9e0cecab784cc0acc050ca1c89c5be in term 0.
I20260203 21:10:27.768582 2857 leader_election.cc:304] T c45683f20a454401bfb90b41570b5125 P 6d9e0cecab784cc0acc050ca1c89c5be [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc, 6d9e0cecab784cc0acc050ca1c89c5be; no voters:
I20260203 21:10:27.768744 3284 raft_consensus.cc:2804] T c45683f20a454401bfb90b41570b5125 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 21:10:27.768790 3284 raft_consensus.cc:493] T c45683f20a454401bfb90b41570b5125 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 21:10:27.768826 3284 raft_consensus.cc:3060] T c45683f20a454401bfb90b41570b5125 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:27.768834 3281 raft_consensus.cc:359] T d019bac79b874559b718570d502c5a13 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:27.768920 3281 raft_consensus.cc:385] T d019bac79b874559b718570d502c5a13 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:27.768950 3281 raft_consensus.cc:740] T d019bac79b874559b718570d502c5a13 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 185c63f61a2645928eeb807d145026b1, State: Initialized, Role: FOLLOWER
I20260203 21:10:27.769542 3281 consensus_queue.cc:260] T d019bac79b874559b718570d502c5a13 P 185c63f61a2645928eeb807d145026b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:27.769635 3284 raft_consensus.cc:515] T c45683f20a454401bfb90b41570b5125 P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:27.769950 3284 leader_election.cc:290] T c45683f20a454401bfb90b41570b5125 P 6d9e0cecab784cc0acc050ca1c89c5be [CANDIDATE]: Term 1 election: Requested vote from peers 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
I20260203 21:10:27.770438 3058 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c45683f20a454401bfb90b41570b5125" candidate_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "185c63f61a2645928eeb807d145026b1"
I20260203 21:10:27.770493 2785 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c45683f20a454401bfb90b41570b5125" candidate_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02bdf326542e474cbe62434dd59087dc"
I20260203 21:10:27.770547 3058 raft_consensus.cc:3060] T c45683f20a454401bfb90b41570b5125 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:27.770594 2785 raft_consensus.cc:3060] T c45683f20a454401bfb90b41570b5125 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:27.771286 3058 raft_consensus.cc:2468] T c45683f20a454401bfb90b41570b5125 P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d9e0cecab784cc0acc050ca1c89c5be in term 1.
I20260203 21:10:27.771428 2785 raft_consensus.cc:2468] T c45683f20a454401bfb90b41570b5125 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d9e0cecab784cc0acc050ca1c89c5be in term 1.
I20260203 21:10:27.771572 2858 leader_election.cc:304] T c45683f20a454401bfb90b41570b5125 P 6d9e0cecab784cc0acc050ca1c89c5be [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be; no voters:
I20260203 21:10:27.771795 3284 raft_consensus.cc:2804] T c45683f20a454401bfb90b41570b5125 P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 FOLLOWER]: Leader election won for term 1
I20260203 21:10:27.771966 3284 raft_consensus.cc:697] T c45683f20a454401bfb90b41570b5125 P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 LEADER]: Becoming Leader. State: Replica: 6d9e0cecab784cc0acc050ca1c89c5be, State: Running, Role: LEADER
I20260203 21:10:27.772086 3284 consensus_queue.cc:237] T c45683f20a454401bfb90b41570b5125 P 6d9e0cecab784cc0acc050ca1c89c5be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:27.772140 3058 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c45683f20a454401bfb90b41570b5125" candidate_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "185c63f61a2645928eeb807d145026b1" is_pre_election: true
I20260203 21:10:27.772248 3058 raft_consensus.cc:2376] T c45683f20a454401bfb90b41570b5125 P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6d9e0cecab784cc0acc050ca1c89c5be in term 1. Re-sending same reply.
I20260203 21:10:27.772457 3281 ts_tablet_manager.cc:1434] T d019bac79b874559b718570d502c5a13 P 185c63f61a2645928eeb807d145026b1: Time spent starting tablet: real 0.004s user 0.000s sys 0.001s
I20260203 21:10:27.772552 3298 leader_election.cc:290] T c45683f20a454401bfb90b41570b5125 P 6d9e0cecab784cc0acc050ca1c89c5be [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
I20260203 21:10:27.774063 3297 ts_tablet_manager.cc:1916] T e3680015777647ba80d0b63661afdd8c P 6d9e0cecab784cc0acc050ca1c89c5be: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260203 21:10:27.774117 3281 tablet_bootstrap.cc:492] T 7786ef435bbd44daae12d3ee4728efb9 P 185c63f61a2645928eeb807d145026b1: Bootstrap starting.
I20260203 21:10:27.774950 3281 tablet_bootstrap.cc:654] T 7786ef435bbd44daae12d3ee4728efb9 P 185c63f61a2645928eeb807d145026b1: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:27.764293 3296 ts_tablet_manager.cc:1916] T 104fa933dbce4d8a934e827601c899a0 P 02bdf326542e474cbe62434dd59087dc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260203 21:10:27.775944 3281 tablet_bootstrap.cc:492] T 7786ef435bbd44daae12d3ee4728efb9 P 185c63f61a2645928eeb807d145026b1: No bootstrap required, opened a new log
I20260203 21:10:27.776034 3281 ts_tablet_manager.cc:1403] T 7786ef435bbd44daae12d3ee4728efb9 P 185c63f61a2645928eeb807d145026b1: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20260203 21:10:27.776479 3281 raft_consensus.cc:359] T 7786ef435bbd44daae12d3ee4728efb9 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:27.776571 3281 raft_consensus.cc:385] T 7786ef435bbd44daae12d3ee4728efb9 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:27.776602 3281 raft_consensus.cc:740] T 7786ef435bbd44daae12d3ee4728efb9 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 185c63f61a2645928eeb807d145026b1, State: Initialized, Role: FOLLOWER
I20260203 21:10:27.776700 3281 consensus_queue.cc:260] T 7786ef435bbd44daae12d3ee4728efb9 P 185c63f61a2645928eeb807d145026b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:27.776942 3281 ts_tablet_manager.cc:1434] T 7786ef435bbd44daae12d3ee4728efb9 P 185c63f61a2645928eeb807d145026b1: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260203 21:10:27.777117 3281 tablet_bootstrap.cc:492] T 930cb06bcbca41e08ac12d60a0d3b6cb P 185c63f61a2645928eeb807d145026b1: Bootstrap starting.
I20260203 21:10:27.777818 3280 tablet_bootstrap.cc:492] T 7786ef435bbd44daae12d3ee4728efb9 P 6d9e0cecab784cc0acc050ca1c89c5be: No bootstrap required, opened a new log
I20260203 21:10:27.777890 3280 ts_tablet_manager.cc:1403] T 7786ef435bbd44daae12d3ee4728efb9 P 6d9e0cecab784cc0acc050ca1c89c5be: Time spent bootstrapping tablet: real 0.026s user 0.001s sys 0.000s
I20260203 21:10:27.777964 3281 tablet_bootstrap.cc:654] T 930cb06bcbca41e08ac12d60a0d3b6cb P 185c63f61a2645928eeb807d145026b1: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:27.778191 3297 ts_tablet_manager.cc:1929] T e3680015777647ba80d0b63661afdd8c P 6d9e0cecab784cc0acc050ca1c89c5be: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260203 21:10:27.778959 2451 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57540:
table { table_name: "default.Table_8695f3c31a784599917744b6d57e2a18" } modify_external_catalogs: true
I20260203 21:10:27.779129 3297 log.cc:1199] T e3680015777647ba80d0b63661afdd8c P 6d9e0cecab784cc0acc050ca1c89c5be: Deleting WAL directory at /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-1/wal/wals/e3680015777647ba80d0b63661afdd8c
I20260203 21:10:27.778303 3280 raft_consensus.cc:359] T 7786ef435bbd44daae12d3ee4728efb9 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:27.779265 3280 raft_consensus.cc:385] T 7786ef435bbd44daae12d3ee4728efb9 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:27.779313 3280 raft_consensus.cc:740] T 7786ef435bbd44daae12d3ee4728efb9 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d9e0cecab784cc0acc050ca1c89c5be, State: Initialized, Role: FOLLOWER
I20260203 21:10:27.779403 3297 ts_tablet_manager.cc:1950] T e3680015777647ba80d0b63661afdd8c P 6d9e0cecab784cc0acc050ca1c89c5be: Deleting consensus metadata
I20260203 21:10:27.779422 3280 consensus_queue.cc:260] T 7786ef435bbd44daae12d3ee4728efb9 P 6d9e0cecab784cc0acc050ca1c89c5be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:27.779697 3280 ts_tablet_manager.cc:1434] T 7786ef435bbd44daae12d3ee4728efb9 P 6d9e0cecab784cc0acc050ca1c89c5be: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260203 21:10:27.779862 3280 tablet_bootstrap.cc:492] T 930cb06bcbca41e08ac12d60a0d3b6cb P 6d9e0cecab784cc0acc050ca1c89c5be: Bootstrap starting.
I20260203 21:10:27.780012 2451 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57540:
table { table_name: "default.Table_8695f3c31a784599917744b6d57e2a18" } modify_external_catalogs: true
I20260203 21:10:27.780246 2439 catalog_manager.cc:4985] TS 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): tablet e3680015777647ba80d0b63661afdd8c (table default.table_1d3ace06028643bba1fbb9d430213ff5 [id=a995c742bb2942838a2385b05a4d4d57]) successfully deleted
I20260203 21:10:27.780689 3280 tablet_bootstrap.cc:654] T 930cb06bcbca41e08ac12d60a0d3b6cb P 6d9e0cecab784cc0acc050ca1c89c5be: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:27.781483 3280 tablet_bootstrap.cc:492] T 930cb06bcbca41e08ac12d60a0d3b6cb P 6d9e0cecab784cc0acc050ca1c89c5be: No bootstrap required, opened a new log
I20260203 21:10:27.781548 3280 ts_tablet_manager.cc:1403] T 930cb06bcbca41e08ac12d60a0d3b6cb P 6d9e0cecab784cc0acc050ca1c89c5be: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260203 21:10:27.782299 3280 raft_consensus.cc:359] T 930cb06bcbca41e08ac12d60a0d3b6cb P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:27.782388 3280 raft_consensus.cc:385] T 930cb06bcbca41e08ac12d60a0d3b6cb P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:27.782418 3280 raft_consensus.cc:740] T 930cb06bcbca41e08ac12d60a0d3b6cb P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d9e0cecab784cc0acc050ca1c89c5be, State: Initialized, Role: FOLLOWER
I20260203 21:10:27.782536 3280 consensus_queue.cc:260] T 930cb06bcbca41e08ac12d60a0d3b6cb P 6d9e0cecab784cc0acc050ca1c89c5be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:27.782855 3280 ts_tablet_manager.cc:1434] T 930cb06bcbca41e08ac12d60a0d3b6cb P 6d9e0cecab784cc0acc050ca1c89c5be: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260203 21:10:27.784786 3295 ts_tablet_manager.cc:1929] T 104fa933dbce4d8a934e827601c899a0 P 185c63f61a2645928eeb807d145026b1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260203 21:10:27.786013 3296 ts_tablet_manager.cc:1929] T 104fa933dbce4d8a934e827601c899a0 P 02bdf326542e474cbe62434dd59087dc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260203 21:10:27.786094 3296 log.cc:1199] T 104fa933dbce4d8a934e827601c899a0 P 02bdf326542e474cbe62434dd59087dc: Deleting WAL directory at /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-0/wal/wals/104fa933dbce4d8a934e827601c899a0
I20260203 21:10:27.786190 3295 log.cc:1199] T 104fa933dbce4d8a934e827601c899a0 P 185c63f61a2645928eeb807d145026b1: Deleting WAL directory at /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-2/wal/wals/104fa933dbce4d8a934e827601c899a0
I20260203 21:10:27.786417 3295 ts_tablet_manager.cc:1950] T 104fa933dbce4d8a934e827601c899a0 P 185c63f61a2645928eeb807d145026b1: Deleting consensus metadata
I20260203 21:10:27.787393 2438 catalog_manager.cc:4985] TS 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): tablet 104fa933dbce4d8a934e827601c899a0 (table default.table_ae3f050e71c94082b0e88a08167c762f [id=73eae179f2ad481d932a5b3c95b1a4ab]) successfully deleted
I20260203 21:10:27.788467 3278 tablet_bootstrap.cc:492] T d019bac79b874559b718570d502c5a13 P 02bdf326542e474cbe62434dd59087dc: No bootstrap required, opened a new log
I20260203 21:10:27.788619 3278 ts_tablet_manager.cc:1403] T d019bac79b874559b718570d502c5a13 P 02bdf326542e474cbe62434dd59087dc: Time spent bootstrapping tablet: real 0.025s user 0.002s sys 0.000s
I20260203 21:10:27.789069 3278 raft_consensus.cc:359] T d019bac79b874559b718570d502c5a13 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:27.789155 3278 raft_consensus.cc:385] T d019bac79b874559b718570d502c5a13 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:27.789168 3281 tablet_bootstrap.cc:492] T 930cb06bcbca41e08ac12d60a0d3b6cb P 185c63f61a2645928eeb807d145026b1: No bootstrap required, opened a new log
I20260203 21:10:27.789184 3278 raft_consensus.cc:740] T d019bac79b874559b718570d502c5a13 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02bdf326542e474cbe62434dd59087dc, State: Initialized, Role: FOLLOWER
I20260203 21:10:27.789252 3281 ts_tablet_manager.cc:1403] T 930cb06bcbca41e08ac12d60a0d3b6cb P 185c63f61a2645928eeb807d145026b1: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.000s
I20260203 21:10:27.789299 3278 consensus_queue.cc:260] T d019bac79b874559b718570d502c5a13 P 02bdf326542e474cbe62434dd59087dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:27.789651 3281 raft_consensus.cc:359] T 930cb06bcbca41e08ac12d60a0d3b6cb P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:27.789745 3281 raft_consensus.cc:385] T 930cb06bcbca41e08ac12d60a0d3b6cb P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:27.789779 3281 raft_consensus.cc:740] T 930cb06bcbca41e08ac12d60a0d3b6cb P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 185c63f61a2645928eeb807d145026b1, State: Initialized, Role: FOLLOWER
I20260203 21:10:27.789896 3281 consensus_queue.cc:260] T 930cb06bcbca41e08ac12d60a0d3b6cb P 185c63f61a2645928eeb807d145026b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:27.790133 3281 ts_tablet_manager.cc:1434] T 930cb06bcbca41e08ac12d60a0d3b6cb P 185c63f61a2645928eeb807d145026b1: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260203 21:10:27.792263 3278 ts_tablet_manager.cc:1434] T d019bac79b874559b718570d502c5a13 P 02bdf326542e474cbe62434dd59087dc: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260203 21:10:27.793121 3278 tablet_bootstrap.cc:492] T 20fec52d63a34162bb79805433de62c0 P 02bdf326542e474cbe62434dd59087dc: Bootstrap starting.
I20260203 21:10:27.794162 3278 tablet_bootstrap.cc:654] T 20fec52d63a34162bb79805433de62c0 P 02bdf326542e474cbe62434dd59087dc: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:27.794603 3296 ts_tablet_manager.cc:1950] T 104fa933dbce4d8a934e827601c899a0 P 02bdf326542e474cbe62434dd59087dc: Deleting consensus metadata
W20260203 21:10:27.794816 2972 tablet.cc:2378] T 20fec52d63a34162bb79805433de62c0 P 6d9e0cecab784cc0acc050ca1c89c5be: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260203 21:10:27.795477 3278 tablet_bootstrap.cc:492] T 20fec52d63a34162bb79805433de62c0 P 02bdf326542e474cbe62434dd59087dc: No bootstrap required, opened a new log
I20260203 21:10:27.795624 3278 ts_tablet_manager.cc:1403] T 20fec52d63a34162bb79805433de62c0 P 02bdf326542e474cbe62434dd59087dc: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260203 21:10:27.796083 3278 raft_consensus.cc:359] T 20fec52d63a34162bb79805433de62c0 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:27.796190 3278 raft_consensus.cc:385] T 20fec52d63a34162bb79805433de62c0 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:27.796221 3278 raft_consensus.cc:740] T 20fec52d63a34162bb79805433de62c0 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02bdf326542e474cbe62434dd59087dc, State: Initialized, Role: FOLLOWER
I20260203 21:10:27.796352 3278 consensus_queue.cc:260] T 20fec52d63a34162bb79805433de62c0 P 02bdf326542e474cbe62434dd59087dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:27.796455 3296 tablet_replica.cc:333] T ed7afe0e6dcf4431a60def7298184187 P 02bdf326542e474cbe62434dd59087dc: stopping tablet replica
I20260203 21:10:27.796512 2437 catalog_manager.cc:4985] TS 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335): tablet 104fa933dbce4d8a934e827601c899a0 (table default.table_ae3f050e71c94082b0e88a08167c762f [id=73eae179f2ad481d932a5b3c95b1a4ab]) successfully deleted
I20260203 21:10:27.796693 3295 tablet_replica.cc:333] T ed7afe0e6dcf4431a60def7298184187 P 185c63f61a2645928eeb807d145026b1: stopping tablet replica
I20260203 21:10:27.797045 3295 raft_consensus.cc:2243] T ed7afe0e6dcf4431a60def7298184187 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260203 21:10:27.797139 3295 raft_consensus.cc:2272] T ed7afe0e6dcf4431a60def7298184187 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260203 21:10:27.796689 3278 ts_tablet_manager.cc:1434] T 20fec52d63a34162bb79805433de62c0 P 02bdf326542e474cbe62434dd59087dc: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260203 21:10:27.797631 3278 tablet_bootstrap.cc:492] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc: Bootstrap starting.
I20260203 21:10:27.797919 3296 raft_consensus.cc:2243] T ed7afe0e6dcf4431a60def7298184187 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Raft consensus shutting down.
I20260203 21:10:27.799010 3296 raft_consensus.cc:2272] T ed7afe0e6dcf4431a60def7298184187 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Raft consensus is shut down!
I20260203 21:10:27.798542 3278 tablet_bootstrap.cc:654] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:27.799782 3295 ts_tablet_manager.cc:1916] T ed7afe0e6dcf4431a60def7298184187 P 185c63f61a2645928eeb807d145026b1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260203 21:10:27.801275 3295 ts_tablet_manager.cc:1929] T ed7afe0e6dcf4431a60def7298184187 P 185c63f61a2645928eeb807d145026b1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260203 21:10:27.801376 3295 log.cc:1199] T ed7afe0e6dcf4431a60def7298184187 P 185c63f61a2645928eeb807d145026b1: Deleting WAL directory at /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-2/wal/wals/ed7afe0e6dcf4431a60def7298184187
I20260203 21:10:27.801592 3295 ts_tablet_manager.cc:1950] T ed7afe0e6dcf4431a60def7298184187 P 185c63f61a2645928eeb807d145026b1: Deleting consensus metadata
I20260203 21:10:27.802122 3295 tablet_replica.cc:333] T e3680015777647ba80d0b63661afdd8c P 185c63f61a2645928eeb807d145026b1: stopping tablet replica
I20260203 21:10:27.802228 3295 raft_consensus.cc:2243] T e3680015777647ba80d0b63661afdd8c P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 21:10:27.802320 3295 raft_consensus.cc:2272] T e3680015777647ba80d0b63661afdd8c P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 21:10:27.802470 2438 catalog_manager.cc:4985] TS 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): tablet ed7afe0e6dcf4431a60def7298184187 (table default.table_8276b49c70934289816f902b52d97652 [id=333213fed7234610bc20c7d92124182b]) successfully deleted
I20260203 21:10:27.802678 3295 ts_tablet_manager.cc:1916] T e3680015777647ba80d0b63661afdd8c P 185c63f61a2645928eeb807d145026b1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260203 21:10:27.802829 3296 ts_tablet_manager.cc:1916] T ed7afe0e6dcf4431a60def7298184187 P 02bdf326542e474cbe62434dd59087dc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260203 21:10:27.804348 3295 ts_tablet_manager.cc:1929] T e3680015777647ba80d0b63661afdd8c P 185c63f61a2645928eeb807d145026b1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260203 21:10:27.804412 3295 log.cc:1199] T e3680015777647ba80d0b63661afdd8c P 185c63f61a2645928eeb807d145026b1: Deleting WAL directory at /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-2/wal/wals/e3680015777647ba80d0b63661afdd8c
I20260203 21:10:27.804592 3295 ts_tablet_manager.cc:1950] T e3680015777647ba80d0b63661afdd8c P 185c63f61a2645928eeb807d145026b1: Deleting consensus metadata
I20260203 21:10:27.804822 3278 tablet_bootstrap.cc:492] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc: No bootstrap required, opened a new log
I20260203 21:10:27.804903 3278 ts_tablet_manager.cc:1403] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.001s
I20260203 21:10:27.805131 2438 catalog_manager.cc:4985] TS 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): tablet e3680015777647ba80d0b63661afdd8c (table default.table_1d3ace06028643bba1fbb9d430213ff5 [id=a995c742bb2942838a2385b05a4d4d57]) successfully deleted
I20260203 21:10:27.805403 3278 raft_consensus.cc:359] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:27.805485 3278 raft_consensus.cc:385] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:27.805514 3278 raft_consensus.cc:740] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02bdf326542e474cbe62434dd59087dc, State: Initialized, Role: FOLLOWER
I20260203 21:10:27.805634 3278 consensus_queue.cc:260] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:27.806167 3278 ts_tablet_manager.cc:1434] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260203 21:10:27.806329 3278 tablet_bootstrap.cc:492] T 930cb06bcbca41e08ac12d60a0d3b6cb P 02bdf326542e474cbe62434dd59087dc: Bootstrap starting.
I20260203 21:10:27.806964 3296 ts_tablet_manager.cc:1929] T ed7afe0e6dcf4431a60def7298184187 P 02bdf326542e474cbe62434dd59087dc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260203 21:10:27.807021 3296 log.cc:1199] T ed7afe0e6dcf4431a60def7298184187 P 02bdf326542e474cbe62434dd59087dc: Deleting WAL directory at /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-0/wal/wals/ed7afe0e6dcf4431a60def7298184187
I20260203 21:10:27.807786 3296 ts_tablet_manager.cc:1950] T ed7afe0e6dcf4431a60def7298184187 P 02bdf326542e474cbe62434dd59087dc: Deleting consensus metadata
I20260203 21:10:27.808759 3278 tablet_bootstrap.cc:654] T 930cb06bcbca41e08ac12d60a0d3b6cb P 02bdf326542e474cbe62434dd59087dc: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:27.809345 3296 tablet_replica.cc:333] T e3680015777647ba80d0b63661afdd8c P 02bdf326542e474cbe62434dd59087dc: stopping tablet replica
I20260203 21:10:27.809454 3296 raft_consensus.cc:2243] T e3680015777647ba80d0b63661afdd8c P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 21:10:27.809551 3296 raft_consensus.cc:2272] T e3680015777647ba80d0b63661afdd8c P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 21:10:27.809942 3296 ts_tablet_manager.cc:1916] T e3680015777647ba80d0b63661afdd8c P 02bdf326542e474cbe62434dd59087dc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260203 21:10:27.812215 3296 ts_tablet_manager.cc:1929] T e3680015777647ba80d0b63661afdd8c P 02bdf326542e474cbe62434dd59087dc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260203 21:10:27.812305 3296 log.cc:1199] T e3680015777647ba80d0b63661afdd8c P 02bdf326542e474cbe62434dd59087dc: Deleting WAL directory at /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-0/wal/wals/e3680015777647ba80d0b63661afdd8c
I20260203 21:10:27.812479 3296 ts_tablet_manager.cc:1950] T e3680015777647ba80d0b63661afdd8c P 02bdf326542e474cbe62434dd59087dc: Deleting consensus metadata
I20260203 21:10:27.815759 2437 catalog_manager.cc:4985] TS 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335): tablet ed7afe0e6dcf4431a60def7298184187 (table default.table_8276b49c70934289816f902b52d97652 [id=333213fed7234610bc20c7d92124182b]) successfully deleted
I20260203 21:10:27.816751 2443 catalog_manager.cc:2174] created HMS catalog entry for table [id=82ec5c95acc84e509c0803db74b626b4]
I20260203 21:10:27.821286 2437 catalog_manager.cc:4985] TS 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335): tablet e3680015777647ba80d0b63661afdd8c (table default.table_1d3ace06028643bba1fbb9d430213ff5 [id=a995c742bb2942838a2385b05a4d4d57]) successfully deleted
I20260203 21:10:27.824888 3278 tablet_bootstrap.cc:492] T 930cb06bcbca41e08ac12d60a0d3b6cb P 02bdf326542e474cbe62434dd59087dc: No bootstrap required, opened a new log
I20260203 21:10:27.825030 3278 ts_tablet_manager.cc:1403] T 930cb06bcbca41e08ac12d60a0d3b6cb P 02bdf326542e474cbe62434dd59087dc: Time spent bootstrapping tablet: real 0.019s user 0.000s sys 0.002s
I20260203 21:10:27.825533 3278 raft_consensus.cc:359] T 930cb06bcbca41e08ac12d60a0d3b6cb P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:27.826215 3278 raft_consensus.cc:385] T 930cb06bcbca41e08ac12d60a0d3b6cb P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:27.826308 3278 raft_consensus.cc:740] T 930cb06bcbca41e08ac12d60a0d3b6cb P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02bdf326542e474cbe62434dd59087dc, State: Initialized, Role: FOLLOWER
I20260203 21:10:27.826507 3278 consensus_queue.cc:260] T 930cb06bcbca41e08ac12d60a0d3b6cb P 02bdf326542e474cbe62434dd59087dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:27.826933 3278 ts_tablet_manager.cc:1434] T 930cb06bcbca41e08ac12d60a0d3b6cb P 02bdf326542e474cbe62434dd59087dc: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260203 21:10:27.828439 2765 tablet_service.cc:1505] Processing CreateTablet for tablet d6c50af1a05941fe98418d50fbb0009b (DEFAULT_TABLE table=default.table_bdb9340290f84eada371f9d8304fcd67 [id=82ec5c95acc84e509c0803db74b626b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:27.828692 2765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6c50af1a05941fe98418d50fbb0009b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:27.828644 2443 catalog_manager.cc:5654] T c45683f20a454401bfb90b41570b5125 P 6d9e0cecab784cc0acc050ca1c89c5be reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130). New cstate: current_term: 1 leader_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } health_report { overall_health: UNKNOWN } } }
I20260203 21:10:27.830549 3039 tablet_service.cc:1505] Processing CreateTablet for tablet d6c50af1a05941fe98418d50fbb0009b (DEFAULT_TABLE table=default.table_bdb9340290f84eada371f9d8304fcd67 [id=82ec5c95acc84e509c0803db74b626b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:27.830801 3039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6c50af1a05941fe98418d50fbb0009b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:27.831440 2902 tablet_service.cc:1505] Processing CreateTablet for tablet d6c50af1a05941fe98418d50fbb0009b (DEFAULT_TABLE table=default.table_bdb9340290f84eada371f9d8304fcd67 [id=82ec5c95acc84e509c0803db74b626b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:27.831741 2902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6c50af1a05941fe98418d50fbb0009b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:27.832784 3281 tablet_bootstrap.cc:492] T d6c50af1a05941fe98418d50fbb0009b P 185c63f61a2645928eeb807d145026b1: Bootstrap starting.
I20260203 21:10:27.833680 3310 raft_consensus.cc:493] T 20fec52d63a34162bb79805433de62c0 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 21:10:27.833763 3281 tablet_bootstrap.cc:654] T d6c50af1a05941fe98418d50fbb0009b P 185c63f61a2645928eeb807d145026b1: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:27.833763 3310 raft_consensus.cc:515] T 20fec52d63a34162bb79805433de62c0 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:27.834157 3310 leader_election.cc:290] T 20fec52d63a34162bb79805433de62c0 P 6d9e0cecab784cc0acc050ca1c89c5be [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
I20260203 21:10:27.834314 3280 tablet_bootstrap.cc:492] T d6c50af1a05941fe98418d50fbb0009b P 6d9e0cecab784cc0acc050ca1c89c5be: Bootstrap starting.
I20260203 21:10:27.835392 3280 tablet_bootstrap.cc:654] T d6c50af1a05941fe98418d50fbb0009b P 6d9e0cecab784cc0acc050ca1c89c5be: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:27.836211 2785 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "20fec52d63a34162bb79805433de62c0" candidate_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02bdf326542e474cbe62434dd59087dc" is_pre_election: true
I20260203 21:10:27.836265 3281 tablet_bootstrap.cc:492] T d6c50af1a05941fe98418d50fbb0009b P 185c63f61a2645928eeb807d145026b1: No bootstrap required, opened a new log
I20260203 21:10:27.836321 2785 raft_consensus.cc:2468] T 20fec52d63a34162bb79805433de62c0 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d9e0cecab784cc0acc050ca1c89c5be in term 0.
I20260203 21:10:27.836336 3281 ts_tablet_manager.cc:1403] T d6c50af1a05941fe98418d50fbb0009b P 185c63f61a2645928eeb807d145026b1: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.001s
I20260203 21:10:27.836833 2857 leader_election.cc:304] T 20fec52d63a34162bb79805433de62c0 P 6d9e0cecab784cc0acc050ca1c89c5be [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc, 6d9e0cecab784cc0acc050ca1c89c5be; no voters:
I20260203 21:10:27.836795 3281 raft_consensus.cc:359] T d6c50af1a05941fe98418d50fbb0009b P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:27.836898 3281 raft_consensus.cc:385] T d6c50af1a05941fe98418d50fbb0009b P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:27.836932 3281 raft_consensus.cc:740] T d6c50af1a05941fe98418d50fbb0009b P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 185c63f61a2645928eeb807d145026b1, State: Initialized, Role: FOLLOWER
I20260203 21:10:27.837049 3281 consensus_queue.cc:260] T d6c50af1a05941fe98418d50fbb0009b P 185c63f61a2645928eeb807d145026b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:27.837284 3281 ts_tablet_manager.cc:1434] T d6c50af1a05941fe98418d50fbb0009b P 185c63f61a2645928eeb807d145026b1: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20260203 21:10:27.837731 2443 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57540:
name: "default.Table_75f7568b9f28464e8d4ce934087b320e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260203 21:10:27.838289 3058 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "20fec52d63a34162bb79805433de62c0" candidate_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "185c63f61a2645928eeb807d145026b1" is_pre_election: true
I20260203 21:10:27.838387 3058 raft_consensus.cc:2468] T 20fec52d63a34162bb79805433de62c0 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d9e0cecab784cc0acc050ca1c89c5be in term 0.
I20260203 21:10:27.842161 3310 raft_consensus.cc:2804] T 20fec52d63a34162bb79805433de62c0 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 21:10:27.842233 3310 raft_consensus.cc:493] T 20fec52d63a34162bb79805433de62c0 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 21:10:27.842278 3310 raft_consensus.cc:3060] T 20fec52d63a34162bb79805433de62c0 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:27.843201 3310 raft_consensus.cc:515] T 20fec52d63a34162bb79805433de62c0 P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:27.843547 3310 leader_election.cc:290] T 20fec52d63a34162bb79805433de62c0 P 6d9e0cecab784cc0acc050ca1c89c5be [CANDIDATE]: Term 1 election: Requested vote from peers 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
I20260203 21:10:27.844050 3058 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "20fec52d63a34162bb79805433de62c0" candidate_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "185c63f61a2645928eeb807d145026b1"
I20260203 21:10:27.844154 3058 raft_consensus.cc:3060] T 20fec52d63a34162bb79805433de62c0 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:27.844180 2785 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "20fec52d63a34162bb79805433de62c0" candidate_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02bdf326542e474cbe62434dd59087dc"
I20260203 21:10:27.844280 2785 raft_consensus.cc:3060] T 20fec52d63a34162bb79805433de62c0 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:27.844466 3278 tablet_bootstrap.cc:492] T d6c50af1a05941fe98418d50fbb0009b P 02bdf326542e474cbe62434dd59087dc: Bootstrap starting.
I20260203 21:10:27.845086 3058 raft_consensus.cc:2468] T 20fec52d63a34162bb79805433de62c0 P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d9e0cecab784cc0acc050ca1c89c5be in term 1.
I20260203 21:10:27.845149 2785 raft_consensus.cc:2468] T 20fec52d63a34162bb79805433de62c0 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d9e0cecab784cc0acc050ca1c89c5be in term 1.
I20260203 21:10:27.845376 3278 tablet_bootstrap.cc:654] T d6c50af1a05941fe98418d50fbb0009b P 02bdf326542e474cbe62434dd59087dc: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:27.845496 2857 leader_election.cc:304] T 20fec52d63a34162bb79805433de62c0 P 6d9e0cecab784cc0acc050ca1c89c5be [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc, 6d9e0cecab784cc0acc050ca1c89c5be; no voters:
I20260203 21:10:27.846203 3310 raft_consensus.cc:2804] T 20fec52d63a34162bb79805433de62c0 P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 FOLLOWER]: Leader election won for term 1
I20260203 21:10:27.846285 3310 raft_consensus.cc:697] T 20fec52d63a34162bb79805433de62c0 P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 LEADER]: Becoming Leader. State: Replica: 6d9e0cecab784cc0acc050ca1c89c5be, State: Running, Role: LEADER
I20260203 21:10:27.846396 3280 tablet_bootstrap.cc:492] T d6c50af1a05941fe98418d50fbb0009b P 6d9e0cecab784cc0acc050ca1c89c5be: No bootstrap required, opened a new log
I20260203 21:10:27.846482 3280 ts_tablet_manager.cc:1403] T d6c50af1a05941fe98418d50fbb0009b P 6d9e0cecab784cc0acc050ca1c89c5be: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.002s
I20260203 21:10:27.846920 3280 raft_consensus.cc:359] T d6c50af1a05941fe98418d50fbb0009b P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:27.847011 3280 raft_consensus.cc:385] T d6c50af1a05941fe98418d50fbb0009b P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:27.847043 3280 raft_consensus.cc:740] T d6c50af1a05941fe98418d50fbb0009b P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d9e0cecab784cc0acc050ca1c89c5be, State: Initialized, Role: FOLLOWER
I20260203 21:10:27.847143 3280 consensus_queue.cc:260] T d6c50af1a05941fe98418d50fbb0009b P 6d9e0cecab784cc0acc050ca1c89c5be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:27.847391 3280 ts_tablet_manager.cc:1434] T d6c50af1a05941fe98418d50fbb0009b P 6d9e0cecab784cc0acc050ca1c89c5be: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260203 21:10:27.846407 3310 consensus_queue.cc:237] T 20fec52d63a34162bb79805433de62c0 P 6d9e0cecab784cc0acc050ca1c89c5be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:27.849237 3278 tablet_bootstrap.cc:492] T d6c50af1a05941fe98418d50fbb0009b P 02bdf326542e474cbe62434dd59087dc: No bootstrap required, opened a new log
I20260203 21:10:27.849316 3278 ts_tablet_manager.cc:1403] T d6c50af1a05941fe98418d50fbb0009b P 02bdf326542e474cbe62434dd59087dc: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260203 21:10:27.852603 3278 raft_consensus.cc:359] T d6c50af1a05941fe98418d50fbb0009b P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:27.852708 3278 raft_consensus.cc:385] T d6c50af1a05941fe98418d50fbb0009b P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:27.852741 3278 raft_consensus.cc:740] T d6c50af1a05941fe98418d50fbb0009b P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02bdf326542e474cbe62434dd59087dc, State: Initialized, Role: FOLLOWER
I20260203 21:10:27.852907 3278 consensus_queue.cc:260] T d6c50af1a05941fe98418d50fbb0009b P 02bdf326542e474cbe62434dd59087dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:27.855420 3278 ts_tablet_manager.cc:1434] T d6c50af1a05941fe98418d50fbb0009b P 02bdf326542e474cbe62434dd59087dc: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20260203 21:10:27.861305 2445 catalog_manager.cc:2174] created HMS catalog entry for table [id=467e79ec835d45669e3155e07b8ba81f]
I20260203 21:10:27.865227 3282 raft_consensus.cc:493] T 930cb06bcbca41e08ac12d60a0d3b6cb P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 21:10:27.865387 3282 raft_consensus.cc:515] T 930cb06bcbca41e08ac12d60a0d3b6cb P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:27.866665 3282 leader_election.cc:290] T 930cb06bcbca41e08ac12d60a0d3b6cb P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
I20260203 21:10:27.869002 2445 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57540:
name: "default.Table_8bbf49750e3f4eccbcf97c6346c65635"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260203 21:10:27.870450 2834 tablet.cc:2378] T 20fec52d63a34162bb79805433de62c0 P 02bdf326542e474cbe62434dd59087dc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260203 21:10:27.875437 2923 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "930cb06bcbca41e08ac12d60a0d3b6cb" candidate_uuid: "02bdf326542e474cbe62434dd59087dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" is_pre_election: true
I20260203 21:10:27.875612 2923 raft_consensus.cc:2468] T 930cb06bcbca41e08ac12d60a0d3b6cb P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02bdf326542e474cbe62434dd59087dc in term 0.
I20260203 21:10:27.876045 2721 leader_election.cc:304] T 930cb06bcbca41e08ac12d60a0d3b6cb P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc, 6d9e0cecab784cc0acc050ca1c89c5be; no voters:
I20260203 21:10:27.876762 3282 raft_consensus.cc:2804] T 930cb06bcbca41e08ac12d60a0d3b6cb P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 21:10:27.876838 3282 raft_consensus.cc:493] T 930cb06bcbca41e08ac12d60a0d3b6cb P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 21:10:27.876879 3282 raft_consensus.cc:3060] T 930cb06bcbca41e08ac12d60a0d3b6cb P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:27.877282 2902 tablet_service.cc:1505] Processing CreateTablet for tablet e540d65d585c4ba1bd1bfaf62ba41fb5 (DEFAULT_TABLE table=default.table_dde2cdf1f5254cb49f3053855a83891e [id=467e79ec835d45669e3155e07b8ba81f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:27.877559 2902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e540d65d585c4ba1bd1bfaf62ba41fb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:27.877885 3282 raft_consensus.cc:515] T 930cb06bcbca41e08ac12d60a0d3b6cb P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:27.878203 3282 leader_election.cc:290] T 930cb06bcbca41e08ac12d60a0d3b6cb P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 1 election: Requested vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
I20260203 21:10:27.878775 2765 tablet_service.cc:1505] Processing CreateTablet for tablet e540d65d585c4ba1bd1bfaf62ba41fb5 (DEFAULT_TABLE table=default.table_dde2cdf1f5254cb49f3053855a83891e [id=467e79ec835d45669e3155e07b8ba81f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:27.879004 2765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e540d65d585c4ba1bd1bfaf62ba41fb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:27.879623 3280 tablet_bootstrap.cc:492] T e540d65d585c4ba1bd1bfaf62ba41fb5 P 6d9e0cecab784cc0acc050ca1c89c5be: Bootstrap starting.
I20260203 21:10:27.880618 3280 tablet_bootstrap.cc:654] T e540d65d585c4ba1bd1bfaf62ba41fb5 P 6d9e0cecab784cc0acc050ca1c89c5be: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:27.881019 2923 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "930cb06bcbca41e08ac12d60a0d3b6cb" candidate_uuid: "02bdf326542e474cbe62434dd59087dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d9e0cecab784cc0acc050ca1c89c5be"
I20260203 21:10:27.881119 2923 raft_consensus.cc:3060] T 930cb06bcbca41e08ac12d60a0d3b6cb P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:27.881871 3039 tablet_service.cc:1505] Processing CreateTablet for tablet e540d65d585c4ba1bd1bfaf62ba41fb5 (DEFAULT_TABLE table=default.table_dde2cdf1f5254cb49f3053855a83891e [id=467e79ec835d45669e3155e07b8ba81f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:27.881973 2923 raft_consensus.cc:2468] T 930cb06bcbca41e08ac12d60a0d3b6cb P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02bdf326542e474cbe62434dd59087dc in term 1.
I20260203 21:10:27.882122 3039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e540d65d585c4ba1bd1bfaf62ba41fb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:27.882431 2721 leader_election.cc:304] T 930cb06bcbca41e08ac12d60a0d3b6cb P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc, 6d9e0cecab784cc0acc050ca1c89c5be; no voters:
I20260203 21:10:27.882627 3282 raft_consensus.cc:2804] T 930cb06bcbca41e08ac12d60a0d3b6cb P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader election won for term 1
I20260203 21:10:27.882838 3282 raft_consensus.cc:697] T 930cb06bcbca41e08ac12d60a0d3b6cb P 02bdf326542e474cbe62434dd59087dc [term 1 LEADER]: Becoming Leader. State: Replica: 02bdf326542e474cbe62434dd59087dc, State: Running, Role: LEADER
I20260203 21:10:27.883123 3282 consensus_queue.cc:237] T 930cb06bcbca41e08ac12d60a0d3b6cb P 02bdf326542e474cbe62434dd59087dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:27.884212 3281 tablet_bootstrap.cc:492] T e540d65d585c4ba1bd1bfaf62ba41fb5 P 185c63f61a2645928eeb807d145026b1: Bootstrap starting.
I20260203 21:10:27.885123 3278 tablet_bootstrap.cc:492] T e540d65d585c4ba1bd1bfaf62ba41fb5 P 02bdf326542e474cbe62434dd59087dc: Bootstrap starting.
I20260203 21:10:27.885391 3281 tablet_bootstrap.cc:654] T e540d65d585c4ba1bd1bfaf62ba41fb5 P 185c63f61a2645928eeb807d145026b1: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:27.886313 3278 tablet_bootstrap.cc:654] T e540d65d585c4ba1bd1bfaf62ba41fb5 P 02bdf326542e474cbe62434dd59087dc: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:27.892059 3058 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "930cb06bcbca41e08ac12d60a0d3b6cb" candidate_uuid: "02bdf326542e474cbe62434dd59087dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "185c63f61a2645928eeb807d145026b1" is_pre_election: true
I20260203 21:10:27.892182 3058 raft_consensus.cc:2468] T 930cb06bcbca41e08ac12d60a0d3b6cb P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02bdf326542e474cbe62434dd59087dc in term 0.
I20260203 21:10:27.892375 3059 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "930cb06bcbca41e08ac12d60a0d3b6cb" candidate_uuid: "02bdf326542e474cbe62434dd59087dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "185c63f61a2645928eeb807d145026b1"
I20260203 21:10:27.892454 3059 raft_consensus.cc:3060] T 930cb06bcbca41e08ac12d60a0d3b6cb P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:27.892553 3281 tablet_bootstrap.cc:492] T e540d65d585c4ba1bd1bfaf62ba41fb5 P 185c63f61a2645928eeb807d145026b1: No bootstrap required, opened a new log
I20260203 21:10:27.892632 3281 ts_tablet_manager.cc:1403] T e540d65d585c4ba1bd1bfaf62ba41fb5 P 185c63f61a2645928eeb807d145026b1: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.001s
I20260203 21:10:27.893044 3281 raft_consensus.cc:359] T e540d65d585c4ba1bd1bfaf62ba41fb5 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:27.893129 3281 raft_consensus.cc:385] T e540d65d585c4ba1bd1bfaf62ba41fb5 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:27.893157 3281 raft_consensus.cc:740] T e540d65d585c4ba1bd1bfaf62ba41fb5 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 185c63f61a2645928eeb807d145026b1, State: Initialized, Role: FOLLOWER
I20260203 21:10:27.893250 3281 consensus_queue.cc:260] T e540d65d585c4ba1bd1bfaf62ba41fb5 P 185c63f61a2645928eeb807d145026b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:27.893348 3059 raft_consensus.cc:2468] T 930cb06bcbca41e08ac12d60a0d3b6cb P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02bdf326542e474cbe62434dd59087dc in term 1.
I20260203 21:10:27.893518 3281 ts_tablet_manager.cc:1434] T e540d65d585c4ba1bd1bfaf62ba41fb5 P 185c63f61a2645928eeb807d145026b1: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20260203 21:10:27.895569 3280 tablet_bootstrap.cc:492] T e540d65d585c4ba1bd1bfaf62ba41fb5 P 6d9e0cecab784cc0acc050ca1c89c5be: No bootstrap required, opened a new log
I20260203 21:10:27.895691 3280 ts_tablet_manager.cc:1403] T e540d65d585c4ba1bd1bfaf62ba41fb5 P 6d9e0cecab784cc0acc050ca1c89c5be: Time spent bootstrapping tablet: real 0.016s user 0.001s sys 0.001s
I20260203 21:10:27.896075 3280 raft_consensus.cc:359] T e540d65d585c4ba1bd1bfaf62ba41fb5 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:27.896163 3280 raft_consensus.cc:385] T e540d65d585c4ba1bd1bfaf62ba41fb5 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:27.896190 3280 raft_consensus.cc:740] T e540d65d585c4ba1bd1bfaf62ba41fb5 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d9e0cecab784cc0acc050ca1c89c5be, State: Initialized, Role: FOLLOWER
I20260203 21:10:27.896319 3280 consensus_queue.cc:260] T e540d65d585c4ba1bd1bfaf62ba41fb5 P 6d9e0cecab784cc0acc050ca1c89c5be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:27.896546 3280 ts_tablet_manager.cc:1434] T e540d65d585c4ba1bd1bfaf62ba41fb5 P 6d9e0cecab784cc0acc050ca1c89c5be: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260203 21:10:27.896951 3278 tablet_bootstrap.cc:492] T e540d65d585c4ba1bd1bfaf62ba41fb5 P 02bdf326542e474cbe62434dd59087dc: No bootstrap required, opened a new log
I20260203 21:10:27.897029 3278 ts_tablet_manager.cc:1403] T e540d65d585c4ba1bd1bfaf62ba41fb5 P 02bdf326542e474cbe62434dd59087dc: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.000s
I20260203 21:10:27.897384 3278 raft_consensus.cc:359] T e540d65d585c4ba1bd1bfaf62ba41fb5 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:27.897477 3278 raft_consensus.cc:385] T e540d65d585c4ba1bd1bfaf62ba41fb5 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:27.897506 3278 raft_consensus.cc:740] T e540d65d585c4ba1bd1bfaf62ba41fb5 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02bdf326542e474cbe62434dd59087dc, State: Initialized, Role: FOLLOWER
I20260203 21:10:27.897610 3278 consensus_queue.cc:260] T e540d65d585c4ba1bd1bfaf62ba41fb5 P 02bdf326542e474cbe62434dd59087dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:27.897852 3278 ts_tablet_manager.cc:1434] T e540d65d585c4ba1bd1bfaf62ba41fb5 P 02bdf326542e474cbe62434dd59087dc: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260203 21:10:27.899415 2448 catalog_manager.cc:2174] created HMS catalog entry for table [id=85725aeaace648d9ac1bb5d3940d0ad0]
I20260203 21:10:27.908942 2448 catalog_manager.cc:5654] T 20fec52d63a34162bb79805433de62c0 P 6d9e0cecab784cc0acc050ca1c89c5be reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130). New cstate: current_term: 1 leader_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } health_report { overall_health: UNKNOWN } } }
I20260203 21:10:27.909718 2765 tablet_service.cc:1505] Processing CreateTablet for tablet 3ae68905ec1942448b444ecd01836805 (DEFAULT_TABLE table=default.table_c2985ddec2e045cba153900329fe9331 [id=85725aeaace648d9ac1bb5d3940d0ad0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:27.909803 2902 tablet_service.cc:1505] Processing CreateTablet for tablet 3ae68905ec1942448b444ecd01836805 (DEFAULT_TABLE table=default.table_c2985ddec2e045cba153900329fe9331 [id=85725aeaace648d9ac1bb5d3940d0ad0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:27.909979 2765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ae68905ec1942448b444ecd01836805. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:27.910038 2902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ae68905ec1942448b444ecd01836805. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:27.911484 3278 tablet_bootstrap.cc:492] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc: Bootstrap starting.
I20260203 21:10:27.912437 3278 tablet_bootstrap.cc:654] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:27.912868 3280 tablet_bootstrap.cc:492] T 3ae68905ec1942448b444ecd01836805 P 6d9e0cecab784cc0acc050ca1c89c5be: Bootstrap starting.
I20260203 21:10:27.912884 3039 tablet_service.cc:1505] Processing CreateTablet for tablet 3ae68905ec1942448b444ecd01836805 (DEFAULT_TABLE table=default.table_c2985ddec2e045cba153900329fe9331 [id=85725aeaace648d9ac1bb5d3940d0ad0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:27.913131 3039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ae68905ec1942448b444ecd01836805. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:27.913795 3280 tablet_bootstrap.cc:654] T 3ae68905ec1942448b444ecd01836805 P 6d9e0cecab784cc0acc050ca1c89c5be: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:27.915143 3281 tablet_bootstrap.cc:492] T 3ae68905ec1942448b444ecd01836805 P 185c63f61a2645928eeb807d145026b1: Bootstrap starting.
I20260203 21:10:27.916074 3281 tablet_bootstrap.cc:654] T 3ae68905ec1942448b444ecd01836805 P 185c63f61a2645928eeb807d145026b1: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:27.917714 2448 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57540:
name: "default.Table_76bef700d9b64243b6b4e93ffbc64f7a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260203 21:10:27.922065 3281 tablet_bootstrap.cc:492] T 3ae68905ec1942448b444ecd01836805 P 185c63f61a2645928eeb807d145026b1: No bootstrap required, opened a new log
I20260203 21:10:27.922145 3281 ts_tablet_manager.cc:1403] T 3ae68905ec1942448b444ecd01836805 P 185c63f61a2645928eeb807d145026b1: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260203 21:10:27.922171 3278 tablet_bootstrap.cc:492] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc: No bootstrap required, opened a new log
I20260203 21:10:27.922238 3278 ts_tablet_manager.cc:1403] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.000s
I20260203 21:10:27.922590 3281 raft_consensus.cc:359] T 3ae68905ec1942448b444ecd01836805 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:27.922684 3281 raft_consensus.cc:385] T 3ae68905ec1942448b444ecd01836805 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:27.922652 3278 raft_consensus.cc:359] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:27.922712 3281 raft_consensus.cc:740] T 3ae68905ec1942448b444ecd01836805 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 185c63f61a2645928eeb807d145026b1, State: Initialized, Role: FOLLOWER
I20260203 21:10:27.922732 3278 raft_consensus.cc:385] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:27.922761 3278 raft_consensus.cc:740] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02bdf326542e474cbe62434dd59087dc, State: Initialized, Role: FOLLOWER
I20260203 21:10:27.922838 3281 consensus_queue.cc:260] T 3ae68905ec1942448b444ecd01836805 P 185c63f61a2645928eeb807d145026b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:27.923089 3281 ts_tablet_manager.cc:1434] T 3ae68905ec1942448b444ecd01836805 P 185c63f61a2645928eeb807d145026b1: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260203 21:10:27.923710 3278 consensus_queue.cc:260] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:27.923972 3278 ts_tablet_manager.cc:1434] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260203 21:10:27.928354 3280 tablet_bootstrap.cc:492] T 3ae68905ec1942448b444ecd01836805 P 6d9e0cecab784cc0acc050ca1c89c5be: No bootstrap required, opened a new log
I20260203 21:10:27.928437 3280 ts_tablet_manager.cc:1403] T 3ae68905ec1942448b444ecd01836805 P 6d9e0cecab784cc0acc050ca1c89c5be: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.000s
I20260203 21:10:27.928838 3280 raft_consensus.cc:359] T 3ae68905ec1942448b444ecd01836805 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:27.928923 3280 raft_consensus.cc:385] T 3ae68905ec1942448b444ecd01836805 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:27.928951 3280 raft_consensus.cc:740] T 3ae68905ec1942448b444ecd01836805 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d9e0cecab784cc0acc050ca1c89c5be, State: Initialized, Role: FOLLOWER
I20260203 21:10:27.929059 3280 consensus_queue.cc:260] T 3ae68905ec1942448b444ecd01836805 P 6d9e0cecab784cc0acc050ca1c89c5be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:27.929270 3280 ts_tablet_manager.cc:1434] T 3ae68905ec1942448b444ecd01836805 P 6d9e0cecab784cc0acc050ca1c89c5be: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260203 21:10:27.940061 2446 catalog_manager.cc:2174] created HMS catalog entry for table [id=b62df06982124a70936068823e4b2324]
I20260203 21:10:27.946077 2446 catalog_manager.cc:5654] T 930cb06bcbca41e08ac12d60a0d3b6cb P 02bdf326542e474cbe62434dd59087dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 02bdf326542e474cbe62434dd59087dc (127.2.32.129). New cstate: current_term: 1 leader_uuid: "02bdf326542e474cbe62434dd59087dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } health_report { overall_health: UNKNOWN } } }
I20260203 21:10:27.954836 2765 tablet_service.cc:1505] Processing CreateTablet for tablet eb6a21a5b1ee454691237d0b160c9a3c (DEFAULT_TABLE table=default.table_66c508c8dbdd4e7ea9283cabe65b62c0 [id=b62df06982124a70936068823e4b2324]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:27.955117 2765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb6a21a5b1ee454691237d0b160c9a3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:27.955509 3039 tablet_service.cc:1505] Processing CreateTablet for tablet eb6a21a5b1ee454691237d0b160c9a3c (DEFAULT_TABLE table=default.table_66c508c8dbdd4e7ea9283cabe65b62c0 [id=b62df06982124a70936068823e4b2324]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:27.955825 3039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb6a21a5b1ee454691237d0b160c9a3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:27.956301 2902 tablet_service.cc:1505] Processing CreateTablet for tablet eb6a21a5b1ee454691237d0b160c9a3c (DEFAULT_TABLE table=default.table_66c508c8dbdd4e7ea9283cabe65b62c0 [id=b62df06982124a70936068823e4b2324]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:27.956532 2902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb6a21a5b1ee454691237d0b160c9a3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:27.957305 3278 tablet_bootstrap.cc:492] T eb6a21a5b1ee454691237d0b160c9a3c P 02bdf326542e474cbe62434dd59087dc: Bootstrap starting.
I20260203 21:10:27.958240 3278 tablet_bootstrap.cc:654] T eb6a21a5b1ee454691237d0b160c9a3c P 02bdf326542e474cbe62434dd59087dc: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:27.958407 3280 tablet_bootstrap.cc:492] T eb6a21a5b1ee454691237d0b160c9a3c P 6d9e0cecab784cc0acc050ca1c89c5be: Bootstrap starting.
I20260203 21:10:27.958912 3281 tablet_bootstrap.cc:492] T eb6a21a5b1ee454691237d0b160c9a3c P 185c63f61a2645928eeb807d145026b1: Bootstrap starting.
I20260203 21:10:27.959367 3280 tablet_bootstrap.cc:654] T eb6a21a5b1ee454691237d0b160c9a3c P 6d9e0cecab784cc0acc050ca1c89c5be: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:27.959844 3281 tablet_bootstrap.cc:654] T eb6a21a5b1ee454691237d0b160c9a3c P 185c63f61a2645928eeb807d145026b1: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:27.960422 2446 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57540:
table { table_name: "default.Table_bdb9340290f84eada371f9d8304fcd67" } new_table_name: "default.Table_7e73ff80019543888e0b8afa9b7a6660" modify_external_catalogs: true
I20260203 21:10:27.961092 3281 tablet_bootstrap.cc:492] T eb6a21a5b1ee454691237d0b160c9a3c P 185c63f61a2645928eeb807d145026b1: No bootstrap required, opened a new log
I20260203 21:10:27.961170 3281 ts_tablet_manager.cc:1403] T eb6a21a5b1ee454691237d0b160c9a3c P 185c63f61a2645928eeb807d145026b1: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260203 21:10:27.961602 3281 raft_consensus.cc:359] T eb6a21a5b1ee454691237d0b160c9a3c P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:27.961712 3281 raft_consensus.cc:385] T eb6a21a5b1ee454691237d0b160c9a3c P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:27.961745 3281 raft_consensus.cc:740] T eb6a21a5b1ee454691237d0b160c9a3c P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 185c63f61a2645928eeb807d145026b1, State: Initialized, Role: FOLLOWER
I20260203 21:10:27.961859 3281 consensus_queue.cc:260] T eb6a21a5b1ee454691237d0b160c9a3c P 185c63f61a2645928eeb807d145026b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:27.962107 3281 ts_tablet_manager.cc:1434] T eb6a21a5b1ee454691237d0b160c9a3c P 185c63f61a2645928eeb807d145026b1: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260203 21:10:27.963539 3278 tablet_bootstrap.cc:492] T eb6a21a5b1ee454691237d0b160c9a3c P 02bdf326542e474cbe62434dd59087dc: No bootstrap required, opened a new log
I20260203 21:10:27.963621 3278 ts_tablet_manager.cc:1403] T eb6a21a5b1ee454691237d0b160c9a3c P 02bdf326542e474cbe62434dd59087dc: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260203 21:10:27.964059 3278 raft_consensus.cc:359] T eb6a21a5b1ee454691237d0b160c9a3c P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:27.964159 3278 raft_consensus.cc:385] T eb6a21a5b1ee454691237d0b160c9a3c P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:27.964187 3278 raft_consensus.cc:740] T eb6a21a5b1ee454691237d0b160c9a3c P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02bdf326542e474cbe62434dd59087dc, State: Initialized, Role: FOLLOWER
I20260203 21:10:27.964291 3278 consensus_queue.cc:260] T eb6a21a5b1ee454691237d0b160c9a3c P 02bdf326542e474cbe62434dd59087dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:27.964540 3278 ts_tablet_manager.cc:1434] T eb6a21a5b1ee454691237d0b160c9a3c P 02bdf326542e474cbe62434dd59087dc: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260203 21:10:27.965044 3280 tablet_bootstrap.cc:492] T eb6a21a5b1ee454691237d0b160c9a3c P 6d9e0cecab784cc0acc050ca1c89c5be: No bootstrap required, opened a new log
I20260203 21:10:27.965121 3280 ts_tablet_manager.cc:1403] T eb6a21a5b1ee454691237d0b160c9a3c P 6d9e0cecab784cc0acc050ca1c89c5be: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.002s
I20260203 21:10:27.965544 3280 raft_consensus.cc:359] T eb6a21a5b1ee454691237d0b160c9a3c P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:27.965637 3280 raft_consensus.cc:385] T eb6a21a5b1ee454691237d0b160c9a3c P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:27.965668 3280 raft_consensus.cc:740] T eb6a21a5b1ee454691237d0b160c9a3c P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d9e0cecab784cc0acc050ca1c89c5be, State: Initialized, Role: FOLLOWER
I20260203 21:10:27.965790 3280 consensus_queue.cc:260] T eb6a21a5b1ee454691237d0b160c9a3c P 6d9e0cecab784cc0acc050ca1c89c5be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:27.966065 3280 ts_tablet_manager.cc:1434] T eb6a21a5b1ee454691237d0b160c9a3c P 6d9e0cecab784cc0acc050ca1c89c5be: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260203 21:10:27.977828 2450 catalog_manager.cc:2174] created HMS catalog entry for table [id=a26f4a67278a4929b2378fbbe9baaf52]
I20260203 21:10:27.988624 3324 raft_consensus.cc:493] T d019bac79b874559b718570d502c5a13 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 21:10:27.988606 3039 tablet_service.cc:1505] Processing CreateTablet for tablet 4d6ed92d766244489541e1c280afacb5 (DEFAULT_TABLE table=default.table_09e62d0aaa0f48ad9ed818ba967be542 [id=a26f4a67278a4929b2378fbbe9baaf52]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:27.988740 3324 raft_consensus.cc:515] T d019bac79b874559b718570d502c5a13 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:27.988920 3039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d6ed92d766244489541e1c280afacb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:27.989135 3324 leader_election.cc:290] T d019bac79b874559b718570d502c5a13 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
I20260203 21:10:27.989328 2450 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57540:
table { table_name: "default.Table_dde2cdf1f5254cb49f3053855a83891e" } new_table_name: "default.Table_b7c2ca72f69c49a0b39163d2fcb69341" modify_external_catalogs: true
I20260203 21:10:27.989815 2902 tablet_service.cc:1505] Processing CreateTablet for tablet 4d6ed92d766244489541e1c280afacb5 (DEFAULT_TABLE table=default.table_09e62d0aaa0f48ad9ed818ba967be542 [id=a26f4a67278a4929b2378fbbe9baaf52]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:27.990090 2902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d6ed92d766244489541e1c280afacb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:27.990047 2765 tablet_service.cc:1505] Processing CreateTablet for tablet 4d6ed92d766244489541e1c280afacb5 (DEFAULT_TABLE table=default.table_09e62d0aaa0f48ad9ed818ba967be542 [id=a26f4a67278a4929b2378fbbe9baaf52]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:27.990271 2765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d6ed92d766244489541e1c280afacb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:27.991058 3059 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d019bac79b874559b718570d502c5a13" candidate_uuid: "02bdf326542e474cbe62434dd59087dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "185c63f61a2645928eeb807d145026b1" is_pre_election: true
I20260203 21:10:27.991055 3281 tablet_bootstrap.cc:492] T 4d6ed92d766244489541e1c280afacb5 P 185c63f61a2645928eeb807d145026b1: Bootstrap starting.
I20260203 21:10:27.991199 3059 raft_consensus.cc:2468] T d019bac79b874559b718570d502c5a13 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02bdf326542e474cbe62434dd59087dc in term 0.
I20260203 21:10:27.991768 2720 leader_election.cc:304] T d019bac79b874559b718570d502c5a13 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc, 185c63f61a2645928eeb807d145026b1; no voters:
I20260203 21:10:27.991935 3280 tablet_bootstrap.cc:492] T 4d6ed92d766244489541e1c280afacb5 P 6d9e0cecab784cc0acc050ca1c89c5be: Bootstrap starting.
I20260203 21:10:27.992270 3281 tablet_bootstrap.cc:654] T 4d6ed92d766244489541e1c280afacb5 P 185c63f61a2645928eeb807d145026b1: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:27.992410 2923 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d019bac79b874559b718570d502c5a13" candidate_uuid: "02bdf326542e474cbe62434dd59087dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" is_pre_election: true
I20260203 21:10:27.992471 3278 tablet_bootstrap.cc:492] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc: Bootstrap starting.
I20260203 21:10:27.992522 2923 raft_consensus.cc:2468] T d019bac79b874559b718570d502c5a13 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02bdf326542e474cbe62434dd59087dc in term 0.
I20260203 21:10:27.992805 3280 tablet_bootstrap.cc:654] T 4d6ed92d766244489541e1c280afacb5 P 6d9e0cecab784cc0acc050ca1c89c5be: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:27.993279 3281 tablet_bootstrap.cc:492] T 4d6ed92d766244489541e1c280afacb5 P 185c63f61a2645928eeb807d145026b1: No bootstrap required, opened a new log
I20260203 21:10:27.993356 3281 ts_tablet_manager.cc:1403] T 4d6ed92d766244489541e1c280afacb5 P 185c63f61a2645928eeb807d145026b1: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260203 21:10:27.993381 3278 tablet_bootstrap.cc:654] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:27.993752 3324 raft_consensus.cc:2804] T d019bac79b874559b718570d502c5a13 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 21:10:27.993813 3324 raft_consensus.cc:493] T d019bac79b874559b718570d502c5a13 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 21:10:27.993853 3324 raft_consensus.cc:3060] T d019bac79b874559b718570d502c5a13 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:27.993791 3281 raft_consensus.cc:359] T 4d6ed92d766244489541e1c280afacb5 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:27.993893 3281 raft_consensus.cc:385] T 4d6ed92d766244489541e1c280afacb5 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:27.993928 3281 raft_consensus.cc:740] T 4d6ed92d766244489541e1c280afacb5 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 185c63f61a2645928eeb807d145026b1, State: Initialized, Role: FOLLOWER
I20260203 21:10:27.993939 3310 raft_consensus.cc:493] T d019bac79b874559b718570d502c5a13 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 21:10:27.994009 3310 raft_consensus.cc:515] T d019bac79b874559b718570d502c5a13 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:27.994046 3281 consensus_queue.cc:260] T 4d6ed92d766244489541e1c280afacb5 P 185c63f61a2645928eeb807d145026b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:27.994268 3281 ts_tablet_manager.cc:1434] T 4d6ed92d766244489541e1c280afacb5 P 185c63f61a2645928eeb807d145026b1: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260203 21:10:27.994346 3310 leader_election.cc:290] T d019bac79b874559b718570d502c5a13 P 6d9e0cecab784cc0acc050ca1c89c5be [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
I20260203 21:10:27.994705 3324 raft_consensus.cc:515] T d019bac79b874559b718570d502c5a13 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:27.995036 3324 leader_election.cc:290] T d019bac79b874559b718570d502c5a13 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 1 election: Requested vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
I20260203 21:10:27.995060 3059 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d019bac79b874559b718570d502c5a13" candidate_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "185c63f61a2645928eeb807d145026b1" is_pre_election: true
I20260203 21:10:27.995151 3059 raft_consensus.cc:2468] T d019bac79b874559b718570d502c5a13 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d9e0cecab784cc0acc050ca1c89c5be in term 0.
I20260203 21:10:27.995339 3058 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d019bac79b874559b718570d502c5a13" candidate_uuid: "02bdf326542e474cbe62434dd59087dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "185c63f61a2645928eeb807d145026b1"
I20260203 21:10:27.995410 2858 leader_election.cc:304] T d019bac79b874559b718570d502c5a13 P 6d9e0cecab784cc0acc050ca1c89c5be [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be; no voters:
I20260203 21:10:27.995430 3058 raft_consensus.cc:3060] T d019bac79b874559b718570d502c5a13 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:27.995524 2785 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d019bac79b874559b718570d502c5a13" candidate_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02bdf326542e474cbe62434dd59087dc" is_pre_election: true
I20260203 21:10:27.995676 2785 raft_consensus.cc:2393] T d019bac79b874559b718570d502c5a13 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d9e0cecab784cc0acc050ca1c89c5be in current term 1: Already voted for candidate 02bdf326542e474cbe62434dd59087dc in this term.
I20260203 21:10:27.995729 2923 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d019bac79b874559b718570d502c5a13" candidate_uuid: "02bdf326542e474cbe62434dd59087dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d9e0cecab784cc0acc050ca1c89c5be"
I20260203 21:10:27.995813 2923 raft_consensus.cc:3060] T d019bac79b874559b718570d502c5a13 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:27.996264 3058 raft_consensus.cc:2468] T d019bac79b874559b718570d502c5a13 P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02bdf326542e474cbe62434dd59087dc in term 1.
I20260203 21:10:27.996640 2923 raft_consensus.cc:2468] T d019bac79b874559b718570d502c5a13 P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02bdf326542e474cbe62434dd59087dc in term 1.
I20260203 21:10:27.997062 2720 leader_election.cc:304] T d019bac79b874559b718570d502c5a13 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc, 185c63f61a2645928eeb807d145026b1; no voters:
I20260203 21:10:27.997102 3310 raft_consensus.cc:2764] T d019bac79b874559b718570d502c5a13 P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260203 21:10:27.997128 3278 tablet_bootstrap.cc:492] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc: No bootstrap required, opened a new log
I20260203 21:10:27.997195 3278 ts_tablet_manager.cc:1403] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260203 21:10:27.997210 3324 raft_consensus.cc:2804] T d019bac79b874559b718570d502c5a13 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader election won for term 1
I20260203 21:10:27.997279 3324 raft_consensus.cc:697] T d019bac79b874559b718570d502c5a13 P 02bdf326542e474cbe62434dd59087dc [term 1 LEADER]: Becoming Leader. State: Replica: 02bdf326542e474cbe62434dd59087dc, State: Running, Role: LEADER
I20260203 21:10:27.997385 3324 consensus_queue.cc:237] T d019bac79b874559b718570d502c5a13 P 02bdf326542e474cbe62434dd59087dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:27.997614 3278 raft_consensus.cc:359] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:27.997702 3278 raft_consensus.cc:385] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:27.997731 3278 raft_consensus.cc:740] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02bdf326542e474cbe62434dd59087dc, State: Initialized, Role: FOLLOWER
I20260203 21:10:27.997849 3278 consensus_queue.cc:260] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:27.998186 3278 ts_tablet_manager.cc:1434] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260203 21:10:28.002317 3280 tablet_bootstrap.cc:492] T 4d6ed92d766244489541e1c280afacb5 P 6d9e0cecab784cc0acc050ca1c89c5be: No bootstrap required, opened a new log
I20260203 21:10:28.002403 3280 ts_tablet_manager.cc:1403] T 4d6ed92d766244489541e1c280afacb5 P 6d9e0cecab784cc0acc050ca1c89c5be: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.001s
I20260203 21:10:28.002962 3280 raft_consensus.cc:359] T 4d6ed92d766244489541e1c280afacb5 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:28.003043 3280 raft_consensus.cc:385] T 4d6ed92d766244489541e1c280afacb5 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:28.003062 3280 raft_consensus.cc:740] T 4d6ed92d766244489541e1c280afacb5 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d9e0cecab784cc0acc050ca1c89c5be, State: Initialized, Role: FOLLOWER
I20260203 21:10:28.003156 3280 consensus_queue.cc:260] T 4d6ed92d766244489541e1c280afacb5 P 6d9e0cecab784cc0acc050ca1c89c5be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:28.003371 3280 ts_tablet_manager.cc:1434] T 4d6ed92d766244489541e1c280afacb5 P 6d9e0cecab784cc0acc050ca1c89c5be: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260203 21:10:28.081210 3289 raft_consensus.cc:493] T 4d6ed92d766244489541e1c280afacb5 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 21:10:28.081365 3289 raft_consensus.cc:515] T 4d6ed92d766244489541e1c280afacb5 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:28.081868 3289 leader_election.cc:290] T 4d6ed92d766244489541e1c280afacb5 P 185c63f61a2645928eeb807d145026b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335), 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897)
I20260203 21:10:28.082500 2785 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4d6ed92d766244489541e1c280afacb5" candidate_uuid: "185c63f61a2645928eeb807d145026b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02bdf326542e474cbe62434dd59087dc" is_pre_election: true
I20260203 21:10:28.082665 2785 raft_consensus.cc:2468] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 185c63f61a2645928eeb807d145026b1 in term 0.
I20260203 21:10:28.082937 3310 raft_consensus.cc:493] T d6c50af1a05941fe98418d50fbb0009b P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 21:10:28.083050 3310 raft_consensus.cc:515] T d6c50af1a05941fe98418d50fbb0009b P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:28.083434 3310 leader_election.cc:290] T d6c50af1a05941fe98418d50fbb0009b P 6d9e0cecab784cc0acc050ca1c89c5be [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
I20260203 21:10:28.084314 3058 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d6c50af1a05941fe98418d50fbb0009b" candidate_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "185c63f61a2645928eeb807d145026b1" is_pre_election: true
I20260203 21:10:28.084450 3058 raft_consensus.cc:2468] T d6c50af1a05941fe98418d50fbb0009b P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d9e0cecab784cc0acc050ca1c89c5be in term 0.
I20260203 21:10:28.084903 2923 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4d6ed92d766244489541e1c280afacb5" candidate_uuid: "185c63f61a2645928eeb807d145026b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" is_pre_election: true
I20260203 21:10:28.085032 2923 raft_consensus.cc:2468] T 4d6ed92d766244489541e1c280afacb5 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 185c63f61a2645928eeb807d145026b1 in term 0.
I20260203 21:10:28.085446 2993 leader_election.cc:304] T 4d6ed92d766244489541e1c280afacb5 P 185c63f61a2645928eeb807d145026b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc, 185c63f61a2645928eeb807d145026b1; no voters:
I20260203 21:10:28.085664 2858 leader_election.cc:304] T d6c50af1a05941fe98418d50fbb0009b P 6d9e0cecab784cc0acc050ca1c89c5be [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be; no voters:
I20260203 21:10:28.086265 2785 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d6c50af1a05941fe98418d50fbb0009b" candidate_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02bdf326542e474cbe62434dd59087dc" is_pre_election: true
I20260203 21:10:28.086400 2785 raft_consensus.cc:2468] T d6c50af1a05941fe98418d50fbb0009b P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d9e0cecab784cc0acc050ca1c89c5be in term 0.
I20260203 21:10:28.086813 3310 raft_consensus.cc:2804] T d6c50af1a05941fe98418d50fbb0009b P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 21:10:28.086876 3310 raft_consensus.cc:493] T d6c50af1a05941fe98418d50fbb0009b P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 21:10:28.086917 3310 raft_consensus.cc:3060] T d6c50af1a05941fe98418d50fbb0009b P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:28.087742 3289 raft_consensus.cc:2804] T 4d6ed92d766244489541e1c280afacb5 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 21:10:28.087817 3289 raft_consensus.cc:493] T 4d6ed92d766244489541e1c280afacb5 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 21:10:28.087859 3289 raft_consensus.cc:3060] T 4d6ed92d766244489541e1c280afacb5 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:28.088869 3289 raft_consensus.cc:515] T 4d6ed92d766244489541e1c280afacb5 P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:28.089205 3289 leader_election.cc:290] T 4d6ed92d766244489541e1c280afacb5 P 185c63f61a2645928eeb807d145026b1 [CANDIDATE]: Term 1 election: Requested vote from peers 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335), 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897)
I20260203 21:10:28.089792 2923 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4d6ed92d766244489541e1c280afacb5" candidate_uuid: "185c63f61a2645928eeb807d145026b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d9e0cecab784cc0acc050ca1c89c5be"
I20260203 21:10:28.089900 2923 raft_consensus.cc:3060] T 4d6ed92d766244489541e1c280afacb5 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:28.090812 2923 raft_consensus.cc:2468] T 4d6ed92d766244489541e1c280afacb5 P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 185c63f61a2645928eeb807d145026b1 in term 1.
I20260203 21:10:28.091061 2785 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4d6ed92d766244489541e1c280afacb5" candidate_uuid: "185c63f61a2645928eeb807d145026b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02bdf326542e474cbe62434dd59087dc"
I20260203 21:10:28.091184 2785 raft_consensus.cc:3060] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:28.092144 2785 raft_consensus.cc:2468] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 185c63f61a2645928eeb807d145026b1 in term 1.
I20260203 21:10:28.092468 2995 leader_election.cc:304] T 4d6ed92d766244489541e1c280afacb5 P 185c63f61a2645928eeb807d145026b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be; no voters:
I20260203 21:10:28.093032 3310 raft_consensus.cc:515] T d6c50af1a05941fe98418d50fbb0009b P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:28.093379 3310 leader_election.cc:290] T d6c50af1a05941fe98418d50fbb0009b P 6d9e0cecab784cc0acc050ca1c89c5be [CANDIDATE]: Term 1 election: Requested vote from peers 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
I20260203 21:10:28.094008 3058 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d6c50af1a05941fe98418d50fbb0009b" candidate_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "185c63f61a2645928eeb807d145026b1"
I20260203 21:10:28.094118 3058 raft_consensus.cc:3060] T d6c50af1a05941fe98418d50fbb0009b P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:28.095011 3058 raft_consensus.cc:2468] T d6c50af1a05941fe98418d50fbb0009b P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d9e0cecab784cc0acc050ca1c89c5be in term 1.
I20260203 21:10:28.095327 2858 leader_election.cc:304] T d6c50af1a05941fe98418d50fbb0009b P 6d9e0cecab784cc0acc050ca1c89c5be [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be; no voters:
I20260203 21:10:28.095556 2785 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d6c50af1a05941fe98418d50fbb0009b" candidate_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02bdf326542e474cbe62434dd59087dc"
I20260203 21:10:28.095715 2785 raft_consensus.cc:3060] T d6c50af1a05941fe98418d50fbb0009b P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:28.096585 2785 raft_consensus.cc:2468] T d6c50af1a05941fe98418d50fbb0009b P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d9e0cecab784cc0acc050ca1c89c5be in term 1.
I20260203 21:10:28.097100 3310 raft_consensus.cc:2804] T d6c50af1a05941fe98418d50fbb0009b P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 FOLLOWER]: Leader election won for term 1
I20260203 21:10:28.097204 3310 raft_consensus.cc:697] T d6c50af1a05941fe98418d50fbb0009b P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 LEADER]: Becoming Leader. State: Replica: 6d9e0cecab784cc0acc050ca1c89c5be, State: Running, Role: LEADER
I20260203 21:10:28.097344 3310 consensus_queue.cc:237] T d6c50af1a05941fe98418d50fbb0009b P 6d9e0cecab784cc0acc050ca1c89c5be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:28.098383 3289 raft_consensus.cc:2804] T 4d6ed92d766244489541e1c280afacb5 P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260203 21:10:28.098618 3289 raft_consensus.cc:697] T 4d6ed92d766244489541e1c280afacb5 P 185c63f61a2645928eeb807d145026b1 [term 1 LEADER]: Becoming Leader. State: Replica: 185c63f61a2645928eeb807d145026b1, State: Running, Role: LEADER
I20260203 21:10:28.098896 3289 consensus_queue.cc:237] T 4d6ed92d766244489541e1c280afacb5 P 185c63f61a2645928eeb807d145026b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:28.106770 3289 raft_consensus.cc:493] T 7786ef435bbd44daae12d3ee4728efb9 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 21:10:28.106869 3289 raft_consensus.cc:515] T 7786ef435bbd44daae12d3ee4728efb9 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:28.107488 2785 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7786ef435bbd44daae12d3ee4728efb9" candidate_uuid: "185c63f61a2645928eeb807d145026b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02bdf326542e474cbe62434dd59087dc" is_pre_election: true
I20260203 21:10:28.107630 2785 raft_consensus.cc:2468] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 185c63f61a2645928eeb807d145026b1 in term 0.
I20260203 21:10:28.107980 2993 leader_election.cc:304] T 7786ef435bbd44daae12d3ee4728efb9 P 185c63f61a2645928eeb807d145026b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc, 185c63f61a2645928eeb807d145026b1; no voters:
I20260203 21:10:28.108165 3340 raft_consensus.cc:2804] T 7786ef435bbd44daae12d3ee4728efb9 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 21:10:28.108217 3340 raft_consensus.cc:493] T 7786ef435bbd44daae12d3ee4728efb9 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 21:10:28.108204 2923 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7786ef435bbd44daae12d3ee4728efb9" candidate_uuid: "185c63f61a2645928eeb807d145026b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" is_pre_election: true
I20260203 21:10:28.108266 3340 raft_consensus.cc:3060] T 7786ef435bbd44daae12d3ee4728efb9 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:28.108328 2923 raft_consensus.cc:2468] T 7786ef435bbd44daae12d3ee4728efb9 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 185c63f61a2645928eeb807d145026b1 in term 0.
I20260203 21:10:28.108649 3289 leader_election.cc:290] T 7786ef435bbd44daae12d3ee4728efb9 P 185c63f61a2645928eeb807d145026b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335), 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897)
I20260203 21:10:28.109334 3340 raft_consensus.cc:515] T 7786ef435bbd44daae12d3ee4728efb9 P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:28.109659 3340 leader_election.cc:290] T 7786ef435bbd44daae12d3ee4728efb9 P 185c63f61a2645928eeb807d145026b1 [CANDIDATE]: Term 1 election: Requested vote from peers 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335), 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897)
I20260203 21:10:28.110164 2785 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7786ef435bbd44daae12d3ee4728efb9" candidate_uuid: "185c63f61a2645928eeb807d145026b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02bdf326542e474cbe62434dd59087dc"
I20260203 21:10:28.110286 2785 raft_consensus.cc:3060] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:28.111378 2785 raft_consensus.cc:2468] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 185c63f61a2645928eeb807d145026b1 in term 1.
I20260203 21:10:28.111740 2993 leader_election.cc:304] T 7786ef435bbd44daae12d3ee4728efb9 P 185c63f61a2645928eeb807d145026b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc, 185c63f61a2645928eeb807d145026b1; no voters:
I20260203 21:10:28.111785 2923 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7786ef435bbd44daae12d3ee4728efb9" candidate_uuid: "185c63f61a2645928eeb807d145026b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d9e0cecab784cc0acc050ca1c89c5be"
I20260203 21:10:28.111923 2923 raft_consensus.cc:3060] T 7786ef435bbd44daae12d3ee4728efb9 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:28.112141 3340 raft_consensus.cc:2804] T 7786ef435bbd44daae12d3ee4728efb9 P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260203 21:10:28.112234 3340 raft_consensus.cc:697] T 7786ef435bbd44daae12d3ee4728efb9 P 185c63f61a2645928eeb807d145026b1 [term 1 LEADER]: Becoming Leader. State: Replica: 185c63f61a2645928eeb807d145026b1, State: Running, Role: LEADER
I20260203 21:10:28.112365 3340 consensus_queue.cc:237] T 7786ef435bbd44daae12d3ee4728efb9 P 185c63f61a2645928eeb807d145026b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:28.112872 2923 raft_consensus.cc:2468] T 7786ef435bbd44daae12d3ee4728efb9 P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 185c63f61a2645928eeb807d145026b1 in term 1.
I20260203 21:10:28.113189 3310 raft_consensus.cc:493] T 3ae68905ec1942448b444ecd01836805 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 21:10:28.113279 3310 raft_consensus.cc:515] T 3ae68905ec1942448b444ecd01836805 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:28.113628 3310 leader_election.cc:290] T 3ae68905ec1942448b444ecd01836805 P 6d9e0cecab784cc0acc050ca1c89c5be [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
I20260203 21:10:28.114431 3058 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3ae68905ec1942448b444ecd01836805" candidate_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "185c63f61a2645928eeb807d145026b1" is_pre_election: true
I20260203 21:10:28.114550 3058 raft_consensus.cc:2468] T 3ae68905ec1942448b444ecd01836805 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d9e0cecab784cc0acc050ca1c89c5be in term 0.
I20260203 21:10:28.115173 2858 leader_election.cc:304] T 3ae68905ec1942448b444ecd01836805 P 6d9e0cecab784cc0acc050ca1c89c5be [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be; no voters:
I20260203 21:10:28.115340 3310 raft_consensus.cc:2804] T 3ae68905ec1942448b444ecd01836805 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 21:10:28.115393 3310 raft_consensus.cc:493] T 3ae68905ec1942448b444ecd01836805 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 21:10:28.115437 3310 raft_consensus.cc:3060] T 3ae68905ec1942448b444ecd01836805 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:28.116371 3310 raft_consensus.cc:515] T 3ae68905ec1942448b444ecd01836805 P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:28.116775 3310 leader_election.cc:290] T 3ae68905ec1942448b444ecd01836805 P 6d9e0cecab784cc0acc050ca1c89c5be [CANDIDATE]: Term 1 election: Requested vote from peers 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
I20260203 21:10:28.117532 2785 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3ae68905ec1942448b444ecd01836805" candidate_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02bdf326542e474cbe62434dd59087dc" is_pre_election: true
I20260203 21:10:28.117671 2785 raft_consensus.cc:2468] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d9e0cecab784cc0acc050ca1c89c5be in term 0.
I20260203 21:10:28.118835 2785 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3ae68905ec1942448b444ecd01836805" candidate_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02bdf326542e474cbe62434dd59087dc"
I20260203 21:10:28.118940 2785 raft_consensus.cc:3060] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:28.119840 2785 raft_consensus.cc:2468] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d9e0cecab784cc0acc050ca1c89c5be in term 1.
I20260203 21:10:28.120102 2857 leader_election.cc:304] T 3ae68905ec1942448b444ecd01836805 P 6d9e0cecab784cc0acc050ca1c89c5be [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc, 6d9e0cecab784cc0acc050ca1c89c5be; no voters:
I20260203 21:10:28.120393 3058 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3ae68905ec1942448b444ecd01836805" candidate_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "185c63f61a2645928eeb807d145026b1"
I20260203 21:10:28.120502 3058 raft_consensus.cc:3060] T 3ae68905ec1942448b444ecd01836805 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:28.121291 3058 raft_consensus.cc:2468] T 3ae68905ec1942448b444ecd01836805 P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d9e0cecab784cc0acc050ca1c89c5be in term 1.
I20260203 21:10:28.122462 3310 raft_consensus.cc:2804] T 3ae68905ec1942448b444ecd01836805 P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 FOLLOWER]: Leader election won for term 1
I20260203 21:10:28.122555 3310 raft_consensus.cc:697] T 3ae68905ec1942448b444ecd01836805 P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 LEADER]: Becoming Leader. State: Replica: 6d9e0cecab784cc0acc050ca1c89c5be, State: Running, Role: LEADER
I20260203 21:10:28.122689 3310 consensus_queue.cc:237] T 3ae68905ec1942448b444ecd01836805 P 6d9e0cecab784cc0acc050ca1c89c5be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:28.134963 3298 raft_consensus.cc:493] T e540d65d585c4ba1bd1bfaf62ba41fb5 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 21:10:28.135092 3298 raft_consensus.cc:515] T e540d65d585c4ba1bd1bfaf62ba41fb5 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:28.135488 3298 leader_election.cc:290] T e540d65d585c4ba1bd1bfaf62ba41fb5 P 6d9e0cecab784cc0acc050ca1c89c5be [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
I20260203 21:10:28.135988 2785 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e540d65d585c4ba1bd1bfaf62ba41fb5" candidate_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02bdf326542e474cbe62434dd59087dc" is_pre_election: true
I20260203 21:10:28.136119 2785 raft_consensus.cc:2468] T e540d65d585c4ba1bd1bfaf62ba41fb5 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d9e0cecab784cc0acc050ca1c89c5be in term 0.
I20260203 21:10:28.136613 3058 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e540d65d585c4ba1bd1bfaf62ba41fb5" candidate_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "185c63f61a2645928eeb807d145026b1" is_pre_election: true
I20260203 21:10:28.136754 3058 raft_consensus.cc:2468] T e540d65d585c4ba1bd1bfaf62ba41fb5 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d9e0cecab784cc0acc050ca1c89c5be in term 0.
I20260203 21:10:28.137135 2857 leader_election.cc:304] T e540d65d585c4ba1bd1bfaf62ba41fb5 P 6d9e0cecab784cc0acc050ca1c89c5be [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc, 6d9e0cecab784cc0acc050ca1c89c5be; no voters:
I20260203 21:10:28.137322 3298 raft_consensus.cc:2804] T e540d65d585c4ba1bd1bfaf62ba41fb5 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 21:10:28.137389 3298 raft_consensus.cc:493] T e540d65d585c4ba1bd1bfaf62ba41fb5 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 21:10:28.137432 3298 raft_consensus.cc:3060] T e540d65d585c4ba1bd1bfaf62ba41fb5 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:28.138437 3298 raft_consensus.cc:515] T e540d65d585c4ba1bd1bfaf62ba41fb5 P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:28.138774 3298 leader_election.cc:290] T e540d65d585c4ba1bd1bfaf62ba41fb5 P 6d9e0cecab784cc0acc050ca1c89c5be [CANDIDATE]: Term 1 election: Requested vote from peers 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
I20260203 21:10:28.139084 2785 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e540d65d585c4ba1bd1bfaf62ba41fb5" candidate_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02bdf326542e474cbe62434dd59087dc"
I20260203 21:10:28.139192 2785 raft_consensus.cc:3060] T e540d65d585c4ba1bd1bfaf62ba41fb5 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:28.139312 3058 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e540d65d585c4ba1bd1bfaf62ba41fb5" candidate_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "185c63f61a2645928eeb807d145026b1"
I20260203 21:10:28.139411 3058 raft_consensus.cc:3060] T e540d65d585c4ba1bd1bfaf62ba41fb5 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:28.140129 2785 raft_consensus.cc:2468] T e540d65d585c4ba1bd1bfaf62ba41fb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d9e0cecab784cc0acc050ca1c89c5be in term 1.
I20260203 21:10:28.140323 3058 raft_consensus.cc:2468] T e540d65d585c4ba1bd1bfaf62ba41fb5 P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d9e0cecab784cc0acc050ca1c89c5be in term 1.
I20260203 21:10:28.140668 2857 leader_election.cc:304] T e540d65d585c4ba1bd1bfaf62ba41fb5 P 6d9e0cecab784cc0acc050ca1c89c5be [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc, 6d9e0cecab784cc0acc050ca1c89c5be; no voters:
I20260203 21:10:28.140895 3298 raft_consensus.cc:2804] T e540d65d585c4ba1bd1bfaf62ba41fb5 P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 FOLLOWER]: Leader election won for term 1
I20260203 21:10:28.140982 3298 raft_consensus.cc:697] T e540d65d585c4ba1bd1bfaf62ba41fb5 P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 LEADER]: Becoming Leader. State: Replica: 6d9e0cecab784cc0acc050ca1c89c5be, State: Running, Role: LEADER
I20260203 21:10:28.141119 3298 consensus_queue.cc:237] T e540d65d585c4ba1bd1bfaf62ba41fb5 P 6d9e0cecab784cc0acc050ca1c89c5be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:28.167182 3298 consensus_queue.cc:1048] T c45683f20a454401bfb90b41570b5125 P 6d9e0cecab784cc0acc050ca1c89c5be [LEADER]: Connected to new peer: Peer: permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 21:10:28.177838 3310 consensus_queue.cc:1048] T c45683f20a454401bfb90b41570b5125 P 6d9e0cecab784cc0acc050ca1c89c5be [LEADER]: Connected to new peer: Peer: permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 21:10:28.225059 2452 catalog_manager.cc:3485] renamed table default.table_1d3ace06028643bba1fbb9d430213ff5 [id=a995c742bb2942838a2385b05a4d4d57] in HMS: new name default.table_800a192f4e9e4ca5806a324b36234706
W20260203 21:10:28.228089 2443 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_75f7568b9f28464e8d4ce934087b320e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260203 21:10:28.228152 2448 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_76bef700d9b64243b6b4e93ffbc64f7a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260203 21:10:28.228834 2445 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_8bbf49750e3f4eccbcf97c6346c65635 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260203 21:10:28.238049 2669 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7786ef435bbd44daae12d3ee4728efb9 consensus state has no leader
I20260203 21:10:28.240060 2452 catalog_manager.cc:5654] T d019bac79b874559b718570d502c5a13 P 02bdf326542e474cbe62434dd59087dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 02bdf326542e474cbe62434dd59087dc (127.2.32.129). New cstate: current_term: 1 leader_uuid: "02bdf326542e474cbe62434dd59087dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } health_report { overall_health: UNKNOWN } } }
I20260203 21:10:28.245693 2452 catalog_manager.cc:5654] T 4d6ed92d766244489541e1c280afacb5 P 185c63f61a2645928eeb807d145026b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 185c63f61a2645928eeb807d145026b1 (127.2.32.131). New cstate: current_term: 1 leader_uuid: "185c63f61a2645928eeb807d145026b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } health_report { overall_health: HEALTHY } } }
I20260203 21:10:28.245980 2452 catalog_manager.cc:5654] T 7786ef435bbd44daae12d3ee4728efb9 P 185c63f61a2645928eeb807d145026b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 185c63f61a2645928eeb807d145026b1 (127.2.32.131). New cstate: current_term: 1 leader_uuid: "185c63f61a2645928eeb807d145026b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } health_report { overall_health: HEALTHY } } }
I20260203 21:10:28.246155 2452 catalog_manager.cc:5746] TS 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223) does not have the latest schema for tablet 7786ef435bbd44daae12d3ee4728efb9 (table default.table_800a192f4e9e4ca5806a324b36234706 [id=a995c742bb2942838a2385b05a4d4d57]). Expected version 1 got 0
I20260203 21:10:28.259704 2452 catalog_manager.cc:5654] T d6c50af1a05941fe98418d50fbb0009b P 6d9e0cecab784cc0acc050ca1c89c5be reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130). New cstate: current_term: 1 leader_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } health_report { overall_health: UNKNOWN } } }
I20260203 21:10:28.260238 2452 catalog_manager.cc:5654] T e540d65d585c4ba1bd1bfaf62ba41fb5 P 6d9e0cecab784cc0acc050ca1c89c5be reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130). New cstate: current_term: 1 leader_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } health_report { overall_health: UNKNOWN } } }
I20260203 21:10:28.260409 2452 catalog_manager.cc:5654] T 3ae68905ec1942448b444ecd01836805 P 6d9e0cecab784cc0acc050ca1c89c5be reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130). New cstate: current_term: 1 leader_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } health_report { overall_health: UNKNOWN } } }
I20260203 21:10:28.265143 3282 raft_consensus.cc:493] T eb6a21a5b1ee454691237d0b160c9a3c P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 21:10:28.265247 3282 raft_consensus.cc:515] T eb6a21a5b1ee454691237d0b160c9a3c P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:28.265638 3282 leader_election.cc:290] T eb6a21a5b1ee454691237d0b160c9a3c P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
I20260203 21:10:28.266224 2923 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "eb6a21a5b1ee454691237d0b160c9a3c" candidate_uuid: "02bdf326542e474cbe62434dd59087dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" is_pre_election: true
I20260203 21:10:28.266362 2923 raft_consensus.cc:2468] T eb6a21a5b1ee454691237d0b160c9a3c P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02bdf326542e474cbe62434dd59087dc in term 0.
I20260203 21:10:28.266614 3058 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "eb6a21a5b1ee454691237d0b160c9a3c" candidate_uuid: "02bdf326542e474cbe62434dd59087dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "185c63f61a2645928eeb807d145026b1" is_pre_election: true
I20260203 21:10:28.266760 3058 raft_consensus.cc:2468] T eb6a21a5b1ee454691237d0b160c9a3c P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02bdf326542e474cbe62434dd59087dc in term 0.
I20260203 21:10:28.267194 2720 leader_election.cc:304] T eb6a21a5b1ee454691237d0b160c9a3c P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc, 185c63f61a2645928eeb807d145026b1; no voters:
I20260203 21:10:28.267470 3282 raft_consensus.cc:2804] T eb6a21a5b1ee454691237d0b160c9a3c P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 21:10:28.267529 3282 raft_consensus.cc:493] T eb6a21a5b1ee454691237d0b160c9a3c P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 21:10:28.267575 3282 raft_consensus.cc:3060] T eb6a21a5b1ee454691237d0b160c9a3c P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:28.268566 3282 raft_consensus.cc:515] T eb6a21a5b1ee454691237d0b160c9a3c P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:28.268931 3282 leader_election.cc:290] T eb6a21a5b1ee454691237d0b160c9a3c P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 1 election: Requested vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
I20260203 21:10:28.269366 2923 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "eb6a21a5b1ee454691237d0b160c9a3c" candidate_uuid: "02bdf326542e474cbe62434dd59087dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d9e0cecab784cc0acc050ca1c89c5be"
I20260203 21:10:28.269387 3058 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "eb6a21a5b1ee454691237d0b160c9a3c" candidate_uuid: "02bdf326542e474cbe62434dd59087dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "185c63f61a2645928eeb807d145026b1"
I20260203 21:10:28.269469 2923 raft_consensus.cc:3060] T eb6a21a5b1ee454691237d0b160c9a3c P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:28.269520 3058 raft_consensus.cc:3060] T eb6a21a5b1ee454691237d0b160c9a3c P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:28.270138 2923 raft_consensus.cc:2468] T eb6a21a5b1ee454691237d0b160c9a3c P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02bdf326542e474cbe62434dd59087dc in term 1.
I20260203 21:10:28.270385 2721 leader_election.cc:304] T eb6a21a5b1ee454691237d0b160c9a3c P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc, 6d9e0cecab784cc0acc050ca1c89c5be; no voters:
I20260203 21:10:28.270493 3058 raft_consensus.cc:2468] T eb6a21a5b1ee454691237d0b160c9a3c P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02bdf326542e474cbe62434dd59087dc in term 1.
I20260203 21:10:28.270542 3282 raft_consensus.cc:2804] T eb6a21a5b1ee454691237d0b160c9a3c P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader election won for term 1
I20260203 21:10:28.270627 3282 raft_consensus.cc:697] T eb6a21a5b1ee454691237d0b160c9a3c P 02bdf326542e474cbe62434dd59087dc [term 1 LEADER]: Becoming Leader. State: Replica: 02bdf326542e474cbe62434dd59087dc, State: Running, Role: LEADER
I20260203 21:10:28.270771 3282 consensus_queue.cc:237] T eb6a21a5b1ee454691237d0b160c9a3c P 02bdf326542e474cbe62434dd59087dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:28.271811 2452 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57540:
name: "default.Table_4f93e096d30349908a32a33e024543d6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260203 21:10:28.279484 2785 raft_consensus.cc:1275] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Refusing update from remote peer 185c63f61a2645928eeb807d145026b1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260203 21:10:28.279973 3340 consensus_queue.cc:1048] T 7786ef435bbd44daae12d3ee4728efb9 P 185c63f61a2645928eeb807d145026b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 21:10:28.282572 2923 raft_consensus.cc:1275] T 7786ef435bbd44daae12d3ee4728efb9 P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 FOLLOWER]: Refusing update from remote peer 185c63f61a2645928eeb807d145026b1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260203 21:10:28.283056 3340 consensus_queue.cc:1048] T 7786ef435bbd44daae12d3ee4728efb9 P 185c63f61a2645928eeb807d145026b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 21:10:28.292690 3349 mvcc.cc:204] Tried to move back new op lower bound from 7250546803826642944 to 7250546803149713408. Current Snapshot: MvccSnapshot[applied={T|T < 7250546803826642944}]
I20260203 21:10:28.296080 3346 mvcc.cc:204] Tried to move back new op lower bound from 7250546803826642944 to 7250546803149713408. Current Snapshot: MvccSnapshot[applied={T|T < 7250546803826642944}]
I20260203 21:10:28.310312 3347 mvcc.cc:204] Tried to move back new op lower bound from 7250546803826642944 to 7250546803149713408. Current Snapshot: MvccSnapshot[applied={T|T < 7250546803826642944}]
I20260203 21:10:28.315763 3354 tablet.cc:1722] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260203 21:10:28.317230 3355 tablet.cc:1722] T 7786ef435bbd44daae12d3ee4728efb9 P 6d9e0cecab784cc0acc050ca1c89c5be: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260203 21:10:28.317888 3353 tablet.cc:1722] T 7786ef435bbd44daae12d3ee4728efb9 P 185c63f61a2645928eeb807d145026b1: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260203 21:10:28.357375 3298 consensus_queue.cc:1048] T 20fec52d63a34162bb79805433de62c0 P 6d9e0cecab784cc0acc050ca1c89c5be [LEADER]: Connected to new peer: Peer: permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 21:10:28.368881 3338 consensus_queue.cc:1048] T 930cb06bcbca41e08ac12d60a0d3b6cb P 02bdf326542e474cbe62434dd59087dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 21:10:28.371299 3284 consensus_queue.cc:1048] T 20fec52d63a34162bb79805433de62c0 P 6d9e0cecab784cc0acc050ca1c89c5be [LEADER]: Connected to new peer: Peer: permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 21:10:28.380127 3324 consensus_queue.cc:1048] T 930cb06bcbca41e08ac12d60a0d3b6cb P 02bdf326542e474cbe62434dd59087dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 21:10:28.430244 3324 consensus_queue.cc:1048] T d019bac79b874559b718570d502c5a13 P 02bdf326542e474cbe62434dd59087dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 21:10:28.439761 3282 consensus_queue.cc:1048] T d019bac79b874559b718570d502c5a13 P 02bdf326542e474cbe62434dd59087dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 21:10:28.510340 3310 consensus_queue.cc:1048] T 3ae68905ec1942448b444ecd01836805 P 6d9e0cecab784cc0acc050ca1c89c5be [LEADER]: Connected to new peer: Peer: permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 21:10:28.515496 3310 consensus_queue.cc:1048] T 3ae68905ec1942448b444ecd01836805 P 6d9e0cecab784cc0acc050ca1c89c5be [LEADER]: Connected to new peer: Peer: permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 21:10:28.530557 3310 consensus_queue.cc:1048] T d6c50af1a05941fe98418d50fbb0009b P 6d9e0cecab784cc0acc050ca1c89c5be [LEADER]: Connected to new peer: Peer: permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 21:10:28.536271 3289 consensus_queue.cc:1048] T 4d6ed92d766244489541e1c280afacb5 P 185c63f61a2645928eeb807d145026b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 21:10:28.550632 3340 consensus_queue.cc:1048] T 4d6ed92d766244489541e1c280afacb5 P 185c63f61a2645928eeb807d145026b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 21:10:28.551404 3284 consensus_queue.cc:1048] T d6c50af1a05941fe98418d50fbb0009b P 6d9e0cecab784cc0acc050ca1c89c5be [LEADER]: Connected to new peer: Peer: permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 21:10:28.566768 3298 consensus_queue.cc:1048] T e540d65d585c4ba1bd1bfaf62ba41fb5 P 6d9e0cecab784cc0acc050ca1c89c5be [LEADER]: Connected to new peer: Peer: permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 21:10:28.575403 3284 consensus_queue.cc:1048] T e540d65d585c4ba1bd1bfaf62ba41fb5 P 6d9e0cecab784cc0acc050ca1c89c5be [LEADER]: Connected to new peer: Peer: permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 21:10:28.635262 2451 catalog_manager.cc:2731] deleted HMS catalog entry for table default.table_8695f3c31a784599917744b6d57e2a18 [id=d3ee372fbea0402796f488b9f48638b9]
I20260203 21:10:28.648896 3282 consensus_queue.cc:1048] T eb6a21a5b1ee454691237d0b160c9a3c P 02bdf326542e474cbe62434dd59087dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 21:10:28.657198 3324 consensus_queue.cc:1048] T eb6a21a5b1ee454691237d0b160c9a3c P 02bdf326542e474cbe62434dd59087dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 21:10:28.684762 2447 catalog_manager.cc:2731] deleted HMS catalog entry for table default.table_42d2deb9edf04a3b8ce372f18fff2cf1 [id=cc496c5ba7e8461b8020f3ab100304c8]
I20260203 21:10:28.763950 2449 catalog_manager.cc:3485] renamed table default.table_8276b49c70934289816f902b52d97652 [id=333213fed7234610bc20c7d92124182b] in HMS: new name default.table_547d99db0d3043499a26ee8c6df4c443
I20260203 21:10:28.764366 3373 raft_consensus.cc:493] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7344d7cd8dea4fa2ae705320daacaf49)
I20260203 21:10:28.764487 3373 raft_consensus.cc:515] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:10:28.765314 2462 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "35397be7e61f4b27a49e9449b9fdf085" candidate_term: 3 candidate_status { last_received { term: 2 index: 39 } } ignore_live_leader: false dest_uuid: "7344d7cd8dea4fa2ae705320daacaf49" is_pre_election: true
I20260203 21:10:28.766427 3373 leader_election.cc:290] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419), 8a7e51013f5041898fe34f4b64a59260 (127.2.32.188:33665)
I20260203 21:10:28.766685 3372 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7344d7cd8dea4fa2ae705320daacaf49)
I20260203 21:10:28.766880 3372 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:10:28.768786 2462 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8a7e51013f5041898fe34f4b64a59260" candidate_term: 3 candidate_status { last_received { term: 2 index: 39 } } ignore_live_leader: false dest_uuid: "7344d7cd8dea4fa2ae705320daacaf49" is_pre_election: true
I20260203 21:10:28.768904 3372 leader_election.cc:290] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419), 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681)
I20260203 21:10:28.769114 2533 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8a7e51013f5041898fe34f4b64a59260" candidate_term: 3 candidate_status { last_received { term: 2 index: 39 } } ignore_live_leader: false dest_uuid: "35397be7e61f4b27a49e9449b9fdf085" is_pre_election: true
I20260203 21:10:28.769232 2533 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a7e51013f5041898fe34f4b64a59260 in term 2.
I20260203 21:10:28.769600 3180 leader_election.cc:304] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35397be7e61f4b27a49e9449b9fdf085, 8a7e51013f5041898fe34f4b64a59260; no voters:
I20260203 21:10:28.770109 3372 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260203 21:10:28.770165 3372 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7344d7cd8dea4fa2ae705320daacaf49)
I20260203 21:10:28.770203 3372 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 2 FOLLOWER]: Advancing to term 3
I20260203 21:10:28.771533 3372 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:10:28.772197 2462 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8a7e51013f5041898fe34f4b64a59260" candidate_term: 3 candidate_status { last_received { term: 2 index: 39 } } ignore_live_leader: false dest_uuid: "7344d7cd8dea4fa2ae705320daacaf49"
I20260203 21:10:28.772796 2533 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8a7e51013f5041898fe34f4b64a59260" candidate_term: 3 candidate_status { last_received { term: 2 index: 39 } } ignore_live_leader: false dest_uuid: "35397be7e61f4b27a49e9449b9fdf085"
I20260203 21:10:28.772917 2533 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [term 2 FOLLOWER]: Advancing to term 3
I20260203 21:10:28.773957 2533 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a7e51013f5041898fe34f4b64a59260 in term 3.
I20260203 21:10:28.774276 3180 leader_election.cc:304] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35397be7e61f4b27a49e9449b9fdf085, 8a7e51013f5041898fe34f4b64a59260; no voters: 7344d7cd8dea4fa2ae705320daacaf49
I20260203 21:10:28.774504 3372 leader_election.cc:290] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 3 election: Requested vote from peers 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419), 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681)
I20260203 21:10:28.774689 3372 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 3 FOLLOWER]: Leader election won for term 3
I20260203 21:10:28.774775 3372 raft_consensus.cc:697] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 3 LEADER]: Becoming Leader. State: Replica: 8a7e51013f5041898fe34f4b64a59260, State: Running, Role: LEADER
I20260203 21:10:28.776067 3372 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 39, Committed index: 39, Last appended: 2.39, Last appended by leader: 39, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:10:28.777971 3372 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8a7e51013f5041898fe34f4b64a59260. Latest consensus state: current_term: 3 leader_uuid: "8a7e51013f5041898fe34f4b64a59260" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } } }
I20260203 21:10:28.778079 3372 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [sys.catalog]: This master's current role is: LEADER
I20260203 21:10:28.783977 3378 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260203 21:10:28.787525 3378 catalog_manager.cc:679] Loaded metadata for table default.table_8276b49c70934289816f902b52d97652 [id=333213fed7234610bc20c7d92124182b]
I20260203 21:10:28.787912 3378 catalog_manager.cc:679] Loaded metadata for table default.table_dde2cdf1f5254cb49f3053855a83891e [id=467e79ec835d45669e3155e07b8ba81f]
I20260203 21:10:28.788166 3378 catalog_manager.cc:679] Loaded metadata for table default.table_ae3f050e71c94082b0e88a08167c762f [id=73eae179f2ad481d932a5b3c95b1a4ab]
I20260203 21:10:28.788398 3378 catalog_manager.cc:679] Loaded metadata for table default.table_bdb9340290f84eada371f9d8304fcd67 [id=82ec5c95acc84e509c0803db74b626b4]
I20260203 21:10:28.788618 3378 catalog_manager.cc:679] Loaded metadata for table default.table_c2985ddec2e045cba153900329fe9331 [id=85725aeaace648d9ac1bb5d3940d0ad0]
I20260203 21:10:28.788839 3378 catalog_manager.cc:679] Loaded metadata for table default.table_09e62d0aaa0f48ad9ed818ba967be542 [id=a26f4a67278a4929b2378fbbe9baaf52]
I20260203 21:10:28.789078 3378 catalog_manager.cc:679] Loaded metadata for table default.table_800a192f4e9e4ca5806a324b36234706 [id=a995c742bb2942838a2385b05a4d4d57]
I20260203 21:10:28.789294 3378 catalog_manager.cc:679] Loaded metadata for table default.table_66c508c8dbdd4e7ea9283cabe65b62c0 [id=b62df06982124a70936068823e4b2324]
I20260203 21:10:28.789498 3378 catalog_manager.cc:679] Loaded metadata for table default.table_42d2deb9edf04a3b8ce372f18fff2cf1 [id=cc496c5ba7e8461b8020f3ab100304c8]
I20260203 21:10:28.789703 3378 catalog_manager.cc:679] Loaded metadata for table default.table_8695f3c31a784599917744b6d57e2a18 [id=d3ee372fbea0402796f488b9f48638b9]
I20260203 21:10:28.791114 3378 tablet_loader.cc:96] loaded metadata for tablet 20fec52d63a34162bb79805433de62c0 (table default.table_8276b49c70934289816f902b52d97652 [id=333213fed7234610bc20c7d92124182b])
I20260203 21:10:28.791348 3378 tablet_loader.cc:96] loaded metadata for tablet 3ae68905ec1942448b444ecd01836805 (table default.table_c2985ddec2e045cba153900329fe9331 [id=85725aeaace648d9ac1bb5d3940d0ad0])
I20260203 21:10:28.791548 3378 tablet_loader.cc:96] loaded metadata for tablet 4d6ed92d766244489541e1c280afacb5 (table default.table_09e62d0aaa0f48ad9ed818ba967be542 [id=a26f4a67278a4929b2378fbbe9baaf52])
I20260203 21:10:28.791792 3378 tablet_loader.cc:96] loaded metadata for tablet 7786ef435bbd44daae12d3ee4728efb9 (table default.table_800a192f4e9e4ca5806a324b36234706 [id=a995c742bb2942838a2385b05a4d4d57])
I20260203 21:10:28.791990 3378 tablet_loader.cc:96] loaded metadata for tablet 930cb06bcbca41e08ac12d60a0d3b6cb (table default.table_8695f3c31a784599917744b6d57e2a18 [id=d3ee372fbea0402796f488b9f48638b9])
I20260203 21:10:28.792186 3378 tablet_loader.cc:96] loaded metadata for tablet c45683f20a454401bfb90b41570b5125 (table default.table_42d2deb9edf04a3b8ce372f18fff2cf1 [id=cc496c5ba7e8461b8020f3ab100304c8])
I20260203 21:10:28.792371 3378 tablet_loader.cc:96] loaded metadata for tablet d019bac79b874559b718570d502c5a13 (table default.table_ae3f050e71c94082b0e88a08167c762f [id=73eae179f2ad481d932a5b3c95b1a4ab])
I20260203 21:10:28.792548 3378 tablet_loader.cc:96] loaded metadata for tablet d6c50af1a05941fe98418d50fbb0009b (table default.table_bdb9340290f84eada371f9d8304fcd67 [id=82ec5c95acc84e509c0803db74b626b4])
I20260203 21:10:28.792847 3378 tablet_loader.cc:96] loaded metadata for tablet e540d65d585c4ba1bd1bfaf62ba41fb5 (table default.table_dde2cdf1f5254cb49f3053855a83891e [id=467e79ec835d45669e3155e07b8ba81f])
I20260203 21:10:28.793015 3378 tablet_loader.cc:96] loaded metadata for tablet eb6a21a5b1ee454691237d0b160c9a3c (table default.table_66c508c8dbdd4e7ea9283cabe65b62c0 [id=b62df06982124a70936068823e4b2324])
I20260203 21:10:28.793373 3378 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260203 21:10:28.793393 3195 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "35397be7e61f4b27a49e9449b9fdf085" candidate_term: 3 candidate_status { last_received { term: 2 index: 39 } } ignore_live_leader: false dest_uuid: "8a7e51013f5041898fe34f4b64a59260" is_pre_election: true
I20260203 21:10:28.793946 2507 leader_election.cc:304] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35397be7e61f4b27a49e9449b9fdf085; no voters: 7344d7cd8dea4fa2ae705320daacaf49, 8a7e51013f5041898fe34f4b64a59260
I20260203 21:10:28.794248 3373 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260203 21:10:28.794651 3378 catalog_manager.cc:1269] Loaded cluster ID: f46367a11713484f92c1d2be2585f5a6
I20260203 21:10:28.794752 3378 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260203 21:10:28.795598 3378 catalog_manager.cc:1514] Loading token signing keys...
I20260203 21:10:28.796252 3378 catalog_manager.cc:6038] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260: Loaded TSK: 0
I20260203 21:10:28.797187 3378 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260203 21:10:28.797832 3378 catalog_manager.cc:1537] Loading latest processed Hive Metastore notification log event ID...
I20260203 21:10:28.798456 3378 catalog_manager.cc:5876] Last processed Hive Metastore notification event ID: 11
I20260203 21:10:28.824565 2444 catalog_manager.cc:3485] renamed table default.table_ae3f050e71c94082b0e88a08167c762f [id=73eae179f2ad481d932a5b3c95b1a4ab] in HMS: new name default.table_a029ba95c22e421585ca4ce640aa9658
I20260203 21:10:28.862211 2533 raft_consensus.cc:1240] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [term 3 FOLLOWER]: Rejecting Update request from peer 7344d7cd8dea4fa2ae705320daacaf49 for earlier term 2. Current term is 3. Ops: []
I20260203 21:10:28.863197 3374 consensus_queue.cc:1059] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 }, Status: INVALID_TERM, Last received: 2.39, Next index: 40, Last known committed idx: 39, Time since last communication: 0.000s
I20260203 21:10:28.863596 3379 raft_consensus.cc:3055] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49 [term 2 LEADER]: Stepping down as leader of term 2
I20260203 21:10:28.863672 3379 raft_consensus.cc:740] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7344d7cd8dea4fa2ae705320daacaf49, State: Running, Role: LEADER
I20260203 21:10:28.863855 3379 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 39, Committed index: 39, Last appended: 2.39, Last appended by leader: 39, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:10:28.864146 3379 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49 [term 2 FOLLOWER]: Advancing to term 3
I20260203 21:10:28.893347 2446 catalog_manager.cc:3485] renamed table default.table_bdb9340290f84eada371f9d8304fcd67 [id=82ec5c95acc84e509c0803db74b626b4] in HMS: new name default.table_7e73ff80019543888e0b8afa9b7a6660
I20260203 21:10:28.912786 2969 heartbeater.cc:499] Master 127.2.32.188:33665 was elected leader, sending a full tablet report...
I20260203 21:10:28.915159 3193 catalog_manager.cc:5654] T eb6a21a5b1ee454691237d0b160c9a3c P 6d9e0cecab784cc0acc050ca1c89c5be reported cstate change: term changed from 0 to 1, leader changed from <none> to 02bdf326542e474cbe62434dd59087dc (127.2.32.129). New cstate: current_term: 1 leader_uuid: "02bdf326542e474cbe62434dd59087dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } }
I20260203 21:10:28.921257 2533 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [term 3 FOLLOWER]: Refusing update from remote peer 8a7e51013f5041898fe34f4b64a59260: Log matching property violated. Preceding OpId in replica: term: 2 index: 39. Preceding OpId from leader: term: 3 index: 41. (index mismatch)
I20260203 21:10:28.921774 3377 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 40, Last known committed idx: 39, Time since last communication: 0.000s
I20260203 21:10:28.923247 3373 sys_catalog.cc:455] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8a7e51013f5041898fe34f4b64a59260. Latest consensus state: current_term: 3 leader_uuid: "8a7e51013f5041898fe34f4b64a59260" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } } }
I20260203 21:10:28.923354 3373 sys_catalog.cc:458] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [sys.catalog]: This master's current role is: FOLLOWER
I20260203 21:10:28.925446 3373 sys_catalog.cc:455] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "8a7e51013f5041898fe34f4b64a59260" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } } }
I20260203 21:10:28.925554 3373 sys_catalog.cc:458] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [sys.catalog]: This master's current role is: FOLLOWER
I20260203 21:10:28.926743 2462 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49 [term 3 FOLLOWER]: Refusing update from remote peer 8a7e51013f5041898fe34f4b64a59260: Log matching property violated. Preceding OpId in replica: term: 2 index: 39. Preceding OpId from leader: term: 3 index: 41. (index mismatch)
I20260203 21:10:28.927253 3372 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 40, Last known committed idx: 39, Time since last communication: 0.000s
I20260203 21:10:28.928689 3379 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8a7e51013f5041898fe34f4b64a59260. Latest consensus state: current_term: 3 leader_uuid: "8a7e51013f5041898fe34f4b64a59260" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } } }
I20260203 21:10:28.928702 3374 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "8a7e51013f5041898fe34f4b64a59260" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } } }
I20260203 21:10:28.928813 3379 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49 [sys.catalog]: This master's current role is: FOLLOWER
I20260203 21:10:28.928838 3374 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49 [sys.catalog]: This master's current role is: FOLLOWER
I20260203 21:10:28.929873 3377 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "8a7e51013f5041898fe34f4b64a59260" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } } }
I20260203 21:10:28.929989 3377 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [sys.catalog]: This master's current role is: LEADER
I20260203 21:10:28.930094 3377 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "8a7e51013f5041898fe34f4b64a59260" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } } }
I20260203 21:10:28.930147 3377 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [sys.catalog]: This master's current role is: LEADER
I20260203 21:10:28.943872 3193 catalog_manager.cc:6199] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260: default.table_800a192f4e9e4ca5806a324b36234706 [id=a995c742bb2942838a2385b05a4d4d57] alter complete (version 1)
I20260203 21:10:28.952320 2831 heartbeater.cc:499] Master 127.2.32.188:33665 was elected leader, sending a full tablet report...
I20260203 21:10:28.963225 2450 catalog_manager.cc:3485] renamed table default.table_dde2cdf1f5254cb49f3053855a83891e [id=467e79ec835d45669e3155e07b8ba81f] in HMS: new name default.table_b7c2ca72f69c49a0b39163d2fcb69341
I20260203 21:10:28.992998 2443 catalog_manager.cc:2174] created HMS catalog entry for table [id=083eb2c7b49741078c89bcc583117adb]
W20260203 21:10:28.993604 2443 catalog_manager.cc:2202] Illegal state: an error occurred while writing to the sys-catalog: replica 7344d7cd8dea4fa2ae705320daacaf49 is not leader of this config: current role FOLLOWER
I20260203 21:10:29.012447 2448 catalog_manager.cc:2174] created HMS catalog entry for table [id=f6e23f2505784c6f98a18a43b9917c06]
W20260203 21:10:29.012985 2448 catalog_manager.cc:2202] Illegal state: an error occurred while writing to the sys-catalog: replica 7344d7cd8dea4fa2ae705320daacaf49 is not leader of this config: current role FOLLOWER
I20260203 21:10:29.034281 2445 catalog_manager.cc:2174] created HMS catalog entry for table [id=66dd8d2abc564ea9941d9c79de23a1e8]
W20260203 21:10:29.034991 2445 catalog_manager.cc:2202] Illegal state: an error occurred while writing to the sys-catalog: replica 7344d7cd8dea4fa2ae705320daacaf49 is not leader of this config: current role FOLLOWER
I20260203 21:10:29.038133 2669 catalog_manager.cc:2772] Deleting table default.table_8695f3c31a784599917744b6d57e2a18 [id=d3ee372fbea0402796f488b9f48638b9] in response to Hive Metastore notification log event 12
W20260203 21:10:29.039242 2669 catalog_manager.cc:2848] Illegal state: an error occurred while updating the sys-catalog: replica 7344d7cd8dea4fa2ae705320daacaf49 is not leader of this config: current role FOLLOWER
W20260203 21:10:29.039397 2669 hms_notification_log_listener.cc:329] Failed to handle Hive Metastore notification: 12 DROP_TABLE default.table_8695f3c31a784599917744b6d57e2a18: Illegal state: an error occurred while updating the sys-catalog: replica 7344d7cd8dea4fa2ae705320daacaf49 is not leader of this config: current role FOLLOWER
W20260203 21:10:29.039497 2669 hms_notification_log_listener.cc:143] Hive Metastore notification log listener poll failed: Service unavailable: lost leadership while handling Hive Metastore notification log events: an error occurred while updating the sys-catalog: replica 7344d7cd8dea4fa2ae705320daacaf49 is not leader of this config: current role FOLLOWER
I20260203 21:10:29.039969 2452 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:57540 (request call id 54) took 1163 ms. Trace:
I20260203 21:10:29.040208 2450 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:57540 (request call id 53) took 1167 ms. Trace:
I20260203 21:10:29.040314 2451 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:57540 (request call id 48) took 1288 ms. Trace:
I20260203 21:10:29.040380 2451 rpcz_store.cc:276] 0203 21:10:27.752153 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 21:10:27.778902 (+ 26749us) service_pool.cc:225] Handling call
0203 21:10:28.227615 (+448713us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0203 21:10:29.040300 (+812685us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":3316,"Hive Metastore.run_cpu_time_us":200,"Hive Metastore.run_wall_time_us":404106}
I20260203 21:10:29.041029 2447 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:57540 (request call id 47) took 1364 ms. Trace:
I20260203 21:10:29.041082 2447 rpcz_store.cc:276] 0203 21:10:27.677008 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 21:10:27.752963 (+ 75955us) service_pool.cc:225] Handling call
0203 21:10:28.227630 (+474667us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0203 21:10:29.041016 (+813386us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":407471,"Hive Metastore.run_cpu_time_us":200,"Hive Metastore.run_wall_time_us":49426}
W20260203 21:10:29.041395 2451 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.2.32.129:42723 (request call id 16) took 769 ms (client timeout 1000 ms). Trace:
W20260203 21:10:29.041460 2451 rpcz_store.cc:269] 0203 21:10:28.272004 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 21:10:29.040896 (+768892us) service_pool.cc:225] Handling call
0203 21:10:29.041371 (+ 475us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260203 21:10:29.041646 2447 master_service.cc:954] ReplaceTablet: received request to replace tablet d019bac79b874559b718570d502c5a13 from {username='slave'} at 127.0.0.1:57540
I20260203 21:10:29.041818 2447 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:57540 (request call id 55) took 1139 ms. Trace:
I20260203 21:10:29.041857 2447 rpcz_store.cc:276] 0203 21:10:27.902672 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 21:10:29.041624 (+1138952us) service_pool.cc:225] Handling call
0203 21:10:29.041808 (+ 184us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260203 21:10:29.042066 2451 master_service.cc:954] ReplaceTablet: received request to replace tablet 930cb06bcbca41e08ac12d60a0d3b6cb from {username='slave'} at 127.0.0.1:57540
I20260203 21:10:29.042240 2451 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:57540 (request call id 57) took 1122 ms. Trace:
I20260203 21:10:29.042281 2451 rpcz_store.cc:276] 0203 21:10:27.920024 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 21:10:29.042047 (+1122023us) service_pool.cc:225] Handling call
0203 21:10:29.042230 (+ 183us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260203 21:10:29.042387 2451 master_service.cc:954] ReplaceTablet: received request to replace tablet 930cb06bcbca41e08ac12d60a0d3b6cb from {username='slave'} at 127.0.0.1:57540
I20260203 21:10:29.040050 2452 rpcz_store.cc:276] 0203 21:10:27.876909 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 21:10:28.270408 (+393499us) service_pool.cc:225] Handling call
0203 21:10:29.039944 (+769536us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260203 21:10:29.040304 2450 rpcz_store.cc:276] 0203 21:10:27.873202 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 21:10:27.989267 (+116065us) service_pool.cc:225] Handling call
0203 21:10:28.228389 (+239122us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0203 21:10:29.039818 (+811429us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0203 21:10:29.039990 (+ 172us) catalog_manager.cc:3708] Apply alter schema
0203 21:10:29.040190 (+ 200us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":664869,"Hive Metastore.run_cpu_time_us":681,"Hive Metastore.run_wall_time_us":69835,"spinlock_wait_cycles":2816}
I20260203 21:10:29.042565 2452 master_service.cc:954] ReplaceTablet: received request to replace tablet d6c50af1a05941fe98418d50fbb0009b from {username='slave'} at 127.0.0.1:57540
I20260203 21:10:29.042714 2452 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:57540 (request call id 59) took 1095 ms. Trace:
I20260203 21:10:29.042768 2452 rpcz_store.cc:276] 0203 21:10:27.947011 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 21:10:29.042551 (+1095540us) service_pool.cc:225] Handling call
0203 21:10:29.042705 (+ 154us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260203 21:10:29.043000 2452 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:57540 (request call id 61) took 1090 ms. Trace:
I20260203 21:10:29.043049 2452 rpcz_store.cc:276] 0203 21:10:27.952498 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 21:10:29.042854 (+1090356us) service_pool.cc:225] Handling call
0203 21:10:29.042990 (+ 136us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260203 21:10:29.043140 2452 master_service.cc:954] ReplaceTablet: received request to replace tablet 20fec52d63a34162bb79805433de62c0 from {username='slave'} at 127.0.0.1:57540
I20260203 21:10:29.043264 2452 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:57540 (request call id 62) took 1075 ms. Trace:
I20260203 21:10:29.043298 2452 rpcz_store.cc:276] 0203 21:10:27.967752 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 21:10:29.043126 (+1075374us) service_pool.cc:225] Handling call
0203 21:10:29.043257 (+ 131us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260203 21:10:29.043468 2452 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:57540 (request call id 63) took 1058 ms. Trace:
I20260203 21:10:29.043505 2452 rpcz_store.cc:276] 0203 21:10:27.984797 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 21:10:29.043368 (+1058571us) service_pool.cc:225] Handling call
0203 21:10:29.043460 (+ 92us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260203 21:10:29.043732 2452 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:57540 (request call id 64) took 1018 ms. Trace:
I20260203 21:10:29.043776 2452 rpcz_store.cc:276] 0203 21:10:28.025612 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 21:10:29.043577 (+1017965us) service_pool.cc:225] Handling call
0203 21:10:29.043722 (+ 145us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260203 21:10:29.044420 3115 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.2.32.190:35419)
W20260203 21:10:29.044711 3115 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.2.32.190:35419)
W20260203 21:10:29.045157 3115 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.2.32.190:35419)
I20260203 21:10:29.046756 2446 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:57540 (request call id 52) took 1221 ms. Trace:
I20260203 21:10:29.046805 2446 rpcz_store.cc:276] 0203 21:10:27.825498 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 21:10:27.960355 (+134857us) service_pool.cc:225] Handling call
0203 21:10:28.228235 (+267880us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0203 21:10:29.046444 (+818209us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0203 21:10:29.046588 (+ 144us) catalog_manager.cc:3708] Apply alter schema
0203 21:10:29.046745 (+ 157us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":595996,"Hive Metastore.run_cpu_time_us":520,"Hive Metastore.run_wall_time_us":68925}
I20260203 21:10:29.042725 2450 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:57540 (request call id 60) took 1095 ms. Trace:
I20260203 21:10:29.047189 2450 rpcz_store.cc:276] 0203 21:10:27.947559 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 21:10:29.042598 (+1095039us) service_pool.cc:225] Handling call
0203 21:10:29.042718 (+ 120us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":25344}
I20260203 21:10:29.042454 2449 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:57540 (request call id 40) took 1460 ms. Trace:
I20260203 21:10:29.047379 2449 rpcz_store.cc:276] 0203 21:10:27.582285 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 21:10:27.583184 (+ 899us) service_pool.cc:225] Handling call
0203 21:10:28.227781 (+644597us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0203 21:10:29.042123 (+814342us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0203 21:10:29.042267 (+ 144us) catalog_manager.cc:3708] Apply alter schema
0203 21:10:29.042441 (+ 174us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":456826,"Hive Metastore.run_cpu_time_us":550,"Hive Metastore.run_wall_time_us":79157}
I20260203 21:10:29.040208 2444 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:57540 (request call id 41) took 1416 ms. Trace:
I20260203 21:10:29.047770 2444 rpcz_store.cc:276] 0203 21:10:27.623617 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 21:10:27.623687 (+ 70us) service_pool.cc:225] Handling call
0203 21:10:28.227935 (+604248us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0203 21:10:29.039814 (+811879us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0203 21:10:29.039990 (+ 176us) catalog_manager.cc:3708] Apply alter schema
0203 21:10:29.040190 (+ 200us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":535933,"Hive Metastore.run_cpu_time_us":545,"Hive Metastore.run_wall_time_us":60362}
I20260203 21:10:29.042084 2447 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:57540 (request call id 56) took 1135 ms. Trace:
I20260203 21:10:29.048930 2447 rpcz_store.cc:276] 0203 21:10:27.907071 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 21:10:29.041960 (+1134889us) service_pool.cc:225] Handling call
0203 21:10:29.042071 (+ 111us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260203 21:10:29.049690 3115 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.2.32.190:35419)
I20260203 21:10:29.042514 2451 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:57540 (request call id 58) took 1121 ms. Trace:
I20260203 21:10:29.050309 2451 rpcz_store.cc:276] 0203 21:10:27.920554 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 21:10:29.042371 (+1121817us) service_pool.cc:225] Handling call
0203 21:10:29.042506 (+ 135us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260203 21:10:29.054152 3193 master_service.cc:954] ReplaceTablet: received request to replace tablet d019bac79b874559b718570d502c5a13 from {username='slave'} at 127.0.0.1:57412
I20260203 21:10:29.054555 3194 master_service.cc:954] ReplaceTablet: received request to replace tablet 930cb06bcbca41e08ac12d60a0d3b6cb from {username='slave'} at 127.0.0.1:57412
I20260203 21:10:29.055397 3192 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57412:
name: "default.Table_4f93e096d30349908a32a33e024543d6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260203 21:10:29.055832 3191 master_service.cc:954] ReplaceTablet: received request to replace tablet d6c50af1a05941fe98418d50fbb0009b from {username='slave'} at 127.0.0.1:57412
I20260203 21:10:29.056094 3190 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57412:
name: "default.Table_4c9a68305b5e4d4aa45e3a351c35eee7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260203 21:10:29.056298 3189 master_service.cc:954] ReplaceTablet: received request to replace tablet 20fec52d63a34162bb79805433de62c0 from {username='slave'} at 127.0.0.1:57412
I20260203 21:10:29.056986 3188 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57412:
table { table_name: "default.Table_09e62d0aaa0f48ad9ed818ba967be542" } modify_external_catalogs: true
I20260203 21:10:29.057116 3188 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57412:
table { table_name: "default.Table_09e62d0aaa0f48ad9ed818ba967be542" } modify_external_catalogs: true
I20260203 21:10:29.057320 3187 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57412:
name: "default.Table_675a6f7413004a62bce7c460e7b6da3b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260203 21:10:29.057569 3186 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57412:
name: "default.Table_72135cb0d98246739f6b8c9aee17c8ba"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260203 21:10:29.057790 3185 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57412:
name: "default.Table_3397dfe4625e42cf8cb5f4d45116d7b1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260203 21:10:29.062830 3194 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260: Sending DeleteTablet for 3 replicas of tablet 930cb06bcbca41e08ac12d60a0d3b6cb
I20260203 21:10:29.064077 3194 catalog_manager.cc:6724] ReplaceTablet: tablet 930cb06bcbca41e08ac12d60a0d3b6cb deleted and replaced by tablet f11742b0380d4f46a2ec058238810d02
I20260203 21:10:29.064402 3194 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57412:
name: "default.Table_98e2e0221eb0485fb87bee758843d37e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260203 21:10:29.064692 3189 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260: Sending DeleteTablet for 3 replicas of tablet 20fec52d63a34162bb79805433de62c0
I20260203 21:10:29.064976 3189 catalog_manager.cc:6724] ReplaceTablet: tablet 20fec52d63a34162bb79805433de62c0 deleted and replaced by tablet a7a06ceeb3c84f788e360a5ba926a71f
I20260203 21:10:29.065173 3189 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57412:
name: "default.Table_8da179b3ec0b4c898eb890f89d54cb6a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260203 21:10:29.068873 3193 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260: Sending DeleteTablet for 3 replicas of tablet d019bac79b874559b718570d502c5a13
I20260203 21:10:29.069155 3193 catalog_manager.cc:6724] ReplaceTablet: tablet d019bac79b874559b718570d502c5a13 deleted and replaced by tablet 4c8edfa3d555490f953a3ec7bef314ae
I20260203 21:10:29.069365 3193 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57412:
table { table_name: "default.Table_800a192f4e9e4ca5806a324b36234706" } new_table_name: "default.Table_9f9f33407af144ea8957cb4f76b5ac87" modify_external_catalogs: true
I20260203 21:10:29.070525 3191 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260: Sending DeleteTablet for 3 replicas of tablet d6c50af1a05941fe98418d50fbb0009b
I20260203 21:10:29.070809 3191 catalog_manager.cc:6724] ReplaceTablet: tablet d6c50af1a05941fe98418d50fbb0009b deleted and replaced by tablet 8672a1e59caf4f70830d7cdac01f36cd
I20260203 21:10:29.070969 3191 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57412:
table { table_name: "default.Table_66c508c8dbdd4e7ea9283cabe65b62c0" } modify_external_catalogs: true
I20260203 21:10:29.071060 3191 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57412:
table { table_name: "default.Table_66c508c8dbdd4e7ea9283cabe65b62c0" } modify_external_catalogs: true
I20260203 21:10:29.075040 3248 catalog_manager.cc:2772] Deleting table default.table_8695f3c31a784599917744b6d57e2a18 [id=d3ee372fbea0402796f488b9f48638b9] in response to Hive Metastore notification log event 12
I20260203 21:10:29.081429 3248 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260: Sending DeleteTablet for 3 replicas of tablet f11742b0380d4f46a2ec058238810d02
I20260203 21:10:29.082127 3248 catalog_manager.cc:2772] Deleting table default.table_42d2deb9edf04a3b8ce372f18fff2cf1 [id=cc496c5ba7e8461b8020f3ab100304c8] in response to Hive Metastore notification log event 13
I20260203 21:10:29.083005 2765 tablet_service.cc:1552] Processing DeleteTablet for tablet 930cb06bcbca41e08ac12d60a0d3b6cb with delete_type TABLET_DATA_DELETED (replaced by tablet f11742b0380d4f46a2ec058238810d02) from {username='slave'} at 127.0.0.1:59654
I20260203 21:10:29.083591 2763 tablet_service.cc:1552] Processing DeleteTablet for tablet d019bac79b874559b718570d502c5a13 with delete_type TABLET_DATA_DELETED (replaced by tablet 4c8edfa3d555490f953a3ec7bef314ae) from {username='slave'} at 127.0.0.1:59654
I20260203 21:10:29.083745 2762 tablet_service.cc:1552] Processing DeleteTablet for tablet d6c50af1a05941fe98418d50fbb0009b with delete_type TABLET_DATA_DELETED (replaced by tablet 8672a1e59caf4f70830d7cdac01f36cd) from {username='slave'} at 127.0.0.1:59654
I20260203 21:10:29.084030 2761 tablet_service.cc:1505] Processing CreateTablet for tablet a7a06ceeb3c84f788e360a5ba926a71f (DEFAULT_TABLE table=default.table_8276b49c70934289816f902b52d97652 [id=333213fed7234610bc20c7d92124182b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:29.083443 2764 tablet_service.cc:1552] Processing DeleteTablet for tablet 20fec52d63a34162bb79805433de62c0 with delete_type TABLET_DATA_DELETED (replaced by tablet a7a06ceeb3c84f788e360a5ba926a71f) from {username='slave'} at 127.0.0.1:59654
I20260203 21:10:29.084313 2759 tablet_service.cc:1505] Processing CreateTablet for tablet 8672a1e59caf4f70830d7cdac01f36cd (DEFAULT_TABLE table=default.table_bdb9340290f84eada371f9d8304fcd67 [id=82ec5c95acc84e509c0803db74b626b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:29.084400 2762 tablet_service.cc:1552] Processing DeleteTablet for tablet f11742b0380d4f46a2ec058238810d02 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-02-03 21:10:29 UTC) from {username='slave'} at 127.0.0.1:59654
I20260203 21:10:29.084705 2761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7a06ceeb3c84f788e360a5ba926a71f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:29.084676 2760 tablet_service.cc:1505] Processing CreateTablet for tablet f11742b0380d4f46a2ec058238810d02 (DEFAULT_TABLE table=default.table_8695f3c31a784599917744b6d57e2a18 [id=d3ee372fbea0402796f488b9f48638b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:29.084887 2760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f11742b0380d4f46a2ec058238810d02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:29.087532 2759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8672a1e59caf4f70830d7cdac01f36cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:29.087785 3248 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260: Sending DeleteTablet for 3 replicas of tablet c45683f20a454401bfb90b41570b5125
I20260203 21:10:29.089398 2903 tablet_service.cc:1552] Processing DeleteTablet for tablet 20fec52d63a34162bb79805433de62c0 with delete_type TABLET_DATA_DELETED (replaced by tablet a7a06ceeb3c84f788e360a5ba926a71f) from {username='slave'} at 127.0.0.1:51090
I20260203 21:10:29.089668 2901 tablet_service.cc:1552] Processing DeleteTablet for tablet d019bac79b874559b718570d502c5a13 with delete_type TABLET_DATA_DELETED (replaced by tablet 4c8edfa3d555490f953a3ec7bef314ae) from {username='slave'} at 127.0.0.1:51090
I20260203 21:10:29.089815 2900 tablet_service.cc:1552] Processing DeleteTablet for tablet d6c50af1a05941fe98418d50fbb0009b with delete_type TABLET_DATA_DELETED (replaced by tablet 8672a1e59caf4f70830d7cdac01f36cd) from {username='slave'} at 127.0.0.1:51090
I20260203 21:10:29.089903 2902 tablet_service.cc:1552] Processing DeleteTablet for tablet 930cb06bcbca41e08ac12d60a0d3b6cb with delete_type TABLET_DATA_DELETED (replaced by tablet f11742b0380d4f46a2ec058238810d02) from {username='slave'} at 127.0.0.1:51090
I20260203 21:10:29.090087 2899 tablet_service.cc:1505] Processing CreateTablet for tablet a7a06ceeb3c84f788e360a5ba926a71f (DEFAULT_TABLE table=default.table_8276b49c70934289816f902b52d97652 [id=333213fed7234610bc20c7d92124182b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:29.090152 2895 tablet_service.cc:1552] Processing DeleteTablet for tablet f11742b0380d4f46a2ec058238810d02 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-02-03 21:10:29 UTC) from {username='slave'} at 127.0.0.1:51090
I20260203 21:10:29.090097 2896 tablet_service.cc:1505] Processing CreateTablet for tablet 8672a1e59caf4f70830d7cdac01f36cd (DEFAULT_TABLE table=default.table_bdb9340290f84eada371f9d8304fcd67 [id=82ec5c95acc84e509c0803db74b626b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:29.090327 2899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7a06ceeb3c84f788e360a5ba926a71f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:29.090893 2896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8672a1e59caf4f70830d7cdac01f36cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:29.091888 2898 tablet_service.cc:1505] Processing CreateTablet for tablet f11742b0380d4f46a2ec058238810d02 (DEFAULT_TABLE table=default.table_8695f3c31a784599917744b6d57e2a18 [id=d3ee372fbea0402796f488b9f48638b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:29.092082 2898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f11742b0380d4f46a2ec058238810d02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:29.093456 2896 tablet_service.cc:1552] Processing DeleteTablet for tablet c45683f20a454401bfb90b41570b5125 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-02-03 21:10:29 UTC) from {username='slave'} at 127.0.0.1:51090
I20260203 21:10:29.093979 2897 tablet_service.cc:1505] Processing CreateTablet for tablet 4c8edfa3d555490f953a3ec7bef314ae (DEFAULT_TABLE table=default.table_ae3f050e71c94082b0e88a08167c762f [id=73eae179f2ad481d932a5b3c95b1a4ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:29.094182 2897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c8edfa3d555490f953a3ec7bef314ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:29.094228 3404 tablet_bootstrap.cc:492] T a7a06ceeb3c84f788e360a5ba926a71f P 02bdf326542e474cbe62434dd59087dc: Bootstrap starting.
I20260203 21:10:29.095153 3404 tablet_bootstrap.cc:654] T a7a06ceeb3c84f788e360a5ba926a71f P 02bdf326542e474cbe62434dd59087dc: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:29.096256 2765 tablet_service.cc:1505] Processing CreateTablet for tablet 4c8edfa3d555490f953a3ec7bef314ae (DEFAULT_TABLE table=default.table_ae3f050e71c94082b0e88a08167c762f [id=73eae179f2ad481d932a5b3c95b1a4ab]), partition=RANGE (key) PARTITION UNBOUNDED
W20260203 21:10:29.096294 3248 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a7a06ceeb3c84f788e360a5ba926a71f consensus state has no leader
I20260203 21:10:29.096472 2765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c8edfa3d555490f953a3ec7bef314ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:29.098965 2765 tablet_service.cc:1552] Processing DeleteTablet for tablet c45683f20a454401bfb90b41570b5125 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-02-03 21:10:29 UTC) from {username='slave'} at 127.0.0.1:59654
I20260203 21:10:29.099066 3404 tablet_bootstrap.cc:492] T a7a06ceeb3c84f788e360a5ba926a71f P 02bdf326542e474cbe62434dd59087dc: No bootstrap required, opened a new log
I20260203 21:10:29.099152 3404 ts_tablet_manager.cc:1403] T a7a06ceeb3c84f788e360a5ba926a71f P 02bdf326542e474cbe62434dd59087dc: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260203 21:10:29.099617 3404 raft_consensus.cc:359] T a7a06ceeb3c84f788e360a5ba926a71f P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } }
I20260203 21:10:29.099740 3404 raft_consensus.cc:385] T a7a06ceeb3c84f788e360a5ba926a71f P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:29.099776 3404 raft_consensus.cc:740] T a7a06ceeb3c84f788e360a5ba926a71f P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02bdf326542e474cbe62434dd59087dc, State: Initialized, Role: FOLLOWER
I20260203 21:10:29.099884 3404 consensus_queue.cc:260] T a7a06ceeb3c84f788e360a5ba926a71f P 02bdf326542e474cbe62434dd59087dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } }
I20260203 21:10:29.100165 3404 ts_tablet_manager.cc:1434] T a7a06ceeb3c84f788e360a5ba926a71f P 02bdf326542e474cbe62434dd59087dc: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260203 21:10:29.100318 3404 tablet_bootstrap.cc:492] T f11742b0380d4f46a2ec058238810d02 P 02bdf326542e474cbe62434dd59087dc: Bootstrap starting.
I20260203 21:10:29.101225 3404 tablet_bootstrap.cc:654] T f11742b0380d4f46a2ec058238810d02 P 02bdf326542e474cbe62434dd59087dc: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:29.102445 3039 tablet_service.cc:1552] Processing DeleteTablet for tablet 930cb06bcbca41e08ac12d60a0d3b6cb with delete_type TABLET_DATA_DELETED (replaced by tablet f11742b0380d4f46a2ec058238810d02) from {username='slave'} at 127.0.0.1:59506
I20260203 21:10:29.102679 3404 tablet_bootstrap.cc:492] T f11742b0380d4f46a2ec058238810d02 P 02bdf326542e474cbe62434dd59087dc: No bootstrap required, opened a new log
I20260203 21:10:29.102748 3404 ts_tablet_manager.cc:1403] T f11742b0380d4f46a2ec058238810d02 P 02bdf326542e474cbe62434dd59087dc: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260203 21:10:29.102967 3039 tablet_service.cc:1552] Processing DeleteTablet for tablet 20fec52d63a34162bb79805433de62c0 with delete_type TABLET_DATA_DELETED (replaced by tablet a7a06ceeb3c84f788e360a5ba926a71f) from {username='slave'} at 127.0.0.1:59506
I20260203 21:10:29.103166 3404 raft_consensus.cc:359] T f11742b0380d4f46a2ec058238810d02 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.103233 3039 tablet_service.cc:1552] Processing DeleteTablet for tablet d019bac79b874559b718570d502c5a13 with delete_type TABLET_DATA_DELETED (replaced by tablet 4c8edfa3d555490f953a3ec7bef314ae) from {username='slave'} at 127.0.0.1:59506
I20260203 21:10:29.103250 3404 raft_consensus.cc:385] T f11742b0380d4f46a2ec058238810d02 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:29.103277 3404 raft_consensus.cc:740] T f11742b0380d4f46a2ec058238810d02 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02bdf326542e474cbe62434dd59087dc, State: Initialized, Role: FOLLOWER
I20260203 21:10:29.103385 3404 consensus_queue.cc:260] T f11742b0380d4f46a2ec058238810d02 P 02bdf326542e474cbe62434dd59087dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.103518 3039 tablet_service.cc:1552] Processing DeleteTablet for tablet d6c50af1a05941fe98418d50fbb0009b with delete_type TABLET_DATA_DELETED (replaced by tablet 8672a1e59caf4f70830d7cdac01f36cd) from {username='slave'} at 127.0.0.1:59506
I20260203 21:10:29.103624 3404 ts_tablet_manager.cc:1434] T f11742b0380d4f46a2ec058238810d02 P 02bdf326542e474cbe62434dd59087dc: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260203 21:10:29.103803 3404 tablet_bootstrap.cc:492] T 8672a1e59caf4f70830d7cdac01f36cd P 02bdf326542e474cbe62434dd59087dc: Bootstrap starting.
I20260203 21:10:29.103931 3039 tablet_service.cc:1505] Processing CreateTablet for tablet a7a06ceeb3c84f788e360a5ba926a71f (DEFAULT_TABLE table=default.table_8276b49c70934289816f902b52d97652 [id=333213fed7234610bc20c7d92124182b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:29.104151 3039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7a06ceeb3c84f788e360a5ba926a71f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:29.104625 3404 tablet_bootstrap.cc:654] T 8672a1e59caf4f70830d7cdac01f36cd P 02bdf326542e474cbe62434dd59087dc: Neither blocks nor log segments found. Creating new log.
W20260203 21:10:29.106042 3248 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4c8edfa3d555490f953a3ec7bef314ae consensus state has no leader
I20260203 21:10:29.106796 3038 tablet_service.cc:1505] Processing CreateTablet for tablet 4c8edfa3d555490f953a3ec7bef314ae (DEFAULT_TABLE table=default.table_ae3f050e71c94082b0e88a08167c762f [id=73eae179f2ad481d932a5b3c95b1a4ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:29.106995 3038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c8edfa3d555490f953a3ec7bef314ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:29.107199 3037 tablet_service.cc:1505] Processing CreateTablet for tablet 8672a1e59caf4f70830d7cdac01f36cd (DEFAULT_TABLE table=default.table_bdb9340290f84eada371f9d8304fcd67 [id=82ec5c95acc84e509c0803db74b626b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:29.107481 3037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8672a1e59caf4f70830d7cdac01f36cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:29.109117 3039 tablet_service.cc:1505] Processing CreateTablet for tablet f11742b0380d4f46a2ec058238810d02 (DEFAULT_TABLE table=default.table_8695f3c31a784599917744b6d57e2a18 [id=d3ee372fbea0402796f488b9f48638b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:29.109383 3039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f11742b0380d4f46a2ec058238810d02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:29.109557 3036 tablet_service.cc:1552] Processing DeleteTablet for tablet f11742b0380d4f46a2ec058238810d02 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-02-03 21:10:29 UTC) from {username='slave'} at 127.0.0.1:59506
I20260203 21:10:29.109660 3035 tablet_service.cc:1552] Processing DeleteTablet for tablet c45683f20a454401bfb90b41570b5125 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-02-03 21:10:29 UTC) from {username='slave'} at 127.0.0.1:59506
I20260203 21:10:29.111174 3404 tablet_bootstrap.cc:492] T 8672a1e59caf4f70830d7cdac01f36cd P 02bdf326542e474cbe62434dd59087dc: No bootstrap required, opened a new log
I20260203 21:10:29.111263 3404 ts_tablet_manager.cc:1403] T 8672a1e59caf4f70830d7cdac01f36cd P 02bdf326542e474cbe62434dd59087dc: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.000s
I20260203 21:10:29.111711 3404 raft_consensus.cc:359] T 8672a1e59caf4f70830d7cdac01f36cd P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.112048 3404 raft_consensus.cc:385] T 8672a1e59caf4f70830d7cdac01f36cd P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:29.112097 3404 raft_consensus.cc:740] T 8672a1e59caf4f70830d7cdac01f36cd P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02bdf326542e474cbe62434dd59087dc, State: Initialized, Role: FOLLOWER
I20260203 21:10:29.112211 3404 consensus_queue.cc:260] T 8672a1e59caf4f70830d7cdac01f36cd P 02bdf326542e474cbe62434dd59087dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.112462 3404 ts_tablet_manager.cc:1434] T 8672a1e59caf4f70830d7cdac01f36cd P 02bdf326542e474cbe62434dd59087dc: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260203 21:10:29.112630 3404 tablet_bootstrap.cc:492] T 4c8edfa3d555490f953a3ec7bef314ae P 02bdf326542e474cbe62434dd59087dc: Bootstrap starting.
I20260203 21:10:29.113618 3404 tablet_bootstrap.cc:654] T 4c8edfa3d555490f953a3ec7bef314ae P 02bdf326542e474cbe62434dd59087dc: Neither blocks nor log segments found. Creating new log.
W20260203 21:10:29.115545 3248 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8672a1e59caf4f70830d7cdac01f36cd consensus state has no leader
I20260203 21:10:29.117817 3405 tablet_replica.cc:333] T 20fec52d63a34162bb79805433de62c0 P 6d9e0cecab784cc0acc050ca1c89c5be: stopping tablet replica
I20260203 21:10:29.117956 3405 raft_consensus.cc:2243] T 20fec52d63a34162bb79805433de62c0 P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 LEADER]: Raft consensus shutting down.
I20260203 21:10:29.118163 3405 raft_consensus.cc:2272] T 20fec52d63a34162bb79805433de62c0 P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 21:10:29.118635 3405 ts_tablet_manager.cc:1916] T 20fec52d63a34162bb79805433de62c0 P 6d9e0cecab784cc0acc050ca1c89c5be: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260203 21:10:29.123967 3405 ts_tablet_manager.cc:1929] T 20fec52d63a34162bb79805433de62c0 P 6d9e0cecab784cc0acc050ca1c89c5be: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260203 21:10:29.124042 3405 log.cc:1199] T 20fec52d63a34162bb79805433de62c0 P 6d9e0cecab784cc0acc050ca1c89c5be: Deleting WAL directory at /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-1/wal/wals/20fec52d63a34162bb79805433de62c0
I20260203 21:10:29.124284 3405 ts_tablet_manager.cc:1950] T 20fec52d63a34162bb79805433de62c0 P 6d9e0cecab784cc0acc050ca1c89c5be: Deleting consensus metadata
I20260203 21:10:29.124850 3405 tablet_replica.cc:333] T d019bac79b874559b718570d502c5a13 P 6d9e0cecab784cc0acc050ca1c89c5be: stopping tablet replica
I20260203 21:10:29.124962 3405 raft_consensus.cc:2243] T d019bac79b874559b718570d502c5a13 P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 21:10:29.125056 3405 raft_consensus.cc:2272] T d019bac79b874559b718570d502c5a13 P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 21:10:29.125291 3406 tablet_bootstrap.cc:492] T 8672a1e59caf4f70830d7cdac01f36cd P 6d9e0cecab784cc0acc050ca1c89c5be: Bootstrap starting.
I20260203 21:10:29.125830 3181 catalog_manager.cc:4985] TS 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): tablet 20fec52d63a34162bb79805433de62c0 (table default.table_547d99db0d3043499a26ee8c6df4c443 [id=333213fed7234610bc20c7d92124182b]) successfully deleted
I20260203 21:10:29.126230 3406 tablet_bootstrap.cc:654] T 8672a1e59caf4f70830d7cdac01f36cd P 6d9e0cecab784cc0acc050ca1c89c5be: Neither blocks nor log segments found. Creating new log.
W20260203 21:10:29.129062 3192 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_4f93e096d30349908a32a33e024543d6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260203 21:10:29.130030 3190 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_4c9a68305b5e4d4aa45e3a351c35eee7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260203 21:10:29.130160 3179 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet a7a06ceeb3c84f788e360a5ba926a71f (table default.table_547d99db0d3043499a26ee8c6df4c443 [id=333213fed7234610bc20c7d92124182b], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet a7a06ceeb3c84f788e360a5ba926a71f consensus state has no leader
W20260203 21:10:29.130841 3187 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_675a6f7413004a62bce7c460e7b6da3b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260203 21:10:29.131397 3186 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_72135cb0d98246739f6b8c9aee17c8ba in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260203 21:10:29.131855 3185 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_3397dfe4625e42cf8cb5f4d45116d7b1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260203 21:10:29.133410 2443 catalog_manager.cc:2184] deleted orphaned HMS catalog entry for table [id=083eb2c7b49741078c89bcc583117adb]
I20260203 21:10:29.133708 2443 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:57540 (request call id 49) took 1358 ms. Trace:
I20260203 21:10:29.133773 2443 rpcz_store.cc:276] 0203 21:10:27.774990 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 21:10:27.837659 (+ 62669us) service_pool.cc:225] Handling call
0203 21:10:28.228195 (+390536us) catalog_manager.cc:2101] Acquired catalog manager lock
0203 21:10:28.228539 (+ 344us) catalog_manager.cc:2147] Created new table and tablet info
0203 21:10:28.992985 (+764446us) catalog_manager.cc:2173] Created new table in HMS catalog
0203 21:10:28.993526 (+ 541us) write_op.cc:489] Releasing partition, row and schema locks
0203 21:10:28.993527 (+ 1us) write_op.cc:454] Released schema lock
0203 21:10:28.993682 (+ 155us) catalog_manager.cc:2181] Rolling back HMS table creation
0203 21:10:29.133689 (+140007us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0203 21:10:28.993462 (+ 0us) op_driver.cc:389] HandleFailure(Illegal state: replica 7344d7cd8dea4fa2ae705320daacaf49 is not leader of this config: current role FOLLOWER)
0203 21:10:28.993472 (+ 10us) write_op.cc:489] Releasing partition, row and schema locks
0203 21:10:28.993476 (+ 4us) write_op.cc:454] Released schema lock
0203 21:10:28.993478 (+ 2us) write_op.cc:335] FINISH: Op aborted
Metrics: {"Hive Metastore.queue_time_us":778574,"Hive Metastore.run_cpu_time_us":343,"Hive Metastore.run_wall_time_us":125373,"child_traces":[["op",{}]]}
I20260203 21:10:29.136924 3248 catalog_manager.cc:2772] Deleting table default.table_75f7568b9f28464e8d4ce934087b320e [id=083eb2c7b49741078c89bcc583117adb] in response to Hive Metastore notification log event 21
W20260203 21:10:29.137068 3248 hms_notification_log_listener.cc:329] Failed to handle Hive Metastore notification: 21 DROP_TABLE default.table_75f7568b9f28464e8d4ce934087b320e: Not found: the table does not exist: table_id: "083eb2c7b49741078c89bcc583117adb" table_name: "default.table_75f7568b9f28464e8d4ce934087b320e"
W20260203 21:10:29.141155 3194 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_98e2e0221eb0485fb87bee758843d37e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260203 21:10:29.141772 3189 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_8da179b3ec0b4c898eb890f89d54cb6a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260203 21:10:29.142359 3415 tablet.cc:1722] T e540d65d585c4ba1bd1bfaf62ba41fb5 P 02bdf326542e474cbe62434dd59087dc: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260203 21:10:29.144207 3411 tablet_bootstrap.cc:492] T a7a06ceeb3c84f788e360a5ba926a71f P 185c63f61a2645928eeb807d145026b1: Bootstrap starting.
I20260203 21:10:29.145481 3411 tablet_bootstrap.cc:654] T a7a06ceeb3c84f788e360a5ba926a71f P 185c63f61a2645928eeb807d145026b1: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:29.136570 3413 tablet.cc:1722] T e540d65d585c4ba1bd1bfaf62ba41fb5 P 6d9e0cecab784cc0acc050ca1c89c5be: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260203 21:10:29.145687 3409 tablet_replica.cc:333] T 930cb06bcbca41e08ac12d60a0d3b6cb P 185c63f61a2645928eeb807d145026b1: stopping tablet replica
I20260203 21:10:29.147238 3409 raft_consensus.cc:2243] T 930cb06bcbca41e08ac12d60a0d3b6cb P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 21:10:29.147413 3409 raft_consensus.cc:2272] T 930cb06bcbca41e08ac12d60a0d3b6cb P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 21:10:29.148109 3409 ts_tablet_manager.cc:1916] T 930cb06bcbca41e08ac12d60a0d3b6cb P 185c63f61a2645928eeb807d145026b1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260203 21:10:29.148216 3403 tablet_replica.cc:333] T 930cb06bcbca41e08ac12d60a0d3b6cb P 02bdf326542e474cbe62434dd59087dc: stopping tablet replica
I20260203 21:10:29.148329 3403 raft_consensus.cc:2243] T 930cb06bcbca41e08ac12d60a0d3b6cb P 02bdf326542e474cbe62434dd59087dc [term 1 LEADER]: Raft consensus shutting down.
I20260203 21:10:29.148603 3403 raft_consensus.cc:2272] T 930cb06bcbca41e08ac12d60a0d3b6cb P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 21:10:29.149204 3403 ts_tablet_manager.cc:1916] T 930cb06bcbca41e08ac12d60a0d3b6cb P 02bdf326542e474cbe62434dd59087dc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260203 21:10:29.151161 3414 tablet.cc:1722] T e540d65d585c4ba1bd1bfaf62ba41fb5 P 185c63f61a2645928eeb807d145026b1: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260203 21:10:29.143628 3405 ts_tablet_manager.cc:1916] T d019bac79b874559b718570d502c5a13 P 6d9e0cecab784cc0acc050ca1c89c5be: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260203 21:10:29.153486 3403 ts_tablet_manager.cc:1929] T 930cb06bcbca41e08ac12d60a0d3b6cb P 02bdf326542e474cbe62434dd59087dc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260203 21:10:29.153754 3403 log.cc:1199] T 930cb06bcbca41e08ac12d60a0d3b6cb P 02bdf326542e474cbe62434dd59087dc: Deleting WAL directory at /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-0/wal/wals/930cb06bcbca41e08ac12d60a0d3b6cb
I20260203 21:10:29.153935 3409 ts_tablet_manager.cc:1929] T 930cb06bcbca41e08ac12d60a0d3b6cb P 185c63f61a2645928eeb807d145026b1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260203 21:10:29.154043 3403 ts_tablet_manager.cc:1950] T 930cb06bcbca41e08ac12d60a0d3b6cb P 02bdf326542e474cbe62434dd59087dc: Deleting consensus metadata
I20260203 21:10:29.154044 3409 log.cc:1199] T 930cb06bcbca41e08ac12d60a0d3b6cb P 185c63f61a2645928eeb807d145026b1: Deleting WAL directory at /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-2/wal/wals/930cb06bcbca41e08ac12d60a0d3b6cb
I20260203 21:10:29.154336 3409 ts_tablet_manager.cc:1950] T 930cb06bcbca41e08ac12d60a0d3b6cb P 185c63f61a2645928eeb807d145026b1: Deleting consensus metadata
I20260203 21:10:29.155032 3406 tablet_bootstrap.cc:492] T 8672a1e59caf4f70830d7cdac01f36cd P 6d9e0cecab784cc0acc050ca1c89c5be: No bootstrap required, opened a new log
I20260203 21:10:29.155123 3406 ts_tablet_manager.cc:1403] T 8672a1e59caf4f70830d7cdac01f36cd P 6d9e0cecab784cc0acc050ca1c89c5be: Time spent bootstrapping tablet: real 0.030s user 0.002s sys 0.000s
I20260203 21:10:29.155571 3406 raft_consensus.cc:359] T 8672a1e59caf4f70830d7cdac01f36cd P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.155763 3406 raft_consensus.cc:385] T 8672a1e59caf4f70830d7cdac01f36cd P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:29.155843 3406 raft_consensus.cc:740] T 8672a1e59caf4f70830d7cdac01f36cd P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d9e0cecab784cc0acc050ca1c89c5be, State: Initialized, Role: FOLLOWER
I20260203 21:10:29.156002 3406 consensus_queue.cc:260] T 8672a1e59caf4f70830d7cdac01f36cd P 6d9e0cecab784cc0acc050ca1c89c5be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.156315 3409 tablet_replica.cc:333] T 20fec52d63a34162bb79805433de62c0 P 185c63f61a2645928eeb807d145026b1: stopping tablet replica
I20260203 21:10:29.156428 3409 raft_consensus.cc:2243] T 20fec52d63a34162bb79805433de62c0 P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 21:10:29.156530 3409 raft_consensus.cc:2272] T 20fec52d63a34162bb79805433de62c0 P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 21:10:29.156674 3406 ts_tablet_manager.cc:1434] T 8672a1e59caf4f70830d7cdac01f36cd P 6d9e0cecab784cc0acc050ca1c89c5be: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260203 21:10:29.156883 3406 tablet_bootstrap.cc:492] T f11742b0380d4f46a2ec058238810d02 P 6d9e0cecab784cc0acc050ca1c89c5be: Bootstrap starting.
I20260203 21:10:29.158020 3406 tablet_bootstrap.cc:654] T f11742b0380d4f46a2ec058238810d02 P 6d9e0cecab784cc0acc050ca1c89c5be: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:29.155653 3405 ts_tablet_manager.cc:1929] T d019bac79b874559b718570d502c5a13 P 6d9e0cecab784cc0acc050ca1c89c5be: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260203 21:10:29.158530 3409 ts_tablet_manager.cc:1916] T 20fec52d63a34162bb79805433de62c0 P 185c63f61a2645928eeb807d145026b1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260203 21:10:29.158839 3405 log.cc:1199] T d019bac79b874559b718570d502c5a13 P 6d9e0cecab784cc0acc050ca1c89c5be: Deleting WAL directory at /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-1/wal/wals/d019bac79b874559b718570d502c5a13
I20260203 21:10:29.159124 3405 ts_tablet_manager.cc:1950] T d019bac79b874559b718570d502c5a13 P 6d9e0cecab784cc0acc050ca1c89c5be: Deleting consensus metadata
I20260203 21:10:29.159698 3181 catalog_manager.cc:4985] TS 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): tablet d019bac79b874559b718570d502c5a13 (table default.table_a029ba95c22e421585ca4ce640aa9658 [id=73eae179f2ad481d932a5b3c95b1a4ab]) successfully deleted
I20260203 21:10:29.159746 3405 tablet_replica.cc:333] T d6c50af1a05941fe98418d50fbb0009b P 6d9e0cecab784cc0acc050ca1c89c5be: stopping tablet replica
I20260203 21:10:29.159891 3405 raft_consensus.cc:2243] T d6c50af1a05941fe98418d50fbb0009b P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 LEADER]: Raft consensus shutting down.
I20260203 21:10:29.160084 3405 raft_consensus.cc:2272] T d6c50af1a05941fe98418d50fbb0009b P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 21:10:29.160531 3405 ts_tablet_manager.cc:1916] T d6c50af1a05941fe98418d50fbb0009b P 6d9e0cecab784cc0acc050ca1c89c5be: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260203 21:10:29.160799 3403 tablet_replica.cc:333] T d019bac79b874559b718570d502c5a13 P 02bdf326542e474cbe62434dd59087dc: stopping tablet replica
I20260203 21:10:29.162281 3409 ts_tablet_manager.cc:1929] T 20fec52d63a34162bb79805433de62c0 P 185c63f61a2645928eeb807d145026b1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260203 21:10:29.162356 3409 log.cc:1199] T 20fec52d63a34162bb79805433de62c0 P 185c63f61a2645928eeb807d145026b1: Deleting WAL directory at /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-2/wal/wals/20fec52d63a34162bb79805433de62c0
I20260203 21:10:29.162537 3405 ts_tablet_manager.cc:1929] T d6c50af1a05941fe98418d50fbb0009b P 6d9e0cecab784cc0acc050ca1c89c5be: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260203 21:10:29.162586 3409 ts_tablet_manager.cc:1950] T 20fec52d63a34162bb79805433de62c0 P 185c63f61a2645928eeb807d145026b1: Deleting consensus metadata
I20260203 21:10:29.162603 3405 log.cc:1199] T d6c50af1a05941fe98418d50fbb0009b P 6d9e0cecab784cc0acc050ca1c89c5be: Deleting WAL directory at /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-1/wal/wals/d6c50af1a05941fe98418d50fbb0009b
I20260203 21:10:29.162818 3405 ts_tablet_manager.cc:1950] T d6c50af1a05941fe98418d50fbb0009b P 6d9e0cecab784cc0acc050ca1c89c5be: Deleting consensus metadata
I20260203 21:10:29.163148 3180 catalog_manager.cc:4985] TS 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): tablet 20fec52d63a34162bb79805433de62c0 (table default.table_547d99db0d3043499a26ee8c6df4c443 [id=333213fed7234610bc20c7d92124182b]) successfully deleted
I20260203 21:10:29.163272 3405 tablet_replica.cc:333] T 930cb06bcbca41e08ac12d60a0d3b6cb P 6d9e0cecab784cc0acc050ca1c89c5be: stopping tablet replica
I20260203 21:10:29.163367 3405 raft_consensus.cc:2243] T 930cb06bcbca41e08ac12d60a0d3b6cb P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 21:10:29.163453 3405 raft_consensus.cc:2272] T 930cb06bcbca41e08ac12d60a0d3b6cb P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 21:10:29.163453 3181 catalog_manager.cc:4985] TS 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): tablet d6c50af1a05941fe98418d50fbb0009b (table default.table_7e73ff80019543888e0b8afa9b7a6660 [id=82ec5c95acc84e509c0803db74b626b4]) successfully deleted
I20260203 21:10:29.163625 3403 raft_consensus.cc:2243] T d019bac79b874559b718570d502c5a13 P 02bdf326542e474cbe62434dd59087dc [term 1 LEADER]: Raft consensus shutting down.
I20260203 21:10:29.163796 3411 tablet_bootstrap.cc:492] T a7a06ceeb3c84f788e360a5ba926a71f P 185c63f61a2645928eeb807d145026b1: No bootstrap required, opened a new log
I20260203 21:10:29.163866 3411 ts_tablet_manager.cc:1403] T a7a06ceeb3c84f788e360a5ba926a71f P 185c63f61a2645928eeb807d145026b1: Time spent bootstrapping tablet: real 0.020s user 0.000s sys 0.002s
I20260203 21:10:29.163856 3403 raft_consensus.cc:2272] T d019bac79b874559b718570d502c5a13 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 21:10:29.164016 3404 tablet_bootstrap.cc:492] T 4c8edfa3d555490f953a3ec7bef314ae P 02bdf326542e474cbe62434dd59087dc: No bootstrap required, opened a new log
I20260203 21:10:29.164114 3404 ts_tablet_manager.cc:1403] T 4c8edfa3d555490f953a3ec7bef314ae P 02bdf326542e474cbe62434dd59087dc: Time spent bootstrapping tablet: real 0.052s user 0.002s sys 0.000s
I20260203 21:10:29.164316 3403 ts_tablet_manager.cc:1916] T d019bac79b874559b718570d502c5a13 P 02bdf326542e474cbe62434dd59087dc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260203 21:10:29.164340 3411 raft_consensus.cc:359] T a7a06ceeb3c84f788e360a5ba926a71f P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } }
I20260203 21:10:29.164418 3411 raft_consensus.cc:385] T a7a06ceeb3c84f788e360a5ba926a71f P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:29.164444 3411 raft_consensus.cc:740] T a7a06ceeb3c84f788e360a5ba926a71f P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 185c63f61a2645928eeb807d145026b1, State: Initialized, Role: FOLLOWER
I20260203 21:10:29.164554 3411 consensus_queue.cc:260] T a7a06ceeb3c84f788e360a5ba926a71f P 185c63f61a2645928eeb807d145026b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } }
I20260203 21:10:29.164577 3404 raft_consensus.cc:359] T 4c8edfa3d555490f953a3ec7bef314ae P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.164681 3404 raft_consensus.cc:385] T 4c8edfa3d555490f953a3ec7bef314ae P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:29.164721 3404 raft_consensus.cc:740] T 4c8edfa3d555490f953a3ec7bef314ae P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02bdf326542e474cbe62434dd59087dc, State: Initialized, Role: FOLLOWER
I20260203 21:10:29.164847 3404 consensus_queue.cc:260] T 4c8edfa3d555490f953a3ec7bef314ae P 02bdf326542e474cbe62434dd59087dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.165162 3404 ts_tablet_manager.cc:1434] T 4c8edfa3d555490f953a3ec7bef314ae P 02bdf326542e474cbe62434dd59087dc: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260203 21:10:29.165669 3411 ts_tablet_manager.cc:1434] T a7a06ceeb3c84f788e360a5ba926a71f P 185c63f61a2645928eeb807d145026b1: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260203 21:10:29.165838 3411 tablet_bootstrap.cc:492] T 4c8edfa3d555490f953a3ec7bef314ae P 185c63f61a2645928eeb807d145026b1: Bootstrap starting.
I20260203 21:10:29.167263 3411 tablet_bootstrap.cc:654] T 4c8edfa3d555490f953a3ec7bef314ae P 185c63f61a2645928eeb807d145026b1: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:29.169821 3409 tablet_replica.cc:333] T d019bac79b874559b718570d502c5a13 P 185c63f61a2645928eeb807d145026b1: stopping tablet replica
I20260203 21:10:29.169937 3409 raft_consensus.cc:2243] T d019bac79b874559b718570d502c5a13 P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 21:10:29.170080 3409 raft_consensus.cc:2272] T d019bac79b874559b718570d502c5a13 P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 21:10:29.170666 3409 ts_tablet_manager.cc:1916] T d019bac79b874559b718570d502c5a13 P 185c63f61a2645928eeb807d145026b1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260203 21:10:29.171850 3403 ts_tablet_manager.cc:1929] T d019bac79b874559b718570d502c5a13 P 02bdf326542e474cbe62434dd59087dc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260203 21:10:29.171936 3403 log.cc:1199] T d019bac79b874559b718570d502c5a13 P 02bdf326542e474cbe62434dd59087dc: Deleting WAL directory at /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-0/wal/wals/d019bac79b874559b718570d502c5a13
I20260203 21:10:29.172209 3403 ts_tablet_manager.cc:1950] T d019bac79b874559b718570d502c5a13 P 02bdf326542e474cbe62434dd59087dc: Deleting consensus metadata
I20260203 21:10:29.174140 3405 ts_tablet_manager.cc:1916] T 930cb06bcbca41e08ac12d60a0d3b6cb P 6d9e0cecab784cc0acc050ca1c89c5be: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260203 21:10:29.175953 3406 tablet_bootstrap.cc:492] T f11742b0380d4f46a2ec058238810d02 P 6d9e0cecab784cc0acc050ca1c89c5be: No bootstrap required, opened a new log
I20260203 21:10:29.176067 3406 ts_tablet_manager.cc:1403] T f11742b0380d4f46a2ec058238810d02 P 6d9e0cecab784cc0acc050ca1c89c5be: Time spent bootstrapping tablet: real 0.019s user 0.000s sys 0.002s
I20260203 21:10:29.176199 3179 catalog_manager.cc:4985] TS 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335): tablet d019bac79b874559b718570d502c5a13 (table default.table_a029ba95c22e421585ca4ce640aa9658 [id=73eae179f2ad481d932a5b3c95b1a4ab]) successfully deleted
I20260203 21:10:29.176299 3403 tablet_replica.cc:333] T d6c50af1a05941fe98418d50fbb0009b P 02bdf326542e474cbe62434dd59087dc: stopping tablet replica
I20260203 21:10:29.176822 3406 raft_consensus.cc:359] T f11742b0380d4f46a2ec058238810d02 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.176930 3403 raft_consensus.cc:2243] T d6c50af1a05941fe98418d50fbb0009b P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 21:10:29.176985 3406 raft_consensus.cc:385] T f11742b0380d4f46a2ec058238810d02 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:29.177026 3406 raft_consensus.cc:740] T f11742b0380d4f46a2ec058238810d02 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d9e0cecab784cc0acc050ca1c89c5be, State: Initialized, Role: FOLLOWER
I20260203 21:10:29.177060 3403 raft_consensus.cc:2272] T d6c50af1a05941fe98418d50fbb0009b P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 21:10:29.177191 3406 consensus_queue.cc:260] T f11742b0380d4f46a2ec058238810d02 P 6d9e0cecab784cc0acc050ca1c89c5be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.177834 3405 ts_tablet_manager.cc:1929] T 930cb06bcbca41e08ac12d60a0d3b6cb P 6d9e0cecab784cc0acc050ca1c89c5be: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260203 21:10:29.177911 3405 log.cc:1199] T 930cb06bcbca41e08ac12d60a0d3b6cb P 6d9e0cecab784cc0acc050ca1c89c5be: Deleting WAL directory at /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-1/wal/wals/930cb06bcbca41e08ac12d60a0d3b6cb
I20260203 21:10:29.178172 3405 ts_tablet_manager.cc:1950] T 930cb06bcbca41e08ac12d60a0d3b6cb P 6d9e0cecab784cc0acc050ca1c89c5be: Deleting consensus metadata
I20260203 21:10:29.178773 3406 ts_tablet_manager.cc:1434] T f11742b0380d4f46a2ec058238810d02 P 6d9e0cecab784cc0acc050ca1c89c5be: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260203 21:10:29.179191 3403 ts_tablet_manager.cc:1916] T d6c50af1a05941fe98418d50fbb0009b P 02bdf326542e474cbe62434dd59087dc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260203 21:10:29.179550 3406 tablet_bootstrap.cc:492] T 4c8edfa3d555490f953a3ec7bef314ae P 6d9e0cecab784cc0acc050ca1c89c5be: Bootstrap starting.
I20260203 21:10:29.180568 3406 tablet_bootstrap.cc:654] T 4c8edfa3d555490f953a3ec7bef314ae P 6d9e0cecab784cc0acc050ca1c89c5be: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:29.181502 3411 tablet_bootstrap.cc:492] T 4c8edfa3d555490f953a3ec7bef314ae P 185c63f61a2645928eeb807d145026b1: No bootstrap required, opened a new log
I20260203 21:10:29.181612 3411 ts_tablet_manager.cc:1403] T 4c8edfa3d555490f953a3ec7bef314ae P 185c63f61a2645928eeb807d145026b1: Time spent bootstrapping tablet: real 0.016s user 0.001s sys 0.001s
I20260203 21:10:29.182178 3409 ts_tablet_manager.cc:1929] T d019bac79b874559b718570d502c5a13 P 185c63f61a2645928eeb807d145026b1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260203 21:10:29.182246 3409 log.cc:1199] T d019bac79b874559b718570d502c5a13 P 185c63f61a2645928eeb807d145026b1: Deleting WAL directory at /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-2/wal/wals/d019bac79b874559b718570d502c5a13
I20260203 21:10:29.182199 3411 raft_consensus.cc:359] T 4c8edfa3d555490f953a3ec7bef314ae P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.182315 3411 raft_consensus.cc:385] T 4c8edfa3d555490f953a3ec7bef314ae P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:29.182360 3411 raft_consensus.cc:740] T 4c8edfa3d555490f953a3ec7bef314ae P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 185c63f61a2645928eeb807d145026b1, State: Initialized, Role: FOLLOWER
I20260203 21:10:29.182418 3409 ts_tablet_manager.cc:1950] T d019bac79b874559b718570d502c5a13 P 185c63f61a2645928eeb807d145026b1: Deleting consensus metadata
I20260203 21:10:29.182536 3411 consensus_queue.cc:260] T 4c8edfa3d555490f953a3ec7bef314ae P 185c63f61a2645928eeb807d145026b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.182873 3411 ts_tablet_manager.cc:1434] T 4c8edfa3d555490f953a3ec7bef314ae P 185c63f61a2645928eeb807d145026b1: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260203 21:10:29.183784 3411 tablet_bootstrap.cc:492] T 8672a1e59caf4f70830d7cdac01f36cd P 185c63f61a2645928eeb807d145026b1: Bootstrap starting.
I20260203 21:10:29.185566 3403 ts_tablet_manager.cc:1929] T d6c50af1a05941fe98418d50fbb0009b P 02bdf326542e474cbe62434dd59087dc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260203 21:10:29.185654 3403 log.cc:1199] T d6c50af1a05941fe98418d50fbb0009b P 02bdf326542e474cbe62434dd59087dc: Deleting WAL directory at /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-0/wal/wals/d6c50af1a05941fe98418d50fbb0009b
I20260203 21:10:29.185923 3403 ts_tablet_manager.cc:1950] T d6c50af1a05941fe98418d50fbb0009b P 02bdf326542e474cbe62434dd59087dc: Deleting consensus metadata
I20260203 21:10:29.186592 3179 catalog_manager.cc:4985] TS 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335): tablet d6c50af1a05941fe98418d50fbb0009b (table default.table_7e73ff80019543888e0b8afa9b7a6660 [id=82ec5c95acc84e509c0803db74b626b4]) successfully deleted
I20260203 21:10:29.186668 3405 tablet_replica.cc:333] T f11742b0380d4f46a2ec058238810d02 P 6d9e0cecab784cc0acc050ca1c89c5be: stopping tablet replica
I20260203 21:10:29.186805 3405 raft_consensus.cc:2243] T f11742b0380d4f46a2ec058238810d02 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Raft consensus shutting down.
I20260203 21:10:29.186919 3405 raft_consensus.cc:2272] T f11742b0380d4f46a2ec058238810d02 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Raft consensus is shut down!
I20260203 21:10:29.187403 3405 ts_tablet_manager.cc:1916] T f11742b0380d4f46a2ec058238810d02 P 6d9e0cecab784cc0acc050ca1c89c5be: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260203 21:10:29.187798 3411 tablet_bootstrap.cc:654] T 8672a1e59caf4f70830d7cdac01f36cd P 185c63f61a2645928eeb807d145026b1: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:29.188602 3406 tablet_bootstrap.cc:492] T 4c8edfa3d555490f953a3ec7bef314ae P 6d9e0cecab784cc0acc050ca1c89c5be: No bootstrap required, opened a new log
I20260203 21:10:29.188700 3406 ts_tablet_manager.cc:1403] T 4c8edfa3d555490f953a3ec7bef314ae P 6d9e0cecab784cc0acc050ca1c89c5be: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20260203 21:10:29.189185 3406 raft_consensus.cc:359] T 4c8edfa3d555490f953a3ec7bef314ae P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.189303 3406 raft_consensus.cc:385] T 4c8edfa3d555490f953a3ec7bef314ae P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:29.189342 3406 raft_consensus.cc:740] T 4c8edfa3d555490f953a3ec7bef314ae P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d9e0cecab784cc0acc050ca1c89c5be, State: Initialized, Role: FOLLOWER
I20260203 21:10:29.189466 3406 consensus_queue.cc:260] T 4c8edfa3d555490f953a3ec7bef314ae P 6d9e0cecab784cc0acc050ca1c89c5be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.189927 3180 catalog_manager.cc:4985] TS 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): tablet d019bac79b874559b718570d502c5a13 (table default.table_a029ba95c22e421585ca4ce640aa9658 [id=73eae179f2ad481d932a5b3c95b1a4ab]) successfully deleted
I20260203 21:10:29.190239 3406 ts_tablet_manager.cc:1434] T 4c8edfa3d555490f953a3ec7bef314ae P 6d9e0cecab784cc0acc050ca1c89c5be: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260203 21:10:29.191128 3409 tablet_replica.cc:333] T d6c50af1a05941fe98418d50fbb0009b P 185c63f61a2645928eeb807d145026b1: stopping tablet replica
I20260203 21:10:29.191256 3409 raft_consensus.cc:2243] T d6c50af1a05941fe98418d50fbb0009b P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 21:10:29.191360 3409 raft_consensus.cc:2272] T d6c50af1a05941fe98418d50fbb0009b P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 21:10:29.192209 3403 tablet_replica.cc:333] T 20fec52d63a34162bb79805433de62c0 P 02bdf326542e474cbe62434dd59087dc: stopping tablet replica
I20260203 21:10:29.192266 3406 tablet_bootstrap.cc:492] T a7a06ceeb3c84f788e360a5ba926a71f P 6d9e0cecab784cc0acc050ca1c89c5be: Bootstrap starting.
I20260203 21:10:29.192349 3403 raft_consensus.cc:2243] T 20fec52d63a34162bb79805433de62c0 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 21:10:29.192467 3403 raft_consensus.cc:2272] T 20fec52d63a34162bb79805433de62c0 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 21:10:29.193073 3409 ts_tablet_manager.cc:1916] T d6c50af1a05941fe98418d50fbb0009b P 185c63f61a2645928eeb807d145026b1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260203 21:10:29.193346 3406 tablet_bootstrap.cc:654] T a7a06ceeb3c84f788e360a5ba926a71f P 6d9e0cecab784cc0acc050ca1c89c5be: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:29.194460 3298 raft_consensus.cc:493] T 4c8edfa3d555490f953a3ec7bef314ae P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 21:10:29.194566 3298 raft_consensus.cc:515] T 4c8edfa3d555490f953a3ec7bef314ae P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.194940 3298 leader_election.cc:290] T 4c8edfa3d555490f953a3ec7bef314ae P 6d9e0cecab784cc0acc050ca1c89c5be [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223), 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335)
I20260203 21:10:29.195355 2784 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4c8edfa3d555490f953a3ec7bef314ae" candidate_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02bdf326542e474cbe62434dd59087dc" is_pre_election: true
I20260203 21:10:29.195459 3059 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4c8edfa3d555490f953a3ec7bef314ae" candidate_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "185c63f61a2645928eeb807d145026b1" is_pre_election: true
I20260203 21:10:29.195490 2784 raft_consensus.cc:2468] T 4c8edfa3d555490f953a3ec7bef314ae P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d9e0cecab784cc0acc050ca1c89c5be in term 0.
I20260203 21:10:29.195562 3059 raft_consensus.cc:2468] T 4c8edfa3d555490f953a3ec7bef314ae P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d9e0cecab784cc0acc050ca1c89c5be in term 0.
I20260203 21:10:29.195909 2858 leader_election.cc:304] T 4c8edfa3d555490f953a3ec7bef314ae P 6d9e0cecab784cc0acc050ca1c89c5be [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be; no voters:
I20260203 21:10:29.196120 3298 raft_consensus.cc:2804] T 4c8edfa3d555490f953a3ec7bef314ae P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 21:10:29.196174 3298 raft_consensus.cc:493] T 4c8edfa3d555490f953a3ec7bef314ae P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 21:10:29.196220 3298 raft_consensus.cc:3060] T 4c8edfa3d555490f953a3ec7bef314ae P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:29.196902 3298 raft_consensus.cc:515] T 4c8edfa3d555490f953a3ec7bef314ae P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.197230 3298 leader_election.cc:290] T 4c8edfa3d555490f953a3ec7bef314ae P 6d9e0cecab784cc0acc050ca1c89c5be [CANDIDATE]: Term 1 election: Requested vote from peers 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223), 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335)
I20260203 21:10:29.197621 2784 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4c8edfa3d555490f953a3ec7bef314ae" candidate_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02bdf326542e474cbe62434dd59087dc"
I20260203 21:10:29.197639 3340 raft_consensus.cc:493] T a7a06ceeb3c84f788e360a5ba926a71f P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 21:10:29.197728 2784 raft_consensus.cc:3060] T 4c8edfa3d555490f953a3ec7bef314ae P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:29.197728 3340 raft_consensus.cc:515] T a7a06ceeb3c84f788e360a5ba926a71f P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } }
I20260203 21:10:29.198073 3340 leader_election.cc:290] T a7a06ceeb3c84f788e360a5ba926a71f P 185c63f61a2645928eeb807d145026b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335), 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897)
I20260203 21:10:29.198325 3059 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4c8edfa3d555490f953a3ec7bef314ae" candidate_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "185c63f61a2645928eeb807d145026b1"
I20260203 21:10:29.198415 3059 raft_consensus.cc:3060] T 4c8edfa3d555490f953a3ec7bef314ae P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:29.198694 2784 raft_consensus.cc:2468] T 4c8edfa3d555490f953a3ec7bef314ae P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d9e0cecab784cc0acc050ca1c89c5be in term 1.
I20260203 21:10:29.199239 3059 raft_consensus.cc:2468] T 4c8edfa3d555490f953a3ec7bef314ae P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d9e0cecab784cc0acc050ca1c89c5be in term 1.
I20260203 21:10:29.199590 2858 leader_election.cc:304] T 4c8edfa3d555490f953a3ec7bef314ae P 6d9e0cecab784cc0acc050ca1c89c5be [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be; no voters:
I20260203 21:10:29.199651 2784 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a7a06ceeb3c84f788e360a5ba926a71f" candidate_uuid: "185c63f61a2645928eeb807d145026b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02bdf326542e474cbe62434dd59087dc" is_pre_election: true
I20260203 21:10:29.199775 2784 raft_consensus.cc:2468] T a7a06ceeb3c84f788e360a5ba926a71f P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 185c63f61a2645928eeb807d145026b1 in term 0.
I20260203 21:10:29.200044 2923 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a7a06ceeb3c84f788e360a5ba926a71f" candidate_uuid: "185c63f61a2645928eeb807d145026b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" is_pre_election: true
I20260203 21:10:29.200444 2993 leader_election.cc:304] T a7a06ceeb3c84f788e360a5ba926a71f P 185c63f61a2645928eeb807d145026b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc, 185c63f61a2645928eeb807d145026b1; no voters:
I20260203 21:10:29.200624 3340 raft_consensus.cc:2804] T a7a06ceeb3c84f788e360a5ba926a71f P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 21:10:29.200683 3340 raft_consensus.cc:493] T a7a06ceeb3c84f788e360a5ba926a71f P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 21:10:29.200749 3340 raft_consensus.cc:3060] T a7a06ceeb3c84f788e360a5ba926a71f P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:29.201603 3340 raft_consensus.cc:515] T a7a06ceeb3c84f788e360a5ba926a71f P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } }
I20260203 21:10:29.201997 3340 leader_election.cc:290] T a7a06ceeb3c84f788e360a5ba926a71f P 185c63f61a2645928eeb807d145026b1 [CANDIDATE]: Term 1 election: Requested vote from peers 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335), 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897)
W20260203 21:10:29.202541 2995 leader_election.cc:343] T a7a06ceeb3c84f788e360a5ba926a71f P 185c63f61a2645928eeb807d145026b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Illegal state: must be running to vote when last-logged opid is not known
I20260203 21:10:29.202886 2923 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a7a06ceeb3c84f788e360a5ba926a71f" candidate_uuid: "185c63f61a2645928eeb807d145026b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d9e0cecab784cc0acc050ca1c89c5be"
I20260203 21:10:29.203387 2784 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a7a06ceeb3c84f788e360a5ba926a71f" candidate_uuid: "185c63f61a2645928eeb807d145026b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02bdf326542e474cbe62434dd59087dc"
I20260203 21:10:29.203501 2784 raft_consensus.cc:3060] T a7a06ceeb3c84f788e360a5ba926a71f P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:29.204457 2784 raft_consensus.cc:2468] T a7a06ceeb3c84f788e360a5ba926a71f P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 185c63f61a2645928eeb807d145026b1 in term 1.
W20260203 21:10:29.204875 2995 leader_election.cc:343] T a7a06ceeb3c84f788e360a5ba926a71f P 185c63f61a2645928eeb807d145026b1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Illegal state: must be running to vote when last-logged opid is not known
I20260203 21:10:29.205040 2993 leader_election.cc:304] T a7a06ceeb3c84f788e360a5ba926a71f P 185c63f61a2645928eeb807d145026b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc, 185c63f61a2645928eeb807d145026b1; no voters: 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:10:29.205265 3298 raft_consensus.cc:2804] T 4c8edfa3d555490f953a3ec7bef314ae P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 FOLLOWER]: Leader election won for term 1
I20260203 21:10:29.205363 3298 raft_consensus.cc:697] T 4c8edfa3d555490f953a3ec7bef314ae P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 LEADER]: Becoming Leader. State: Replica: 6d9e0cecab784cc0acc050ca1c89c5be, State: Running, Role: LEADER
I20260203 21:10:29.205510 3298 consensus_queue.cc:237] T 4c8edfa3d555490f953a3ec7bef314ae P 6d9e0cecab784cc0acc050ca1c89c5be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.205647 3411 tablet_bootstrap.cc:492] T 8672a1e59caf4f70830d7cdac01f36cd P 185c63f61a2645928eeb807d145026b1: No bootstrap required, opened a new log
I20260203 21:10:29.205753 3411 ts_tablet_manager.cc:1403] T 8672a1e59caf4f70830d7cdac01f36cd P 185c63f61a2645928eeb807d145026b1: Time spent bootstrapping tablet: real 0.022s user 0.001s sys 0.001s
I20260203 21:10:29.206318 3340 raft_consensus.cc:2804] T a7a06ceeb3c84f788e360a5ba926a71f P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260203 21:10:29.206418 3340 raft_consensus.cc:697] T a7a06ceeb3c84f788e360a5ba926a71f P 185c63f61a2645928eeb807d145026b1 [term 1 LEADER]: Becoming Leader. State: Replica: 185c63f61a2645928eeb807d145026b1, State: Running, Role: LEADER
I20260203 21:10:29.206548 3340 consensus_queue.cc:237] T a7a06ceeb3c84f788e360a5ba926a71f P 185c63f61a2645928eeb807d145026b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } }
I20260203 21:10:29.206987 3411 raft_consensus.cc:359] T 8672a1e59caf4f70830d7cdac01f36cd P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.207109 3411 raft_consensus.cc:385] T 8672a1e59caf4f70830d7cdac01f36cd P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:29.207147 3411 raft_consensus.cc:740] T 8672a1e59caf4f70830d7cdac01f36cd P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 185c63f61a2645928eeb807d145026b1, State: Initialized, Role: FOLLOWER
I20260203 21:10:29.207237 3411 consensus_queue.cc:260] T 8672a1e59caf4f70830d7cdac01f36cd P 185c63f61a2645928eeb807d145026b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.207494 3411 ts_tablet_manager.cc:1434] T 8672a1e59caf4f70830d7cdac01f36cd P 185c63f61a2645928eeb807d145026b1: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260203 21:10:29.207696 3411 tablet_bootstrap.cc:492] T f11742b0380d4f46a2ec058238810d02 P 185c63f61a2645928eeb807d145026b1: Bootstrap starting.
I20260203 21:10:29.209257 3403 ts_tablet_manager.cc:1916] T 20fec52d63a34162bb79805433de62c0 P 02bdf326542e474cbe62434dd59087dc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260203 21:10:29.210889 3405 ts_tablet_manager.cc:1929] T f11742b0380d4f46a2ec058238810d02 P 6d9e0cecab784cc0acc050ca1c89c5be: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260203 21:10:29.210973 3405 log.cc:1199] T f11742b0380d4f46a2ec058238810d02 P 6d9e0cecab784cc0acc050ca1c89c5be: Deleting WAL directory at /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-1/wal/wals/f11742b0380d4f46a2ec058238810d02
I20260203 21:10:29.211201 3405 ts_tablet_manager.cc:1950] T f11742b0380d4f46a2ec058238810d02 P 6d9e0cecab784cc0acc050ca1c89c5be: Deleting consensus metadata
I20260203 21:10:29.211567 3411 tablet_bootstrap.cc:654] T f11742b0380d4f46a2ec058238810d02 P 185c63f61a2645928eeb807d145026b1: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:29.212474 3406 tablet_bootstrap.cc:492] T a7a06ceeb3c84f788e360a5ba926a71f P 6d9e0cecab784cc0acc050ca1c89c5be: No bootstrap required, opened a new log
I20260203 21:10:29.212582 3406 ts_tablet_manager.cc:1403] T a7a06ceeb3c84f788e360a5ba926a71f P 6d9e0cecab784cc0acc050ca1c89c5be: Time spent bootstrapping tablet: real 0.020s user 0.001s sys 0.001s
I20260203 21:10:29.212730 3411 tablet_bootstrap.cc:492] T f11742b0380d4f46a2ec058238810d02 P 185c63f61a2645928eeb807d145026b1: No bootstrap required, opened a new log
I20260203 21:10:29.212913 3411 ts_tablet_manager.cc:1403] T f11742b0380d4f46a2ec058238810d02 P 185c63f61a2645928eeb807d145026b1: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260203 21:10:29.213032 3406 raft_consensus.cc:359] T a7a06ceeb3c84f788e360a5ba926a71f P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } }
I20260203 21:10:29.213131 3406 raft_consensus.cc:385] T a7a06ceeb3c84f788e360a5ba926a71f P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:29.213094 3181 catalog_manager.cc:4985] TS 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): tablet f11742b0380d4f46a2ec058238810d02 (table default.table_8695f3c31a784599917744b6d57e2a18 [id=d3ee372fbea0402796f488b9f48638b9]) successfully deleted
I20260203 21:10:29.213166 3406 raft_consensus.cc:740] T a7a06ceeb3c84f788e360a5ba926a71f P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d9e0cecab784cc0acc050ca1c89c5be, State: Initialized, Role: FOLLOWER
I20260203 21:10:29.213296 3406 consensus_queue.cc:260] T a7a06ceeb3c84f788e360a5ba926a71f P 6d9e0cecab784cc0acc050ca1c89c5be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } }
I20260203 21:10:29.213624 3411 raft_consensus.cc:359] T f11742b0380d4f46a2ec058238810d02 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.213783 3411 raft_consensus.cc:385] T f11742b0380d4f46a2ec058238810d02 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:29.213857 3403 ts_tablet_manager.cc:1929] T 20fec52d63a34162bb79805433de62c0 P 02bdf326542e474cbe62434dd59087dc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260203 21:10:29.213863 3411 raft_consensus.cc:740] T f11742b0380d4f46a2ec058238810d02 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 185c63f61a2645928eeb807d145026b1, State: Initialized, Role: FOLLOWER
I20260203 21:10:29.213883 3406 ts_tablet_manager.cc:1434] T a7a06ceeb3c84f788e360a5ba926a71f P 6d9e0cecab784cc0acc050ca1c89c5be: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20260203 21:10:29.213932 3403 log.cc:1199] T 20fec52d63a34162bb79805433de62c0 P 02bdf326542e474cbe62434dd59087dc: Deleting WAL directory at /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-0/wal/wals/20fec52d63a34162bb79805433de62c0
I20260203 21:10:29.213339 3405 tablet_replica.cc:333] T c45683f20a454401bfb90b41570b5125 P 6d9e0cecab784cc0acc050ca1c89c5be: stopping tablet replica
I20260203 21:10:29.214088 3411 consensus_queue.cc:260] T f11742b0380d4f46a2ec058238810d02 P 185c63f61a2645928eeb807d145026b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.214425 3411 ts_tablet_manager.cc:1434] T f11742b0380d4f46a2ec058238810d02 P 185c63f61a2645928eeb807d145026b1: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260203 21:10:29.215286 3405 raft_consensus.cc:2243] T c45683f20a454401bfb90b41570b5125 P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 LEADER]: Raft consensus shutting down.
I20260203 21:10:29.215498 3405 raft_consensus.cc:2272] T c45683f20a454401bfb90b41570b5125 P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 21:10:29.215813 3409 ts_tablet_manager.cc:1929] T d6c50af1a05941fe98418d50fbb0009b P 185c63f61a2645928eeb807d145026b1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260203 21:10:29.215880 3409 log.cc:1199] T d6c50af1a05941fe98418d50fbb0009b P 185c63f61a2645928eeb807d145026b1: Deleting WAL directory at /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-2/wal/wals/d6c50af1a05941fe98418d50fbb0009b
I20260203 21:10:29.216145 3409 ts_tablet_manager.cc:1950] T d6c50af1a05941fe98418d50fbb0009b P 185c63f61a2645928eeb807d145026b1: Deleting consensus metadata
I20260203 21:10:29.216775 3180 catalog_manager.cc:4985] TS 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): tablet d6c50af1a05941fe98418d50fbb0009b (table default.table_7e73ff80019543888e0b8afa9b7a6660 [id=82ec5c95acc84e509c0803db74b626b4]) successfully deleted
I20260203 21:10:29.217213 3405 ts_tablet_manager.cc:1916] T c45683f20a454401bfb90b41570b5125 P 6d9e0cecab784cc0acc050ca1c89c5be: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260203 21:10:29.217712 3403 ts_tablet_manager.cc:1950] T 20fec52d63a34162bb79805433de62c0 P 02bdf326542e474cbe62434dd59087dc: Deleting consensus metadata
I20260203 21:10:29.218317 3403 tablet_replica.cc:333] T f11742b0380d4f46a2ec058238810d02 P 02bdf326542e474cbe62434dd59087dc: stopping tablet replica
I20260203 21:10:29.218400 3179 catalog_manager.cc:4985] TS 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335): tablet 20fec52d63a34162bb79805433de62c0 (table default.table_547d99db0d3043499a26ee8c6df4c443 [id=333213fed7234610bc20c7d92124182b]) successfully deleted
I20260203 21:10:29.218436 3403 raft_consensus.cc:2243] T f11742b0380d4f46a2ec058238810d02 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Raft consensus shutting down.
I20260203 21:10:29.218520 3403 raft_consensus.cc:2272] T f11742b0380d4f46a2ec058238810d02 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Raft consensus is shut down!
I20260203 21:10:29.219993 3405 ts_tablet_manager.cc:1929] T c45683f20a454401bfb90b41570b5125 P 6d9e0cecab784cc0acc050ca1c89c5be: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260203 21:10:29.220072 3405 log.cc:1199] T c45683f20a454401bfb90b41570b5125 P 6d9e0cecab784cc0acc050ca1c89c5be: Deleting WAL directory at /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-1/wal/wals/c45683f20a454401bfb90b41570b5125
I20260203 21:10:29.220316 3405 ts_tablet_manager.cc:1950] T c45683f20a454401bfb90b41570b5125 P 6d9e0cecab784cc0acc050ca1c89c5be: Deleting consensus metadata
I20260203 21:10:29.220938 3181 catalog_manager.cc:4985] TS 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): tablet c45683f20a454401bfb90b41570b5125 (table default.table_42d2deb9edf04a3b8ce372f18fff2cf1 [id=cc496c5ba7e8461b8020f3ab100304c8]) successfully deleted
I20260203 21:10:29.221093 3409 tablet_replica.cc:333] T f11742b0380d4f46a2ec058238810d02 P 185c63f61a2645928eeb807d145026b1: stopping tablet replica
I20260203 21:10:29.221686 3409 raft_consensus.cc:2243] T f11742b0380d4f46a2ec058238810d02 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260203 21:10:29.221819 3409 raft_consensus.cc:2272] T f11742b0380d4f46a2ec058238810d02 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260203 21:10:29.222277 3409 ts_tablet_manager.cc:1916] T f11742b0380d4f46a2ec058238810d02 P 185c63f61a2645928eeb807d145026b1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260203 21:10:29.222783 3403 ts_tablet_manager.cc:1916] T f11742b0380d4f46a2ec058238810d02 P 02bdf326542e474cbe62434dd59087dc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260203 21:10:29.224882 3403 ts_tablet_manager.cc:1929] T f11742b0380d4f46a2ec058238810d02 P 02bdf326542e474cbe62434dd59087dc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260203 21:10:29.224965 3403 log.cc:1199] T f11742b0380d4f46a2ec058238810d02 P 02bdf326542e474cbe62434dd59087dc: Deleting WAL directory at /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-0/wal/wals/f11742b0380d4f46a2ec058238810d02
I20260203 21:10:29.225176 3403 ts_tablet_manager.cc:1950] T f11742b0380d4f46a2ec058238810d02 P 02bdf326542e474cbe62434dd59087dc: Deleting consensus metadata
I20260203 21:10:29.225821 3179 catalog_manager.cc:4985] TS 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335): tablet f11742b0380d4f46a2ec058238810d02 (table default.table_8695f3c31a784599917744b6d57e2a18 [id=d3ee372fbea0402796f488b9f48638b9]) successfully deleted
I20260203 21:10:29.228029 3409 ts_tablet_manager.cc:1929] T f11742b0380d4f46a2ec058238810d02 P 185c63f61a2645928eeb807d145026b1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260203 21:10:29.228112 3409 log.cc:1199] T f11742b0380d4f46a2ec058238810d02 P 185c63f61a2645928eeb807d145026b1: Deleting WAL directory at /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-2/wal/wals/f11742b0380d4f46a2ec058238810d02
I20260203 21:10:29.228320 3409 ts_tablet_manager.cc:1950] T f11742b0380d4f46a2ec058238810d02 P 185c63f61a2645928eeb807d145026b1: Deleting consensus metadata
I20260203 21:10:29.229051 3180 catalog_manager.cc:4985] TS 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): tablet f11742b0380d4f46a2ec058238810d02 (table default.table_8695f3c31a784599917744b6d57e2a18 [id=d3ee372fbea0402796f488b9f48638b9]) successfully deleted
I20260203 21:10:29.229410 3409 tablet_replica.cc:333] T c45683f20a454401bfb90b41570b5125 P 185c63f61a2645928eeb807d145026b1: stopping tablet replica
I20260203 21:10:29.229549 3409 raft_consensus.cc:2243] T c45683f20a454401bfb90b41570b5125 P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 21:10:29.229665 3409 raft_consensus.cc:2272] T c45683f20a454401bfb90b41570b5125 P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 21:10:29.230064 3409 ts_tablet_manager.cc:1916] T c45683f20a454401bfb90b41570b5125 P 185c63f61a2645928eeb807d145026b1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260203 21:10:29.232035 3409 ts_tablet_manager.cc:1929] T c45683f20a454401bfb90b41570b5125 P 185c63f61a2645928eeb807d145026b1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260203 21:10:29.232122 3409 log.cc:1199] T c45683f20a454401bfb90b41570b5125 P 185c63f61a2645928eeb807d145026b1: Deleting WAL directory at /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-2/wal/wals/c45683f20a454401bfb90b41570b5125
I20260203 21:10:29.232399 3409 ts_tablet_manager.cc:1950] T c45683f20a454401bfb90b41570b5125 P 185c63f61a2645928eeb807d145026b1: Deleting consensus metadata
I20260203 21:10:29.233084 3180 catalog_manager.cc:4985] TS 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): tablet c45683f20a454401bfb90b41570b5125 (table default.table_42d2deb9edf04a3b8ce372f18fff2cf1 [id=cc496c5ba7e8461b8020f3ab100304c8]) successfully deleted
I20260203 21:10:29.233340 3403 tablet_replica.cc:333] T c45683f20a454401bfb90b41570b5125 P 02bdf326542e474cbe62434dd59087dc: stopping tablet replica
I20260203 21:10:29.233469 3403 raft_consensus.cc:2243] T c45683f20a454401bfb90b41570b5125 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 21:10:29.233582 3403 raft_consensus.cc:2272] T c45683f20a454401bfb90b41570b5125 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 21:10:29.234005 3403 ts_tablet_manager.cc:1916] T c45683f20a454401bfb90b41570b5125 P 02bdf326542e474cbe62434dd59087dc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260203 21:10:29.236264 3403 ts_tablet_manager.cc:1929] T c45683f20a454401bfb90b41570b5125 P 02bdf326542e474cbe62434dd59087dc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260203 21:10:29.236352 3403 log.cc:1199] T c45683f20a454401bfb90b41570b5125 P 02bdf326542e474cbe62434dd59087dc: Deleting WAL directory at /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-0/wal/wals/c45683f20a454401bfb90b41570b5125
I20260203 21:10:29.236615 3403 ts_tablet_manager.cc:1950] T c45683f20a454401bfb90b41570b5125 P 02bdf326542e474cbe62434dd59087dc: Deleting consensus metadata
I20260203 21:10:29.237327 3179 catalog_manager.cc:4985] TS 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335): tablet c45683f20a454401bfb90b41570b5125 (table default.table_42d2deb9edf04a3b8ce372f18fff2cf1 [id=cc496c5ba7e8461b8020f3ab100304c8]) successfully deleted
I20260203 21:10:29.258800 3192 catalog_manager.cc:2174] created HMS catalog entry for table [id=fa8fb788ff754fcd8641964a9d894664]
I20260203 21:10:29.264986 3192 catalog_manager.cc:5746] TS 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335) does not have the latest schema for tablet a7a06ceeb3c84f788e360a5ba926a71f (table default.table_547d99db0d3043499a26ee8c6df4c443 [id=333213fed7234610bc20c7d92124182b]). Expected version 1 got 0
I20260203 21:10:29.266719 3105 heartbeater.cc:499] Master 127.2.32.188:33665 was elected leader, sending a full tablet report...
I20260203 21:10:29.279289 2765 tablet_service.cc:1505] Processing CreateTablet for tablet 4de1de23650548c2a078b51c9bf4d031 (DEFAULT_TABLE table=default.table_4f93e096d30349908a32a33e024543d6 [id=fa8fb788ff754fcd8641964a9d894664]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:29.279609 2765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4de1de23650548c2a078b51c9bf4d031. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:29.279655 3039 tablet_service.cc:1505] Processing CreateTablet for tablet 4de1de23650548c2a078b51c9bf4d031 (DEFAULT_TABLE table=default.table_4f93e096d30349908a32a33e024543d6 [id=fa8fb788ff754fcd8641964a9d894664]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:29.279975 3039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4de1de23650548c2a078b51c9bf4d031. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:29.281380 3404 tablet_bootstrap.cc:492] T 4de1de23650548c2a078b51c9bf4d031 P 02bdf326542e474cbe62434dd59087dc: Bootstrap starting.
I20260203 21:10:29.281555 2899 tablet_service.cc:1505] Processing CreateTablet for tablet 4de1de23650548c2a078b51c9bf4d031 (DEFAULT_TABLE table=default.table_4f93e096d30349908a32a33e024543d6 [id=fa8fb788ff754fcd8641964a9d894664]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:29.281795 2899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4de1de23650548c2a078b51c9bf4d031. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:29.281893 3411 tablet_bootstrap.cc:492] T 4de1de23650548c2a078b51c9bf4d031 P 185c63f61a2645928eeb807d145026b1: Bootstrap starting.
I20260203 21:10:29.282438 3404 tablet_bootstrap.cc:654] T 4de1de23650548c2a078b51c9bf4d031 P 02bdf326542e474cbe62434dd59087dc: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:29.282850 3411 tablet_bootstrap.cc:654] T 4de1de23650548c2a078b51c9bf4d031 P 185c63f61a2645928eeb807d145026b1: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:29.283999 3411 tablet_bootstrap.cc:492] T 4de1de23650548c2a078b51c9bf4d031 P 185c63f61a2645928eeb807d145026b1: No bootstrap required, opened a new log
I20260203 21:10:29.284085 3411 ts_tablet_manager.cc:1403] T 4de1de23650548c2a078b51c9bf4d031 P 185c63f61a2645928eeb807d145026b1: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260203 21:10:29.284204 3192 catalog_manager.cc:6199] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260: default.table_b7c2ca72f69c49a0b39163d2fcb69341 [id=467e79ec835d45669e3155e07b8ba81f] alter complete (version 1)
I20260203 21:10:29.284586 3411 raft_consensus.cc:359] T 4de1de23650548c2a078b51c9bf4d031 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.284716 3411 raft_consensus.cc:385] T 4de1de23650548c2a078b51c9bf4d031 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:29.284754 3411 raft_consensus.cc:740] T 4de1de23650548c2a078b51c9bf4d031 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 185c63f61a2645928eeb807d145026b1, State: Initialized, Role: FOLLOWER
I20260203 21:10:29.284879 3411 consensus_queue.cc:260] T 4de1de23650548c2a078b51c9bf4d031 P 185c63f61a2645928eeb807d145026b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.285185 3411 ts_tablet_manager.cc:1434] T 4de1de23650548c2a078b51c9bf4d031 P 185c63f61a2645928eeb807d145026b1: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260203 21:10:29.285221 3406 tablet_bootstrap.cc:492] T 4de1de23650548c2a078b51c9bf4d031 P 6d9e0cecab784cc0acc050ca1c89c5be: Bootstrap starting.
I20260203 21:10:29.286165 3406 tablet_bootstrap.cc:654] T 4de1de23650548c2a078b51c9bf4d031 P 6d9e0cecab784cc0acc050ca1c89c5be: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:29.286736 3192 catalog_manager.cc:5746] TS 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335) does not have the latest schema for tablet 8672a1e59caf4f70830d7cdac01f36cd (table default.table_7e73ff80019543888e0b8afa9b7a6660 [id=82ec5c95acc84e509c0803db74b626b4]). Expected version 1 got 0
I20260203 21:10:29.286906 3192 catalog_manager.cc:5746] TS 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335) does not have the latest schema for tablet 4c8edfa3d555490f953a3ec7bef314ae (table default.table_a029ba95c22e421585ca4ce640aa9658 [id=73eae179f2ad481d932a5b3c95b1a4ab]). Expected version 1 got 0
I20260203 21:10:29.288136 3406 tablet_bootstrap.cc:492] T 4de1de23650548c2a078b51c9bf4d031 P 6d9e0cecab784cc0acc050ca1c89c5be: No bootstrap required, opened a new log
I20260203 21:10:29.288226 3406 ts_tablet_manager.cc:1403] T 4de1de23650548c2a078b51c9bf4d031 P 6d9e0cecab784cc0acc050ca1c89c5be: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20260203 21:10:29.288686 3406 raft_consensus.cc:359] T 4de1de23650548c2a078b51c9bf4d031 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.288800 3406 raft_consensus.cc:385] T 4de1de23650548c2a078b51c9bf4d031 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:29.288785 3192 catalog_manager.cc:5746] TS 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223) does not have the latest schema for tablet 8672a1e59caf4f70830d7cdac01f36cd (table default.table_7e73ff80019543888e0b8afa9b7a6660 [id=82ec5c95acc84e509c0803db74b626b4]). Expected version 1 got 0
I20260203 21:10:29.288836 3406 raft_consensus.cc:740] T 4de1de23650548c2a078b51c9bf4d031 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d9e0cecab784cc0acc050ca1c89c5be, State: Initialized, Role: FOLLOWER
I20260203 21:10:29.288867 3192 catalog_manager.cc:5746] TS 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223) does not have the latest schema for tablet 4c8edfa3d555490f953a3ec7bef314ae (table default.table_a029ba95c22e421585ca4ce640aa9658 [id=73eae179f2ad481d932a5b3c95b1a4ab]). Expected version 1 got 0
I20260203 21:10:29.288949 3406 consensus_queue.cc:260] T 4de1de23650548c2a078b51c9bf4d031 P 6d9e0cecab784cc0acc050ca1c89c5be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.288954 3192 catalog_manager.cc:5654] T a7a06ceeb3c84f788e360a5ba926a71f P 185c63f61a2645928eeb807d145026b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 185c63f61a2645928eeb807d145026b1 (127.2.32.131). New cstate: current_term: 1 leader_uuid: "185c63f61a2645928eeb807d145026b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } health_report { overall_health: UNKNOWN } } }
I20260203 21:10:29.289142 3192 catalog_manager.cc:5746] TS 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223) does not have the latest schema for tablet a7a06ceeb3c84f788e360a5ba926a71f (table default.table_547d99db0d3043499a26ee8c6df4c443 [id=333213fed7234610bc20c7d92124182b]). Expected version 1 got 0
I20260203 21:10:29.289222 3406 ts_tablet_manager.cc:1434] T 4de1de23650548c2a078b51c9bf4d031 P 6d9e0cecab784cc0acc050ca1c89c5be: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20260203 21:10:29.294879 3282 raft_consensus.cc:493] T 8672a1e59caf4f70830d7cdac01f36cd P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 21:10:29.294973 3282 raft_consensus.cc:515] T 8672a1e59caf4f70830d7cdac01f36cd P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.295360 3282 leader_election.cc:290] T 8672a1e59caf4f70830d7cdac01f36cd P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
I20260203 21:10:29.295646 2923 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8672a1e59caf4f70830d7cdac01f36cd" candidate_uuid: "02bdf326542e474cbe62434dd59087dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" is_pre_election: true
I20260203 21:10:29.295810 2923 raft_consensus.cc:2468] T 8672a1e59caf4f70830d7cdac01f36cd P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02bdf326542e474cbe62434dd59087dc in term 0.
I20260203 21:10:29.295972 3059 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8672a1e59caf4f70830d7cdac01f36cd" candidate_uuid: "02bdf326542e474cbe62434dd59087dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "185c63f61a2645928eeb807d145026b1" is_pre_election: true
I20260203 21:10:29.296108 3059 raft_consensus.cc:2468] T 8672a1e59caf4f70830d7cdac01f36cd P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02bdf326542e474cbe62434dd59087dc in term 0.
I20260203 21:10:29.296114 2721 leader_election.cc:304] T 8672a1e59caf4f70830d7cdac01f36cd P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc, 6d9e0cecab784cc0acc050ca1c89c5be; no voters:
I20260203 21:10:29.296259 3282 raft_consensus.cc:2804] T 8672a1e59caf4f70830d7cdac01f36cd P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 21:10:29.296307 3282 raft_consensus.cc:493] T 8672a1e59caf4f70830d7cdac01f36cd P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 21:10:29.296344 3282 raft_consensus.cc:3060] T 8672a1e59caf4f70830d7cdac01f36cd P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:29.297034 3192 catalog_manager.cc:5746] TS 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897) does not have the latest schema for tablet 8672a1e59caf4f70830d7cdac01f36cd (table default.table_7e73ff80019543888e0b8afa9b7a6660 [id=82ec5c95acc84e509c0803db74b626b4]). Expected version 1 got 0
I20260203 21:10:29.297127 3192 catalog_manager.cc:5746] TS 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897) does not have the latest schema for tablet a7a06ceeb3c84f788e360a5ba926a71f (table default.table_547d99db0d3043499a26ee8c6df4c443 [id=333213fed7234610bc20c7d92124182b]). Expected version 1 got 0
I20260203 21:10:29.297204 3192 catalog_manager.cc:5654] T 4c8edfa3d555490f953a3ec7bef314ae P 6d9e0cecab784cc0acc050ca1c89c5be reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130). New cstate: current_term: 1 leader_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } health_report { overall_health: UNKNOWN } } }
I20260203 21:10:29.297318 3282 raft_consensus.cc:515] T 8672a1e59caf4f70830d7cdac01f36cd P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.297363 3192 catalog_manager.cc:5746] TS 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897) does not have the latest schema for tablet 4c8edfa3d555490f953a3ec7bef314ae (table default.table_a029ba95c22e421585ca4ce640aa9658 [id=73eae179f2ad481d932a5b3c95b1a4ab]). Expected version 1 got 0
I20260203 21:10:29.297629 3282 leader_election.cc:290] T 8672a1e59caf4f70830d7cdac01f36cd P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 1 election: Requested vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
I20260203 21:10:29.297926 3059 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8672a1e59caf4f70830d7cdac01f36cd" candidate_uuid: "02bdf326542e474cbe62434dd59087dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "185c63f61a2645928eeb807d145026b1"
I20260203 21:10:29.298027 3059 raft_consensus.cc:3060] T 8672a1e59caf4f70830d7cdac01f36cd P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:29.298027 2923 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8672a1e59caf4f70830d7cdac01f36cd" candidate_uuid: "02bdf326542e474cbe62434dd59087dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d9e0cecab784cc0acc050ca1c89c5be"
I20260203 21:10:29.298130 2923 raft_consensus.cc:3060] T 8672a1e59caf4f70830d7cdac01f36cd P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:29.298820 3059 raft_consensus.cc:2468] T 8672a1e59caf4f70830d7cdac01f36cd P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02bdf326542e474cbe62434dd59087dc in term 1.
I20260203 21:10:29.298998 2923 raft_consensus.cc:2468] T 8672a1e59caf4f70830d7cdac01f36cd P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02bdf326542e474cbe62434dd59087dc in term 1.
I20260203 21:10:29.299104 2720 leader_election.cc:304] T 8672a1e59caf4f70830d7cdac01f36cd P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc, 185c63f61a2645928eeb807d145026b1; no voters:
I20260203 21:10:29.299500 3282 raft_consensus.cc:2804] T 8672a1e59caf4f70830d7cdac01f36cd P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader election won for term 1
I20260203 21:10:29.299589 3282 raft_consensus.cc:697] T 8672a1e59caf4f70830d7cdac01f36cd P 02bdf326542e474cbe62434dd59087dc [term 1 LEADER]: Becoming Leader. State: Replica: 02bdf326542e474cbe62434dd59087dc, State: Running, Role: LEADER
I20260203 21:10:29.299757 3282 consensus_queue.cc:237] T 8672a1e59caf4f70830d7cdac01f36cd P 02bdf326542e474cbe62434dd59087dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.308882 2448 catalog_manager.cc:2184] deleted orphaned HMS catalog entry for table [id=f6e23f2505784c6f98a18a43b9917c06]
I20260203 21:10:29.309088 2448 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:57540 (request call id 51) took 1483 ms. Trace:
I20260203 21:10:29.309137 2448 rpcz_store.cc:276] 0203 21:10:27.825287 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 21:10:27.917643 (+ 92356us) service_pool.cc:225] Handling call
0203 21:10:28.228567 (+310924us) catalog_manager.cc:2101] Acquired catalog manager lock
0203 21:10:28.228845 (+ 278us) catalog_manager.cc:2147] Created new table and tablet info
0203 21:10:29.012435 (+783590us) catalog_manager.cc:2173] Created new table in HMS catalog
0203 21:10:29.012934 (+ 499us) write_op.cc:489] Releasing partition, row and schema locks
0203 21:10:29.012935 (+ 1us) write_op.cc:454] Released schema lock
0203 21:10:29.013055 (+ 120us) catalog_manager.cc:2181] Rolling back HMS table creation
0203 21:10:29.309075 (+296020us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0203 21:10:29.012896 (+ 0us) op_driver.cc:389] HandleFailure(Illegal state: replica 7344d7cd8dea4fa2ae705320daacaf49 is not leader of this config: current role FOLLOWER)
0203 21:10:29.012902 (+ 6us) write_op.cc:489] Releasing partition, row and schema locks
0203 21:10:29.012906 (+ 4us) write_op.cc:454] Released schema lock
0203 21:10:29.012909 (+ 3us) write_op.cc:335] FINISH: Op aborted
Metrics: {"Hive Metastore.queue_time_us":884353,"Hive Metastore.run_cpu_time_us":348,"Hive Metastore.run_wall_time_us":194740,"child_traces":[["op",{}]]}
I20260203 21:10:29.306903 3192 catalog_manager.cc:5654] T 8672a1e59caf4f70830d7cdac01f36cd P 02bdf326542e474cbe62434dd59087dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 02bdf326542e474cbe62434dd59087dc (127.2.32.129). New cstate: current_term: 1 leader_uuid: "02bdf326542e474cbe62434dd59087dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } health_report { overall_health: HEALTHY } } }
I20260203 21:10:29.309794 3192 catalog_manager.cc:5746] TS 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335) does not have the latest schema for tablet 8672a1e59caf4f70830d7cdac01f36cd (table default.table_7e73ff80019543888e0b8afa9b7a6660 [id=82ec5c95acc84e509c0803db74b626b4]). Expected version 1 got 0
I20260203 21:10:29.310578 3190 catalog_manager.cc:2174] created HMS catalog entry for table [id=8f8f5b53d1204b56979a8db32be6ee89]
I20260203 21:10:29.312711 3404 tablet_bootstrap.cc:492] T 4de1de23650548c2a078b51c9bf4d031 P 02bdf326542e474cbe62434dd59087dc: No bootstrap required, opened a new log
I20260203 21:10:29.312803 3404 ts_tablet_manager.cc:1403] T 4de1de23650548c2a078b51c9bf4d031 P 02bdf326542e474cbe62434dd59087dc: Time spent bootstrapping tablet: real 0.031s user 0.003s sys 0.000s
I20260203 21:10:29.313259 3404 raft_consensus.cc:359] T 4de1de23650548c2a078b51c9bf4d031 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.313351 3404 raft_consensus.cc:385] T 4de1de23650548c2a078b51c9bf4d031 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:29.313380 3404 raft_consensus.cc:740] T 4de1de23650548c2a078b51c9bf4d031 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02bdf326542e474cbe62434dd59087dc, State: Initialized, Role: FOLLOWER
I20260203 21:10:29.313483 3404 consensus_queue.cc:260] T 4de1de23650548c2a078b51c9bf4d031 P 02bdf326542e474cbe62434dd59087dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.313737 3404 ts_tablet_manager.cc:1434] T 4de1de23650548c2a078b51c9bf4d031 P 02bdf326542e474cbe62434dd59087dc: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260203 21:10:29.320683 3190 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57412:
table { table_name: "default.Table_c2985ddec2e045cba153900329fe9331" } modify_external_catalogs: true
I20260203 21:10:29.320828 3190 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57412:
table { table_name: "default.Table_c2985ddec2e045cba153900329fe9331" } modify_external_catalogs: true
I20260203 21:10:29.330459 2765 tablet_service.cc:1505] Processing CreateTablet for tablet 98cd2089483c4121944152e5cee8ca30 (DEFAULT_TABLE table=default.table_4c9a68305b5e4d4aa45e3a351c35eee7 [id=8f8f5b53d1204b56979a8db32be6ee89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:29.330746 2765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98cd2089483c4121944152e5cee8ca30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:29.330968 2899 tablet_service.cc:1505] Processing CreateTablet for tablet 98cd2089483c4121944152e5cee8ca30 (DEFAULT_TABLE table=default.table_4c9a68305b5e4d4aa45e3a351c35eee7 [id=8f8f5b53d1204b56979a8db32be6ee89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:29.331238 2899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98cd2089483c4121944152e5cee8ca30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:29.332845 3404 tablet_bootstrap.cc:492] T 98cd2089483c4121944152e5cee8ca30 P 02bdf326542e474cbe62434dd59087dc: Bootstrap starting.
I20260203 21:10:29.333595 3406 tablet_bootstrap.cc:492] T 98cd2089483c4121944152e5cee8ca30 P 6d9e0cecab784cc0acc050ca1c89c5be: Bootstrap starting.
I20260203 21:10:29.333788 3404 tablet_bootstrap.cc:654] T 98cd2089483c4121944152e5cee8ca30 P 02bdf326542e474cbe62434dd59087dc: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:29.334374 3406 tablet_bootstrap.cc:654] T 98cd2089483c4121944152e5cee8ca30 P 6d9e0cecab784cc0acc050ca1c89c5be: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:29.335428 3406 tablet_bootstrap.cc:492] T 98cd2089483c4121944152e5cee8ca30 P 6d9e0cecab784cc0acc050ca1c89c5be: No bootstrap required, opened a new log
I20260203 21:10:29.335501 3406 ts_tablet_manager.cc:1403] T 98cd2089483c4121944152e5cee8ca30 P 6d9e0cecab784cc0acc050ca1c89c5be: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20260203 21:10:29.335834 3039 tablet_service.cc:1505] Processing CreateTablet for tablet 98cd2089483c4121944152e5cee8ca30 (DEFAULT_TABLE table=default.table_4c9a68305b5e4d4aa45e3a351c35eee7 [id=8f8f5b53d1204b56979a8db32be6ee89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:29.335918 3406 raft_consensus.cc:359] T 98cd2089483c4121944152e5cee8ca30 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.336005 3406 raft_consensus.cc:385] T 98cd2089483c4121944152e5cee8ca30 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:29.336030 3406 raft_consensus.cc:740] T 98cd2089483c4121944152e5cee8ca30 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d9e0cecab784cc0acc050ca1c89c5be, State: Initialized, Role: FOLLOWER
I20260203 21:10:29.336131 3039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98cd2089483c4121944152e5cee8ca30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:29.336131 3406 consensus_queue.cc:260] T 98cd2089483c4121944152e5cee8ca30 P 6d9e0cecab784cc0acc050ca1c89c5be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.336357 3406 ts_tablet_manager.cc:1434] T 98cd2089483c4121944152e5cee8ca30 P 6d9e0cecab784cc0acc050ca1c89c5be: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260203 21:10:29.339783 3404 tablet_bootstrap.cc:492] T 98cd2089483c4121944152e5cee8ca30 P 02bdf326542e474cbe62434dd59087dc: No bootstrap required, opened a new log
I20260203 21:10:29.339874 3404 ts_tablet_manager.cc:1403] T 98cd2089483c4121944152e5cee8ca30 P 02bdf326542e474cbe62434dd59087dc: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260203 21:10:29.339972 3411 tablet_bootstrap.cc:492] T 98cd2089483c4121944152e5cee8ca30 P 185c63f61a2645928eeb807d145026b1: Bootstrap starting.
I20260203 21:10:29.340349 3404 raft_consensus.cc:359] T 98cd2089483c4121944152e5cee8ca30 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.340446 3404 raft_consensus.cc:385] T 98cd2089483c4121944152e5cee8ca30 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:29.340477 3404 raft_consensus.cc:740] T 98cd2089483c4121944152e5cee8ca30 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02bdf326542e474cbe62434dd59087dc, State: Initialized, Role: FOLLOWER
I20260203 21:10:29.340591 3404 consensus_queue.cc:260] T 98cd2089483c4121944152e5cee8ca30 P 02bdf326542e474cbe62434dd59087dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.340857 3404 ts_tablet_manager.cc:1434] T 98cd2089483c4121944152e5cee8ca30 P 02bdf326542e474cbe62434dd59087dc: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260203 21:10:29.341096 3411 tablet_bootstrap.cc:654] T 98cd2089483c4121944152e5cee8ca30 P 185c63f61a2645928eeb807d145026b1: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:29.341562 3284 raft_consensus.cc:493] T a7a06ceeb3c84f788e360a5ba926a71f P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 21:10:29.341640 3284 raft_consensus.cc:515] T a7a06ceeb3c84f788e360a5ba926a71f P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } }
I20260203 21:10:29.342002 3284 leader_election.cc:290] T a7a06ceeb3c84f788e360a5ba926a71f P 6d9e0cecab784cc0acc050ca1c89c5be [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
I20260203 21:10:29.342367 3059 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a7a06ceeb3c84f788e360a5ba926a71f" candidate_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "185c63f61a2645928eeb807d145026b1" is_pre_election: true
I20260203 21:10:29.342658 2784 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a7a06ceeb3c84f788e360a5ba926a71f" candidate_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02bdf326542e474cbe62434dd59087dc" is_pre_election: true
I20260203 21:10:29.342783 2784 raft_consensus.cc:2393] T a7a06ceeb3c84f788e360a5ba926a71f P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d9e0cecab784cc0acc050ca1c89c5be in current term 1: Already voted for candidate 185c63f61a2645928eeb807d145026b1 in this term.
I20260203 21:10:29.328560 3192 master_service.cc:954] ReplaceTablet: received request to replace tablet 930cb06bcbca41e08ac12d60a0d3b6cb from {username='slave'} at 127.0.0.1:57412
I20260203 21:10:29.343045 2857 leader_election.cc:304] T a7a06ceeb3c84f788e360a5ba926a71f P 6d9e0cecab784cc0acc050ca1c89c5be [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d9e0cecab784cc0acc050ca1c89c5be; no voters: 02bdf326542e474cbe62434dd59087dc, 185c63f61a2645928eeb807d145026b1
I20260203 21:10:29.343236 3284 raft_consensus.cc:3060] T a7a06ceeb3c84f788e360a5ba926a71f P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:29.344558 3284 raft_consensus.cc:2749] T a7a06ceeb3c84f788e360a5ba926a71f P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 21:10:29.347580 3192 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57412:
table { table_name: "default.Table_a029ba95c22e421585ca4ce640aa9658" } modify_external_catalogs: true
I20260203 21:10:29.347776 3192 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57412:
table { table_name: "default.Table_a029ba95c22e421585ca4ce640aa9658" } modify_external_catalogs: true
I20260203 21:10:29.348516 3411 tablet_bootstrap.cc:492] T 98cd2089483c4121944152e5cee8ca30 P 185c63f61a2645928eeb807d145026b1: No bootstrap required, opened a new log
I20260203 21:10:29.348619 3411 ts_tablet_manager.cc:1403] T 98cd2089483c4121944152e5cee8ca30 P 185c63f61a2645928eeb807d145026b1: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.001s
I20260203 21:10:29.349097 3411 raft_consensus.cc:359] T 98cd2089483c4121944152e5cee8ca30 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.349212 3411 raft_consensus.cc:385] T 98cd2089483c4121944152e5cee8ca30 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:29.349252 3411 raft_consensus.cc:740] T 98cd2089483c4121944152e5cee8ca30 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 185c63f61a2645928eeb807d145026b1, State: Initialized, Role: FOLLOWER
I20260203 21:10:29.349390 3411 consensus_queue.cc:260] T 98cd2089483c4121944152e5cee8ca30 P 185c63f61a2645928eeb807d145026b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.349648 3411 ts_tablet_manager.cc:1434] T 98cd2089483c4121944152e5cee8ca30 P 185c63f61a2645928eeb807d145026b1: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20260203 21:10:29.382079 3188 catalog_manager.cc:2731] deleted HMS catalog entry for table default.table_09e62d0aaa0f48ad9ed818ba967be542 [id=a26f4a67278a4929b2378fbbe9baaf52]
I20260203 21:10:29.406919 2445 catalog_manager.cc:2184] deleted orphaned HMS catalog entry for table [id=66dd8d2abc564ea9941d9c79de23a1e8]
I20260203 21:10:29.407243 2445 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:57540 (request call id 50) took 1624 ms. Trace:
I20260203 21:10:29.407315 2445 rpcz_store.cc:276] 0203 21:10:27.782371 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 21:10:27.868921 (+ 86550us) service_pool.cc:225] Handling call
0203 21:10:28.228915 (+359994us) catalog_manager.cc:2101] Acquired catalog manager lock
0203 21:10:28.229181 (+ 266us) catalog_manager.cc:2147] Created new table and tablet info
0203 21:10:29.034268 (+805087us) catalog_manager.cc:2173] Created new table in HMS catalog
0203 21:10:29.034930 (+ 662us) write_op.cc:489] Releasing partition, row and schema locks
0203 21:10:29.034932 (+ 2us) write_op.cc:454] Released schema lock
0203 21:10:29.035084 (+ 152us) catalog_manager.cc:2181] Rolling back HMS table creation
0203 21:10:29.407215 (+372131us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0203 21:10:29.034869 (+ 0us) op_driver.cc:389] HandleFailure(Illegal state: replica 7344d7cd8dea4fa2ae705320daacaf49 is not leader of this config: current role FOLLOWER)
0203 21:10:29.034880 (+ 11us) write_op.cc:489] Releasing partition, row and schema locks
0203 21:10:29.034885 (+ 5us) write_op.cc:454] Released schema lock
0203 21:10:29.034889 (+ 4us) write_op.cc:335] FINISH: Op aborted
Metrics: {"Hive Metastore.queue_time_us":1056816,"Hive Metastore.run_cpu_time_us":434,"Hive Metastore.run_wall_time_us":119808,"child_traces":[["op",{}]]}
I20260203 21:10:29.421943 3187 catalog_manager.cc:2174] created HMS catalog entry for table [id=1df0a5e5434d4c00a3dfe92d216cfb54]
I20260203 21:10:29.433311 3187 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57412:
table { table_name: "default.Table_547d99db0d3043499a26ee8c6df4c443" } modify_external_catalogs: true
I20260203 21:10:29.433471 3187 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57412:
table { table_name: "default.Table_547d99db0d3043499a26ee8c6df4c443" } modify_external_catalogs: true
I20260203 21:10:29.433923 3039 tablet_service.cc:1505] Processing CreateTablet for tablet 8df16fd039bf4d9b91ee2e49151c18c2 (DEFAULT_TABLE table=default.table_675a6f7413004a62bce7c460e7b6da3b [id=1df0a5e5434d4c00a3dfe92d216cfb54]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:29.434242 3039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8df16fd039bf4d9b91ee2e49151c18c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:29.436658 3411 tablet_bootstrap.cc:492] T 8df16fd039bf4d9b91ee2e49151c18c2 P 185c63f61a2645928eeb807d145026b1: Bootstrap starting.
I20260203 21:10:29.437709 3411 tablet_bootstrap.cc:654] T 8df16fd039bf4d9b91ee2e49151c18c2 P 185c63f61a2645928eeb807d145026b1: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:29.439644 2899 tablet_service.cc:1505] Processing CreateTablet for tablet 8df16fd039bf4d9b91ee2e49151c18c2 (DEFAULT_TABLE table=default.table_675a6f7413004a62bce7c460e7b6da3b [id=1df0a5e5434d4c00a3dfe92d216cfb54]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:29.439956 2899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8df16fd039bf4d9b91ee2e49151c18c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:29.442195 3406 tablet_bootstrap.cc:492] T 8df16fd039bf4d9b91ee2e49151c18c2 P 6d9e0cecab784cc0acc050ca1c89c5be: Bootstrap starting.
I20260203 21:10:29.443171 3406 tablet_bootstrap.cc:654] T 8df16fd039bf4d9b91ee2e49151c18c2 P 6d9e0cecab784cc0acc050ca1c89c5be: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:29.443253 3411 tablet_bootstrap.cc:492] T 8df16fd039bf4d9b91ee2e49151c18c2 P 185c63f61a2645928eeb807d145026b1: No bootstrap required, opened a new log
I20260203 21:10:29.443333 3411 ts_tablet_manager.cc:1403] T 8df16fd039bf4d9b91ee2e49151c18c2 P 185c63f61a2645928eeb807d145026b1: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.001s
I20260203 21:10:29.443845 2784 raft_consensus.cc:1275] T 4c8edfa3d555490f953a3ec7bef314ae P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Refusing update from remote peer 6d9e0cecab784cc0acc050ca1c89c5be: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260203 21:10:29.443871 3411 raft_consensus.cc:359] T 8df16fd039bf4d9b91ee2e49151c18c2 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.443953 3411 raft_consensus.cc:385] T 8df16fd039bf4d9b91ee2e49151c18c2 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:29.443981 3411 raft_consensus.cc:740] T 8df16fd039bf4d9b91ee2e49151c18c2 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 185c63f61a2645928eeb807d145026b1, State: Initialized, Role: FOLLOWER
I20260203 21:10:29.444092 3411 consensus_queue.cc:260] T 8df16fd039bf4d9b91ee2e49151c18c2 P 185c63f61a2645928eeb807d145026b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.444192 2765 tablet_service.cc:1505] Processing CreateTablet for tablet 8df16fd039bf4d9b91ee2e49151c18c2 (DEFAULT_TABLE table=default.table_675a6f7413004a62bce7c460e7b6da3b [id=1df0a5e5434d4c00a3dfe92d216cfb54]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:29.444267 3298 consensus_queue.cc:1048] T 4c8edfa3d555490f953a3ec7bef314ae P 6d9e0cecab784cc0acc050ca1c89c5be [LEADER]: Connected to new peer: Peer: permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 21:10:29.444375 3411 ts_tablet_manager.cc:1434] T 8df16fd039bf4d9b91ee2e49151c18c2 P 185c63f61a2645928eeb807d145026b1: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260203 21:10:29.444425 2765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8df16fd039bf4d9b91ee2e49151c18c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:29.446681 3404 tablet_bootstrap.cc:492] T 8df16fd039bf4d9b91ee2e49151c18c2 P 02bdf326542e474cbe62434dd59087dc: Bootstrap starting.
I20260203 21:10:29.447602 3059 raft_consensus.cc:1275] T 4c8edfa3d555490f953a3ec7bef314ae P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Refusing update from remote peer 6d9e0cecab784cc0acc050ca1c89c5be: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260203 21:10:29.447626 3404 tablet_bootstrap.cc:654] T 8df16fd039bf4d9b91ee2e49151c18c2 P 02bdf326542e474cbe62434dd59087dc: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:29.447921 3413 tablet.cc:1722] T 4c8edfa3d555490f953a3ec7bef314ae P 6d9e0cecab784cc0acc050ca1c89c5be: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260203 21:10:29.448396 3310 consensus_queue.cc:1048] T 4c8edfa3d555490f953a3ec7bef314ae P 6d9e0cecab784cc0acc050ca1c89c5be [LEADER]: Connected to new peer: Peer: permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 21:10:29.449673 3415 tablet.cc:1722] T 4c8edfa3d555490f953a3ec7bef314ae P 02bdf326542e474cbe62434dd59087dc: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260203 21:10:29.450294 3414 tablet.cc:1722] T 4c8edfa3d555490f953a3ec7bef314ae P 185c63f61a2645928eeb807d145026b1: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260203 21:10:29.451782 3404 tablet_bootstrap.cc:492] T 8df16fd039bf4d9b91ee2e49151c18c2 P 02bdf326542e474cbe62434dd59087dc: No bootstrap required, opened a new log
I20260203 21:10:29.451875 3404 ts_tablet_manager.cc:1403] T 8df16fd039bf4d9b91ee2e49151c18c2 P 02bdf326542e474cbe62434dd59087dc: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260203 21:10:29.452340 3404 raft_consensus.cc:359] T 8df16fd039bf4d9b91ee2e49151c18c2 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.452443 3404 raft_consensus.cc:385] T 8df16fd039bf4d9b91ee2e49151c18c2 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:29.452478 3404 raft_consensus.cc:740] T 8df16fd039bf4d9b91ee2e49151c18c2 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02bdf326542e474cbe62434dd59087dc, State: Initialized, Role: FOLLOWER
I20260203 21:10:29.452594 3404 consensus_queue.cc:260] T 8df16fd039bf4d9b91ee2e49151c18c2 P 02bdf326542e474cbe62434dd59087dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.452880 3404 ts_tablet_manager.cc:1434] T 8df16fd039bf4d9b91ee2e49151c18c2 P 02bdf326542e474cbe62434dd59087dc: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260203 21:10:29.456463 3185 catalog_manager.cc:2174] created HMS catalog entry for table [id=1047aea4c6eb42f4994b72f5cafef147]
I20260203 21:10:29.462333 2784 raft_consensus.cc:1275] T a7a06ceeb3c84f788e360a5ba926a71f P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Refusing update from remote peer 185c63f61a2645928eeb807d145026b1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260203 21:10:29.464054 2922 raft_consensus.cc:1275] T a7a06ceeb3c84f788e360a5ba926a71f P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 FOLLOWER]: Refusing update from remote peer 185c63f61a2645928eeb807d145026b1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260203 21:10:29.464327 3340 consensus_queue.cc:1048] T a7a06ceeb3c84f788e360a5ba926a71f P 185c63f61a2645928eeb807d145026b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 21:10:29.466384 3289 consensus_queue.cc:1048] T a7a06ceeb3c84f788e360a5ba926a71f P 185c63f61a2645928eeb807d145026b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 21:10:29.469326 3185 catalog_manager.cc:5746] TS 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335) does not have the latest schema for tablet 4c8edfa3d555490f953a3ec7bef314ae (table default.table_a029ba95c22e421585ca4ce640aa9658 [id=73eae179f2ad481d932a5b3c95b1a4ab]). Expected version 1 got 0
I20260203 21:10:29.474220 3340 raft_consensus.cc:493] T 98cd2089483c4121944152e5cee8ca30 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 21:10:29.474350 3059 raft_consensus.cc:1275] T 8672a1e59caf4f70830d7cdac01f36cd P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Refusing update from remote peer 02bdf326542e474cbe62434dd59087dc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260203 21:10:29.474332 3340 raft_consensus.cc:515] T 98cd2089483c4121944152e5cee8ca30 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.474745 3340 leader_election.cc:290] T 98cd2089483c4121944152e5cee8ca30 P 185c63f61a2645928eeb807d145026b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335)
I20260203 21:10:29.475011 3338 consensus_queue.cc:1048] T 8672a1e59caf4f70830d7cdac01f36cd P 02bdf326542e474cbe62434dd59087dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 21:10:29.475539 2923 raft_consensus.cc:1275] T 8672a1e59caf4f70830d7cdac01f36cd P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 FOLLOWER]: Refusing update from remote peer 02bdf326542e474cbe62434dd59087dc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260203 21:10:29.476359 2785 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "98cd2089483c4121944152e5cee8ca30" candidate_uuid: "185c63f61a2645928eeb807d145026b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02bdf326542e474cbe62434dd59087dc" is_pre_election: true
I20260203 21:10:29.476387 3338 consensus_queue.cc:1048] T 8672a1e59caf4f70830d7cdac01f36cd P 02bdf326542e474cbe62434dd59087dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 21:10:29.476506 2785 raft_consensus.cc:2468] T 98cd2089483c4121944152e5cee8ca30 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 185c63f61a2645928eeb807d145026b1 in term 0.
I20260203 21:10:29.476809 2993 leader_election.cc:304] T 98cd2089483c4121944152e5cee8ca30 P 185c63f61a2645928eeb807d145026b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc, 185c63f61a2645928eeb807d145026b1; no voters:
I20260203 21:10:29.480103 3289 raft_consensus.cc:2804] T 98cd2089483c4121944152e5cee8ca30 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 21:10:29.480191 3289 raft_consensus.cc:493] T 98cd2089483c4121944152e5cee8ca30 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 21:10:29.480238 3289 raft_consensus.cc:3060] T 98cd2089483c4121944152e5cee8ca30 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:29.480510 3186 catalog_manager.cc:2174] created HMS catalog entry for table [id=7402e05c90cf4b15be6effde36465fff]
I20260203 21:10:29.481389 3289 raft_consensus.cc:515] T 98cd2089483c4121944152e5cee8ca30 P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.481854 3289 leader_election.cc:290] T 98cd2089483c4121944152e5cee8ca30 P 185c63f61a2645928eeb807d145026b1 [CANDIDATE]: Term 1 election: Requested vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335)
I20260203 21:10:29.483259 2785 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "98cd2089483c4121944152e5cee8ca30" candidate_uuid: "185c63f61a2645928eeb807d145026b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02bdf326542e474cbe62434dd59087dc"
I20260203 21:10:29.483404 2785 raft_consensus.cc:3060] T 98cd2089483c4121944152e5cee8ca30 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:29.483724 2923 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "98cd2089483c4121944152e5cee8ca30" candidate_uuid: "185c63f61a2645928eeb807d145026b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" is_pre_election: true
I20260203 21:10:29.483858 2923 raft_consensus.cc:2468] T 98cd2089483c4121944152e5cee8ca30 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 185c63f61a2645928eeb807d145026b1 in term 0.
I20260203 21:10:29.484498 2785 raft_consensus.cc:2468] T 98cd2089483c4121944152e5cee8ca30 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 185c63f61a2645928eeb807d145026b1 in term 1.
I20260203 21:10:29.487044 2993 leader_election.cc:304] T 98cd2089483c4121944152e5cee8ca30 P 185c63f61a2645928eeb807d145026b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc, 185c63f61a2645928eeb807d145026b1; no voters:
I20260203 21:10:29.491078 2765 tablet_service.cc:1505] Processing CreateTablet for tablet ba8723a952564816a5c1f7945c448db9 (DEFAULT_TABLE table=default.table_3397dfe4625e42cf8cb5f4d45116d7b1 [id=1047aea4c6eb42f4994b72f5cafef147]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:29.491237 3039 tablet_service.cc:1505] Processing CreateTablet for tablet ba8723a952564816a5c1f7945c448db9 (DEFAULT_TABLE table=default.table_3397dfe4625e42cf8cb5f4d45116d7b1 [id=1047aea4c6eb42f4994b72f5cafef147]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:29.491406 2765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba8723a952564816a5c1f7945c448db9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:29.491526 3039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba8723a952564816a5c1f7945c448db9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:29.493853 3411 tablet_bootstrap.cc:492] T ba8723a952564816a5c1f7945c448db9 P 185c63f61a2645928eeb807d145026b1: Bootstrap starting.
I20260203 21:10:29.493882 3404 tablet_bootstrap.cc:492] T ba8723a952564816a5c1f7945c448db9 P 02bdf326542e474cbe62434dd59087dc: Bootstrap starting.
I20260203 21:10:29.494848 3404 tablet_bootstrap.cc:654] T ba8723a952564816a5c1f7945c448db9 P 02bdf326542e474cbe62434dd59087dc: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:29.494903 3411 tablet_bootstrap.cc:654] T ba8723a952564816a5c1f7945c448db9 P 185c63f61a2645928eeb807d145026b1: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:29.495070 2923 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "98cd2089483c4121944152e5cee8ca30" candidate_uuid: "185c63f61a2645928eeb807d145026b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d9e0cecab784cc0acc050ca1c89c5be"
I20260203 21:10:29.495193 2923 raft_consensus.cc:3060] T 98cd2089483c4121944152e5cee8ca30 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:29.496162 2923 raft_consensus.cc:2468] T 98cd2089483c4121944152e5cee8ca30 P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 185c63f61a2645928eeb807d145026b1 in term 1.
I20260203 21:10:29.496420 2897 tablet_service.cc:1505] Processing CreateTablet for tablet ba8723a952564816a5c1f7945c448db9 (DEFAULT_TABLE table=default.table_3397dfe4625e42cf8cb5f4d45116d7b1 [id=1047aea4c6eb42f4994b72f5cafef147]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:29.496562 3340 raft_consensus.cc:2804] T 98cd2089483c4121944152e5cee8ca30 P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260203 21:10:29.496634 3340 raft_consensus.cc:697] T 98cd2089483c4121944152e5cee8ca30 P 185c63f61a2645928eeb807d145026b1 [term 1 LEADER]: Becoming Leader. State: Replica: 185c63f61a2645928eeb807d145026b1, State: Running, Role: LEADER
I20260203 21:10:29.496686 2897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba8723a952564816a5c1f7945c448db9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:29.496771 3340 consensus_queue.cc:237] T 98cd2089483c4121944152e5cee8ca30 P 185c63f61a2645928eeb807d145026b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.497547 3406 tablet_bootstrap.cc:492] T 8df16fd039bf4d9b91ee2e49151c18c2 P 6d9e0cecab784cc0acc050ca1c89c5be: No bootstrap required, opened a new log
I20260203 21:10:29.497637 3406 ts_tablet_manager.cc:1403] T 8df16fd039bf4d9b91ee2e49151c18c2 P 6d9e0cecab784cc0acc050ca1c89c5be: Time spent bootstrapping tablet: real 0.055s user 0.001s sys 0.001s
I20260203 21:10:29.498158 3406 raft_consensus.cc:359] T 8df16fd039bf4d9b91ee2e49151c18c2 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.498255 3406 raft_consensus.cc:385] T 8df16fd039bf4d9b91ee2e49151c18c2 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:29.498286 3406 raft_consensus.cc:740] T 8df16fd039bf4d9b91ee2e49151c18c2 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d9e0cecab784cc0acc050ca1c89c5be, State: Initialized, Role: FOLLOWER
I20260203 21:10:29.498409 3406 consensus_queue.cc:260] T 8df16fd039bf4d9b91ee2e49151c18c2 P 6d9e0cecab784cc0acc050ca1c89c5be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.498711 3406 ts_tablet_manager.cc:1434] T 8df16fd039bf4d9b91ee2e49151c18c2 P 6d9e0cecab784cc0acc050ca1c89c5be: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260203 21:10:29.498903 3406 tablet_bootstrap.cc:492] T ba8723a952564816a5c1f7945c448db9 P 6d9e0cecab784cc0acc050ca1c89c5be: Bootstrap starting.
I20260203 21:10:29.501251 3185 catalog_manager.cc:6199] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260: default.table_a029ba95c22e421585ca4ce640aa9658 [id=73eae179f2ad481d932a5b3c95b1a4ab] alter complete (version 1)
I20260203 21:10:29.502027 3186 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57412:
table { table_name: "default.Table_7e73ff80019543888e0b8afa9b7a6660" } new_table_name: "default.Table_6c687150b16c40cb8fb3e90a5cb19c16" modify_external_catalogs: true
I20260203 21:10:29.502142 3185 catalog_manager.cc:5746] TS 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335) does not have the latest schema for tablet a7a06ceeb3c84f788e360a5ba926a71f (table default.table_547d99db0d3043499a26ee8c6df4c443 [id=333213fed7234610bc20c7d92124182b]). Expected version 1 got 0
I20260203 21:10:29.502851 3185 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57412:
table { table_name: "default.Table_b7c2ca72f69c49a0b39163d2fcb69341" } new_table_name: "default.Table_18c764c9748848f7b81aa13d7cae0ead" modify_external_catalogs: true
I20260203 21:10:29.504582 3406 tablet_bootstrap.cc:654] T ba8723a952564816a5c1f7945c448db9 P 6d9e0cecab784cc0acc050ca1c89c5be: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:29.506402 3411 tablet_bootstrap.cc:492] T ba8723a952564816a5c1f7945c448db9 P 185c63f61a2645928eeb807d145026b1: No bootstrap required, opened a new log
I20260203 21:10:29.506515 3411 ts_tablet_manager.cc:1403] T ba8723a952564816a5c1f7945c448db9 P 185c63f61a2645928eeb807d145026b1: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.000s
I20260203 21:10:29.507030 3411 raft_consensus.cc:359] T ba8723a952564816a5c1f7945c448db9 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } }
I20260203 21:10:29.507117 3404 tablet_bootstrap.cc:492] T ba8723a952564816a5c1f7945c448db9 P 02bdf326542e474cbe62434dd59087dc: No bootstrap required, opened a new log
I20260203 21:10:29.507139 3411 raft_consensus.cc:385] T ba8723a952564816a5c1f7945c448db9 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:29.507176 3411 raft_consensus.cc:740] T ba8723a952564816a5c1f7945c448db9 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 185c63f61a2645928eeb807d145026b1, State: Initialized, Role: FOLLOWER
I20260203 21:10:29.507192 3404 ts_tablet_manager.cc:1403] T ba8723a952564816a5c1f7945c448db9 P 02bdf326542e474cbe62434dd59087dc: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.002s
I20260203 21:10:29.507293 3411 consensus_queue.cc:260] T ba8723a952564816a5c1f7945c448db9 P 185c63f61a2645928eeb807d145026b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } }
I20260203 21:10:29.507441 3340 raft_consensus.cc:493] T ba8723a952564816a5c1f7945c448db9 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 21:10:29.507531 3340 raft_consensus.cc:515] T ba8723a952564816a5c1f7945c448db9 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } }
I20260203 21:10:29.507577 3411 ts_tablet_manager.cc:1434] T ba8723a952564816a5c1f7945c448db9 P 185c63f61a2645928eeb807d145026b1: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260203 21:10:29.507893 3340 leader_election.cc:290] T ba8723a952564816a5c1f7945c448db9 P 185c63f61a2645928eeb807d145026b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335), 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897)
I20260203 21:10:29.508380 2923 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ba8723a952564816a5c1f7945c448db9" candidate_uuid: "185c63f61a2645928eeb807d145026b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" is_pre_election: true
I20260203 21:10:29.508394 2785 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ba8723a952564816a5c1f7945c448db9" candidate_uuid: "185c63f61a2645928eeb807d145026b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02bdf326542e474cbe62434dd59087dc" is_pre_election: true
W20260203 21:10:29.508728 2995 leader_election.cc:343] T ba8723a952564816a5c1f7945c448db9 P 185c63f61a2645928eeb807d145026b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Illegal state: must be running to vote when last-logged opid is not known
I20260203 21:10:29.509052 3039 tablet_service.cc:1505] Processing CreateTablet for tablet 62542a22943242c7987cc65423f548b4 (DEFAULT_TABLE table=default.table_72135cb0d98246739f6b8c9aee17c8ba [id=7402e05c90cf4b15be6effde36465fff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:29.509305 3039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62542a22943242c7987cc65423f548b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:29.511288 3415 tablet.cc:1722] T 8672a1e59caf4f70830d7cdac01f36cd P 02bdf326542e474cbe62434dd59087dc: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260203 21:10:29.512073 3411 tablet_bootstrap.cc:492] T 62542a22943242c7987cc65423f548b4 P 185c63f61a2645928eeb807d145026b1: Bootstrap starting.
I20260203 21:10:29.513108 3411 tablet_bootstrap.cc:654] T 62542a22943242c7987cc65423f548b4 P 185c63f61a2645928eeb807d145026b1: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:29.513283 3413 tablet.cc:1722] T 8672a1e59caf4f70830d7cdac01f36cd P 6d9e0cecab784cc0acc050ca1c89c5be: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260203 21:10:29.516050 2765 tablet_service.cc:1505] Processing CreateTablet for tablet 62542a22943242c7987cc65423f548b4 (DEFAULT_TABLE table=default.table_72135cb0d98246739f6b8c9aee17c8ba [id=7402e05c90cf4b15be6effde36465fff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:29.516281 2765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62542a22943242c7987cc65423f548b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:29.516903 2897 tablet_service.cc:1505] Processing CreateTablet for tablet 62542a22943242c7987cc65423f548b4 (DEFAULT_TABLE table=default.table_72135cb0d98246739f6b8c9aee17c8ba [id=7402e05c90cf4b15be6effde36465fff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:29.517168 2897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62542a22943242c7987cc65423f548b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:29.507642 3404 raft_consensus.cc:359] T ba8723a952564816a5c1f7945c448db9 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } }
I20260203 21:10:29.519896 3411 tablet_bootstrap.cc:492] T 62542a22943242c7987cc65423f548b4 P 185c63f61a2645928eeb807d145026b1: No bootstrap required, opened a new log
I20260203 21:10:29.519917 3404 raft_consensus.cc:385] T ba8723a952564816a5c1f7945c448db9 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:29.519958 3404 raft_consensus.cc:740] T ba8723a952564816a5c1f7945c448db9 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02bdf326542e474cbe62434dd59087dc, State: Initialized, Role: FOLLOWER
I20260203 21:10:29.519979 3411 ts_tablet_manager.cc:1403] T 62542a22943242c7987cc65423f548b4 P 185c63f61a2645928eeb807d145026b1: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20260203 21:10:29.520078 3404 consensus_queue.cc:260] T ba8723a952564816a5c1f7945c448db9 P 02bdf326542e474cbe62434dd59087dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } }
I20260203 21:10:29.520357 3404 ts_tablet_manager.cc:1434] T ba8723a952564816a5c1f7945c448db9 P 02bdf326542e474cbe62434dd59087dc: Time spent starting tablet: real 0.013s user 0.000s sys 0.001s
I20260203 21:10:29.520466 3411 raft_consensus.cc:359] T 62542a22943242c7987cc65423f548b4 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.520542 3404 tablet_bootstrap.cc:492] T 62542a22943242c7987cc65423f548b4 P 02bdf326542e474cbe62434dd59087dc: Bootstrap starting.
I20260203 21:10:29.520581 3411 raft_consensus.cc:385] T 62542a22943242c7987cc65423f548b4 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:29.520617 3411 raft_consensus.cc:740] T 62542a22943242c7987cc65423f548b4 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 185c63f61a2645928eeb807d145026b1, State: Initialized, Role: FOLLOWER
I20260203 21:10:29.520730 3411 consensus_queue.cc:260] T 62542a22943242c7987cc65423f548b4 P 185c63f61a2645928eeb807d145026b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.521034 3411 ts_tablet_manager.cc:1434] T 62542a22943242c7987cc65423f548b4 P 185c63f61a2645928eeb807d145026b1: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260203 21:10:29.521483 3404 tablet_bootstrap.cc:654] T 62542a22943242c7987cc65423f548b4 P 02bdf326542e474cbe62434dd59087dc: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:29.522078 2785 raft_consensus.cc:2468] T ba8723a952564816a5c1f7945c448db9 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 185c63f61a2645928eeb807d145026b1 in term 0.
I20260203 21:10:29.522540 3404 tablet_bootstrap.cc:492] T 62542a22943242c7987cc65423f548b4 P 02bdf326542e474cbe62434dd59087dc: No bootstrap required, opened a new log
I20260203 21:10:29.522617 3404 ts_tablet_manager.cc:1403] T 62542a22943242c7987cc65423f548b4 P 02bdf326542e474cbe62434dd59087dc: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260203 21:10:29.522594 2993 leader_election.cc:304] T ba8723a952564816a5c1f7945c448db9 P 185c63f61a2645928eeb807d145026b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc, 185c63f61a2645928eeb807d145026b1; no voters: 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:10:29.522801 3340 raft_consensus.cc:2804] T ba8723a952564816a5c1f7945c448db9 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 21:10:29.522850 3340 raft_consensus.cc:493] T ba8723a952564816a5c1f7945c448db9 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 21:10:29.522882 3340 raft_consensus.cc:3060] T ba8723a952564816a5c1f7945c448db9 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:29.523063 3404 raft_consensus.cc:359] T 62542a22943242c7987cc65423f548b4 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.523342 3404 raft_consensus.cc:385] T 62542a22943242c7987cc65423f548b4 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:29.523386 3404 raft_consensus.cc:740] T 62542a22943242c7987cc65423f548b4 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02bdf326542e474cbe62434dd59087dc, State: Initialized, Role: FOLLOWER
I20260203 21:10:29.523502 3404 consensus_queue.cc:260] T 62542a22943242c7987cc65423f548b4 P 02bdf326542e474cbe62434dd59087dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.523818 3404 ts_tablet_manager.cc:1434] T 62542a22943242c7987cc65423f548b4 P 02bdf326542e474cbe62434dd59087dc: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260203 21:10:29.528329 3414 tablet.cc:1722] T a7a06ceeb3c84f788e360a5ba926a71f P 185c63f61a2645928eeb807d145026b1: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260203 21:10:29.528872 3452 tablet.cc:1722] T a7a06ceeb3c84f788e360a5ba926a71f P 02bdf326542e474cbe62434dd59087dc: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260203 21:10:29.529803 3340 raft_consensus.cc:515] T ba8723a952564816a5c1f7945c448db9 P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } }
I20260203 21:10:29.530125 3340 leader_election.cc:290] T ba8723a952564816a5c1f7945c448db9 P 185c63f61a2645928eeb807d145026b1 [CANDIDATE]: Term 1 election: Requested vote from peers 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335), 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897)
I20260203 21:10:29.530414 2784 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ba8723a952564816a5c1f7945c448db9" candidate_uuid: "185c63f61a2645928eeb807d145026b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02bdf326542e474cbe62434dd59087dc"
I20260203 21:10:29.530514 2784 raft_consensus.cc:3060] T ba8723a952564816a5c1f7945c448db9 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:29.530826 3414 tablet.cc:1722] T 8672a1e59caf4f70830d7cdac01f36cd P 185c63f61a2645928eeb807d145026b1: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260203 21:10:29.531466 2784 raft_consensus.cc:2468] T ba8723a952564816a5c1f7945c448db9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 185c63f61a2645928eeb807d145026b1 in term 1.
I20260203 21:10:29.531903 2922 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ba8723a952564816a5c1f7945c448db9" candidate_uuid: "185c63f61a2645928eeb807d145026b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d9e0cecab784cc0acc050ca1c89c5be"
W20260203 21:10:29.532245 2995 leader_election.cc:343] T ba8723a952564816a5c1f7945c448db9 P 185c63f61a2645928eeb807d145026b1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Illegal state: must be running to vote when last-logged opid is not known
I20260203 21:10:29.532524 2993 leader_election.cc:304] T ba8723a952564816a5c1f7945c448db9 P 185c63f61a2645928eeb807d145026b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc, 185c63f61a2645928eeb807d145026b1; no voters: 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:10:29.535120 3406 tablet_bootstrap.cc:492] T ba8723a952564816a5c1f7945c448db9 P 6d9e0cecab784cc0acc050ca1c89c5be: No bootstrap required, opened a new log
I20260203 21:10:29.535213 3406 ts_tablet_manager.cc:1403] T ba8723a952564816a5c1f7945c448db9 P 6d9e0cecab784cc0acc050ca1c89c5be: Time spent bootstrapping tablet: real 0.036s user 0.002s sys 0.000s
I20260203 21:10:29.535722 3340 raft_consensus.cc:2804] T ba8723a952564816a5c1f7945c448db9 P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260203 21:10:29.535804 3340 raft_consensus.cc:697] T ba8723a952564816a5c1f7945c448db9 P 185c63f61a2645928eeb807d145026b1 [term 1 LEADER]: Becoming Leader. State: Replica: 185c63f61a2645928eeb807d145026b1, State: Running, Role: LEADER
I20260203 21:10:29.535923 3340 consensus_queue.cc:237] T ba8723a952564816a5c1f7945c448db9 P 185c63f61a2645928eeb807d145026b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } }
I20260203 21:10:29.536327 3406 raft_consensus.cc:359] T ba8723a952564816a5c1f7945c448db9 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } }
I20260203 21:10:29.536439 3406 raft_consensus.cc:385] T ba8723a952564816a5c1f7945c448db9 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:29.536476 3406 raft_consensus.cc:740] T ba8723a952564816a5c1f7945c448db9 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d9e0cecab784cc0acc050ca1c89c5be, State: Initialized, Role: FOLLOWER
I20260203 21:10:29.536594 3406 consensus_queue.cc:260] T ba8723a952564816a5c1f7945c448db9 P 6d9e0cecab784cc0acc050ca1c89c5be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } }
I20260203 21:10:29.536904 3406 ts_tablet_manager.cc:1434] T ba8723a952564816a5c1f7945c448db9 P 6d9e0cecab784cc0acc050ca1c89c5be: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260203 21:10:29.537091 3406 tablet_bootstrap.cc:492] T 62542a22943242c7987cc65423f548b4 P 6d9e0cecab784cc0acc050ca1c89c5be: Bootstrap starting.
I20260203 21:10:29.538082 3406 tablet_bootstrap.cc:654] T 62542a22943242c7987cc65423f548b4 P 6d9e0cecab784cc0acc050ca1c89c5be: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:29.540340 3450 tablet.cc:1722] T a7a06ceeb3c84f788e360a5ba926a71f P 6d9e0cecab784cc0acc050ca1c89c5be: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260203 21:10:29.543800 3406 tablet_bootstrap.cc:492] T 62542a22943242c7987cc65423f548b4 P 6d9e0cecab784cc0acc050ca1c89c5be: No bootstrap required, opened a new log
I20260203 21:10:29.543888 3406 ts_tablet_manager.cc:1403] T 62542a22943242c7987cc65423f548b4 P 6d9e0cecab784cc0acc050ca1c89c5be: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260203 21:10:29.544353 3406 raft_consensus.cc:359] T 62542a22943242c7987cc65423f548b4 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.544448 3406 raft_consensus.cc:385] T 62542a22943242c7987cc65423f548b4 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:29.544482 3406 raft_consensus.cc:740] T 62542a22943242c7987cc65423f548b4 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d9e0cecab784cc0acc050ca1c89c5be, State: Initialized, Role: FOLLOWER
I20260203 21:10:29.544598 3406 consensus_queue.cc:260] T 62542a22943242c7987cc65423f548b4 P 6d9e0cecab784cc0acc050ca1c89c5be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.544883 3406 ts_tablet_manager.cc:1434] T 62542a22943242c7987cc65423f548b4 P 6d9e0cecab784cc0acc050ca1c89c5be: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260203 21:10:29.554250 3194 catalog_manager.cc:2174] created HMS catalog entry for table [id=42eb95ae2b9442b18dac664ea886b4b3]
I20260203 21:10:29.559055 3194 catalog_manager.cc:5746] TS 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897) does not have the latest schema for tablet a7a06ceeb3c84f788e360a5ba926a71f (table default.table_547d99db0d3043499a26ee8c6df4c443 [id=333213fed7234610bc20c7d92124182b]). Expected version 1 got 0
I20260203 21:10:29.559188 3194 catalog_manager.cc:5746] TS 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897) does not have the latest schema for tablet 8672a1e59caf4f70830d7cdac01f36cd (table default.table_7e73ff80019543888e0b8afa9b7a6660 [id=82ec5c95acc84e509c0803db74b626b4]). Expected version 1 got 0
I20260203 21:10:29.560566 3194 catalog_manager.cc:5746] TS 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223) does not have the latest schema for tablet 8672a1e59caf4f70830d7cdac01f36cd (table default.table_7e73ff80019543888e0b8afa9b7a6660 [id=82ec5c95acc84e509c0803db74b626b4]). Expected version 1 got 0
I20260203 21:10:29.560676 3194 catalog_manager.cc:5654] T 98cd2089483c4121944152e5cee8ca30 P 185c63f61a2645928eeb807d145026b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 185c63f61a2645928eeb807d145026b1 (127.2.32.131). New cstate: current_term: 1 leader_uuid: "185c63f61a2645928eeb807d145026b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } health_report { overall_health: UNKNOWN } } }
I20260203 21:10:29.574879 3194 catalog_manager.cc:5746] TS 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335) does not have the latest schema for tablet 8672a1e59caf4f70830d7cdac01f36cd (table default.table_7e73ff80019543888e0b8afa9b7a6660 [id=82ec5c95acc84e509c0803db74b626b4]). Expected version 1 got 0
I20260203 21:10:29.579538 2765 tablet_service.cc:1505] Processing CreateTablet for tablet 2f8e36b89ebf456d964c9a31f7c7636a (DEFAULT_TABLE table=default.table_98e2e0221eb0485fb87bee758843d37e [id=42eb95ae2b9442b18dac664ea886b4b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:29.579538 3039 tablet_service.cc:1505] Processing CreateTablet for tablet 2f8e36b89ebf456d964c9a31f7c7636a (DEFAULT_TABLE table=default.table_98e2e0221eb0485fb87bee758843d37e [id=42eb95ae2b9442b18dac664ea886b4b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:29.579851 3039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f8e36b89ebf456d964c9a31f7c7636a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:29.579850 2765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f8e36b89ebf456d964c9a31f7c7636a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:29.581893 3411 tablet_bootstrap.cc:492] T 2f8e36b89ebf456d964c9a31f7c7636a P 185c63f61a2645928eeb807d145026b1: Bootstrap starting.
I20260203 21:10:29.581911 3404 tablet_bootstrap.cc:492] T 2f8e36b89ebf456d964c9a31f7c7636a P 02bdf326542e474cbe62434dd59087dc: Bootstrap starting.
I20260203 21:10:29.582746 3411 tablet_bootstrap.cc:654] T 2f8e36b89ebf456d964c9a31f7c7636a P 185c63f61a2645928eeb807d145026b1: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:29.582782 3404 tablet_bootstrap.cc:654] T 2f8e36b89ebf456d964c9a31f7c7636a P 02bdf326542e474cbe62434dd59087dc: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:29.583626 3310 raft_consensus.cc:493] T 62542a22943242c7987cc65423f548b4 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 21:10:29.583750 3310 raft_consensus.cc:515] T 62542a22943242c7987cc65423f548b4 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.583834 2897 tablet_service.cc:1505] Processing CreateTablet for tablet 2f8e36b89ebf456d964c9a31f7c7636a (DEFAULT_TABLE table=default.table_98e2e0221eb0485fb87bee758843d37e [id=42eb95ae2b9442b18dac664ea886b4b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:29.584156 2897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f8e36b89ebf456d964c9a31f7c7636a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:29.584518 3404 tablet_bootstrap.cc:492] T 2f8e36b89ebf456d964c9a31f7c7636a P 02bdf326542e474cbe62434dd59087dc: No bootstrap required, opened a new log
I20260203 21:10:29.584599 3404 ts_tablet_manager.cc:1403] T 2f8e36b89ebf456d964c9a31f7c7636a P 02bdf326542e474cbe62434dd59087dc: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260203 21:10:29.584575 3058 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "62542a22943242c7987cc65423f548b4" candidate_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "185c63f61a2645928eeb807d145026b1" is_pre_election: true
I20260203 21:10:29.584661 2784 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "62542a22943242c7987cc65423f548b4" candidate_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02bdf326542e474cbe62434dd59087dc" is_pre_election: true
I20260203 21:10:29.584705 3058 raft_consensus.cc:2468] T 62542a22943242c7987cc65423f548b4 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d9e0cecab784cc0acc050ca1c89c5be in term 0.
I20260203 21:10:29.584756 2784 raft_consensus.cc:2468] T 62542a22943242c7987cc65423f548b4 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d9e0cecab784cc0acc050ca1c89c5be in term 0.
I20260203 21:10:29.585086 2858 leader_election.cc:304] T 62542a22943242c7987cc65423f548b4 P 6d9e0cecab784cc0acc050ca1c89c5be [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be; no voters:
I20260203 21:10:29.585059 3404 raft_consensus.cc:359] T 2f8e36b89ebf456d964c9a31f7c7636a P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:29.585155 3404 raft_consensus.cc:385] T 2f8e36b89ebf456d964c9a31f7c7636a P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:29.585183 3404 raft_consensus.cc:740] T 2f8e36b89ebf456d964c9a31f7c7636a P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02bdf326542e474cbe62434dd59087dc, State: Initialized, Role: FOLLOWER
I20260203 21:10:29.585242 3284 raft_consensus.cc:2804] T 62542a22943242c7987cc65423f548b4 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 21:10:29.585290 3284 raft_consensus.cc:493] T 62542a22943242c7987cc65423f548b4 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 21:10:29.585335 3284 raft_consensus.cc:3060] T 62542a22943242c7987cc65423f548b4 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:29.585312 3404 consensus_queue.cc:260] T 2f8e36b89ebf456d964c9a31f7c7636a P 02bdf326542e474cbe62434dd59087dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:29.585577 3404 ts_tablet_manager.cc:1434] T 2f8e36b89ebf456d964c9a31f7c7636a P 02bdf326542e474cbe62434dd59087dc: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260203 21:10:29.586215 3284 raft_consensus.cc:515] T 62542a22943242c7987cc65423f548b4 P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.584164 3310 leader_election.cc:290] T 62542a22943242c7987cc65423f548b4 P 6d9e0cecab784cc0acc050ca1c89c5be [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223), 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335)
I20260203 21:10:29.586463 3406 tablet_bootstrap.cc:492] T 2f8e36b89ebf456d964c9a31f7c7636a P 6d9e0cecab784cc0acc050ca1c89c5be: Bootstrap starting.
I20260203 21:10:29.586546 3284 leader_election.cc:290] T 62542a22943242c7987cc65423f548b4 P 6d9e0cecab784cc0acc050ca1c89c5be [CANDIDATE]: Term 1 election: Requested vote from peers 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223), 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335)
I20260203 21:10:29.587484 3406 tablet_bootstrap.cc:654] T 2f8e36b89ebf456d964c9a31f7c7636a P 6d9e0cecab784cc0acc050ca1c89c5be: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:29.587800 3411 tablet_bootstrap.cc:492] T 2f8e36b89ebf456d964c9a31f7c7636a P 185c63f61a2645928eeb807d145026b1: No bootstrap required, opened a new log
I20260203 21:10:29.587875 3411 ts_tablet_manager.cc:1403] T 2f8e36b89ebf456d964c9a31f7c7636a P 185c63f61a2645928eeb807d145026b1: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.001s
I20260203 21:10:29.588326 3411 raft_consensus.cc:359] T 2f8e36b89ebf456d964c9a31f7c7636a P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:29.588423 3411 raft_consensus.cc:385] T 2f8e36b89ebf456d964c9a31f7c7636a P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:29.588418 2784 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "62542a22943242c7987cc65423f548b4" candidate_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02bdf326542e474cbe62434dd59087dc"
I20260203 21:10:29.588454 3411 raft_consensus.cc:740] T 2f8e36b89ebf456d964c9a31f7c7636a P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 185c63f61a2645928eeb807d145026b1, State: Initialized, Role: FOLLOWER
I20260203 21:10:29.588500 2784 raft_consensus.cc:3060] T 62542a22943242c7987cc65423f548b4 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:29.588562 3411 consensus_queue.cc:260] T 2f8e36b89ebf456d964c9a31f7c7636a P 185c63f61a2645928eeb807d145026b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:29.588758 3058 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "62542a22943242c7987cc65423f548b4" candidate_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "185c63f61a2645928eeb807d145026b1"
I20260203 21:10:29.588809 3411 ts_tablet_manager.cc:1434] T 2f8e36b89ebf456d964c9a31f7c7636a P 185c63f61a2645928eeb807d145026b1: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260203 21:10:29.588863 3058 raft_consensus.cc:3060] T 62542a22943242c7987cc65423f548b4 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:29.589380 2784 raft_consensus.cc:2468] T 62542a22943242c7987cc65423f548b4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d9e0cecab784cc0acc050ca1c89c5be in term 1.
I20260203 21:10:29.589706 3058 raft_consensus.cc:2468] T 62542a22943242c7987cc65423f548b4 P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d9e0cecab784cc0acc050ca1c89c5be in term 1.
I20260203 21:10:29.590044 2857 leader_election.cc:304] T 62542a22943242c7987cc65423f548b4 P 6d9e0cecab784cc0acc050ca1c89c5be [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc, 6d9e0cecab784cc0acc050ca1c89c5be; no voters:
I20260203 21:10:29.593257 3284 raft_consensus.cc:2804] T 62542a22943242c7987cc65423f548b4 P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 FOLLOWER]: Leader election won for term 1
I20260203 21:10:29.593343 3284 raft_consensus.cc:697] T 62542a22943242c7987cc65423f548b4 P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 LEADER]: Becoming Leader. State: Replica: 6d9e0cecab784cc0acc050ca1c89c5be, State: Running, Role: LEADER
I20260203 21:10:29.593374 3189 catalog_manager.cc:2174] created HMS catalog entry for table [id=ad58be29e80345e1afe7f5a55e129af2]
I20260203 21:10:29.593462 3284 consensus_queue.cc:237] T 62542a22943242c7987cc65423f548b4 P 6d9e0cecab784cc0acc050ca1c89c5be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.595404 3406 tablet_bootstrap.cc:492] T 2f8e36b89ebf456d964c9a31f7c7636a P 6d9e0cecab784cc0acc050ca1c89c5be: No bootstrap required, opened a new log
I20260203 21:10:29.595499 3406 ts_tablet_manager.cc:1403] T 2f8e36b89ebf456d964c9a31f7c7636a P 6d9e0cecab784cc0acc050ca1c89c5be: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20260203 21:10:29.595975 3406 raft_consensus.cc:359] T 2f8e36b89ebf456d964c9a31f7c7636a P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:29.596073 3406 raft_consensus.cc:385] T 2f8e36b89ebf456d964c9a31f7c7636a P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:29.596110 3406 raft_consensus.cc:740] T 2f8e36b89ebf456d964c9a31f7c7636a P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d9e0cecab784cc0acc050ca1c89c5be, State: Initialized, Role: FOLLOWER
I20260203 21:10:29.596215 3406 consensus_queue.cc:260] T 2f8e36b89ebf456d964c9a31f7c7636a P 6d9e0cecab784cc0acc050ca1c89c5be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:29.596503 3406 ts_tablet_manager.cc:1434] T 2f8e36b89ebf456d964c9a31f7c7636a P 6d9e0cecab784cc0acc050ca1c89c5be: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260203 21:10:29.598771 3194 catalog_manager.cc:6199] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260: default.table_547d99db0d3043499a26ee8c6df4c443 [id=333213fed7234610bc20c7d92124182b] alter complete (version 1)
I20260203 21:10:29.603088 3189 catalog_manager.cc:5654] T ba8723a952564816a5c1f7945c448db9 P 185c63f61a2645928eeb807d145026b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 185c63f61a2645928eeb807d145026b1 (127.2.32.131). New cstate: current_term: 1 leader_uuid: "185c63f61a2645928eeb807d145026b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } health_report { overall_health: UNKNOWN } } }
I20260203 21:10:29.607340 3194 catalog_manager.cc:6199] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260: default.table_7e73ff80019543888e0b8afa9b7a6660 [id=82ec5c95acc84e509c0803db74b626b4] alter complete (version 1)
I20260203 21:10:29.609851 3189 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57412:
table { table_name: "default.Table_4f93e096d30349908a32a33e024543d6" } new_table_name: "default.Table_65ec2660e3164688879b576a359a84c1" modify_external_catalogs: true
I20260203 21:10:29.612751 3310 raft_consensus.cc:493] T 4de1de23650548c2a078b51c9bf4d031 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 21:10:29.612857 3310 raft_consensus.cc:515] T 4de1de23650548c2a078b51c9bf4d031 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.613260 3310 leader_election.cc:290] T 4de1de23650548c2a078b51c9bf4d031 P 6d9e0cecab784cc0acc050ca1c89c5be [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223), 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335)
I20260203 21:10:29.614199 3058 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4de1de23650548c2a078b51c9bf4d031" candidate_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "185c63f61a2645928eeb807d145026b1" is_pre_election: true
I20260203 21:10:29.614344 3058 raft_consensus.cc:2468] T 4de1de23650548c2a078b51c9bf4d031 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d9e0cecab784cc0acc050ca1c89c5be in term 0.
I20260203 21:10:29.614650 2858 leader_election.cc:304] T 4de1de23650548c2a078b51c9bf4d031 P 6d9e0cecab784cc0acc050ca1c89c5be [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be; no voters:
I20260203 21:10:29.614831 3310 raft_consensus.cc:2804] T 4de1de23650548c2a078b51c9bf4d031 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 21:10:29.614894 3310 raft_consensus.cc:493] T 4de1de23650548c2a078b51c9bf4d031 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 21:10:29.614934 3310 raft_consensus.cc:3060] T 4de1de23650548c2a078b51c9bf4d031 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:29.615176 2765 tablet_service.cc:1505] Processing CreateTablet for tablet b20e604665624843b957080dc6016d78 (DEFAULT_TABLE table=default.table_8da179b3ec0b4c898eb890f89d54cb6a [id=ad58be29e80345e1afe7f5a55e129af2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:29.615468 2765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b20e604665624843b957080dc6016d78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:29.616755 3310 raft_consensus.cc:515] T 4de1de23650548c2a078b51c9bf4d031 P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.617184 3310 leader_election.cc:290] T 4de1de23650548c2a078b51c9bf4d031 P 6d9e0cecab784cc0acc050ca1c89c5be [CANDIDATE]: Term 1 election: Requested vote from peers 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223), 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335)
I20260203 21:10:29.617755 2785 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4de1de23650548c2a078b51c9bf4d031" candidate_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02bdf326542e474cbe62434dd59087dc"
I20260203 21:10:29.617862 2785 raft_consensus.cc:3060] T 4de1de23650548c2a078b51c9bf4d031 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:29.617878 3058 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4de1de23650548c2a078b51c9bf4d031" candidate_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "185c63f61a2645928eeb807d145026b1"
I20260203 21:10:29.617991 3058 raft_consensus.cc:3060] T 4de1de23650548c2a078b51c9bf4d031 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:29.618073 2784 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4de1de23650548c2a078b51c9bf4d031" candidate_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02bdf326542e474cbe62434dd59087dc" is_pre_election: true
I20260203 21:10:29.618681 2785 raft_consensus.cc:2468] T 4de1de23650548c2a078b51c9bf4d031 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d9e0cecab784cc0acc050ca1c89c5be in term 1.
I20260203 21:10:29.618896 3404 tablet_bootstrap.cc:492] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc: Bootstrap starting.
I20260203 21:10:29.619079 3058 raft_consensus.cc:2468] T 4de1de23650548c2a078b51c9bf4d031 P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d9e0cecab784cc0acc050ca1c89c5be in term 1.
I20260203 21:10:29.619607 3194 catalog_manager.cc:5654] T 62542a22943242c7987cc65423f548b4 P 6d9e0cecab784cc0acc050ca1c89c5be reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130). New cstate: current_term: 1 leader_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } health_report { overall_health: UNKNOWN } } }
I20260203 21:10:29.619868 2857 leader_election.cc:304] T 4de1de23650548c2a078b51c9bf4d031 P 6d9e0cecab784cc0acc050ca1c89c5be [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc, 6d9e0cecab784cc0acc050ca1c89c5be; no voters:
I20260203 21:10:29.620184 3310 raft_consensus.cc:2804] T 4de1de23650548c2a078b51c9bf4d031 P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 FOLLOWER]: Leader election won for term 1
I20260203 21:10:29.620270 3310 raft_consensus.cc:697] T 4de1de23650548c2a078b51c9bf4d031 P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 LEADER]: Becoming Leader. State: Replica: 6d9e0cecab784cc0acc050ca1c89c5be, State: Running, Role: LEADER
I20260203 21:10:29.620399 3310 consensus_queue.cc:237] T 4de1de23650548c2a078b51c9bf4d031 P 6d9e0cecab784cc0acc050ca1c89c5be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.620671 2897 tablet_service.cc:1505] Processing CreateTablet for tablet b20e604665624843b957080dc6016d78 (DEFAULT_TABLE table=default.table_8da179b3ec0b4c898eb890f89d54cb6a [id=ad58be29e80345e1afe7f5a55e129af2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:29.620909 2897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b20e604665624843b957080dc6016d78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:29.622423 3404 tablet_bootstrap.cc:654] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:29.622910 3406 tablet_bootstrap.cc:492] T b20e604665624843b957080dc6016d78 P 6d9e0cecab784cc0acc050ca1c89c5be: Bootstrap starting.
I20260203 21:10:29.623421 3039 tablet_service.cc:1505] Processing CreateTablet for tablet b20e604665624843b957080dc6016d78 (DEFAULT_TABLE table=default.table_8da179b3ec0b4c898eb890f89d54cb6a [id=ad58be29e80345e1afe7f5a55e129af2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:29.623530 3404 tablet_bootstrap.cc:492] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc: No bootstrap required, opened a new log
I20260203 21:10:29.623615 3404 ts_tablet_manager.cc:1403] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260203 21:10:29.623653 3039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b20e604665624843b957080dc6016d78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:29.623819 3406 tablet_bootstrap.cc:654] T b20e604665624843b957080dc6016d78 P 6d9e0cecab784cc0acc050ca1c89c5be: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:29.624135 3404 raft_consensus.cc:359] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.624236 3404 raft_consensus.cc:385] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:29.624272 3404 raft_consensus.cc:740] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02bdf326542e474cbe62434dd59087dc, State: Initialized, Role: FOLLOWER
I20260203 21:10:29.624399 3404 consensus_queue.cc:260] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.624737 3404 ts_tablet_manager.cc:1434] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260203 21:10:29.626204 3411 tablet_bootstrap.cc:492] T b20e604665624843b957080dc6016d78 P 185c63f61a2645928eeb807d145026b1: Bootstrap starting.
I20260203 21:10:29.627223 3411 tablet_bootstrap.cc:654] T b20e604665624843b957080dc6016d78 P 185c63f61a2645928eeb807d145026b1: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:29.631851 3194 master_service.cc:954] ReplaceTablet: received request to replace tablet a7a06ceeb3c84f788e360a5ba926a71f from {username='slave'} at 127.0.0.1:57412
I20260203 21:10:29.636400 3194 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260: Sending DeleteTablet for 3 replicas of tablet a7a06ceeb3c84f788e360a5ba926a71f
I20260203 21:10:29.636705 3194 catalog_manager.cc:6724] ReplaceTablet: tablet a7a06ceeb3c84f788e360a5ba926a71f deleted and replaced by tablet a375114bebc64385827b7b6e0060d1e4
I20260203 21:10:29.638527 3039 tablet_service.cc:1552] Processing DeleteTablet for tablet a7a06ceeb3c84f788e360a5ba926a71f with delete_type TABLET_DATA_DELETED (replaced by tablet a375114bebc64385827b7b6e0060d1e4) from {username='slave'} at 127.0.0.1:59506
I20260203 21:10:29.638746 3409 tablet_replica.cc:333] T a7a06ceeb3c84f788e360a5ba926a71f P 185c63f61a2645928eeb807d145026b1: stopping tablet replica
I20260203 21:10:29.638908 3409 raft_consensus.cc:2243] T a7a06ceeb3c84f788e360a5ba926a71f P 185c63f61a2645928eeb807d145026b1 [term 1 LEADER]: Raft consensus shutting down.
I20260203 21:10:29.639079 2897 tablet_service.cc:1552] Processing DeleteTablet for tablet a7a06ceeb3c84f788e360a5ba926a71f with delete_type TABLET_DATA_DELETED (replaced by tablet a375114bebc64385827b7b6e0060d1e4) from {username='slave'} at 127.0.0.1:51090
I20260203 21:10:29.639258 3409 raft_consensus.cc:2272] T a7a06ceeb3c84f788e360a5ba926a71f P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 21:10:29.639266 2765 tablet_service.cc:1552] Processing DeleteTablet for tablet a7a06ceeb3c84f788e360a5ba926a71f with delete_type TABLET_DATA_DELETED (replaced by tablet a375114bebc64385827b7b6e0060d1e4) from {username='slave'} at 127.0.0.1:59654
I20260203 21:10:29.639431 3282 raft_consensus.cc:493] T 8df16fd039bf4d9b91ee2e49151c18c2 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 21:10:29.639525 3282 raft_consensus.cc:515] T 8df16fd039bf4d9b91ee2e49151c18c2 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.639950 3282 leader_election.cc:290] T 8df16fd039bf4d9b91ee2e49151c18c2 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
I20260203 21:10:29.640125 3405 tablet_replica.cc:333] T a7a06ceeb3c84f788e360a5ba926a71f P 6d9e0cecab784cc0acc050ca1c89c5be: stopping tablet replica
I20260203 21:10:29.640267 3405 raft_consensus.cc:2243] T a7a06ceeb3c84f788e360a5ba926a71f P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 21:10:29.640391 3405 raft_consensus.cc:2272] T a7a06ceeb3c84f788e360a5ba926a71f P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 21:10:29.640573 3403 tablet_replica.cc:333] T a7a06ceeb3c84f788e360a5ba926a71f P 02bdf326542e474cbe62434dd59087dc: stopping tablet replica
I20260203 21:10:29.640697 3403 raft_consensus.cc:2243] T a7a06ceeb3c84f788e360a5ba926a71f P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 21:10:29.640856 3403 raft_consensus.cc:2272] T a7a06ceeb3c84f788e360a5ba926a71f P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 21:10:29.641077 3405 ts_tablet_manager.cc:1916] T a7a06ceeb3c84f788e360a5ba926a71f P 6d9e0cecab784cc0acc050ca1c89c5be: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260203 21:10:29.642230 3403 ts_tablet_manager.cc:1916] T a7a06ceeb3c84f788e360a5ba926a71f P 02bdf326542e474cbe62434dd59087dc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260203 21:10:29.642684 2922 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8df16fd039bf4d9b91ee2e49151c18c2" candidate_uuid: "02bdf326542e474cbe62434dd59087dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" is_pre_election: true
I20260203 21:10:29.642808 2922 raft_consensus.cc:2468] T 8df16fd039bf4d9b91ee2e49151c18c2 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02bdf326542e474cbe62434dd59087dc in term 0.
I20260203 21:10:29.643239 3405 ts_tablet_manager.cc:1929] T a7a06ceeb3c84f788e360a5ba926a71f P 6d9e0cecab784cc0acc050ca1c89c5be: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260203 21:10:29.643314 3405 log.cc:1199] T a7a06ceeb3c84f788e360a5ba926a71f P 6d9e0cecab784cc0acc050ca1c89c5be: Deleting WAL directory at /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-1/wal/wals/a7a06ceeb3c84f788e360a5ba926a71f
I20260203 21:10:29.643550 3405 ts_tablet_manager.cc:1950] T a7a06ceeb3c84f788e360a5ba926a71f P 6d9e0cecab784cc0acc050ca1c89c5be: Deleting consensus metadata
I20260203 21:10:29.644433 3181 catalog_manager.cc:4985] TS 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): tablet a7a06ceeb3c84f788e360a5ba926a71f (table default.table_547d99db0d3043499a26ee8c6df4c443 [id=333213fed7234610bc20c7d92124182b]) successfully deleted
I20260203 21:10:29.644527 3403 ts_tablet_manager.cc:1929] T a7a06ceeb3c84f788e360a5ba926a71f P 02bdf326542e474cbe62434dd59087dc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260203 21:10:29.644598 3403 log.cc:1199] T a7a06ceeb3c84f788e360a5ba926a71f P 02bdf326542e474cbe62434dd59087dc: Deleting WAL directory at /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-0/wal/wals/a7a06ceeb3c84f788e360a5ba926a71f
I20260203 21:10:29.644696 3194 catalog_manager.cc:5654] T 4de1de23650548c2a078b51c9bf4d031 P 6d9e0cecab784cc0acc050ca1c89c5be reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130). New cstate: current_term: 1 leader_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } health_report { overall_health: UNKNOWN } } }
I20260203 21:10:29.644842 3403 ts_tablet_manager.cc:1950] T a7a06ceeb3c84f788e360a5ba926a71f P 02bdf326542e474cbe62434dd59087dc: Deleting consensus metadata
I20260203 21:10:29.644866 3039 tablet_service.cc:1505] Processing CreateTablet for tablet a375114bebc64385827b7b6e0060d1e4 (DEFAULT_TABLE table=default.table_547d99db0d3043499a26ee8c6df4c443 [id=333213fed7234610bc20c7d92124182b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:29.645119 3039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a375114bebc64385827b7b6e0060d1e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:29.645572 2721 leader_election.cc:304] T 8df16fd039bf4d9b91ee2e49151c18c2 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc, 6d9e0cecab784cc0acc050ca1c89c5be; no voters:
I20260203 21:10:29.645777 3282 raft_consensus.cc:2804] T 8df16fd039bf4d9b91ee2e49151c18c2 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 21:10:29.645825 3282 raft_consensus.cc:493] T 8df16fd039bf4d9b91ee2e49151c18c2 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 21:10:29.645857 3282 raft_consensus.cc:3060] T 8df16fd039bf4d9b91ee2e49151c18c2 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:29.646310 3179 catalog_manager.cc:4985] TS 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335): tablet a7a06ceeb3c84f788e360a5ba926a71f (table default.table_547d99db0d3043499a26ee8c6df4c443 [id=333213fed7234610bc20c7d92124182b]) successfully deleted
I20260203 21:10:29.646541 3409 ts_tablet_manager.cc:1916] T a7a06ceeb3c84f788e360a5ba926a71f P 185c63f61a2645928eeb807d145026b1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260203 21:10:29.646762 3282 raft_consensus.cc:515] T 8df16fd039bf4d9b91ee2e49151c18c2 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.647097 3282 leader_election.cc:290] T 8df16fd039bf4d9b91ee2e49151c18c2 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 1 election: Requested vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
I20260203 21:10:29.647626 2922 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8df16fd039bf4d9b91ee2e49151c18c2" candidate_uuid: "02bdf326542e474cbe62434dd59087dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d9e0cecab784cc0acc050ca1c89c5be"
I20260203 21:10:29.647749 2922 raft_consensus.cc:3060] T 8df16fd039bf4d9b91ee2e49151c18c2 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:29.648672 2922 raft_consensus.cc:2468] T 8df16fd039bf4d9b91ee2e49151c18c2 P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02bdf326542e474cbe62434dd59087dc in term 1.
I20260203 21:10:29.648763 3409 ts_tablet_manager.cc:1929] T a7a06ceeb3c84f788e360a5ba926a71f P 185c63f61a2645928eeb807d145026b1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260203 21:10:29.648783 2765 tablet_service.cc:1505] Processing CreateTablet for tablet a375114bebc64385827b7b6e0060d1e4 (DEFAULT_TABLE table=default.table_547d99db0d3043499a26ee8c6df4c443 [id=333213fed7234610bc20c7d92124182b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:29.648837 3409 log.cc:1199] T a7a06ceeb3c84f788e360a5ba926a71f P 185c63f61a2645928eeb807d145026b1: Deleting WAL directory at /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-2/wal/wals/a7a06ceeb3c84f788e360a5ba926a71f
I20260203 21:10:29.648995 2765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a375114bebc64385827b7b6e0060d1e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:29.648967 2897 tablet_service.cc:1505] Processing CreateTablet for tablet a375114bebc64385827b7b6e0060d1e4 (DEFAULT_TABLE table=default.table_547d99db0d3043499a26ee8c6df4c443 [id=333213fed7234610bc20c7d92124182b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:29.649098 3409 ts_tablet_manager.cc:1950] T a7a06ceeb3c84f788e360a5ba926a71f P 185c63f61a2645928eeb807d145026b1: Deleting consensus metadata
I20260203 21:10:29.649163 2897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a375114bebc64385827b7b6e0060d1e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:29.650621 3058 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8df16fd039bf4d9b91ee2e49151c18c2" candidate_uuid: "02bdf326542e474cbe62434dd59087dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "185c63f61a2645928eeb807d145026b1" is_pre_election: true
I20260203 21:10:29.650789 3058 raft_consensus.cc:2468] T 8df16fd039bf4d9b91ee2e49151c18c2 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02bdf326542e474cbe62434dd59087dc in term 0.
I20260203 21:10:29.650978 2721 leader_election.cc:304] T 8df16fd039bf4d9b91ee2e49151c18c2 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc, 6d9e0cecab784cc0acc050ca1c89c5be; no voters:
I20260203 21:10:29.651010 3059 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8df16fd039bf4d9b91ee2e49151c18c2" candidate_uuid: "02bdf326542e474cbe62434dd59087dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "185c63f61a2645928eeb807d145026b1"
I20260203 21:10:29.651106 3059 raft_consensus.cc:3060] T 8df16fd039bf4d9b91ee2e49151c18c2 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:29.652036 3059 raft_consensus.cc:2468] T 8df16fd039bf4d9b91ee2e49151c18c2 P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02bdf326542e474cbe62434dd59087dc in term 1.
I20260203 21:10:29.652537 3282 raft_consensus.cc:2804] T 8df16fd039bf4d9b91ee2e49151c18c2 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader election won for term 1
I20260203 21:10:29.652621 3282 raft_consensus.cc:697] T 8df16fd039bf4d9b91ee2e49151c18c2 P 02bdf326542e474cbe62434dd59087dc [term 1 LEADER]: Becoming Leader. State: Replica: 02bdf326542e474cbe62434dd59087dc, State: Running, Role: LEADER
I20260203 21:10:29.652733 3282 consensus_queue.cc:237] T 8df16fd039bf4d9b91ee2e49151c18c2 P 02bdf326542e474cbe62434dd59087dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.653290 3194 master_service.cc:954] ReplaceTablet: received request to replace tablet 8672a1e59caf4f70830d7cdac01f36cd from {username='slave'} at 127.0.0.1:57412
I20260203 21:10:29.655130 3404 tablet_bootstrap.cc:492] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc: Bootstrap starting.
I20260203 21:10:29.656263 3404 tablet_bootstrap.cc:654] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:29.657598 3404 tablet_bootstrap.cc:492] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc: No bootstrap required, opened a new log
I20260203 21:10:29.657704 3404 ts_tablet_manager.cc:1403] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260203 21:10:29.657718 3180 catalog_manager.cc:4985] TS 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): tablet a7a06ceeb3c84f788e360a5ba926a71f (table default.table_547d99db0d3043499a26ee8c6df4c443 [id=333213fed7234610bc20c7d92124182b]) successfully deleted
I20260203 21:10:29.658227 3404 raft_consensus.cc:359] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.658346 3404 raft_consensus.cc:385] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:29.658396 3404 raft_consensus.cc:740] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02bdf326542e474cbe62434dd59087dc, State: Initialized, Role: FOLLOWER
I20260203 21:10:29.658535 3404 consensus_queue.cc:260] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.658874 3404 ts_tablet_manager.cc:1434] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260203 21:10:29.660102 3411 tablet_bootstrap.cc:492] T b20e604665624843b957080dc6016d78 P 185c63f61a2645928eeb807d145026b1: No bootstrap required, opened a new log
I20260203 21:10:29.660183 3411 ts_tablet_manager.cc:1403] T b20e604665624843b957080dc6016d78 P 185c63f61a2645928eeb807d145026b1: Time spent bootstrapping tablet: real 0.034s user 0.002s sys 0.000s
I20260203 21:10:29.660591 3411 raft_consensus.cc:359] T b20e604665624843b957080dc6016d78 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.660681 3411 raft_consensus.cc:385] T b20e604665624843b957080dc6016d78 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:29.660712 3411 raft_consensus.cc:740] T b20e604665624843b957080dc6016d78 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 185c63f61a2645928eeb807d145026b1, State: Initialized, Role: FOLLOWER
I20260203 21:10:29.660837 3411 consensus_queue.cc:260] T b20e604665624843b957080dc6016d78 P 185c63f61a2645928eeb807d145026b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.661105 3411 ts_tablet_manager.cc:1434] T b20e604665624843b957080dc6016d78 P 185c63f61a2645928eeb807d145026b1: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260203 21:10:29.661660 3406 tablet_bootstrap.cc:492] T b20e604665624843b957080dc6016d78 P 6d9e0cecab784cc0acc050ca1c89c5be: No bootstrap required, opened a new log
I20260203 21:10:29.661748 3406 ts_tablet_manager.cc:1403] T b20e604665624843b957080dc6016d78 P 6d9e0cecab784cc0acc050ca1c89c5be: Time spent bootstrapping tablet: real 0.039s user 0.002s sys 0.000s
I20260203 21:10:29.662187 3406 raft_consensus.cc:359] T b20e604665624843b957080dc6016d78 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.662282 3406 raft_consensus.cc:385] T b20e604665624843b957080dc6016d78 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:29.662312 3406 raft_consensus.cc:740] T b20e604665624843b957080dc6016d78 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d9e0cecab784cc0acc050ca1c89c5be, State: Initialized, Role: FOLLOWER
I20260203 21:10:29.662420 3406 consensus_queue.cc:260] T b20e604665624843b957080dc6016d78 P 6d9e0cecab784cc0acc050ca1c89c5be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.662671 3406 ts_tablet_manager.cc:1434] T b20e604665624843b957080dc6016d78 P 6d9e0cecab784cc0acc050ca1c89c5be: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260203 21:10:29.662861 3406 tablet_bootstrap.cc:492] T a375114bebc64385827b7b6e0060d1e4 P 6d9e0cecab784cc0acc050ca1c89c5be: Bootstrap starting.
I20260203 21:10:29.663396 3411 tablet_bootstrap.cc:492] T a375114bebc64385827b7b6e0060d1e4 P 185c63f61a2645928eeb807d145026b1: Bootstrap starting.
I20260203 21:10:29.663758 3406 tablet_bootstrap.cc:654] T a375114bebc64385827b7b6e0060d1e4 P 6d9e0cecab784cc0acc050ca1c89c5be: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:29.664309 3411 tablet_bootstrap.cc:654] T a375114bebc64385827b7b6e0060d1e4 P 185c63f61a2645928eeb807d145026b1: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:29.664638 3284 raft_consensus.cc:493] T ba8723a952564816a5c1f7945c448db9 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 21:10:29.664722 3284 raft_consensus.cc:515] T ba8723a952564816a5c1f7945c448db9 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } }
I20260203 21:10:29.665246 3284 leader_election.cc:290] T ba8723a952564816a5c1f7945c448db9 P 6d9e0cecab784cc0acc050ca1c89c5be [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223), 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335)
I20260203 21:10:29.665488 3059 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ba8723a952564816a5c1f7945c448db9" candidate_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "185c63f61a2645928eeb807d145026b1" is_pre_election: true
I20260203 21:10:29.665973 2785 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ba8723a952564816a5c1f7945c448db9" candidate_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02bdf326542e474cbe62434dd59087dc" is_pre_election: true
I20260203 21:10:29.666117 2785 raft_consensus.cc:2393] T ba8723a952564816a5c1f7945c448db9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d9e0cecab784cc0acc050ca1c89c5be in current term 1: Already voted for candidate 185c63f61a2645928eeb807d145026b1 in this term.
I20260203 21:10:29.666432 3194 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260: Sending DeleteTablet for 3 replicas of tablet 8672a1e59caf4f70830d7cdac01f36cd
I20260203 21:10:29.666747 3194 catalog_manager.cc:6724] ReplaceTablet: tablet 8672a1e59caf4f70830d7cdac01f36cd deleted and replaced by tablet 739e31c065d94d7badfe9097b04ca0a9
I20260203 21:10:29.666867 2897 tablet_service.cc:1552] Processing DeleteTablet for tablet 8672a1e59caf4f70830d7cdac01f36cd with delete_type TABLET_DATA_DELETED (replaced by tablet 739e31c065d94d7badfe9097b04ca0a9) from {username='slave'} at 127.0.0.1:51090
I20260203 21:10:29.666992 2765 tablet_service.cc:1552] Processing DeleteTablet for tablet 8672a1e59caf4f70830d7cdac01f36cd with delete_type TABLET_DATA_DELETED (replaced by tablet 739e31c065d94d7badfe9097b04ca0a9) from {username='slave'} at 127.0.0.1:59654
I20260203 21:10:29.667037 3405 tablet_replica.cc:333] T 8672a1e59caf4f70830d7cdac01f36cd P 6d9e0cecab784cc0acc050ca1c89c5be: stopping tablet replica
I20260203 21:10:29.667145 3403 tablet_replica.cc:333] T 8672a1e59caf4f70830d7cdac01f36cd P 02bdf326542e474cbe62434dd59087dc: stopping tablet replica
I20260203 21:10:29.667152 3405 raft_consensus.cc:2243] T 8672a1e59caf4f70830d7cdac01f36cd P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 21:10:29.667241 3403 raft_consensus.cc:2243] T 8672a1e59caf4f70830d7cdac01f36cd P 02bdf326542e474cbe62434dd59087dc [term 1 LEADER]: Raft consensus shutting down.
I20260203 21:10:29.667250 3405 raft_consensus.cc:2272] T 8672a1e59caf4f70830d7cdac01f36cd P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 21:10:29.667418 3403 raft_consensus.cc:2272] T 8672a1e59caf4f70830d7cdac01f36cd P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 21:10:29.667384 3194 catalog_manager.cc:5654] T 8df16fd039bf4d9b91ee2e49151c18c2 P 02bdf326542e474cbe62434dd59087dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 02bdf326542e474cbe62434dd59087dc (127.2.32.129). New cstate: current_term: 1 leader_uuid: "02bdf326542e474cbe62434dd59087dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } health_report { overall_health: HEALTHY } } }
I20260203 21:10:29.667858 2857 leader_election.cc:304] T ba8723a952564816a5c1f7945c448db9 P 6d9e0cecab784cc0acc050ca1c89c5be [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d9e0cecab784cc0acc050ca1c89c5be; no voters: 02bdf326542e474cbe62434dd59087dc, 185c63f61a2645928eeb807d145026b1
I20260203 21:10:29.668087 3405 ts_tablet_manager.cc:1916] T 8672a1e59caf4f70830d7cdac01f36cd P 6d9e0cecab784cc0acc050ca1c89c5be: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260203 21:10:29.668116 3284 raft_consensus.cc:3060] T ba8723a952564816a5c1f7945c448db9 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:29.669080 3284 raft_consensus.cc:2749] T ba8723a952564816a5c1f7945c448db9 P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 21:10:29.670058 3405 ts_tablet_manager.cc:1929] T 8672a1e59caf4f70830d7cdac01f36cd P 6d9e0cecab784cc0acc050ca1c89c5be: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260203 21:10:29.670121 3405 log.cc:1199] T 8672a1e59caf4f70830d7cdac01f36cd P 6d9e0cecab784cc0acc050ca1c89c5be: Deleting WAL directory at /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-1/wal/wals/8672a1e59caf4f70830d7cdac01f36cd
I20260203 21:10:29.670336 3405 ts_tablet_manager.cc:1950] T 8672a1e59caf4f70830d7cdac01f36cd P 6d9e0cecab784cc0acc050ca1c89c5be: Deleting consensus metadata
I20260203 21:10:29.670945 3181 catalog_manager.cc:4985] TS 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): tablet 8672a1e59caf4f70830d7cdac01f36cd (table default.table_7e73ff80019543888e0b8afa9b7a6660 [id=82ec5c95acc84e509c0803db74b626b4]) successfully deleted
I20260203 21:10:29.671166 3403 ts_tablet_manager.cc:1916] T 8672a1e59caf4f70830d7cdac01f36cd P 02bdf326542e474cbe62434dd59087dc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260203 21:10:29.671600 3406 tablet_bootstrap.cc:492] T a375114bebc64385827b7b6e0060d1e4 P 6d9e0cecab784cc0acc050ca1c89c5be: No bootstrap required, opened a new log
I20260203 21:10:29.671727 3406 ts_tablet_manager.cc:1403] T a375114bebc64385827b7b6e0060d1e4 P 6d9e0cecab784cc0acc050ca1c89c5be: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20260203 21:10:29.672161 3406 raft_consensus.cc:359] T a375114bebc64385827b7b6e0060d1e4 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.672251 3406 raft_consensus.cc:385] T a375114bebc64385827b7b6e0060d1e4 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:29.672281 3406 raft_consensus.cc:740] T a375114bebc64385827b7b6e0060d1e4 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d9e0cecab784cc0acc050ca1c89c5be, State: Initialized, Role: FOLLOWER
I20260203 21:10:29.672394 3411 tablet_bootstrap.cc:492] T a375114bebc64385827b7b6e0060d1e4 P 185c63f61a2645928eeb807d145026b1: No bootstrap required, opened a new log
I20260203 21:10:29.672382 3406 consensus_queue.cc:260] T a375114bebc64385827b7b6e0060d1e4 P 6d9e0cecab784cc0acc050ca1c89c5be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.672468 3411 ts_tablet_manager.cc:1403] T a375114bebc64385827b7b6e0060d1e4 P 185c63f61a2645928eeb807d145026b1: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.000s
I20260203 21:10:29.672634 3406 ts_tablet_manager.cc:1434] T a375114bebc64385827b7b6e0060d1e4 P 6d9e0cecab784cc0acc050ca1c89c5be: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260203 21:10:29.672904 3411 raft_consensus.cc:359] T a375114bebc64385827b7b6e0060d1e4 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.672996 3411 raft_consensus.cc:385] T a375114bebc64385827b7b6e0060d1e4 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:29.673030 3411 raft_consensus.cc:740] T a375114bebc64385827b7b6e0060d1e4 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 185c63f61a2645928eeb807d145026b1, State: Initialized, Role: FOLLOWER
I20260203 21:10:29.673079 3403 ts_tablet_manager.cc:1929] T 8672a1e59caf4f70830d7cdac01f36cd P 02bdf326542e474cbe62434dd59087dc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260203 21:10:29.673131 3403 log.cc:1199] T 8672a1e59caf4f70830d7cdac01f36cd P 02bdf326542e474cbe62434dd59087dc: Deleting WAL directory at /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-0/wal/wals/8672a1e59caf4f70830d7cdac01f36cd
I20260203 21:10:29.673167 3411 consensus_queue.cc:260] T a375114bebc64385827b7b6e0060d1e4 P 185c63f61a2645928eeb807d145026b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.673337 3403 ts_tablet_manager.cc:1950] T 8672a1e59caf4f70830d7cdac01f36cd P 02bdf326542e474cbe62434dd59087dc: Deleting consensus metadata
I20260203 21:10:29.673432 3411 ts_tablet_manager.cc:1434] T a375114bebc64385827b7b6e0060d1e4 P 185c63f61a2645928eeb807d145026b1: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260203 21:10:29.674793 3179 catalog_manager.cc:4985] TS 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335): tablet 8672a1e59caf4f70830d7cdac01f36cd (table default.table_7e73ff80019543888e0b8afa9b7a6660 [id=82ec5c95acc84e509c0803db74b626b4]) successfully deleted
I20260203 21:10:29.675036 3039 tablet_service.cc:1552] Processing DeleteTablet for tablet 8672a1e59caf4f70830d7cdac01f36cd with delete_type TABLET_DATA_DELETED (replaced by tablet 739e31c065d94d7badfe9097b04ca0a9) from {username='slave'} at 127.0.0.1:59506
I20260203 21:10:29.675182 3409 tablet_replica.cc:333] T 8672a1e59caf4f70830d7cdac01f36cd P 185c63f61a2645928eeb807d145026b1: stopping tablet replica
I20260203 21:10:29.675277 3409 raft_consensus.cc:2243] T 8672a1e59caf4f70830d7cdac01f36cd P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 21:10:29.675377 3409 raft_consensus.cc:2272] T 8672a1e59caf4f70830d7cdac01f36cd P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 21:10:29.676292 3409 ts_tablet_manager.cc:1916] T 8672a1e59caf4f70830d7cdac01f36cd P 185c63f61a2645928eeb807d145026b1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260203 21:10:29.678196 3409 ts_tablet_manager.cc:1929] T 8672a1e59caf4f70830d7cdac01f36cd P 185c63f61a2645928eeb807d145026b1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260203 21:10:29.678261 3409 log.cc:1199] T 8672a1e59caf4f70830d7cdac01f36cd P 185c63f61a2645928eeb807d145026b1: Deleting WAL directory at /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-2/wal/wals/8672a1e59caf4f70830d7cdac01f36cd
I20260203 21:10:29.678481 3409 ts_tablet_manager.cc:1950] T 8672a1e59caf4f70830d7cdac01f36cd P 185c63f61a2645928eeb807d145026b1: Deleting consensus metadata
I20260203 21:10:29.679111 3180 catalog_manager.cc:4985] TS 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): tablet 8672a1e59caf4f70830d7cdac01f36cd (table default.table_7e73ff80019543888e0b8afa9b7a6660 [id=82ec5c95acc84e509c0803db74b626b4]) successfully deleted
I20260203 21:10:29.681630 3194 catalog_manager.cc:5746] TS 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335) does not have the latest schema for tablet a375114bebc64385827b7b6e0060d1e4 (table default.table_547d99db0d3043499a26ee8c6df4c443 [id=333213fed7234610bc20c7d92124182b]). Expected version 1 got 0
W20260203 21:10:29.682828 3194 catalog_manager.cc:5846] Failed to send AlterTable RPC for tablet a375114bebc64385827b7b6e0060d1e4 (table default.table_547d99db0d3043499a26ee8c6df4c443 [id=333213fed7234610bc20c7d92124182b], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet a375114bebc64385827b7b6e0060d1e4 consensus state has no leader
I20260203 21:10:29.687207 2765 tablet_service.cc:1505] Processing CreateTablet for tablet 739e31c065d94d7badfe9097b04ca0a9 (DEFAULT_TABLE table=default.table_7e73ff80019543888e0b8afa9b7a6660 [id=82ec5c95acc84e509c0803db74b626b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:29.687497 2765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 739e31c065d94d7badfe9097b04ca0a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:29.688037 3039 tablet_service.cc:1505] Processing CreateTablet for tablet 739e31c065d94d7badfe9097b04ca0a9 (DEFAULT_TABLE table=default.table_7e73ff80019543888e0b8afa9b7a6660 [id=82ec5c95acc84e509c0803db74b626b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:29.688278 3039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 739e31c065d94d7badfe9097b04ca0a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:29.689903 3404 tablet_bootstrap.cc:492] T 739e31c065d94d7badfe9097b04ca0a9 P 02bdf326542e474cbe62434dd59087dc: Bootstrap starting.
I20260203 21:10:29.690407 3194 catalog_manager.cc:5746] TS 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223) does not have the latest schema for tablet a375114bebc64385827b7b6e0060d1e4 (table default.table_547d99db0d3043499a26ee8c6df4c443 [id=333213fed7234610bc20c7d92124182b]). Expected version 1 got 0
I20260203 21:10:29.690910 3404 tablet_bootstrap.cc:654] T 739e31c065d94d7badfe9097b04ca0a9 P 02bdf326542e474cbe62434dd59087dc: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:29.691288 3194 catalog_manager.cc:5746] TS 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897) does not have the latest schema for tablet a375114bebc64385827b7b6e0060d1e4 (table default.table_547d99db0d3043499a26ee8c6df4c443 [id=333213fed7234610bc20c7d92124182b]). Expected version 1 got 0
I20260203 21:10:29.691607 3194 master_service.cc:954] ReplaceTablet: received request to replace tablet e540d65d585c4ba1bd1bfaf62ba41fb5 from {username='slave'} at 127.0.0.1:57412
I20260203 21:10:29.692296 3411 tablet_bootstrap.cc:492] T 739e31c065d94d7badfe9097b04ca0a9 P 185c63f61a2645928eeb807d145026b1: Bootstrap starting.
I20260203 21:10:29.693287 3411 tablet_bootstrap.cc:654] T 739e31c065d94d7badfe9097b04ca0a9 P 185c63f61a2645928eeb807d145026b1: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:29.694260 2897 tablet_service.cc:1505] Processing CreateTablet for tablet 739e31c065d94d7badfe9097b04ca0a9 (DEFAULT_TABLE table=default.table_7e73ff80019543888e0b8afa9b7a6660 [id=82ec5c95acc84e509c0803db74b626b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:29.694509 2897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 739e31c065d94d7badfe9097b04ca0a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:29.696197 3338 raft_consensus.cc:493] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 21:10:29.696290 3338 raft_consensus.cc:515] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.696717 3338 leader_election.cc:290] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
I20260203 21:10:29.697168 3059 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b20e604665624843b957080dc6016d78" candidate_uuid: "02bdf326542e474cbe62434dd59087dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "185c63f61a2645928eeb807d145026b1" is_pre_election: true
I20260203 21:10:29.697285 3059 raft_consensus.cc:2468] T b20e604665624843b957080dc6016d78 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02bdf326542e474cbe62434dd59087dc in term 0.
I20260203 21:10:29.697399 2922 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b20e604665624843b957080dc6016d78" candidate_uuid: "02bdf326542e474cbe62434dd59087dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" is_pre_election: true
I20260203 21:10:29.697512 2922 raft_consensus.cc:2468] T b20e604665624843b957080dc6016d78 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02bdf326542e474cbe62434dd59087dc in term 0.
I20260203 21:10:29.697557 2720 leader_election.cc:304] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc, 185c63f61a2645928eeb807d145026b1; no voters:
I20260203 21:10:29.697697 3338 raft_consensus.cc:2804] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 21:10:29.697746 3338 raft_consensus.cc:493] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 21:10:29.697782 3338 raft_consensus.cc:3060] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:29.698136 3411 tablet_bootstrap.cc:492] T 739e31c065d94d7badfe9097b04ca0a9 P 185c63f61a2645928eeb807d145026b1: No bootstrap required, opened a new log
I20260203 21:10:29.698208 3411 ts_tablet_manager.cc:1403] T 739e31c065d94d7badfe9097b04ca0a9 P 185c63f61a2645928eeb807d145026b1: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20260203 21:10:29.698666 3411 raft_consensus.cc:359] T 739e31c065d94d7badfe9097b04ca0a9 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.698766 3411 raft_consensus.cc:385] T 739e31c065d94d7badfe9097b04ca0a9 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:29.698812 3411 raft_consensus.cc:740] T 739e31c065d94d7badfe9097b04ca0a9 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 185c63f61a2645928eeb807d145026b1, State: Initialized, Role: FOLLOWER
I20260203 21:10:29.698930 3338 raft_consensus.cc:515] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.698963 3411 consensus_queue.cc:260] T 739e31c065d94d7badfe9097b04ca0a9 P 185c63f61a2645928eeb807d145026b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.699275 3338 leader_election.cc:290] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 1 election: Requested vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
I20260203 21:10:29.699740 3193 catalog_manager.cc:3485] renamed table default.table_800a192f4e9e4ca5806a324b36234706 [id=a995c742bb2942838a2385b05a4d4d57] in HMS: new name default.table_9f9f33407af144ea8957cb4f76b5ac87
I20260203 21:10:29.699859 3059 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b20e604665624843b957080dc6016d78" candidate_uuid: "02bdf326542e474cbe62434dd59087dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "185c63f61a2645928eeb807d145026b1"
I20260203 21:10:29.699954 3059 raft_consensus.cc:3060] T b20e604665624843b957080dc6016d78 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:29.700376 3411 ts_tablet_manager.cc:1434] T 739e31c065d94d7badfe9097b04ca0a9 P 185c63f61a2645928eeb807d145026b1: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260203 21:10:29.700807 3059 raft_consensus.cc:2468] T b20e604665624843b957080dc6016d78 P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02bdf326542e474cbe62434dd59087dc in term 1.
I20260203 21:10:29.701470 2720 leader_election.cc:304] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc, 185c63f61a2645928eeb807d145026b1; no voters:
I20260203 21:10:29.702868 3406 tablet_bootstrap.cc:492] T 739e31c065d94d7badfe9097b04ca0a9 P 6d9e0cecab784cc0acc050ca1c89c5be: Bootstrap starting.
I20260203 21:10:29.703189 2922 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b20e604665624843b957080dc6016d78" candidate_uuid: "02bdf326542e474cbe62434dd59087dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d9e0cecab784cc0acc050ca1c89c5be"
I20260203 21:10:29.703294 2922 raft_consensus.cc:3060] T b20e604665624843b957080dc6016d78 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:29.703936 3406 tablet_bootstrap.cc:654] T 739e31c065d94d7badfe9097b04ca0a9 P 6d9e0cecab784cc0acc050ca1c89c5be: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:29.704222 2922 raft_consensus.cc:2468] T b20e604665624843b957080dc6016d78 P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02bdf326542e474cbe62434dd59087dc in term 1.
I20260203 21:10:29.704937 3406 tablet_bootstrap.cc:492] T 739e31c065d94d7badfe9097b04ca0a9 P 6d9e0cecab784cc0acc050ca1c89c5be: No bootstrap required, opened a new log
I20260203 21:10:29.705072 3406 ts_tablet_manager.cc:1403] T 739e31c065d94d7badfe9097b04ca0a9 P 6d9e0cecab784cc0acc050ca1c89c5be: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260203 21:10:29.705523 3406 raft_consensus.cc:359] T 739e31c065d94d7badfe9097b04ca0a9 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.705654 3338 raft_consensus.cc:2804] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader election won for term 1
I20260203 21:10:29.705677 3406 raft_consensus.cc:385] T 739e31c065d94d7badfe9097b04ca0a9 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:29.705752 3338 raft_consensus.cc:697] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc [term 1 LEADER]: Becoming Leader. State: Replica: 02bdf326542e474cbe62434dd59087dc, State: Running, Role: LEADER
I20260203 21:10:29.705793 3406 raft_consensus.cc:740] T 739e31c065d94d7badfe9097b04ca0a9 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d9e0cecab784cc0acc050ca1c89c5be, State: Initialized, Role: FOLLOWER
I20260203 21:10:29.705891 3338 consensus_queue.cc:237] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.706080 3406 consensus_queue.cc:260] T 739e31c065d94d7badfe9097b04ca0a9 P 6d9e0cecab784cc0acc050ca1c89c5be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.709088 3406 ts_tablet_manager.cc:1434] T 739e31c065d94d7badfe9097b04ca0a9 P 6d9e0cecab784cc0acc050ca1c89c5be: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260203 21:10:29.713575 3404 tablet_bootstrap.cc:492] T 739e31c065d94d7badfe9097b04ca0a9 P 02bdf326542e474cbe62434dd59087dc: No bootstrap required, opened a new log
I20260203 21:10:29.713685 3404 ts_tablet_manager.cc:1403] T 739e31c065d94d7badfe9097b04ca0a9 P 02bdf326542e474cbe62434dd59087dc: Time spent bootstrapping tablet: real 0.024s user 0.001s sys 0.000s
I20260203 21:10:29.714206 3404 raft_consensus.cc:359] T 739e31c065d94d7badfe9097b04ca0a9 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.714323 3404 raft_consensus.cc:385] T 739e31c065d94d7badfe9097b04ca0a9 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:29.714370 3404 raft_consensus.cc:740] T 739e31c065d94d7badfe9097b04ca0a9 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02bdf326542e474cbe62434dd59087dc, State: Initialized, Role: FOLLOWER
I20260203 21:10:29.714543 3404 consensus_queue.cc:260] T 739e31c065d94d7badfe9097b04ca0a9 P 02bdf326542e474cbe62434dd59087dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.714860 3404 ts_tablet_manager.cc:1434] T 739e31c065d94d7badfe9097b04ca0a9 P 02bdf326542e474cbe62434dd59087dc: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260203 21:10:29.715167 3194 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260: Sending DeleteTablet for 3 replicas of tablet e540d65d585c4ba1bd1bfaf62ba41fb5
I20260203 21:10:29.716464 2765 tablet_service.cc:1552] Processing DeleteTablet for tablet e540d65d585c4ba1bd1bfaf62ba41fb5 with delete_type TABLET_DATA_DELETED (replaced by tablet 387f8e87a39f402e9a6416d5408427df) from {username='slave'} at 127.0.0.1:59654
I20260203 21:10:29.717607 3194 catalog_manager.cc:6724] ReplaceTablet: tablet e540d65d585c4ba1bd1bfaf62ba41fb5 deleted and replaced by tablet 387f8e87a39f402e9a6416d5408427df
I20260203 21:10:29.717870 3039 tablet_service.cc:1552] Processing DeleteTablet for tablet e540d65d585c4ba1bd1bfaf62ba41fb5 with delete_type TABLET_DATA_DELETED (replaced by tablet 387f8e87a39f402e9a6416d5408427df) from {username='slave'} at 127.0.0.1:59506
I20260203 21:10:29.718055 3409 tablet_replica.cc:333] T e540d65d585c4ba1bd1bfaf62ba41fb5 P 185c63f61a2645928eeb807d145026b1: stopping tablet replica
I20260203 21:10:29.718181 3409 raft_consensus.cc:2243] T e540d65d585c4ba1bd1bfaf62ba41fb5 P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 21:10:29.718297 3409 raft_consensus.cc:2272] T e540d65d585c4ba1bd1bfaf62ba41fb5 P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 21:10:29.718564 3194 catalog_manager.cc:5746] TS 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223) does not have the latest schema for tablet 739e31c065d94d7badfe9097b04ca0a9 (table default.table_7e73ff80019543888e0b8afa9b7a6660 [id=82ec5c95acc84e509c0803db74b626b4]). Expected version 1 got 0
W20260203 21:10:29.718881 3194 catalog_manager.cc:5846] Failed to send AlterTable RPC for tablet 739e31c065d94d7badfe9097b04ca0a9 (table default.table_7e73ff80019543888e0b8afa9b7a6660 [id=82ec5c95acc84e509c0803db74b626b4], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 739e31c065d94d7badfe9097b04ca0a9 consensus state has no leader
I20260203 21:10:29.718919 3409 ts_tablet_manager.cc:1916] T e540d65d585c4ba1bd1bfaf62ba41fb5 P 185c63f61a2645928eeb807d145026b1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260203 21:10:29.719487 3194 catalog_manager.cc:5746] TS 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897) does not have the latest schema for tablet 739e31c065d94d7badfe9097b04ca0a9 (table default.table_7e73ff80019543888e0b8afa9b7a6660 [id=82ec5c95acc84e509c0803db74b626b4]). Expected version 1 got 0
I20260203 21:10:29.720283 3194 catalog_manager.cc:5654] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 02bdf326542e474cbe62434dd59087dc (127.2.32.129). New cstate: current_term: 1 leader_uuid: "02bdf326542e474cbe62434dd59087dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } health_report { overall_health: HEALTHY } } }
I20260203 21:10:29.729101 3409 ts_tablet_manager.cc:1929] T e540d65d585c4ba1bd1bfaf62ba41fb5 P 185c63f61a2645928eeb807d145026b1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260203 21:10:29.729189 3409 log.cc:1199] T e540d65d585c4ba1bd1bfaf62ba41fb5 P 185c63f61a2645928eeb807d145026b1: Deleting WAL directory at /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-2/wal/wals/e540d65d585c4ba1bd1bfaf62ba41fb5
I20260203 21:10:29.729431 3409 ts_tablet_manager.cc:1950] T e540d65d585c4ba1bd1bfaf62ba41fb5 P 185c63f61a2645928eeb807d145026b1: Deleting consensus metadata
I20260203 21:10:29.730064 2897 tablet_service.cc:1552] Processing DeleteTablet for tablet e540d65d585c4ba1bd1bfaf62ba41fb5 with delete_type TABLET_DATA_DELETED (replaced by tablet 387f8e87a39f402e9a6416d5408427df) from {username='slave'} at 127.0.0.1:51090
I20260203 21:10:29.730085 3180 catalog_manager.cc:4985] TS 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): tablet e540d65d585c4ba1bd1bfaf62ba41fb5 (table default.table_b7c2ca72f69c49a0b39163d2fcb69341 [id=467e79ec835d45669e3155e07b8ba81f]) successfully deleted
I20260203 21:10:29.730262 3405 tablet_replica.cc:333] T e540d65d585c4ba1bd1bfaf62ba41fb5 P 6d9e0cecab784cc0acc050ca1c89c5be: stopping tablet replica
I20260203 21:10:29.730391 3405 raft_consensus.cc:2243] T e540d65d585c4ba1bd1bfaf62ba41fb5 P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 LEADER]: Raft consensus shutting down.
I20260203 21:10:29.730590 3405 raft_consensus.cc:2272] T e540d65d585c4ba1bd1bfaf62ba41fb5 P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 21:10:29.730624 3403 tablet_replica.cc:333] T e540d65d585c4ba1bd1bfaf62ba41fb5 P 02bdf326542e474cbe62434dd59087dc: stopping tablet replica
I20260203 21:10:29.730865 3403 raft_consensus.cc:2243] T e540d65d585c4ba1bd1bfaf62ba41fb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 21:10:29.731112 3403 raft_consensus.cc:2272] T e540d65d585c4ba1bd1bfaf62ba41fb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 21:10:29.731175 3405 ts_tablet_manager.cc:1916] T e540d65d585c4ba1bd1bfaf62ba41fb5 P 6d9e0cecab784cc0acc050ca1c89c5be: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260203 21:10:29.730985 3338 raft_consensus.cc:493] T 2f8e36b89ebf456d964c9a31f7c7636a P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 21:10:29.731694 3338 raft_consensus.cc:515] T 2f8e36b89ebf456d964c9a31f7c7636a P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:29.732118 3338 leader_election.cc:290] T 2f8e36b89ebf456d964c9a31f7c7636a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
I20260203 21:10:29.732645 3403 ts_tablet_manager.cc:1916] T e540d65d585c4ba1bd1bfaf62ba41fb5 P 02bdf326542e474cbe62434dd59087dc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260203 21:10:29.733458 3059 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f8e36b89ebf456d964c9a31f7c7636a" candidate_uuid: "02bdf326542e474cbe62434dd59087dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "185c63f61a2645928eeb807d145026b1" is_pre_election: true
I20260203 21:10:29.733585 3059 raft_consensus.cc:2468] T 2f8e36b89ebf456d964c9a31f7c7636a P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02bdf326542e474cbe62434dd59087dc in term 0.
I20260203 21:10:29.733999 2922 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f8e36b89ebf456d964c9a31f7c7636a" candidate_uuid: "02bdf326542e474cbe62434dd59087dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" is_pre_election: true
I20260203 21:10:29.734088 2720 leader_election.cc:304] T 2f8e36b89ebf456d964c9a31f7c7636a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc, 185c63f61a2645928eeb807d145026b1; no voters:
I20260203 21:10:29.734144 2922 raft_consensus.cc:2468] T 2f8e36b89ebf456d964c9a31f7c7636a P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02bdf326542e474cbe62434dd59087dc in term 0.
I20260203 21:10:29.734452 3405 ts_tablet_manager.cc:1929] T e540d65d585c4ba1bd1bfaf62ba41fb5 P 6d9e0cecab784cc0acc050ca1c89c5be: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260203 21:10:29.734508 3405 log.cc:1199] T e540d65d585c4ba1bd1bfaf62ba41fb5 P 6d9e0cecab784cc0acc050ca1c89c5be: Deleting WAL directory at /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-1/wal/wals/e540d65d585c4ba1bd1bfaf62ba41fb5
I20260203 21:10:29.734714 3405 ts_tablet_manager.cc:1950] T e540d65d585c4ba1bd1bfaf62ba41fb5 P 6d9e0cecab784cc0acc050ca1c89c5be: Deleting consensus metadata
I20260203 21:10:29.735489 3181 catalog_manager.cc:4985] TS 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): tablet e540d65d585c4ba1bd1bfaf62ba41fb5 (table default.table_b7c2ca72f69c49a0b39163d2fcb69341 [id=467e79ec835d45669e3155e07b8ba81f]) successfully deleted
I20260203 21:10:29.735536 3403 ts_tablet_manager.cc:1929] T e540d65d585c4ba1bd1bfaf62ba41fb5 P 02bdf326542e474cbe62434dd59087dc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260203 21:10:29.735699 3403 log.cc:1199] T e540d65d585c4ba1bd1bfaf62ba41fb5 P 02bdf326542e474cbe62434dd59087dc: Deleting WAL directory at /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-0/wal/wals/e540d65d585c4ba1bd1bfaf62ba41fb5
I20260203 21:10:29.735730 3338 raft_consensus.cc:2804] T 2f8e36b89ebf456d964c9a31f7c7636a P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 21:10:29.735816 3338 raft_consensus.cc:493] T 2f8e36b89ebf456d964c9a31f7c7636a P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 21:10:29.735863 3338 raft_consensus.cc:3060] T 2f8e36b89ebf456d964c9a31f7c7636a P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:29.736094 3403 ts_tablet_manager.cc:1950] T e540d65d585c4ba1bd1bfaf62ba41fb5 P 02bdf326542e474cbe62434dd59087dc: Deleting consensus metadata
I20260203 21:10:29.736668 3179 catalog_manager.cc:4985] TS 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335): tablet e540d65d585c4ba1bd1bfaf62ba41fb5 (table default.table_b7c2ca72f69c49a0b39163d2fcb69341 [id=467e79ec835d45669e3155e07b8ba81f]) successfully deleted
I20260203 21:10:29.736871 3338 raft_consensus.cc:515] T 2f8e36b89ebf456d964c9a31f7c7636a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:29.737468 2922 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f8e36b89ebf456d964c9a31f7c7636a" candidate_uuid: "02bdf326542e474cbe62434dd59087dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d9e0cecab784cc0acc050ca1c89c5be"
I20260203 21:10:29.737564 2922 raft_consensus.cc:3060] T 2f8e36b89ebf456d964c9a31f7c7636a P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:29.737727 3059 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f8e36b89ebf456d964c9a31f7c7636a" candidate_uuid: "02bdf326542e474cbe62434dd59087dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "185c63f61a2645928eeb807d145026b1"
I20260203 21:10:29.737828 3059 raft_consensus.cc:3060] T 2f8e36b89ebf456d964c9a31f7c7636a P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:29.738389 2922 raft_consensus.cc:2468] T 2f8e36b89ebf456d964c9a31f7c7636a P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02bdf326542e474cbe62434dd59087dc in term 1.
I20260203 21:10:29.738696 3059 raft_consensus.cc:2468] T 2f8e36b89ebf456d964c9a31f7c7636a P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02bdf326542e474cbe62434dd59087dc in term 1.
I20260203 21:10:29.739850 2721 leader_election.cc:304] T 2f8e36b89ebf456d964c9a31f7c7636a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc, 6d9e0cecab784cc0acc050ca1c89c5be; no voters:
I20260203 21:10:29.739992 3282 raft_consensus.cc:2804] T 2f8e36b89ebf456d964c9a31f7c7636a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader election won for term 1
I20260203 21:10:29.740067 3282 raft_consensus.cc:697] T 2f8e36b89ebf456d964c9a31f7c7636a P 02bdf326542e474cbe62434dd59087dc [term 1 LEADER]: Becoming Leader. State: Replica: 02bdf326542e474cbe62434dd59087dc, State: Running, Role: LEADER
I20260203 21:10:29.740177 3282 consensus_queue.cc:237] T 2f8e36b89ebf456d964c9a31f7c7636a P 02bdf326542e474cbe62434dd59087dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:29.744638 3194 catalog_manager.cc:5746] TS 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223) does not have the latest schema for tablet 739e31c065d94d7badfe9097b04ca0a9 (table default.table_7e73ff80019543888e0b8afa9b7a6660 [id=82ec5c95acc84e509c0803db74b626b4]). Expected version 1 got 0
I20260203 21:10:29.745563 3039 tablet_service.cc:1505] Processing CreateTablet for tablet 387f8e87a39f402e9a6416d5408427df (DEFAULT_TABLE table=default.table_b7c2ca72f69c49a0b39163d2fcb69341 [id=467e79ec835d45669e3155e07b8ba81f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:29.745613 2897 tablet_service.cc:1505] Processing CreateTablet for tablet 387f8e87a39f402e9a6416d5408427df (DEFAULT_TABLE table=default.table_b7c2ca72f69c49a0b39163d2fcb69341 [id=467e79ec835d45669e3155e07b8ba81f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:29.745600 2765 tablet_service.cc:1505] Processing CreateTablet for tablet 387f8e87a39f402e9a6416d5408427df (DEFAULT_TABLE table=default.table_b7c2ca72f69c49a0b39163d2fcb69341 [id=467e79ec835d45669e3155e07b8ba81f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:29.745829 3039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 387f8e87a39f402e9a6416d5408427df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:29.745828 2897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 387f8e87a39f402e9a6416d5408427df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:29.745844 2765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 387f8e87a39f402e9a6416d5408427df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:29.747583 3404 tablet_bootstrap.cc:492] T 387f8e87a39f402e9a6416d5408427df P 02bdf326542e474cbe62434dd59087dc: Bootstrap starting.
I20260203 21:10:29.747988 3406 tablet_bootstrap.cc:492] T 387f8e87a39f402e9a6416d5408427df P 6d9e0cecab784cc0acc050ca1c89c5be: Bootstrap starting.
I20260203 21:10:29.748594 3404 tablet_bootstrap.cc:654] T 387f8e87a39f402e9a6416d5408427df P 02bdf326542e474cbe62434dd59087dc: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:29.748814 3194 catalog_manager.cc:5746] TS 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897) does not have the latest schema for tablet 739e31c065d94d7badfe9097b04ca0a9 (table default.table_7e73ff80019543888e0b8afa9b7a6660 [id=82ec5c95acc84e509c0803db74b626b4]). Expected version 1 got 0
I20260203 21:10:29.749008 3406 tablet_bootstrap.cc:654] T 387f8e87a39f402e9a6416d5408427df P 6d9e0cecab784cc0acc050ca1c89c5be: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:29.749212 3411 tablet_bootstrap.cc:492] T 387f8e87a39f402e9a6416d5408427df P 185c63f61a2645928eeb807d145026b1: Bootstrap starting.
I20260203 21:10:29.749500 3191 catalog_manager.cc:2731] deleted HMS catalog entry for table default.table_66c508c8dbdd4e7ea9283cabe65b62c0 [id=b62df06982124a70936068823e4b2324]
I20260203 21:10:29.749817 3194 catalog_manager.cc:5746] TS 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335) does not have the latest schema for tablet 739e31c065d94d7badfe9097b04ca0a9 (table default.table_7e73ff80019543888e0b8afa9b7a6660 [id=82ec5c95acc84e509c0803db74b626b4]). Expected version 1 got 0
I20260203 21:10:29.750034 3338 leader_election.cc:290] T 2f8e36b89ebf456d964c9a31f7c7636a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 1 election: Requested vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
I20260203 21:10:29.750167 3194 master_service.cc:954] ReplaceTablet: received request to replace tablet eb6a21a5b1ee454691237d0b160c9a3c from {username='slave'} at 127.0.0.1:57412
I20260203 21:10:29.750226 3411 tablet_bootstrap.cc:654] T 387f8e87a39f402e9a6416d5408427df P 185c63f61a2645928eeb807d145026b1: Neither blocks nor log segments found. Creating new log.
F20260203 21:10:29.753141 3248 hms_notification_log_listener.cc:287] non-monotonous event IDs from HMS: current 22, previous 22; dumping first 2 out of 12 received events: NotificationEvent(eventId=22, eventTime=1770153029, eventType=DROP_TABLE, dbName=default, tableName=table_76bef700d9b64243b6b4e93ffbc64f7a, message={"server":"","servicePrincipal":"","db":"default","table":"table_76bef700d9b64243b6b4e93ffbc64f7a","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_76bef700d9b64243b6b4e93ffbc64f7a\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1770153028},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/warehouse/table_76bef700d9b64243b6b4e93ffbc64f7a\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_76bef700d9b64243b6b4e93ffbc64f7a\",\"kudu.table_id\":\"f6e23f2505784c6f98a18a43b9917c06\",\"transient_lastDdlTime\":\"1770153028\",\"comment\":\"\",\"kudu.master_addresses\":\"127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"f46367a11713484f92c1d2be2585f5a6\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1770153029}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=22, eventTime=1770153029, eventType=CREATE_TABLE, dbName=default, tableName=table_4f93e096d30349908a32a33e024543d6, message={"server":"","servicePrincipal":"","db":"default","table":"table_4f93e096d30349908a32a33e024543d6","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_4f93e096d30349908a32a33e024543d6\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1770153029},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/warehouse/table_4f93e096d30349908a32a33e024543d6\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_4f93e096d30349908a32a33e024543d6\",\"kudu.table_id\":\"fa8fb788ff754fcd8641964a9d894664\",\"transient_lastDdlTime\":\"1770153029\",\"comment\":\"\",\"kudu.master_addresses\":\"127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"f46367a11713484f92c1d2be2585f5a6\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1770153029,"files":[]}, messageFormat=json-0.2, catName=hive);
*** Check failure stack trace: ***
I20260203 21:10:29.755595 3406 tablet_bootstrap.cc:492] T 387f8e87a39f402e9a6416d5408427df P 6d9e0cecab784cc0acc050ca1c89c5be: No bootstrap required, opened a new log
I20260203 21:10:29.755708 3406 ts_tablet_manager.cc:1403] T 387f8e87a39f402e9a6416d5408427df P 6d9e0cecab784cc0acc050ca1c89c5be: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20260203 21:10:29.755999 3194 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260: Sending DeleteTablet for 3 replicas of tablet eb6a21a5b1ee454691237d0b160c9a3c
I20260203 21:10:29.756177 3411 tablet_bootstrap.cc:492] T 387f8e87a39f402e9a6416d5408427df P 185c63f61a2645928eeb807d145026b1: No bootstrap required, opened a new log
I20260203 21:10:29.756158 3406 raft_consensus.cc:359] T 387f8e87a39f402e9a6416d5408427df P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.756258 3406 raft_consensus.cc:385] T 387f8e87a39f402e9a6416d5408427df P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:29.756261 3411 ts_tablet_manager.cc:1403] T 387f8e87a39f402e9a6416d5408427df P 185c63f61a2645928eeb807d145026b1: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.001s
I20260203 21:10:29.756299 3406 raft_consensus.cc:740] T 387f8e87a39f402e9a6416d5408427df P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d9e0cecab784cc0acc050ca1c89c5be, State: Initialized, Role: FOLLOWER
I20260203 21:10:29.756419 3406 consensus_queue.cc:260] T 387f8e87a39f402e9a6416d5408427df P 6d9e0cecab784cc0acc050ca1c89c5be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.756669 3406 ts_tablet_manager.cc:1434] T 387f8e87a39f402e9a6416d5408427df P 6d9e0cecab784cc0acc050ca1c89c5be: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260203 21:10:29.756688 3411 raft_consensus.cc:359] T 387f8e87a39f402e9a6416d5408427df P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.756772 3411 raft_consensus.cc:385] T 387f8e87a39f402e9a6416d5408427df P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:29.756800 3411 raft_consensus.cc:740] T 387f8e87a39f402e9a6416d5408427df P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 185c63f61a2645928eeb807d145026b1, State: Initialized, Role: FOLLOWER
I20260203 21:10:29.756917 3411 consensus_queue.cc:260] T 387f8e87a39f402e9a6416d5408427df P 185c63f61a2645928eeb807d145026b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.756963 2897 tablet_service.cc:1552] Processing DeleteTablet for tablet eb6a21a5b1ee454691237d0b160c9a3c with delete_type TABLET_DATA_DELETED (replaced by tablet 06b80064d47349c2830718f553ba3d7d) from {username='slave'} at 127.0.0.1:51090
I20260203 21:10:29.757154 3039 tablet_service.cc:1552] Processing DeleteTablet for tablet eb6a21a5b1ee454691237d0b160c9a3c with delete_type TABLET_DATA_DELETED (replaced by tablet 06b80064d47349c2830718f553ba3d7d) from {username='slave'} at 127.0.0.1:59506
I20260203 21:10:29.757179 3411 ts_tablet_manager.cc:1434] T 387f8e87a39f402e9a6416d5408427df P 185c63f61a2645928eeb807d145026b1: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260203 21:10:29.757302 3409 tablet_replica.cc:333] T eb6a21a5b1ee454691237d0b160c9a3c P 185c63f61a2645928eeb807d145026b1: stopping tablet replica
I20260203 21:10:29.757402 3409 raft_consensus.cc:2243] T eb6a21a5b1ee454691237d0b160c9a3c P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 21:10:29.757491 3409 raft_consensus.cc:2272] T eb6a21a5b1ee454691237d0b160c9a3c P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 21:10:29.757679 3194 catalog_manager.cc:6724] ReplaceTablet: tablet eb6a21a5b1ee454691237d0b160c9a3c deleted and replaced by tablet 06b80064d47349c2830718f553ba3d7d
I20260203 21:10:29.757819 3409 ts_tablet_manager.cc:1916] T eb6a21a5b1ee454691237d0b160c9a3c P 185c63f61a2645928eeb807d145026b1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260203 21:10:29.758085 2765 tablet_service.cc:1552] Processing DeleteTablet for tablet eb6a21a5b1ee454691237d0b160c9a3c with delete_type TABLET_DATA_DELETED (replaced by tablet 06b80064d47349c2830718f553ba3d7d) from {username='slave'} at 127.0.0.1:59654
I20260203 21:10:29.758247 3403 tablet_replica.cc:333] T eb6a21a5b1ee454691237d0b160c9a3c P 02bdf326542e474cbe62434dd59087dc: stopping tablet replica
I20260203 21:10:29.758359 3403 raft_consensus.cc:2243] T eb6a21a5b1ee454691237d0b160c9a3c P 02bdf326542e474cbe62434dd59087dc [term 1 LEADER]: Raft consensus shutting down.
I20260203 21:10:29.758515 3403 raft_consensus.cc:2272] T eb6a21a5b1ee454691237d0b160c9a3c P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 21:10:29.758853 3403 ts_tablet_manager.cc:1916] T eb6a21a5b1ee454691237d0b160c9a3c P 02bdf326542e474cbe62434dd59087dc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260203 21:10:29.759444 3405 tablet_replica.cc:333] T eb6a21a5b1ee454691237d0b160c9a3c P 6d9e0cecab784cc0acc050ca1c89c5be: stopping tablet replica
I20260203 21:10:29.759562 3405 raft_consensus.cc:2243] T eb6a21a5b1ee454691237d0b160c9a3c P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 21:10:29.759653 3405 raft_consensus.cc:2272] T eb6a21a5b1ee454691237d0b160c9a3c P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 21:10:29.759996 3409 ts_tablet_manager.cc:1929] T eb6a21a5b1ee454691237d0b160c9a3c P 185c63f61a2645928eeb807d145026b1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260203 21:10:29.760053 3405 ts_tablet_manager.cc:1916] T eb6a21a5b1ee454691237d0b160c9a3c P 6d9e0cecab784cc0acc050ca1c89c5be: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260203 21:10:29.760076 3409 log.cc:1199] T eb6a21a5b1ee454691237d0b160c9a3c P 185c63f61a2645928eeb807d145026b1: Deleting WAL directory at /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-2/wal/wals/eb6a21a5b1ee454691237d0b160c9a3c
I20260203 21:10:29.760293 3409 ts_tablet_manager.cc:1950] T eb6a21a5b1ee454691237d0b160c9a3c P 185c63f61a2645928eeb807d145026b1: Deleting consensus metadata
I20260203 21:10:29.760705 3403 ts_tablet_manager.cc:1929] T eb6a21a5b1ee454691237d0b160c9a3c P 02bdf326542e474cbe62434dd59087dc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260203 21:10:29.760764 3403 log.cc:1199] T eb6a21a5b1ee454691237d0b160c9a3c P 02bdf326542e474cbe62434dd59087dc: Deleting WAL directory at /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-0/wal/wals/eb6a21a5b1ee454691237d0b160c9a3c
I20260203 21:10:29.760978 3403 ts_tablet_manager.cc:1950] T eb6a21a5b1ee454691237d0b160c9a3c P 02bdf326542e474cbe62434dd59087dc: Deleting consensus metadata
I20260203 21:10:29.760998 3180 catalog_manager.cc:4985] TS 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): tablet eb6a21a5b1ee454691237d0b160c9a3c (table default.table_66c508c8dbdd4e7ea9283cabe65b62c0 [id=b62df06982124a70936068823e4b2324]) successfully deleted
I20260203 21:10:29.761514 3179 catalog_manager.cc:4985] TS 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335): tablet eb6a21a5b1ee454691237d0b160c9a3c (table default.table_66c508c8dbdd4e7ea9283cabe65b62c0 [id=b62df06982124a70936068823e4b2324]) successfully deleted
I20260203 21:10:29.761840 3405 ts_tablet_manager.cc:1929] T eb6a21a5b1ee454691237d0b160c9a3c P 6d9e0cecab784cc0acc050ca1c89c5be: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260203 21:10:29.761898 3405 log.cc:1199] T eb6a21a5b1ee454691237d0b160c9a3c P 6d9e0cecab784cc0acc050ca1c89c5be: Deleting WAL directory at /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-1/wal/wals/eb6a21a5b1ee454691237d0b160c9a3c
I20260203 21:10:29.761976 3404 tablet_bootstrap.cc:492] T 387f8e87a39f402e9a6416d5408427df P 02bdf326542e474cbe62434dd59087dc: No bootstrap required, opened a new log
I20260203 21:10:29.762068 3404 ts_tablet_manager.cc:1403] T 387f8e87a39f402e9a6416d5408427df P 02bdf326542e474cbe62434dd59087dc: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.000s
I20260203 21:10:29.762108 3405 ts_tablet_manager.cc:1950] T eb6a21a5b1ee454691237d0b160c9a3c P 6d9e0cecab784cc0acc050ca1c89c5be: Deleting consensus metadata
I20260203 21:10:29.762507 3404 raft_consensus.cc:359] T 387f8e87a39f402e9a6416d5408427df P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.762607 3404 raft_consensus.cc:385] T 387f8e87a39f402e9a6416d5408427df P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:29.762638 3404 raft_consensus.cc:740] T 387f8e87a39f402e9a6416d5408427df P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02bdf326542e474cbe62434dd59087dc, State: Initialized, Role: FOLLOWER
I20260203 21:10:29.762737 3404 consensus_queue.cc:260] T 387f8e87a39f402e9a6416d5408427df P 02bdf326542e474cbe62434dd59087dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.762969 3404 ts_tablet_manager.cc:1434] T 387f8e87a39f402e9a6416d5408427df P 02bdf326542e474cbe62434dd59087dc: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260203 21:10:29.765322 3181 catalog_manager.cc:4985] TS 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): tablet eb6a21a5b1ee454691237d0b160c9a3c (table default.table_66c508c8dbdd4e7ea9283cabe65b62c0 [id=b62df06982124a70936068823e4b2324]) successfully deleted
I20260203 21:10:29.767937 2765 tablet_service.cc:1505] Processing CreateTablet for tablet 06b80064d47349c2830718f553ba3d7d (DEFAULT_TABLE table=default.table_66c508c8dbdd4e7ea9283cabe65b62c0 [id=b62df06982124a70936068823e4b2324]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:29.768046 3194 catalog_manager.cc:5654] T 2f8e36b89ebf456d964c9a31f7c7636a P 02bdf326542e474cbe62434dd59087dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 02bdf326542e474cbe62434dd59087dc (127.2.32.129). New cstate: current_term: 1 leader_uuid: "02bdf326542e474cbe62434dd59087dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } health_report { overall_health: UNKNOWN } } }
I20260203 21:10:29.768198 2765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06b80064d47349c2830718f553ba3d7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:29.770349 3039 tablet_service.cc:1505] Processing CreateTablet for tablet 06b80064d47349c2830718f553ba3d7d (DEFAULT_TABLE table=default.table_66c508c8dbdd4e7ea9283cabe65b62c0 [id=b62df06982124a70936068823e4b2324]), partition=RANGE (key) PARTITION UNBOUNDED
@ 0x7fe5d46d5dcd google::LogMessage::Fail() at ??:0
I20260203 21:10:29.770599 3039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06b80064d47349c2830718f553ba3d7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:29.771148 3404 tablet_bootstrap.cc:492] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc: Bootstrap starting.
I20260203 21:10:29.772101 3404 tablet_bootstrap.cc:654] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:29.772889 3411 tablet_bootstrap.cc:492] T 06b80064d47349c2830718f553ba3d7d P 185c63f61a2645928eeb807d145026b1: Bootstrap starting.
@ 0x7fe5d46d9b93 google::LogMessage::SendToLog() at ??:0
I20260203 21:10:29.773265 2897 tablet_service.cc:1505] Processing CreateTablet for tablet 06b80064d47349c2830718f553ba3d7d (DEFAULT_TABLE table=default.table_66c508c8dbdd4e7ea9283cabe65b62c0 [id=b62df06982124a70936068823e4b2324]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:29.773497 2897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06b80064d47349c2830718f553ba3d7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:29.773780 3411 tablet_bootstrap.cc:654] T 06b80064d47349c2830718f553ba3d7d P 185c63f61a2645928eeb807d145026b1: Neither blocks nor log segments found. Creating new log.
@ 0x7fe5d46d57cc google::LogMessage::Flush() at ??:0
I20260203 21:10:29.775156 3406 tablet_bootstrap.cc:492] T 06b80064d47349c2830718f553ba3d7d P 6d9e0cecab784cc0acc050ca1c89c5be: Bootstrap starting.
I20260203 21:10:29.776082 3406 tablet_bootstrap.cc:654] T 06b80064d47349c2830718f553ba3d7d P 6d9e0cecab784cc0acc050ca1c89c5be: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:29.777168 3404 tablet_bootstrap.cc:492] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc: No bootstrap required, opened a new log
I20260203 21:10:29.777240 3404 ts_tablet_manager.cc:1403] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20260203 21:10:29.777675 3404 raft_consensus.cc:359] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } }
I20260203 21:10:29.777769 3404 raft_consensus.cc:385] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:29.777812 3404 raft_consensus.cc:740] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02bdf326542e474cbe62434dd59087dc, State: Initialized, Role: FOLLOWER
I20260203 21:10:29.777918 3404 consensus_queue.cc:260] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } }
I20260203 21:10:29.778195 3404 ts_tablet_manager.cc:1434] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260203 21:10:29.779579 3194 catalog_manager.cc:5746] TS 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897) does not have the latest schema for tablet 387f8e87a39f402e9a6416d5408427df (table default.table_b7c2ca72f69c49a0b39163d2fcb69341 [id=467e79ec835d45669e3155e07b8ba81f]). Expected version 1 got 0
W20260203 21:10:29.779933 3194 catalog_manager.cc:5846] Failed to send AlterTable RPC for tablet 387f8e87a39f402e9a6416d5408427df (table default.table_b7c2ca72f69c49a0b39163d2fcb69341 [id=467e79ec835d45669e3155e07b8ba81f], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 387f8e87a39f402e9a6416d5408427df consensus state has no leader
I20260203 21:10:29.780202 3406 tablet_bootstrap.cc:492] T 06b80064d47349c2830718f553ba3d7d P 6d9e0cecab784cc0acc050ca1c89c5be: No bootstrap required, opened a new log
I20260203 21:10:29.780273 3406 ts_tablet_manager.cc:1403] T 06b80064d47349c2830718f553ba3d7d P 6d9e0cecab784cc0acc050ca1c89c5be: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.001s
I20260203 21:10:29.780527 3194 catalog_manager.cc:5746] TS 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223) does not have the latest schema for tablet 387f8e87a39f402e9a6416d5408427df (table default.table_b7c2ca72f69c49a0b39163d2fcb69341 [id=467e79ec835d45669e3155e07b8ba81f]). Expected version 1 got 0
I20260203 21:10:29.780682 3406 raft_consensus.cc:359] T 06b80064d47349c2830718f553ba3d7d P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } }
I20260203 21:10:29.780766 3406 raft_consensus.cc:385] T 06b80064d47349c2830718f553ba3d7d P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:29.780800 3406 raft_consensus.cc:740] T 06b80064d47349c2830718f553ba3d7d P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d9e0cecab784cc0acc050ca1c89c5be, State: Initialized, Role: FOLLOWER
I20260203 21:10:29.780943 3406 consensus_queue.cc:260] T 06b80064d47349c2830718f553ba3d7d P 6d9e0cecab784cc0acc050ca1c89c5be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } }
I20260203 21:10:29.781337 3194 catalog_manager.cc:5746] TS 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335) does not have the latest schema for tablet 387f8e87a39f402e9a6416d5408427df (table default.table_b7c2ca72f69c49a0b39163d2fcb69341 [id=467e79ec835d45669e3155e07b8ba81f]). Expected version 1 got 0
I20260203 21:10:29.781816 3194 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57412:
table { table_name: "default.Table_4c9a68305b5e4d4aa45e3a351c35eee7" } new_table_name: "default.Table_23a38bddaee24e5fa7bfe16e5af12fb5" modify_external_catalogs: true
I20260203 21:10:29.782652 3406 ts_tablet_manager.cc:1434] T 06b80064d47349c2830718f553ba3d7d P 6d9e0cecab784cc0acc050ca1c89c5be: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
@ 0x7fe5d46d5a11 google::LogMessage::~LogMessage() at ??:0
I20260203 21:10:29.785713 3411 tablet_bootstrap.cc:492] T 06b80064d47349c2830718f553ba3d7d P 185c63f61a2645928eeb807d145026b1: No bootstrap required, opened a new log
I20260203 21:10:29.785796 3411 ts_tablet_manager.cc:1403] T 06b80064d47349c2830718f553ba3d7d P 185c63f61a2645928eeb807d145026b1: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.000s
I20260203 21:10:29.786243 3411 raft_consensus.cc:359] T 06b80064d47349c2830718f553ba3d7d P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } }
I20260203 21:10:29.786330 3411 raft_consensus.cc:385] T 06b80064d47349c2830718f553ba3d7d P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:29.786351 3411 raft_consensus.cc:740] T 06b80064d47349c2830718f553ba3d7d P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 185c63f61a2645928eeb807d145026b1, State: Initialized, Role: FOLLOWER
I20260203 21:10:29.786449 3411 consensus_queue.cc:260] T 06b80064d47349c2830718f553ba3d7d P 185c63f61a2645928eeb807d145026b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } }
I20260203 21:10:29.786700 3411 ts_tablet_manager.cc:1434] T 06b80064d47349c2830718f553ba3d7d P 185c63f61a2645928eeb807d145026b1: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
@ 0x7fe5d984bef9 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
@ 0x7fe5d984ae10 kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
@ 0x7fe5d984a573 _ZZN4kudu6master30HmsNotificationLogListenerTask4InitEvENKUlvE_clEv at ??:0
@ 0x7fe5d984fc7a _ZNSt17_Function_handlerIFvvEZN4kudu6master30HmsNotificationLogListenerTask4InitEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x558a272baa0a std::function<>::operator()() at ??:0
@ 0x7fe5d5b2fb04 kudu::Thread::SuperviseThread() at ??:0
@ 0x7fe5d63c96db start_thread at ??:0
@ 0x7fe5d388c71f clone at ??:0
I20260203 21:10:29.804004 2178 external_mini_cluster.cc:1658] Killing /tmp/dist-test-task0vmSZW/build/debug/bin/kudu with pid 2421
I20260203 21:10:29.809484 3284 raft_consensus.cc:493] T a375114bebc64385827b7b6e0060d1e4 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 21:10:29.809599 3284 raft_consensus.cc:515] T a375114bebc64385827b7b6e0060d1e4 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.810035 3284 leader_election.cc:290] T a375114bebc64385827b7b6e0060d1e4 P 6d9e0cecab784cc0acc050ca1c89c5be [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223), 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335)
I20260203 21:10:29.810509 3059 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a375114bebc64385827b7b6e0060d1e4" candidate_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "185c63f61a2645928eeb807d145026b1" is_pre_election: true
I20260203 21:10:29.810640 3059 raft_consensus.cc:2468] T a375114bebc64385827b7b6e0060d1e4 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d9e0cecab784cc0acc050ca1c89c5be in term 0.
I20260203 21:10:29.810962 2858 leader_election.cc:304] T a375114bebc64385827b7b6e0060d1e4 P 6d9e0cecab784cc0acc050ca1c89c5be [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be; no voters:
I20260203 21:10:29.811228 2785 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a375114bebc64385827b7b6e0060d1e4" candidate_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02bdf326542e474cbe62434dd59087dc" is_pre_election: true
I20260203 21:10:29.811357 2785 raft_consensus.cc:2468] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d9e0cecab784cc0acc050ca1c89c5be in term 0.
I20260203 21:10:29.811801 3284 raft_consensus.cc:2804] T a375114bebc64385827b7b6e0060d1e4 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 21:10:29.811858 3284 raft_consensus.cc:493] T a375114bebc64385827b7b6e0060d1e4 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 21:10:29.811894 3284 raft_consensus.cc:3060] T a375114bebc64385827b7b6e0060d1e4 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:29.812898 3284 raft_consensus.cc:515] T a375114bebc64385827b7b6e0060d1e4 P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.813249 3284 leader_election.cc:290] T a375114bebc64385827b7b6e0060d1e4 P 6d9e0cecab784cc0acc050ca1c89c5be [CANDIDATE]: Term 1 election: Requested vote from peers 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223), 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335)
I20260203 21:10:29.813627 2785 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a375114bebc64385827b7b6e0060d1e4" candidate_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02bdf326542e474cbe62434dd59087dc"
I20260203 21:10:29.813740 2785 raft_consensus.cc:3060] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:29.813892 3059 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a375114bebc64385827b7b6e0060d1e4" candidate_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "185c63f61a2645928eeb807d145026b1"
I20260203 21:10:29.814074 3059 raft_consensus.cc:3060] T a375114bebc64385827b7b6e0060d1e4 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:29.814636 2785 raft_consensus.cc:2468] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d9e0cecab784cc0acc050ca1c89c5be in term 1.
I20260203 21:10:29.814898 2857 leader_election.cc:304] T a375114bebc64385827b7b6e0060d1e4 P 6d9e0cecab784cc0acc050ca1c89c5be [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc, 6d9e0cecab784cc0acc050ca1c89c5be; no voters:
I20260203 21:10:29.815052 3284 raft_consensus.cc:2804] T a375114bebc64385827b7b6e0060d1e4 P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 FOLLOWER]: Leader election won for term 1
I20260203 21:10:29.815120 3284 raft_consensus.cc:697] T a375114bebc64385827b7b6e0060d1e4 P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 LEADER]: Becoming Leader. State: Replica: 6d9e0cecab784cc0acc050ca1c89c5be, State: Running, Role: LEADER
I20260203 21:10:29.815282 3284 consensus_queue.cc:237] T a375114bebc64385827b7b6e0060d1e4 P 6d9e0cecab784cc0acc050ca1c89c5be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.815472 3059 raft_consensus.cc:2468] T a375114bebc64385827b7b6e0060d1e4 P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d9e0cecab784cc0acc050ca1c89c5be in term 1.
I20260203 21:10:29.819484 3310 raft_consensus.cc:493] T 739e31c065d94d7badfe9097b04ca0a9 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 21:10:29.819557 3310 raft_consensus.cc:515] T 739e31c065d94d7badfe9097b04ca0a9 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.819885 3310 leader_election.cc:290] T 739e31c065d94d7badfe9097b04ca0a9 P 6d9e0cecab784cc0acc050ca1c89c5be [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223), 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335)
I20260203 21:10:29.820191 3059 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "739e31c065d94d7badfe9097b04ca0a9" candidate_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "185c63f61a2645928eeb807d145026b1" is_pre_election: true
I20260203 21:10:29.820241 2785 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "739e31c065d94d7badfe9097b04ca0a9" candidate_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02bdf326542e474cbe62434dd59087dc" is_pre_election: true
I20260203 21:10:29.820300 3059 raft_consensus.cc:2468] T 739e31c065d94d7badfe9097b04ca0a9 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d9e0cecab784cc0acc050ca1c89c5be in term 0.
I20260203 21:10:29.820354 2785 raft_consensus.cc:2468] T 739e31c065d94d7badfe9097b04ca0a9 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d9e0cecab784cc0acc050ca1c89c5be in term 0.
I20260203 21:10:29.820597 2857 leader_election.cc:304] T 739e31c065d94d7badfe9097b04ca0a9 P 6d9e0cecab784cc0acc050ca1c89c5be [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc, 6d9e0cecab784cc0acc050ca1c89c5be; no voters:
I20260203 21:10:29.820742 3310 raft_consensus.cc:2804] T 739e31c065d94d7badfe9097b04ca0a9 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 21:10:29.820798 3310 raft_consensus.cc:493] T 739e31c065d94d7badfe9097b04ca0a9 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 21:10:29.820829 3310 raft_consensus.cc:3060] T 739e31c065d94d7badfe9097b04ca0a9 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:29.821483 3310 raft_consensus.cc:515] T 739e31c065d94d7badfe9097b04ca0a9 P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.821748 3310 leader_election.cc:290] T 739e31c065d94d7badfe9097b04ca0a9 P 6d9e0cecab784cc0acc050ca1c89c5be [CANDIDATE]: Term 1 election: Requested vote from peers 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223), 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335)
I20260203 21:10:29.822044 2785 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "739e31c065d94d7badfe9097b04ca0a9" candidate_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02bdf326542e474cbe62434dd59087dc"
I20260203 21:10:29.822060 3059 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "739e31c065d94d7badfe9097b04ca0a9" candidate_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "185c63f61a2645928eeb807d145026b1"
I20260203 21:10:29.822149 2785 raft_consensus.cc:3060] T 739e31c065d94d7badfe9097b04ca0a9 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:29.822182 3059 raft_consensus.cc:3060] T 739e31c065d94d7badfe9097b04ca0a9 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:29.822788 2785 raft_consensus.cc:2468] T 739e31c065d94d7badfe9097b04ca0a9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d9e0cecab784cc0acc050ca1c89c5be in term 1.
I20260203 21:10:29.823043 2857 leader_election.cc:304] T 739e31c065d94d7badfe9097b04ca0a9 P 6d9e0cecab784cc0acc050ca1c89c5be [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc, 6d9e0cecab784cc0acc050ca1c89c5be; no voters:
I20260203 21:10:29.823105 3059 raft_consensus.cc:2468] T 739e31c065d94d7badfe9097b04ca0a9 P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d9e0cecab784cc0acc050ca1c89c5be in term 1.
I20260203 21:10:29.823187 3310 raft_consensus.cc:2804] T 739e31c065d94d7badfe9097b04ca0a9 P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 FOLLOWER]: Leader election won for term 1
I20260203 21:10:29.823264 3310 raft_consensus.cc:697] T 739e31c065d94d7badfe9097b04ca0a9 P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 LEADER]: Becoming Leader. State: Replica: 6d9e0cecab784cc0acc050ca1c89c5be, State: Running, Role: LEADER
I20260203 21:10:29.823382 3310 consensus_queue.cc:237] T 739e31c065d94d7badfe9097b04ca0a9 P 6d9e0cecab784cc0acc050ca1c89c5be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.853878 3448 raft_consensus.cc:493] T 06b80064d47349c2830718f553ba3d7d P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 21:10:29.854017 3448 raft_consensus.cc:515] T 06b80064d47349c2830718f553ba3d7d P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } }
I20260203 21:10:29.854457 3448 leader_election.cc:290] T 06b80064d47349c2830718f553ba3d7d P 185c63f61a2645928eeb807d145026b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335), 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897)
I20260203 21:10:29.854920 2785 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "06b80064d47349c2830718f553ba3d7d" candidate_uuid: "185c63f61a2645928eeb807d145026b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02bdf326542e474cbe62434dd59087dc" is_pre_election: true
I20260203 21:10:29.854920 2922 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "06b80064d47349c2830718f553ba3d7d" candidate_uuid: "185c63f61a2645928eeb807d145026b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" is_pre_election: true
I20260203 21:10:29.855067 2922 raft_consensus.cc:2468] T 06b80064d47349c2830718f553ba3d7d P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 185c63f61a2645928eeb807d145026b1 in term 0.
I20260203 21:10:29.855075 2785 raft_consensus.cc:2468] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 185c63f61a2645928eeb807d145026b1 in term 0.
I20260203 21:10:29.855356 2995 leader_election.cc:304] T 06b80064d47349c2830718f553ba3d7d P 185c63f61a2645928eeb807d145026b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be; no voters:
I20260203 21:10:29.855558 3448 raft_consensus.cc:2804] T 06b80064d47349c2830718f553ba3d7d P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 21:10:29.855639 3448 raft_consensus.cc:493] T 06b80064d47349c2830718f553ba3d7d P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 21:10:29.855697 3448 raft_consensus.cc:3060] T 06b80064d47349c2830718f553ba3d7d P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:29.856768 3448 raft_consensus.cc:515] T 06b80064d47349c2830718f553ba3d7d P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } }
I20260203 21:10:29.857156 3448 leader_election.cc:290] T 06b80064d47349c2830718f553ba3d7d P 185c63f61a2645928eeb807d145026b1 [CANDIDATE]: Term 1 election: Requested vote from peers 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335), 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897)
I20260203 21:10:29.857451 2922 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "06b80064d47349c2830718f553ba3d7d" candidate_uuid: "185c63f61a2645928eeb807d145026b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d9e0cecab784cc0acc050ca1c89c5be"
I20260203 21:10:29.857482 2785 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "06b80064d47349c2830718f553ba3d7d" candidate_uuid: "185c63f61a2645928eeb807d145026b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02bdf326542e474cbe62434dd59087dc"
I20260203 21:10:29.857558 2922 raft_consensus.cc:3060] T 06b80064d47349c2830718f553ba3d7d P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:29.857590 2785 raft_consensus.cc:3060] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:29.858307 2922 raft_consensus.cc:2468] T 06b80064d47349c2830718f553ba3d7d P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 185c63f61a2645928eeb807d145026b1 in term 1.
I20260203 21:10:29.858492 2785 raft_consensus.cc:2468] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 185c63f61a2645928eeb807d145026b1 in term 1.
I20260203 21:10:29.858566 2995 leader_election.cc:304] T 06b80064d47349c2830718f553ba3d7d P 185c63f61a2645928eeb807d145026b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be; no voters:
I20260203 21:10:29.858726 3448 raft_consensus.cc:2804] T 06b80064d47349c2830718f553ba3d7d P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260203 21:10:29.858829 3448 raft_consensus.cc:697] T 06b80064d47349c2830718f553ba3d7d P 185c63f61a2645928eeb807d145026b1 [term 1 LEADER]: Becoming Leader. State: Replica: 185c63f61a2645928eeb807d145026b1, State: Running, Role: LEADER
I20260203 21:10:29.858968 3448 consensus_queue.cc:237] T 06b80064d47349c2830718f553ba3d7d P 185c63f61a2645928eeb807d145026b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } }
I20260203 21:10:29.922045 3338 raft_consensus.cc:493] T 387f8e87a39f402e9a6416d5408427df P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 21:10:29.922214 3338 raft_consensus.cc:515] T 387f8e87a39f402e9a6416d5408427df P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.922696 3338 leader_election.cc:290] T 387f8e87a39f402e9a6416d5408427df P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
I20260203 21:10:29.923074 2922 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "387f8e87a39f402e9a6416d5408427df" candidate_uuid: "02bdf326542e474cbe62434dd59087dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" is_pre_election: true
I20260203 21:10:29.923082 3059 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "387f8e87a39f402e9a6416d5408427df" candidate_uuid: "02bdf326542e474cbe62434dd59087dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "185c63f61a2645928eeb807d145026b1" is_pre_election: true
I20260203 21:10:29.923238 3059 raft_consensus.cc:2468] T 387f8e87a39f402e9a6416d5408427df P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02bdf326542e474cbe62434dd59087dc in term 0.
I20260203 21:10:29.923251 2922 raft_consensus.cc:2468] T 387f8e87a39f402e9a6416d5408427df P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02bdf326542e474cbe62434dd59087dc in term 0.
I20260203 21:10:29.923542 2721 leader_election.cc:304] T 387f8e87a39f402e9a6416d5408427df P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc, 6d9e0cecab784cc0acc050ca1c89c5be; no voters:
I20260203 21:10:29.923732 3338 raft_consensus.cc:2804] T 387f8e87a39f402e9a6416d5408427df P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 21:10:29.923794 3338 raft_consensus.cc:493] T 387f8e87a39f402e9a6416d5408427df P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 21:10:29.923830 3338 raft_consensus.cc:3060] T 387f8e87a39f402e9a6416d5408427df P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:29.924576 3338 raft_consensus.cc:515] T 387f8e87a39f402e9a6416d5408427df P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:29.924889 3338 leader_election.cc:290] T 387f8e87a39f402e9a6416d5408427df P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 1 election: Requested vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
I20260203 21:10:29.925186 2922 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "387f8e87a39f402e9a6416d5408427df" candidate_uuid: "02bdf326542e474cbe62434dd59087dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d9e0cecab784cc0acc050ca1c89c5be"
I20260203 21:10:29.925211 3059 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "387f8e87a39f402e9a6416d5408427df" candidate_uuid: "02bdf326542e474cbe62434dd59087dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "185c63f61a2645928eeb807d145026b1"
I20260203 21:10:29.925308 3059 raft_consensus.cc:3060] T 387f8e87a39f402e9a6416d5408427df P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:29.925307 2922 raft_consensus.cc:3060] T 387f8e87a39f402e9a6416d5408427df P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:29.926005 3059 raft_consensus.cc:2468] T 387f8e87a39f402e9a6416d5408427df P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02bdf326542e474cbe62434dd59087dc in term 1.
I20260203 21:10:29.926301 2922 raft_consensus.cc:2468] T 387f8e87a39f402e9a6416d5408427df P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02bdf326542e474cbe62434dd59087dc in term 1.
I20260203 21:10:29.926347 2720 leader_election.cc:304] T 387f8e87a39f402e9a6416d5408427df P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc, 185c63f61a2645928eeb807d145026b1; no voters:
I20260203 21:10:29.926537 3338 raft_consensus.cc:2804] T 387f8e87a39f402e9a6416d5408427df P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader election won for term 1
I20260203 21:10:29.926622 3338 raft_consensus.cc:697] T 387f8e87a39f402e9a6416d5408427df P 02bdf326542e474cbe62434dd59087dc [term 1 LEADER]: Becoming Leader. State: Replica: 02bdf326542e474cbe62434dd59087dc, State: Running, Role: LEADER
I20260203 21:10:29.926762 3338 consensus_queue.cc:237] T 387f8e87a39f402e9a6416d5408427df P 02bdf326542e474cbe62434dd59087dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
W20260203 21:10:29.974423 2718 connection.cc:537] client connection to 127.2.32.188:33665 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260203 21:10:29.974593 3112 connection.cc:537] client connection to 127.2.32.188:33665 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260203 21:10:30.018858 3499 consensus_queue.cc:1048] T 62542a22943242c7987cc65423f548b4 P 6d9e0cecab784cc0acc050ca1c89c5be [LEADER]: Connected to new peer: Peer: permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 21:10:30.021737 3499 consensus_queue.cc:1048] T 62542a22943242c7987cc65423f548b4 P 6d9e0cecab784cc0acc050ca1c89c5be [LEADER]: Connected to new peer: Peer: permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 21:10:30.056851 3448 consensus_queue.cc:1048] T 98cd2089483c4121944152e5cee8ca30 P 185c63f61a2645928eeb807d145026b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 21:10:30.057648 3499 consensus_queue.cc:1048] T 4de1de23650548c2a078b51c9bf4d031 P 6d9e0cecab784cc0acc050ca1c89c5be [LEADER]: Connected to new peer: Peer: permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 21:10:30.058830 3499 consensus_queue.cc:1048] T 4de1de23650548c2a078b51c9bf4d031 P 6d9e0cecab784cc0acc050ca1c89c5be [LEADER]: Connected to new peer: Peer: permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 21:10:30.062754 3340 consensus_queue.cc:1048] T 98cd2089483c4121944152e5cee8ca30 P 185c63f61a2645928eeb807d145026b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 21:10:30.088212 3338 consensus_queue.cc:1048] T 8df16fd039bf4d9b91ee2e49151c18c2 P 02bdf326542e474cbe62434dd59087dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 21:10:30.091150 3282 consensus_queue.cc:1048] T 8df16fd039bf4d9b91ee2e49151c18c2 P 02bdf326542e474cbe62434dd59087dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 21:10:30.093550 3340 consensus_queue.cc:1048] T ba8723a952564816a5c1f7945c448db9 P 185c63f61a2645928eeb807d145026b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 21:10:30.097975 3513 consensus_queue.cc:1048] T ba8723a952564816a5c1f7945c448db9 P 185c63f61a2645928eeb807d145026b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 21:10:30.137908 3338 consensus_queue.cc:1048] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 21:10:30.141418 3324 consensus_queue.cc:1048] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 21:10:30.260339 3284 consensus_queue.cc:1048] T a375114bebc64385827b7b6e0060d1e4 P 6d9e0cecab784cc0acc050ca1c89c5be [LEADER]: Connected to new peer: Peer: permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 21:10:30.264178 3284 consensus_queue.cc:1048] T a375114bebc64385827b7b6e0060d1e4 P 6d9e0cecab784cc0acc050ca1c89c5be [LEADER]: Connected to new peer: Peer: permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 21:10:30.281365 3513 consensus_queue.cc:1048] T 06b80064d47349c2830718f553ba3d7d P 185c63f61a2645928eeb807d145026b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 21:10:30.281605 3519 raft_consensus.cc:493] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8a7e51013f5041898fe34f4b64a59260)
I20260203 21:10:30.281708 3519 raft_consensus.cc:515] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:10:30.282229 3519 leader_election.cc:290] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419), 8a7e51013f5041898fe34f4b64a59260 (127.2.32.188:33665)
W20260203 21:10:30.284384 2507 leader_election.cc:336] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 8a7e51013f5041898fe34f4b64a59260 (127.2.32.188:33665): Network error: Client connection negotiation failed: client connection to 127.2.32.188:33665: connect: Connection refused (error 111)
W20260203 21:10:30.284744 2510 leader_election.cc:336] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419): Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111)
I20260203 21:10:30.284838 2510 leader_election.cc:304] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35397be7e61f4b27a49e9449b9fdf085; no voters: 7344d7cd8dea4fa2ae705320daacaf49, 8a7e51013f5041898fe34f4b64a59260
I20260203 21:10:30.285112 3519 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260203 21:10:30.285590 3524 consensus_queue.cc:1048] T 06b80064d47349c2830718f553ba3d7d P 185c63f61a2645928eeb807d145026b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 21:10:30.299705 3324 consensus_queue.cc:1048] T 2f8e36b89ebf456d964c9a31f7c7636a P 02bdf326542e474cbe62434dd59087dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 21:10:30.303340 3282 consensus_queue.cc:1048] T 2f8e36b89ebf456d964c9a31f7c7636a P 02bdf326542e474cbe62434dd59087dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 21:10:30.306384 3284 consensus_queue.cc:1048] T 739e31c065d94d7badfe9097b04ca0a9 P 6d9e0cecab784cc0acc050ca1c89c5be [LEADER]: Connected to new peer: Peer: permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 21:10:30.309782 3284 consensus_queue.cc:1048] T 739e31c065d94d7badfe9097b04ca0a9 P 6d9e0cecab784cc0acc050ca1c89c5be [LEADER]: Connected to new peer: Peer: permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 21:10:30.315337 3282 consensus_queue.cc:1048] T 387f8e87a39f402e9a6416d5408427df P 02bdf326542e474cbe62434dd59087dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 21:10:30.318465 3282 consensus_queue.cc:1048] T 387f8e87a39f402e9a6416d5408427df P 02bdf326542e474cbe62434dd59087dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 21:10:30.627743 2489 master_runner.cc:186] Error getting master registration for 127.2.32.190:35419: Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111),
I20260203 21:10:30.629386 2489 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260203 21:10:30.763979 2178 external_mini_cluster.cc:1366] Running /tmp/dist-test-task0vmSZW/build/debug/bin/kudu
/tmp/dist-test-task0vmSZW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.32.190:35419
--webserver_interface=127.2.32.190
--webserver_port=46853
--builtin_ntp_servers=127.2.32.148:39497
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665
--hive_metastore_uris=thrift://127.0.0.1:33779
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260203 21:10:30.816917 3534 raft_consensus.cc:493] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8a7e51013f5041898fe34f4b64a59260)
I20260203 21:10:30.817040 3534 raft_consensus.cc:515] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:10:30.817468 3534 leader_election.cc:290] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419), 8a7e51013f5041898fe34f4b64a59260 (127.2.32.188:33665)
W20260203 21:10:30.817922 2510 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111) [suppressed 5 similar messages]
W20260203 21:10:30.818610 2507 leader_election.cc:336] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 8a7e51013f5041898fe34f4b64a59260 (127.2.32.188:33665): Network error: Client connection negotiation failed: client connection to 127.2.32.188:33665: connect: Connection refused (error 111)
W20260203 21:10:30.818732 2510 leader_election.cc:336] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419): Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111)
I20260203 21:10:30.818780 2510 leader_election.cc:304] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35397be7e61f4b27a49e9449b9fdf085; no voters: 7344d7cd8dea4fa2ae705320daacaf49, 8a7e51013f5041898fe34f4b64a59260
I20260203 21:10:30.818900 3534 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260203 21:10:30.870081 3533 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260203 21:10:30.870293 3533 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260203 21:10:30.870347 3533 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260203 21:10:30.873590 3533 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260203 21:10:30.873648 3533 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260203 21:10:30.873677 3533 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260203 21:10:30.873699 3533 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260203 21:10:30.877393 3533 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.32.148:39497
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-0/wal
--hive_metastore_uris=thrift://127.0.0.1:33779
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.32.190:35419
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.32.190
--webserver_port=46853
--never_fsync=true
--heap_profile_path=/tmp/kudu.3533
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 0efbebd487e7d0c7f21ab0d5a91e0fa70046af83
build type DEBUG
built by None at 03 Feb 2026 20:50:43 UTC on 24a791456cd2
build id 10330
I20260203 21:10:30.878422 3533 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260203 21:10:30.879484 3533 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260203 21:10:30.884725 3542 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260203 21:10:30.884760 3541 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260203 21:10:30.884869 3544 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260203 21:10:30.885044 3533 server_base.cc:1060] running on GCE node
I20260203 21:10:30.885473 3533 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260203 21:10:30.886325 3533 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260203 21:10:30.887485 3533 hybrid_clock.cc:648] HybridClock initialized: now 1770153030887470 us; error 26 us; skew 500 ppm
I20260203 21:10:30.889762 3533 webserver.cc:492] Webserver started at http://127.2.32.190:46853/ using document root <none> and password file <none>
I20260203 21:10:30.890338 3533 fs_manager.cc:362] Metadata directory not provided
I20260203 21:10:30.890417 3533 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260203 21:10:30.893781 3533 fs_manager.cc:714] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260203 21:10:30.895541 3550 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260203 21:10:30.896512 3533 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260203 21:10:30.896610 3533 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-0/data,/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-0/wal
uuid: "7344d7cd8dea4fa2ae705320daacaf49"
format_stamp: "Formatted at 2026-02-03 21:10:25 on dist-test-slave-npns"
I20260203 21:10:30.896953 3533 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260203 21:10:30.909286 3533 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260203 21:10:30.909857 3533 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260203 21:10:30.909991 3533 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260203 21:10:30.916538 3533 rpc_server.cc:307] RPC server started. Bound to: 127.2.32.190:35419
I20260203 21:10:30.916548 3602 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.32.190:35419 every 8 connection(s)
I20260203 21:10:30.917585 3533 server_base.cc:1192] Dumped server information to /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-0/data/info.pb
I20260203 21:10:30.919164 2178 external_mini_cluster.cc:1428] Started /tmp/dist-test-task0vmSZW/build/debug/bin/kudu as pid 3533
I20260203 21:10:30.921636 3603 sys_catalog.cc:263] Verifying existing consensus state
I20260203 21:10:30.923751 3603 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49: Bootstrap starting.
I20260203 21:10:30.934537 3603 log.cc:826] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49: Log is configured to *not* fsync() on all Append() calls
I20260203 21:10:30.978773 3603 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49: Bootstrap replayed 1/1 log segments. Stats: ops{read=92 overwritten=0 applied=92 ignored=0} inserts{seen=58 ignored=0} mutations{seen=73 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260203 21:10:30.979121 3603 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49: Bootstrap complete.
I20260203 21:10:30.981689 3603 raft_consensus.cc:359] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:10:30.982028 3603 raft_consensus.cc:740] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7344d7cd8dea4fa2ae705320daacaf49, State: Initialized, Role: FOLLOWER
I20260203 21:10:30.982400 3603 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 92, Last appended: 3.92, Last appended by leader: 92, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:10:30.982832 3608 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } } }
I20260203 21:10:30.982941 3608 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49 [sys.catalog]: This master's current role is: FOLLOWER
I20260203 21:10:30.983484 3603 sys_catalog.cc:565] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49 [sys.catalog]: configured and running, proceeding with master startup.
I20260203 21:10:30.989450 3622 catalog_manager.cc:1269] Loaded cluster ID: f46367a11713484f92c1d2be2585f5a6
I20260203 21:10:30.989500 3622 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49: loading cluster ID for follower catalog manager: success
I20260203 21:10:30.991472 3622 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49: acquiring CA information for follower catalog manager: success
I20260203 21:10:30.992877 3622 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260203 21:10:31.006062 3533 master_runner.cc:186] Error getting master registration for 127.2.32.188:33665: Network error: Client connection negotiation failed: client connection to 127.2.32.188:33665: connect: Connection refused (error 111),
I20260203 21:10:31.008100 3533 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260203 21:10:31.184010 3106 heartbeater.cc:344] Connected to a master server at 127.2.32.190:35419
I20260203 21:10:31.185961 3567 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "185c63f61a2645928eeb807d145026b1" instance_seqno: 1770153026474418) as {username='slave'} at 127.2.32.131:52997; Asking this server to re-register.
I20260203 21:10:31.186452 3106 heartbeater.cc:461] Registering TS with master...
I20260203 21:10:31.187503 3567 ts_manager.cc:194] Registered new tserver with Master: 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
I20260203 21:10:31.275544 2832 heartbeater.cc:344] Connected to a master server at 127.2.32.190:35419
I20260203 21:10:31.276876 3567 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "02bdf326542e474cbe62434dd59087dc" instance_seqno: 1770153026114330) as {username='slave'} at 127.2.32.129:40055; Asking this server to re-register.
I20260203 21:10:31.277280 2832 heartbeater.cc:461] Registering TS with master...
I20260203 21:10:31.278110 3567 ts_manager.cc:194] Registered new tserver with Master: 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335)
I20260203 21:10:31.393771 2970 heartbeater.cc:344] Connected to a master server at 127.2.32.190:35419
I20260203 21:10:31.395423 3567 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" instance_seqno: 1770153026289802) as {username='slave'} at 127.2.32.130:58679; Asking this server to re-register.
I20260203 21:10:31.396026 2970 heartbeater.cc:461] Registering TS with master...
I20260203 21:10:31.396942 3567 ts_manager.cc:194] Registered new tserver with Master: 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897)
I20260203 21:10:31.587121 3633 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 21:10:31.587321 3633 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:10:31.588490 3633 leader_election.cc:290] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681), 8a7e51013f5041898fe34f4b64a59260 (127.2.32.188:33665)
I20260203 21:10:31.588884 2533 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7344d7cd8dea4fa2ae705320daacaf49" candidate_term: 4 candidate_status { last_received { term: 3 index: 92 } } ignore_live_leader: false dest_uuid: "35397be7e61f4b27a49e9449b9fdf085" is_pre_election: true
I20260203 21:10:31.589023 2533 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7344d7cd8dea4fa2ae705320daacaf49 in term 3.
W20260203 21:10:31.589048 3551 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.32.188:33665: connect: Connection refused (error 111)
I20260203 21:10:31.589444 3553 leader_election.cc:304] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35397be7e61f4b27a49e9449b9fdf085, 7344d7cd8dea4fa2ae705320daacaf49; no voters:
I20260203 21:10:31.589686 3633 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260203 21:10:31.589774 3633 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 21:10:31.589828 3633 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49 [term 3 FOLLOWER]: Advancing to term 4
W20260203 21:10:31.589848 3551 leader_election.cc:336] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 8a7e51013f5041898fe34f4b64a59260 (127.2.32.188:33665): Network error: Client connection negotiation failed: client connection to 127.2.32.188:33665: connect: Connection refused (error 111)
I20260203 21:10:31.591490 3633 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:10:31.591833 3633 leader_election.cc:290] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49 [CANDIDATE]: Term 4 election: Requested vote from peers 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681), 8a7e51013f5041898fe34f4b64a59260 (127.2.32.188:33665)
I20260203 21:10:31.592149 2533 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7344d7cd8dea4fa2ae705320daacaf49" candidate_term: 4 candidate_status { last_received { term: 3 index: 92 } } ignore_live_leader: false dest_uuid: "35397be7e61f4b27a49e9449b9fdf085"
I20260203 21:10:31.592278 2533 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [term 3 FOLLOWER]: Advancing to term 4
W20260203 21:10:31.592646 3551 leader_election.cc:336] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 8a7e51013f5041898fe34f4b64a59260 (127.2.32.188:33665): Network error: Client connection negotiation failed: client connection to 127.2.32.188:33665: connect: Connection refused (error 111)
I20260203 21:10:31.593132 2533 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7344d7cd8dea4fa2ae705320daacaf49 in term 4.
I20260203 21:10:31.593379 3553 leader_election.cc:304] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35397be7e61f4b27a49e9449b9fdf085, 7344d7cd8dea4fa2ae705320daacaf49; no voters: 8a7e51013f5041898fe34f4b64a59260
I20260203 21:10:31.593546 3633 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49 [term 4 FOLLOWER]: Leader election won for term 4
I20260203 21:10:31.593730 3633 raft_consensus.cc:697] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49 [term 4 LEADER]: Becoming Leader. State: Replica: 7344d7cd8dea4fa2ae705320daacaf49, State: Running, Role: LEADER
I20260203 21:10:31.593995 3633 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 92, Committed index: 92, Last appended: 3.92, Last appended by leader: 92, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:10:31.595744 3636 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7344d7cd8dea4fa2ae705320daacaf49. Latest consensus state: current_term: 4 leader_uuid: "7344d7cd8dea4fa2ae705320daacaf49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } } }
I20260203 21:10:31.595836 3636 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49 [sys.catalog]: This master's current role is: LEADER
I20260203 21:10:31.596089 3638 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260203 21:10:31.597661 3638 catalog_manager.cc:679] Loaded metadata for table default.table_3397dfe4625e42cf8cb5f4d45116d7b1 [id=1047aea4c6eb42f4994b72f5cafef147]
I20260203 21:10:31.597910 3638 catalog_manager.cc:679] Loaded metadata for table default.table_675a6f7413004a62bce7c460e7b6da3b [id=1df0a5e5434d4c00a3dfe92d216cfb54]
I20260203 21:10:31.598086 3638 catalog_manager.cc:679] Loaded metadata for table default.table_547d99db0d3043499a26ee8c6df4c443 [id=333213fed7234610bc20c7d92124182b]
I20260203 21:10:31.598244 3638 catalog_manager.cc:679] Loaded metadata for table default.table_98e2e0221eb0485fb87bee758843d37e [id=42eb95ae2b9442b18dac664ea886b4b3]
I20260203 21:10:31.598407 3638 catalog_manager.cc:679] Loaded metadata for table default.table_b7c2ca72f69c49a0b39163d2fcb69341 [id=467e79ec835d45669e3155e07b8ba81f]
I20260203 21:10:31.598559 3638 catalog_manager.cc:679] Loaded metadata for table default.table_a029ba95c22e421585ca4ce640aa9658 [id=73eae179f2ad481d932a5b3c95b1a4ab]
I20260203 21:10:31.598711 3638 catalog_manager.cc:679] Loaded metadata for table default.table_72135cb0d98246739f6b8c9aee17c8ba [id=7402e05c90cf4b15be6effde36465fff]
I20260203 21:10:31.598888 3638 catalog_manager.cc:679] Loaded metadata for table default.table_7e73ff80019543888e0b8afa9b7a6660 [id=82ec5c95acc84e509c0803db74b626b4]
I20260203 21:10:31.599107 3638 catalog_manager.cc:679] Loaded metadata for table default.table_c2985ddec2e045cba153900329fe9331 [id=85725aeaace648d9ac1bb5d3940d0ad0]
I20260203 21:10:31.599311 3638 catalog_manager.cc:679] Loaded metadata for table default.table_4c9a68305b5e4d4aa45e3a351c35eee7 [id=8f8f5b53d1204b56979a8db32be6ee89]
I20260203 21:10:31.599505 3638 catalog_manager.cc:679] Loaded metadata for table default.table_09e62d0aaa0f48ad9ed818ba967be542 [id=a26f4a67278a4929b2378fbbe9baaf52]
I20260203 21:10:31.599727 3638 catalog_manager.cc:679] Loaded metadata for table default.table_800a192f4e9e4ca5806a324b36234706 [id=a995c742bb2942838a2385b05a4d4d57]
I20260203 21:10:31.599924 3638 catalog_manager.cc:679] Loaded metadata for table default.table_8da179b3ec0b4c898eb890f89d54cb6a [id=ad58be29e80345e1afe7f5a55e129af2]
I20260203 21:10:31.600123 3638 catalog_manager.cc:679] Loaded metadata for table default.table_66c508c8dbdd4e7ea9283cabe65b62c0 [id=b62df06982124a70936068823e4b2324]
I20260203 21:10:31.600481 3638 catalog_manager.cc:679] Loaded metadata for table default.table_4f93e096d30349908a32a33e024543d6 [id=fa8fb788ff754fcd8641964a9d894664]
I20260203 21:10:31.601610 3638 tablet_loader.cc:96] loaded metadata for tablet 06b80064d47349c2830718f553ba3d7d (table default.table_66c508c8dbdd4e7ea9283cabe65b62c0 [id=b62df06982124a70936068823e4b2324])
I20260203 21:10:31.601991 3638 tablet_loader.cc:96] loaded metadata for tablet 2f8e36b89ebf456d964c9a31f7c7636a (table default.table_98e2e0221eb0485fb87bee758843d37e [id=42eb95ae2b9442b18dac664ea886b4b3])
I20260203 21:10:31.602149 3638 tablet_loader.cc:96] loaded metadata for tablet 387f8e87a39f402e9a6416d5408427df (table default.table_b7c2ca72f69c49a0b39163d2fcb69341 [id=467e79ec835d45669e3155e07b8ba81f])
I20260203 21:10:31.602303 3638 tablet_loader.cc:96] loaded metadata for tablet 3ae68905ec1942448b444ecd01836805 (table default.table_c2985ddec2e045cba153900329fe9331 [id=85725aeaace648d9ac1bb5d3940d0ad0])
I20260203 21:10:31.602463 3638 tablet_loader.cc:96] loaded metadata for tablet 4c8edfa3d555490f953a3ec7bef314ae (table default.table_a029ba95c22e421585ca4ce640aa9658 [id=73eae179f2ad481d932a5b3c95b1a4ab])
I20260203 21:10:31.602617 3638 tablet_loader.cc:96] loaded metadata for tablet 4d6ed92d766244489541e1c280afacb5 (table default.table_09e62d0aaa0f48ad9ed818ba967be542 [id=a26f4a67278a4929b2378fbbe9baaf52])
I20260203 21:10:31.602797 3638 tablet_loader.cc:96] loaded metadata for tablet 4de1de23650548c2a078b51c9bf4d031 (table default.table_4f93e096d30349908a32a33e024543d6 [id=fa8fb788ff754fcd8641964a9d894664])
I20260203 21:10:31.602974 3638 tablet_loader.cc:96] loaded metadata for tablet 62542a22943242c7987cc65423f548b4 (table default.table_72135cb0d98246739f6b8c9aee17c8ba [id=7402e05c90cf4b15be6effde36465fff])
I20260203 21:10:31.603127 3638 tablet_loader.cc:96] loaded metadata for tablet 739e31c065d94d7badfe9097b04ca0a9 (table default.table_7e73ff80019543888e0b8afa9b7a6660 [id=82ec5c95acc84e509c0803db74b626b4])
I20260203 21:10:31.603278 3638 tablet_loader.cc:96] loaded metadata for tablet 7786ef435bbd44daae12d3ee4728efb9 (table default.table_800a192f4e9e4ca5806a324b36234706 [id=a995c742bb2942838a2385b05a4d4d57])
I20260203 21:10:31.603514 3638 tablet_loader.cc:96] loaded metadata for tablet 8df16fd039bf4d9b91ee2e49151c18c2 (table default.table_675a6f7413004a62bce7c460e7b6da3b [id=1df0a5e5434d4c00a3dfe92d216cfb54])
I20260203 21:10:31.603777 3638 tablet_loader.cc:96] loaded metadata for tablet 98cd2089483c4121944152e5cee8ca30 (table default.table_4c9a68305b5e4d4aa45e3a351c35eee7 [id=8f8f5b53d1204b56979a8db32be6ee89])
I20260203 21:10:31.603935 3638 tablet_loader.cc:96] loaded metadata for tablet a375114bebc64385827b7b6e0060d1e4 (table default.table_547d99db0d3043499a26ee8c6df4c443 [id=333213fed7234610bc20c7d92124182b])
I20260203 21:10:31.604169 3638 tablet_loader.cc:96] loaded metadata for tablet b20e604665624843b957080dc6016d78 (table default.table_8da179b3ec0b4c898eb890f89d54cb6a [id=ad58be29e80345e1afe7f5a55e129af2])
I20260203 21:10:31.604310 3638 tablet_loader.cc:96] loaded metadata for tablet ba8723a952564816a5c1f7945c448db9 (table default.table_3397dfe4625e42cf8cb5f4d45116d7b1 [id=1047aea4c6eb42f4994b72f5cafef147])
I20260203 21:10:31.605026 3638 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260203 21:10:31.605646 3638 catalog_manager.cc:1269] Loaded cluster ID: f46367a11713484f92c1d2be2585f5a6
I20260203 21:10:31.605691 3638 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260203 21:10:31.606452 3638 catalog_manager.cc:1514] Loading token signing keys...
I20260203 21:10:31.607030 3638 catalog_manager.cc:6038] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49: Loaded TSK: 0
I20260203 21:10:31.607749 3638 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260203 21:10:31.608327 3638 catalog_manager.cc:1537] Loading latest processed Hive Metastore notification log event ID...
I20260203 21:10:31.608888 3638 catalog_manager.cc:5876] Last processed Hive Metastore notification event ID: 21
I20260203 21:10:31.656561 3566 master_service.cc:954] ReplaceTablet: received request to replace tablet 06b80064d47349c2830718f553ba3d7d from {username='slave'} at 127.0.0.1:60984
I20260203 21:10:31.656649 3565 master_service.cc:954] ReplaceTablet: received request to replace tablet 7786ef435bbd44daae12d3ee4728efb9 from {username='slave'} at 127.0.0.1:60984
I20260203 21:10:31.656589 3567 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60984:
name: "default.Table_8bbf49750e3f4eccbcf97c6346c65635"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260203 21:10:31.658560 3564 master_service.cc:954] ReplaceTablet: received request to replace tablet 2f8e36b89ebf456d964c9a31f7c7636a from {username='slave'} at 127.0.0.1:60984
I20260203 21:10:31.658583 3563 master_service.cc:954] ReplaceTablet: received request to replace tablet a375114bebc64385827b7b6e0060d1e4 from {username='slave'} at 127.0.0.1:60984
I20260203 21:10:31.659461 3562 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60984:
name: "default.Table_e694e6681f2a426c9b583f4567326376"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260203 21:10:31.659490 3560 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60984:
name: "default.Table_447b2216cf154804ab167c592d1437dc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260203 21:10:31.660059 3561 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60984:
name: "default.Table_09ddf2e9b9804049beecd01e88d7f031"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260203 21:10:31.660307 3558 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60984:
name: "default.Table_a408ffd16e534530bf3124d504ceb186"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260203 21:10:31.660923 3559 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60984:
name: "default.Table_bd33ab5dd9a44bf2bdfd58475903bbc9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
F20260203 21:10:31.662899 3621 hms_notification_log_listener.cc:287] non-monotonous event IDs from HMS: current 22, previous 22; dumping first 2 out of 12 received events: NotificationEvent(eventId=22, eventTime=1770153029, eventType=DROP_TABLE, dbName=default, tableName=table_76bef700d9b64243b6b4e93ffbc64f7a, message={"server":"","servicePrincipal":"","db":"default","table":"table_76bef700d9b64243b6b4e93ffbc64f7a","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_76bef700d9b64243b6b4e93ffbc64f7a\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1770153028},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/warehouse/table_76bef700d9b64243b6b4e93ffbc64f7a\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_76bef700d9b64243b6b4e93ffbc64f7a\",\"kudu.table_id\":\"f6e23f2505784c6f98a18a43b9917c06\",\"transient_lastDdlTime\":\"1770153028\",\"comment\":\"\",\"kudu.master_addresses\":\"127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"f46367a11713484f92c1d2be2585f5a6\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1770153029}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=22, eventTime=1770153029, eventType=CREATE_TABLE, dbName=default, tableName=table_4f93e096d30349908a32a33e024543d6, message={"server":"","servicePrincipal":"","db":"default","table":"table_4f93e096d30349908a32a33e024543d6","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_4f93e096d30349908a32a33e024543d6\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1770153029},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/warehouse/table_4f93e096d30349908a32a33e024543d6\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_4f93e096d30349908a32a33e024543d6\",\"kudu.table_id\":\"fa8fb788ff754fcd8641964a9d894664\",\"transient_lastDdlTime\":\"1770153029\",\"comment\":\"\",\"kudu.master_addresses\":\"127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"f46367a11713484f92c1d2be2585f5a6\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1770153029,"files":[]}, messageFormat=json-0.2, catName=hive);
*** Check failure stack trace: ***
W20260203 21:10:31.664129 3551 consensus_peers.cc:597] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49 -> Peer 8a7e51013f5041898fe34f4b64a59260 (127.2.32.188:33665): Couldn't send request to peer 8a7e51013f5041898fe34f4b64a59260. Status: Network error: Client connection negotiation failed: client connection to 127.2.32.188:33665: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260203 21:10:31.664494 2533 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [term 4 FOLLOWER]: Refusing update from remote peer 7344d7cd8dea4fa2ae705320daacaf49: Log matching property violated. Preceding OpId in replica: term: 3 index: 92. Preceding OpId from leader: term: 4 index: 95. (index mismatch)
I20260203 21:10:31.665040 3636 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 93, Last known committed idx: 92, Time since last communication: 0.000s
@ 0x7f48a2b83dcd google::LogMessage::Fail() at ??:0
@ 0x7f48a2b87b93 google::LogMessage::SendToLog() at ??:0
I20260203 21:10:31.667809 3640 sys_catalog.cc:455] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7344d7cd8dea4fa2ae705320daacaf49. Latest consensus state: current_term: 4 leader_uuid: "7344d7cd8dea4fa2ae705320daacaf49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } } }
I20260203 21:10:31.667912 3640 sys_catalog.cc:458] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [sys.catalog]: This master's current role is: FOLLOWER
I20260203 21:10:31.669629 3633 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 4 leader_uuid: "7344d7cd8dea4fa2ae705320daacaf49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } } }
@ 0x7f48a2b837cc google::LogMessage::Flush() at ??:0
I20260203 21:10:31.669718 3633 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49 [sys.catalog]: This master's current role is: LEADER
I20260203 21:10:31.670425 3640 sys_catalog.cc:455] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 4 leader_uuid: "7344d7cd8dea4fa2ae705320daacaf49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } } }
I20260203 21:10:31.670516 3640 sys_catalog.cc:458] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [sys.catalog]: This master's current role is: FOLLOWER
@ 0x7f48a2b83a11 google::LogMessage::~LogMessage() at ??:0
I20260203 21:10:31.671922 3566 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49: Sending DeleteTablet for 3 replicas of tablet 06b80064d47349c2830718f553ba3d7d
I20260203 21:10:31.672171 3563 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49: Sending DeleteTablet for 3 replicas of tablet a375114bebc64385827b7b6e0060d1e4
I20260203 21:10:31.672413 3564 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49: Sending DeleteTablet for 3 replicas of tablet 2f8e36b89ebf456d964c9a31f7c7636a
I20260203 21:10:31.672770 3563 catalog_manager.cc:6724] ReplaceTablet: tablet a375114bebc64385827b7b6e0060d1e4 deleted and replaced by tablet 576be22c2477419192cc271e46b8e57e
I20260203 21:10:31.672971 3563 master_service.cc:954] ReplaceTablet: received request to replace tablet 3ae68905ec1942448b444ecd01836805 from {username='slave'} at 127.0.0.1:60984
I20260203 21:10:31.673343 3565 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49: Sending DeleteTablet for 3 replicas of tablet 7786ef435bbd44daae12d3ee4728efb9
I20260203 21:10:31.673609 3565 catalog_manager.cc:6724] ReplaceTablet: tablet 7786ef435bbd44daae12d3ee4728efb9 deleted and replaced by tablet 9c19a7b6dba6432f91e68164734a7e6d
I20260203 21:10:31.673806 3565 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60984:
name: "default.Table_0e7e19b98aa74ff5a094a070317a1555"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260203 21:10:31.675253 3564 catalog_manager.cc:6724] ReplaceTablet: tablet 2f8e36b89ebf456d964c9a31f7c7636a deleted and replaced by tablet f8f173ff52ed4daa8b8ddcbeae43bc4a
I20260203 21:10:31.675412 3566 catalog_manager.cc:6724] ReplaceTablet: tablet 06b80064d47349c2830718f553ba3d7d deleted and replaced by tablet 6606bf5d7de047cda4a0523197210c1a
I20260203 21:10:31.675457 3564 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60984:
name: "default.Table_002112ac16a246d19bd71fd9b416c635"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260203 21:10:31.675611 3566 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60984:
name: "default.Table_76bef700d9b64243b6b4e93ffbc64f7a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
@ 0x7f48a7cf9ef9 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
I20260203 21:10:31.678284 3563 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 7344d7cd8dea4fa2ae705320daacaf49: Sending DeleteTablet for 3 replicas of tablet 3ae68905ec1942448b444ecd01836805
I20260203 21:10:31.678572 3563 catalog_manager.cc:6724] ReplaceTablet: tablet 3ae68905ec1942448b444ecd01836805 deleted and replaced by tablet dd27d2dc29364e1b87fb1936bae8d2a1
I20260203 21:10:31.678750 3563 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60984:
name: "default.Table_75f7568b9f28464e8d4ce934087b320e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
@ 0x7f48a7cf8e10 kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
@ 0x7f48a7cf8573 _ZZN4kudu6master30HmsNotificationLogListenerTask4InitEvENKUlvE_clEv at ??:0
I20260203 21:10:31.684743 2897 tablet_service.cc:1552] Processing DeleteTablet for tablet a375114bebc64385827b7b6e0060d1e4 with delete_type TABLET_DATA_DELETED (replaced by tablet 576be22c2477419192cc271e46b8e57e) from {username='slave'} at 127.0.0.1:50004
I20260203 21:10:31.685150 2897 tablet_service.cc:1505] Processing CreateTablet for tablet 6606bf5d7de047cda4a0523197210c1a (DEFAULT_TABLE table=default.table_66c508c8dbdd4e7ea9283cabe65b62c0 [id=b62df06982124a70936068823e4b2324]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:31.685343 2899 tablet_service.cc:1552] Processing DeleteTablet for tablet 2f8e36b89ebf456d964c9a31f7c7636a with delete_type TABLET_DATA_DELETED (replaced by tablet f8f173ff52ed4daa8b8ddcbeae43bc4a) from {username='slave'} at 127.0.0.1:50004
I20260203 21:10:31.685421 2897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6606bf5d7de047cda4a0523197210c1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:31.685453 2898 tablet_service.cc:1552] Processing DeleteTablet for tablet 06b80064d47349c2830718f553ba3d7d with delete_type TABLET_DATA_DELETED (replaced by tablet 6606bf5d7de047cda4a0523197210c1a) from {username='slave'} at 127.0.0.1:50004
I20260203 21:10:31.685539 2896 tablet_service.cc:1552] Processing DeleteTablet for tablet 7786ef435bbd44daae12d3ee4728efb9 with delete_type TABLET_DATA_DELETED (replaced by tablet 9c19a7b6dba6432f91e68164734a7e6d) from {username='slave'} at 127.0.0.1:50004
I20260203 21:10:31.685618 2895 tablet_service.cc:1552] Processing DeleteTablet for tablet 3ae68905ec1942448b444ecd01836805 with delete_type TABLET_DATA_DELETED (replaced by tablet dd27d2dc29364e1b87fb1936bae8d2a1) from {username='slave'} at 127.0.0.1:50004
I20260203 21:10:31.685827 2902 tablet_service.cc:1505] Processing CreateTablet for tablet f8f173ff52ed4daa8b8ddcbeae43bc4a (DEFAULT_TABLE table=default.table_98e2e0221eb0485fb87bee758843d37e [id=42eb95ae2b9442b18dac664ea886b4b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:31.686012 2902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8f173ff52ed4daa8b8ddcbeae43bc4a. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7f48a7cfdc7a _ZNSt17_Function_handlerIFvvEZN4kudu6master30HmsNotificationLogListenerTask4InitEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x556b2feeaa0a std::function<>::operator()() at ??:0
I20260203 21:10:31.687831 2900 tablet_service.cc:1505] Processing CreateTablet for tablet 576be22c2477419192cc271e46b8e57e (DEFAULT_TABLE table=default.table_547d99db0d3043499a26ee8c6df4c443 [id=333213fed7234610bc20c7d92124182b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:31.688040 2900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 576be22c2477419192cc271e46b8e57e. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7f48a3fddb04 kudu::Thread::SuperviseThread() at ??:0
I20260203 21:10:31.690999 3661 tablet_bootstrap.cc:492] T 6606bf5d7de047cda4a0523197210c1a P 6d9e0cecab784cc0acc050ca1c89c5be: Bootstrap starting.
I20260203 21:10:31.692196 3661 tablet_bootstrap.cc:654] T 6606bf5d7de047cda4a0523197210c1a P 6d9e0cecab784cc0acc050ca1c89c5be: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:31.692813 3659 tablet_replica.cc:333] T a375114bebc64385827b7b6e0060d1e4 P 6d9e0cecab784cc0acc050ca1c89c5be: stopping tablet replica
I20260203 21:10:31.692934 3659 raft_consensus.cc:2243] T a375114bebc64385827b7b6e0060d1e4 P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 LEADER]: Raft consensus shutting down.
I20260203 21:10:31.693136 3659 raft_consensus.cc:2272] T a375114bebc64385827b7b6e0060d1e4 P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 21:10:31.693245 3039 tablet_service.cc:1552] Processing DeleteTablet for tablet 06b80064d47349c2830718f553ba3d7d with delete_type TABLET_DATA_DELETED (replaced by tablet 6606bf5d7de047cda4a0523197210c1a) from {username='slave'} at 127.0.0.1:54150
I20260203 21:10:31.693476 3659 ts_tablet_manager.cc:1916] T a375114bebc64385827b7b6e0060d1e4 P 6d9e0cecab784cc0acc050ca1c89c5be: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260203 21:10:31.693472 3035 tablet_service.cc:1552] Processing DeleteTablet for tablet a375114bebc64385827b7b6e0060d1e4 with delete_type TABLET_DATA_DELETED (replaced by tablet 576be22c2477419192cc271e46b8e57e) from {username='slave'} at 127.0.0.1:54150
I20260203 21:10:31.693589 3036 tablet_service.cc:1552] Processing DeleteTablet for tablet 2f8e36b89ebf456d964c9a31f7c7636a with delete_type TABLET_DATA_DELETED (replaced by tablet f8f173ff52ed4daa8b8ddcbeae43bc4a) from {username='slave'} at 127.0.0.1:54150
I20260203 21:10:31.693686 3037 tablet_service.cc:1552] Processing DeleteTablet for tablet 7786ef435bbd44daae12d3ee4728efb9 with delete_type TABLET_DATA_DELETED (replaced by tablet 9c19a7b6dba6432f91e68164734a7e6d) from {username='slave'} at 127.0.0.1:54150
I20260203 21:10:31.693770 3038 tablet_service.cc:1552] Processing DeleteTablet for tablet 3ae68905ec1942448b444ecd01836805 with delete_type TABLET_DATA_DELETED (replaced by tablet dd27d2dc29364e1b87fb1936bae8d2a1) from {username='slave'} at 127.0.0.1:54150
I20260203 21:10:31.694002 3034 tablet_service.cc:1505] Processing CreateTablet for tablet 6606bf5d7de047cda4a0523197210c1a (DEFAULT_TABLE table=default.table_66c508c8dbdd4e7ea9283cabe65b62c0 [id=b62df06982124a70936068823e4b2324]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:31.694233 3034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6606bf5d7de047cda4a0523197210c1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:31.695494 3659 ts_tablet_manager.cc:1929] T a375114bebc64385827b7b6e0060d1e4 P 6d9e0cecab784cc0acc050ca1c89c5be: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260203 21:10:31.695554 3659 log.cc:1199] T a375114bebc64385827b7b6e0060d1e4 P 6d9e0cecab784cc0acc050ca1c89c5be: Deleting WAL directory at /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-1/wal/wals/a375114bebc64385827b7b6e0060d1e4
@ 0x7f48a48776db start_thread at ??:0
I20260203 21:10:31.695655 3665 tablet_replica.cc:333] T 06b80064d47349c2830718f553ba3d7d P 185c63f61a2645928eeb807d145026b1: stopping tablet replica
I20260203 21:10:31.695827 3659 ts_tablet_manager.cc:1950] T a375114bebc64385827b7b6e0060d1e4 P 6d9e0cecab784cc0acc050ca1c89c5be: Deleting consensus metadata
I20260203 21:10:31.695852 3665 raft_consensus.cc:2243] T 06b80064d47349c2830718f553ba3d7d P 185c63f61a2645928eeb807d145026b1 [term 1 LEADER]: Raft consensus shutting down.
I20260203 21:10:31.696049 3665 raft_consensus.cc:2272] T 06b80064d47349c2830718f553ba3d7d P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 21:10:31.696378 3659 tablet_replica.cc:333] T 2f8e36b89ebf456d964c9a31f7c7636a P 6d9e0cecab784cc0acc050ca1c89c5be: stopping tablet replica
I20260203 21:10:31.696424 3665 ts_tablet_manager.cc:1916] T 06b80064d47349c2830718f553ba3d7d P 185c63f61a2645928eeb807d145026b1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260203 21:10:31.696484 3659 raft_consensus.cc:2243] T 2f8e36b89ebf456d964c9a31f7c7636a P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 21:10:31.696576 3659 raft_consensus.cc:2272] T 2f8e36b89ebf456d964c9a31f7c7636a P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 21:10:31.696702 3033 tablet_service.cc:1505] Processing CreateTablet for tablet f8f173ff52ed4daa8b8ddcbeae43bc4a (DEFAULT_TABLE table=default.table_98e2e0221eb0485fb87bee758843d37e [id=42eb95ae2b9442b18dac664ea886b4b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:31.696877 3659 ts_tablet_manager.cc:1916] T 2f8e36b89ebf456d964c9a31f7c7636a P 6d9e0cecab784cc0acc050ca1c89c5be: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260203 21:10:31.696928 3033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8f173ff52ed4daa8b8ddcbeae43bc4a. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7f48a1d3a71f clone at ??:0
I20260203 21:10:31.698382 3661 tablet_bootstrap.cc:492] T 6606bf5d7de047cda4a0523197210c1a P 6d9e0cecab784cc0acc050ca1c89c5be: No bootstrap required, opened a new log
I20260203 21:10:31.698396 3667 tablet_bootstrap.cc:492] T 6606bf5d7de047cda4a0523197210c1a P 185c63f61a2645928eeb807d145026b1: Bootstrap starting.
I20260203 21:10:31.698457 3661 ts_tablet_manager.cc:1403] T 6606bf5d7de047cda4a0523197210c1a P 6d9e0cecab784cc0acc050ca1c89c5be: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20260203 21:10:31.698673 3665 ts_tablet_manager.cc:1929] T 06b80064d47349c2830718f553ba3d7d P 185c63f61a2645928eeb807d145026b1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260203 21:10:31.698729 3665 log.cc:1199] T 06b80064d47349c2830718f553ba3d7d P 185c63f61a2645928eeb807d145026b1: Deleting WAL directory at /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-2/wal/wals/06b80064d47349c2830718f553ba3d7d
I20260203 21:10:31.698872 3661 raft_consensus.cc:359] T 6606bf5d7de047cda4a0523197210c1a P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:31.698900 3032 tablet_service.cc:1505] Processing CreateTablet for tablet 576be22c2477419192cc271e46b8e57e (DEFAULT_TABLE table=default.table_547d99db0d3043499a26ee8c6df4c443 [id=333213fed7234610bc20c7d92124182b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:31.698968 3665 ts_tablet_manager.cc:1950] T 06b80064d47349c2830718f553ba3d7d P 185c63f61a2645928eeb807d145026b1: Deleting consensus metadata
I20260203 21:10:31.698971 3661 raft_consensus.cc:385] T 6606bf5d7de047cda4a0523197210c1a P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:31.699002 3661 raft_consensus.cc:740] T 6606bf5d7de047cda4a0523197210c1a P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d9e0cecab784cc0acc050ca1c89c5be, State: Initialized, Role: FOLLOWER
I20260203 21:10:31.699102 3032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 576be22c2477419192cc271e46b8e57e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:31.699172 3661 consensus_queue.cc:260] T 6606bf5d7de047cda4a0523197210c1a P 6d9e0cecab784cc0acc050ca1c89c5be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:31.699331 3667 tablet_bootstrap.cc:654] T 6606bf5d7de047cda4a0523197210c1a P 185c63f61a2645928eeb807d145026b1: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:31.699433 3661 ts_tablet_manager.cc:1434] T 6606bf5d7de047cda4a0523197210c1a P 6d9e0cecab784cc0acc050ca1c89c5be: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260203 21:10:31.699447 3665 tablet_replica.cc:333] T a375114bebc64385827b7b6e0060d1e4 P 185c63f61a2645928eeb807d145026b1: stopping tablet replica
I20260203 21:10:31.699548 3665 raft_consensus.cc:2243] T a375114bebc64385827b7b6e0060d1e4 P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 21:10:31.700460 3659 ts_tablet_manager.cc:1929] T 2f8e36b89ebf456d964c9a31f7c7636a P 6d9e0cecab784cc0acc050ca1c89c5be: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260203 21:10:31.700520 3659 log.cc:1199] T 2f8e36b89ebf456d964c9a31f7c7636a P 6d9e0cecab784cc0acc050ca1c89c5be: Deleting WAL directory at /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-1/wal/wals/2f8e36b89ebf456d964c9a31f7c7636a
I20260203 21:10:31.700743 3659 ts_tablet_manager.cc:1950] T 2f8e36b89ebf456d964c9a31f7c7636a P 6d9e0cecab784cc0acc050ca1c89c5be: Deleting consensus metadata
I20260203 21:10:31.700903 3661 tablet_bootstrap.cc:492] T f8f173ff52ed4daa8b8ddcbeae43bc4a P 6d9e0cecab784cc0acc050ca1c89c5be: Bootstrap starting.
I20260203 21:10:31.699635 3665 raft_consensus.cc:2272] T a375114bebc64385827b7b6e0060d1e4 P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 21:10:31.701320 3665 ts_tablet_manager.cc:1916] T a375114bebc64385827b7b6e0060d1e4 P 185c63f61a2645928eeb807d145026b1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260203 21:10:31.701767 3661 tablet_bootstrap.cc:654] T f8f173ff52ed4daa8b8ddcbeae43bc4a P 6d9e0cecab784cc0acc050ca1c89c5be: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:31.703058 3665 ts_tablet_manager.cc:1929] T a375114bebc64385827b7b6e0060d1e4 P 185c63f61a2645928eeb807d145026b1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260203 21:10:31.703123 3665 log.cc:1199] T a375114bebc64385827b7b6e0060d1e4 P 185c63f61a2645928eeb807d145026b1: Deleting WAL directory at /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-2/wal/wals/a375114bebc64385827b7b6e0060d1e4
I20260203 21:10:31.703339 3665 ts_tablet_manager.cc:1950] T a375114bebc64385827b7b6e0060d1e4 P 185c63f61a2645928eeb807d145026b1: Deleting consensus metadata
I20260203 21:10:31.703847 3665 tablet_replica.cc:333] T 2f8e36b89ebf456d964c9a31f7c7636a P 185c63f61a2645928eeb807d145026b1: stopping tablet replica
I20260203 21:10:31.703954 3665 raft_consensus.cc:2243] T 2f8e36b89ebf456d964c9a31f7c7636a P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 21:10:31.704053 3665 raft_consensus.cc:2272] T 2f8e36b89ebf456d964c9a31f7c7636a P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 21:10:31.704378 3665 ts_tablet_manager.cc:1916] T 2f8e36b89ebf456d964c9a31f7c7636a P 185c63f61a2645928eeb807d145026b1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260203 21:10:31.704901 3659 tablet_replica.cc:333] T 06b80064d47349c2830718f553ba3d7d P 6d9e0cecab784cc0acc050ca1c89c5be: stopping tablet replica
I20260203 21:10:31.705003 3659 raft_consensus.cc:2243] T 06b80064d47349c2830718f553ba3d7d P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 21:10:31.705090 3659 raft_consensus.cc:2272] T 06b80064d47349c2830718f553ba3d7d P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 21:10:31.705404 3659 ts_tablet_manager.cc:1916] T 06b80064d47349c2830718f553ba3d7d P 6d9e0cecab784cc0acc050ca1c89c5be: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260203 21:10:31.705986 3665 ts_tablet_manager.cc:1929] T 2f8e36b89ebf456d964c9a31f7c7636a P 185c63f61a2645928eeb807d145026b1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260203 21:10:31.706041 3665 log.cc:1199] T 2f8e36b89ebf456d964c9a31f7c7636a P 185c63f61a2645928eeb807d145026b1: Deleting WAL directory at /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-2/wal/wals/2f8e36b89ebf456d964c9a31f7c7636a
W20260203 21:10:31.706074 2720 consensus_peers.cc:597] T 2f8e36b89ebf456d964c9a31f7c7636a P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260203 21:10:31.706259 3665 ts_tablet_manager.cc:1950] T 2f8e36b89ebf456d964c9a31f7c7636a P 185c63f61a2645928eeb807d145026b1: Deleting consensus metadata
I20260203 21:10:31.706723 3665 tablet_replica.cc:333] T 7786ef435bbd44daae12d3ee4728efb9 P 185c63f61a2645928eeb807d145026b1: stopping tablet replica
I20260203 21:10:31.706830 3665 raft_consensus.cc:2243] T 7786ef435bbd44daae12d3ee4728efb9 P 185c63f61a2645928eeb807d145026b1 [term 1 LEADER]: Raft consensus shutting down.
I20260203 21:10:31.706983 3665 raft_consensus.cc:2272] T 7786ef435bbd44daae12d3ee4728efb9 P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 21:10:31.707285 3665 ts_tablet_manager.cc:1916] T 7786ef435bbd44daae12d3ee4728efb9 P 185c63f61a2645928eeb807d145026b1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260203 21:10:31.707471 3659 ts_tablet_manager.cc:1929] T 06b80064d47349c2830718f553ba3d7d P 6d9e0cecab784cc0acc050ca1c89c5be: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260203 21:10:31.707526 3659 log.cc:1199] T 06b80064d47349c2830718f553ba3d7d P 6d9e0cecab784cc0acc050ca1c89c5be: Deleting WAL directory at /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-1/wal/wals/06b80064d47349c2830718f553ba3d7d
I20260203 21:10:31.707805 3659 ts_tablet_manager.cc:1950] T 06b80064d47349c2830718f553ba3d7d P 6d9e0cecab784cc0acc050ca1c89c5be: Deleting consensus metadata
I20260203 21:10:31.708083 3661 tablet_bootstrap.cc:492] T f8f173ff52ed4daa8b8ddcbeae43bc4a P 6d9e0cecab784cc0acc050ca1c89c5be: No bootstrap required, opened a new log
I20260203 21:10:31.708169 3661 ts_tablet_manager.cc:1403] T f8f173ff52ed4daa8b8ddcbeae43bc4a P 6d9e0cecab784cc0acc050ca1c89c5be: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.000s
I20260203 21:10:31.708376 3659 tablet_replica.cc:333] T 7786ef435bbd44daae12d3ee4728efb9 P 6d9e0cecab784cc0acc050ca1c89c5be: stopping tablet replica
I20260203 21:10:31.708487 3659 raft_consensus.cc:2243] T 7786ef435bbd44daae12d3ee4728efb9 P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 21:10:31.708581 3659 raft_consensus.cc:2272] T 7786ef435bbd44daae12d3ee4728efb9 P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 21:10:31.708612 3661 raft_consensus.cc:359] T f8f173ff52ed4daa8b8ddcbeae43bc4a P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } }
I20260203 21:10:31.708707 3661 raft_consensus.cc:385] T f8f173ff52ed4daa8b8ddcbeae43bc4a P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:31.708734 3661 raft_consensus.cc:740] T f8f173ff52ed4daa8b8ddcbeae43bc4a P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d9e0cecab784cc0acc050ca1c89c5be, State: Initialized, Role: FOLLOWER
I20260203 21:10:31.708864 3659 ts_tablet_manager.cc:1916] T 7786ef435bbd44daae12d3ee4728efb9 P 6d9e0cecab784cc0acc050ca1c89c5be: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260203 21:10:31.708994 3665 ts_tablet_manager.cc:1929] T 7786ef435bbd44daae12d3ee4728efb9 P 185c63f61a2645928eeb807d145026b1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260203 21:10:31.709048 3665 log.cc:1199] T 7786ef435bbd44daae12d3ee4728efb9 P 185c63f61a2645928eeb807d145026b1: Deleting WAL directory at /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-2/wal/wals/7786ef435bbd44daae12d3ee4728efb9
I20260203 21:10:31.709262 3665 ts_tablet_manager.cc:1950] T 7786ef435bbd44daae12d3ee4728efb9 P 185c63f61a2645928eeb807d145026b1: Deleting consensus metadata
I20260203 21:10:31.709893 3667 tablet_bootstrap.cc:492] T 6606bf5d7de047cda4a0523197210c1a P 185c63f61a2645928eeb807d145026b1: No bootstrap required, opened a new log
I20260203 21:10:31.709964 3667 ts_tablet_manager.cc:1403] T 6606bf5d7de047cda4a0523197210c1a P 185c63f61a2645928eeb807d145026b1: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.000s
I20260203 21:10:31.709918 3661 consensus_queue.cc:260] T f8f173ff52ed4daa8b8ddcbeae43bc4a P 6d9e0cecab784cc0acc050ca1c89c5be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } }
I20260203 21:10:31.710392 3667 raft_consensus.cc:359] T 6606bf5d7de047cda4a0523197210c1a P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:31.710482 3667 raft_consensus.cc:385] T 6606bf5d7de047cda4a0523197210c1a P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:31.710510 3667 raft_consensus.cc:740] T 6606bf5d7de047cda4a0523197210c1a P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 185c63f61a2645928eeb807d145026b1, State: Initialized, Role: FOLLOWER
I20260203 21:10:31.710614 3667 consensus_queue.cc:260] T 6606bf5d7de047cda4a0523197210c1a P 185c63f61a2645928eeb807d145026b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:31.710758 3659 ts_tablet_manager.cc:1929] T 7786ef435bbd44daae12d3ee4728efb9 P 6d9e0cecab784cc0acc050ca1c89c5be: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260203 21:10:31.710811 3659 log.cc:1199] T 7786ef435bbd44daae12d3ee4728efb9 P 6d9e0cecab784cc0acc050ca1c89c5be: Deleting WAL directory at /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-1/wal/wals/7786ef435bbd44daae12d3ee4728efb9
I20260203 21:10:31.710875 3667 ts_tablet_manager.cc:1434] T 6606bf5d7de047cda4a0523197210c1a P 185c63f61a2645928eeb807d145026b1: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260203 21:10:31.711048 3659 ts_tablet_manager.cc:1950] T 7786ef435bbd44daae12d3ee4728efb9 P 6d9e0cecab784cc0acc050ca1c89c5be: Deleting consensus metadata
I20260203 21:10:31.711354 3661 ts_tablet_manager.cc:1434] T f8f173ff52ed4daa8b8ddcbeae43bc4a P 6d9e0cecab784cc0acc050ca1c89c5be: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260203 21:10:31.711524 3661 tablet_bootstrap.cc:492] T 576be22c2477419192cc271e46b8e57e P 6d9e0cecab784cc0acc050ca1c89c5be: Bootstrap starting.
I20260203 21:10:31.712471 3661 tablet_bootstrap.cc:654] T 576be22c2477419192cc271e46b8e57e P 6d9e0cecab784cc0acc050ca1c89c5be: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:31.712586 3659 tablet_replica.cc:333] T 3ae68905ec1942448b444ecd01836805 P 6d9e0cecab784cc0acc050ca1c89c5be: stopping tablet replica
I20260203 21:10:31.712682 3659 raft_consensus.cc:2243] T 3ae68905ec1942448b444ecd01836805 P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 LEADER]: Raft consensus shutting down.
I20260203 21:10:31.712826 3659 raft_consensus.cc:2272] T 3ae68905ec1942448b444ecd01836805 P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 21:10:31.713105 3659 ts_tablet_manager.cc:1916] T 3ae68905ec1942448b444ecd01836805 P 6d9e0cecab784cc0acc050ca1c89c5be: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260203 21:10:31.713670 3661 tablet_bootstrap.cc:492] T 576be22c2477419192cc271e46b8e57e P 6d9e0cecab784cc0acc050ca1c89c5be: No bootstrap required, opened a new log
I20260203 21:10:31.713738 3661 ts_tablet_manager.cc:1403] T 576be22c2477419192cc271e46b8e57e P 6d9e0cecab784cc0acc050ca1c89c5be: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260203 21:10:31.714283 3661 raft_consensus.cc:359] T 576be22c2477419192cc271e46b8e57e P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } }
I20260203 21:10:31.714375 3661 raft_consensus.cc:385] T 576be22c2477419192cc271e46b8e57e P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:31.714406 3661 raft_consensus.cc:740] T 576be22c2477419192cc271e46b8e57e P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d9e0cecab784cc0acc050ca1c89c5be, State: Initialized, Role: FOLLOWER
I20260203 21:10:31.714514 3661 consensus_queue.cc:260] T 576be22c2477419192cc271e46b8e57e P 6d9e0cecab784cc0acc050ca1c89c5be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } }
I20260203 21:10:31.714718 3659 ts_tablet_manager.cc:1929] T 3ae68905ec1942448b444ecd01836805 P 6d9e0cecab784cc0acc050ca1c89c5be: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260203 21:10:31.714764 3661 ts_tablet_manager.cc:1434] T 576be22c2477419192cc271e46b8e57e P 6d9e0cecab784cc0acc050ca1c89c5be: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260203 21:10:31.715088 3667 tablet_bootstrap.cc:492] T f8f173ff52ed4daa8b8ddcbeae43bc4a P 185c63f61a2645928eeb807d145026b1: Bootstrap starting.
I20260203 21:10:31.714769 3659 log.cc:1199] T 3ae68905ec1942448b444ecd01836805 P 6d9e0cecab784cc0acc050ca1c89c5be: Deleting WAL directory at /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-1/wal/wals/3ae68905ec1942448b444ecd01836805
I20260203 21:10:31.715943 3659 ts_tablet_manager.cc:1950] T 3ae68905ec1942448b444ecd01836805 P 6d9e0cecab784cc0acc050ca1c89c5be: Deleting consensus metadata
I20260203 21:10:31.716017 3667 tablet_bootstrap.cc:654] T f8f173ff52ed4daa8b8ddcbeae43bc4a P 185c63f61a2645928eeb807d145026b1: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:31.716775 3665 tablet_replica.cc:333] T 3ae68905ec1942448b444ecd01836805 P 185c63f61a2645928eeb807d145026b1: stopping tablet replica
I20260203 21:10:31.716877 3665 raft_consensus.cc:2243] T 3ae68905ec1942448b444ecd01836805 P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 21:10:31.717222 3667 tablet_bootstrap.cc:492] T f8f173ff52ed4daa8b8ddcbeae43bc4a P 185c63f61a2645928eeb807d145026b1: No bootstrap required, opened a new log
I20260203 21:10:31.717288 3667 ts_tablet_manager.cc:1403] T f8f173ff52ed4daa8b8ddcbeae43bc4a P 185c63f61a2645928eeb807d145026b1: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260203 21:10:31.717507 3665 raft_consensus.cc:2272] T 3ae68905ec1942448b444ecd01836805 P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 21:10:31.717749 3667 raft_consensus.cc:359] T f8f173ff52ed4daa8b8ddcbeae43bc4a P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } }
I20260203 21:10:31.717811 3665 ts_tablet_manager.cc:1916] T 3ae68905ec1942448b444ecd01836805 P 185c63f61a2645928eeb807d145026b1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260203 21:10:31.717837 3667 raft_consensus.cc:385] T f8f173ff52ed4daa8b8ddcbeae43bc4a P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:31.717865 3667 raft_consensus.cc:740] T f8f173ff52ed4daa8b8ddcbeae43bc4a P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 185c63f61a2645928eeb807d145026b1, State: Initialized, Role: FOLLOWER
I20260203 21:10:31.718073 3667 consensus_queue.cc:260] T f8f173ff52ed4daa8b8ddcbeae43bc4a P 185c63f61a2645928eeb807d145026b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } }
I20260203 21:10:31.718773 3667 ts_tablet_manager.cc:1434] T f8f173ff52ed4daa8b8ddcbeae43bc4a P 185c63f61a2645928eeb807d145026b1: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260203 21:10:31.718948 3667 tablet_bootstrap.cc:492] T 576be22c2477419192cc271e46b8e57e P 185c63f61a2645928eeb807d145026b1: Bootstrap starting.
I20260203 21:10:31.719820 3665 ts_tablet_manager.cc:1929] T 3ae68905ec1942448b444ecd01836805 P 185c63f61a2645928eeb807d145026b1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260203 21:10:31.719874 3665 log.cc:1199] T 3ae68905ec1942448b444ecd01836805 P 185c63f61a2645928eeb807d145026b1: Deleting WAL directory at /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-2/wal/wals/3ae68905ec1942448b444ecd01836805
I20260203 21:10:31.720082 3665 ts_tablet_manager.cc:1950] T 3ae68905ec1942448b444ecd01836805 P 185c63f61a2645928eeb807d145026b1: Deleting consensus metadata
I20260203 21:10:31.720641 3667 tablet_bootstrap.cc:654] T 576be22c2477419192cc271e46b8e57e P 185c63f61a2645928eeb807d145026b1: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:31.723362 3667 tablet_bootstrap.cc:492] T 576be22c2477419192cc271e46b8e57e P 185c63f61a2645928eeb807d145026b1: No bootstrap required, opened a new log
I20260203 21:10:31.723452 3667 ts_tablet_manager.cc:1403] T 576be22c2477419192cc271e46b8e57e P 185c63f61a2645928eeb807d145026b1: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.002s
I20260203 21:10:31.723930 3667 raft_consensus.cc:359] T 576be22c2477419192cc271e46b8e57e P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } }
I20260203 21:10:31.724004 3667 raft_consensus.cc:385] T 576be22c2477419192cc271e46b8e57e P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:31.724028 3667 raft_consensus.cc:740] T 576be22c2477419192cc271e46b8e57e P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 185c63f61a2645928eeb807d145026b1, State: Initialized, Role: FOLLOWER
I20260203 21:10:31.724123 3667 consensus_queue.cc:260] T 576be22c2477419192cc271e46b8e57e P 185c63f61a2645928eeb807d145026b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } }
I20260203 21:10:31.724483 3667 ts_tablet_manager.cc:1434] T 576be22c2477419192cc271e46b8e57e P 185c63f61a2645928eeb807d145026b1: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20260203 21:10:31.758714 3284 raft_consensus.cc:493] T 6606bf5d7de047cda4a0523197210c1a P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 21:10:31.758858 3284 raft_consensus.cc:515] T 6606bf5d7de047cda4a0523197210c1a P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:31.759328 3284 leader_election.cc:290] T 6606bf5d7de047cda4a0523197210c1a P 6d9e0cecab784cc0acc050ca1c89c5be [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223), 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335)
I20260203 21:10:31.759907 3058 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6606bf5d7de047cda4a0523197210c1a" candidate_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "185c63f61a2645928eeb807d145026b1" is_pre_election: true
I20260203 21:10:31.760042 3058 raft_consensus.cc:2468] T 6606bf5d7de047cda4a0523197210c1a P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d9e0cecab784cc0acc050ca1c89c5be in term 0.
I20260203 21:10:31.760391 2858 leader_election.cc:304] T 6606bf5d7de047cda4a0523197210c1a P 6d9e0cecab784cc0acc050ca1c89c5be [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be; no voters:
W20260203 21:10:31.760531 2857 leader_election.cc:343] T 6606bf5d7de047cda4a0523197210c1a P 6d9e0cecab784cc0acc050ca1c89c5be [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335): Not found: Tablet not found: 6606bf5d7de047cda4a0523197210c1a
I20260203 21:10:31.760594 3284 raft_consensus.cc:2804] T 6606bf5d7de047cda4a0523197210c1a P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 21:10:31.760640 3284 raft_consensus.cc:493] T 6606bf5d7de047cda4a0523197210c1a P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 21:10:31.760682 3284 raft_consensus.cc:3060] T 6606bf5d7de047cda4a0523197210c1a P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:31.761744 3284 raft_consensus.cc:515] T 6606bf5d7de047cda4a0523197210c1a P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:31.762147 3284 leader_election.cc:290] T 6606bf5d7de047cda4a0523197210c1a P 6d9e0cecab784cc0acc050ca1c89c5be [CANDIDATE]: Term 1 election: Requested vote from peers 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223), 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335)
I20260203 21:10:31.762523 3058 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6606bf5d7de047cda4a0523197210c1a" candidate_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "185c63f61a2645928eeb807d145026b1"
I20260203 21:10:31.762641 3058 raft_consensus.cc:3060] T 6606bf5d7de047cda4a0523197210c1a P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Advancing to term 1
W20260203 21:10:31.762754 2857 leader_election.cc:343] T 6606bf5d7de047cda4a0523197210c1a P 6d9e0cecab784cc0acc050ca1c89c5be [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335): Not found: Tablet not found: 6606bf5d7de047cda4a0523197210c1a
I20260203 21:10:31.763397 3058 raft_consensus.cc:2468] T 6606bf5d7de047cda4a0523197210c1a P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d9e0cecab784cc0acc050ca1c89c5be in term 1.
I20260203 21:10:31.763654 2858 leader_election.cc:304] T 6606bf5d7de047cda4a0523197210c1a P 6d9e0cecab784cc0acc050ca1c89c5be [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be; no voters: 02bdf326542e474cbe62434dd59087dc
I20260203 21:10:31.763830 3284 raft_consensus.cc:2804] T 6606bf5d7de047cda4a0523197210c1a P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 FOLLOWER]: Leader election won for term 1
I20260203 21:10:31.764020 3284 raft_consensus.cc:697] T 6606bf5d7de047cda4a0523197210c1a P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 LEADER]: Becoming Leader. State: Replica: 6d9e0cecab784cc0acc050ca1c89c5be, State: Running, Role: LEADER
I20260203 21:10:31.764168 3284 consensus_queue.cc:237] T 6606bf5d7de047cda4a0523197210c1a P 6d9e0cecab784cc0acc050ca1c89c5be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
W20260203 21:10:31.866823 2995 connection.cc:537] server connection from 127.0.0.1:54150 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260203 21:10:31.866852 2508 connection.cc:537] server connection from 127.0.0.1:52994 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260203 21:10:31.866863 2859 connection.cc:537] server connection from 127.0.0.1:50004 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260203 21:10:31.866919 2721 connection.cc:537] client connection to 127.2.32.190:35419 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260203 21:10:31.866993 2859 connection.cc:537] client connection to 127.2.32.190:35419 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260203 21:10:31.867591 3115 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.2.32.190:35419)
W20260203 21:10:31.867870 3115 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.2.32.190:35419)
W20260203 21:10:31.868101 3115 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.2.32.190:35419)
W20260203 21:10:31.877663 3115 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.2.32.190:35419)
W20260203 21:10:31.881038 2721 consensus_peers.cc:597] T 2f8e36b89ebf456d964c9a31f7c7636a P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2f8e36b89ebf456d964c9a31f7c7636a. This is attempt 1: this message will repeat every 5th retry.
I20260203 21:10:31.917510 3524 raft_consensus.cc:493] T 576be22c2477419192cc271e46b8e57e P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 21:10:31.917650 3524 raft_consensus.cc:515] T 576be22c2477419192cc271e46b8e57e P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } }
I20260203 21:10:31.918077 3524 leader_election.cc:290] T 576be22c2477419192cc271e46b8e57e P 185c63f61a2645928eeb807d145026b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335), 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897)
I20260203 21:10:31.918453 2922 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "576be22c2477419192cc271e46b8e57e" candidate_uuid: "185c63f61a2645928eeb807d145026b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" is_pre_election: true
I20260203 21:10:31.918614 2922 raft_consensus.cc:2468] T 576be22c2477419192cc271e46b8e57e P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 185c63f61a2645928eeb807d145026b1 in term 0.
W20260203 21:10:31.918740 2993 leader_election.cc:343] T 576be22c2477419192cc271e46b8e57e P 185c63f61a2645928eeb807d145026b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335): Not found: Tablet not found: 576be22c2477419192cc271e46b8e57e
I20260203 21:10:31.918957 2995 leader_election.cc:304] T 576be22c2477419192cc271e46b8e57e P 185c63f61a2645928eeb807d145026b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be; no voters: 02bdf326542e474cbe62434dd59087dc
I20260203 21:10:31.919137 3524 raft_consensus.cc:2804] T 576be22c2477419192cc271e46b8e57e P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 21:10:31.919190 3524 raft_consensus.cc:493] T 576be22c2477419192cc271e46b8e57e P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 21:10:31.919217 3524 raft_consensus.cc:3060] T 576be22c2477419192cc271e46b8e57e P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:31.920089 3524 raft_consensus.cc:515] T 576be22c2477419192cc271e46b8e57e P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } }
I20260203 21:10:31.920423 3524 leader_election.cc:290] T 576be22c2477419192cc271e46b8e57e P 185c63f61a2645928eeb807d145026b1 [CANDIDATE]: Term 1 election: Requested vote from peers 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335), 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897)
I20260203 21:10:31.920795 2922 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "576be22c2477419192cc271e46b8e57e" candidate_uuid: "185c63f61a2645928eeb807d145026b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d9e0cecab784cc0acc050ca1c89c5be"
I20260203 21:10:31.920925 2922 raft_consensus.cc:3060] T 576be22c2477419192cc271e46b8e57e P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Advancing to term 1
W20260203 21:10:31.921012 2993 leader_election.cc:343] T 576be22c2477419192cc271e46b8e57e P 185c63f61a2645928eeb807d145026b1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335): Not found: Tablet not found: 576be22c2477419192cc271e46b8e57e
I20260203 21:10:31.921698 2922 raft_consensus.cc:2468] T 576be22c2477419192cc271e46b8e57e P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 185c63f61a2645928eeb807d145026b1 in term 1.
I20260203 21:10:31.921954 2995 leader_election.cc:304] T 576be22c2477419192cc271e46b8e57e P 185c63f61a2645928eeb807d145026b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be; no voters: 02bdf326542e474cbe62434dd59087dc
I20260203 21:10:31.922106 3524 raft_consensus.cc:2804] T 576be22c2477419192cc271e46b8e57e P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260203 21:10:31.922294 3524 raft_consensus.cc:697] T 576be22c2477419192cc271e46b8e57e P 185c63f61a2645928eeb807d145026b1 [term 1 LEADER]: Becoming Leader. State: Replica: 185c63f61a2645928eeb807d145026b1, State: Running, Role: LEADER
I20260203 21:10:31.922426 3524 consensus_queue.cc:237] T 576be22c2477419192cc271e46b8e57e P 185c63f61a2645928eeb807d145026b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } }
I20260203 21:10:32.035782 3524 raft_consensus.cc:493] T f8f173ff52ed4daa8b8ddcbeae43bc4a P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 21:10:32.035916 3524 raft_consensus.cc:515] T f8f173ff52ed4daa8b8ddcbeae43bc4a P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } }
I20260203 21:10:32.036332 3524 leader_election.cc:290] T f8f173ff52ed4daa8b8ddcbeae43bc4a P 185c63f61a2645928eeb807d145026b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335), 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897)
I20260203 21:10:32.036697 2922 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f8f173ff52ed4daa8b8ddcbeae43bc4a" candidate_uuid: "185c63f61a2645928eeb807d145026b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" is_pre_election: true
I20260203 21:10:32.036823 2922 raft_consensus.cc:2468] T f8f173ff52ed4daa8b8ddcbeae43bc4a P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 185c63f61a2645928eeb807d145026b1 in term 0.
W20260203 21:10:32.036923 2993 leader_election.cc:343] T f8f173ff52ed4daa8b8ddcbeae43bc4a P 185c63f61a2645928eeb807d145026b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335): Not found: Tablet not found: f8f173ff52ed4daa8b8ddcbeae43bc4a
I20260203 21:10:32.037091 2995 leader_election.cc:304] T f8f173ff52ed4daa8b8ddcbeae43bc4a P 185c63f61a2645928eeb807d145026b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be; no voters: 02bdf326542e474cbe62434dd59087dc
I20260203 21:10:32.037293 3524 raft_consensus.cc:2804] T f8f173ff52ed4daa8b8ddcbeae43bc4a P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 21:10:32.037351 3524 raft_consensus.cc:493] T f8f173ff52ed4daa8b8ddcbeae43bc4a P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 21:10:32.037387 3524 raft_consensus.cc:3060] T f8f173ff52ed4daa8b8ddcbeae43bc4a P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:32.038144 3524 raft_consensus.cc:515] T f8f173ff52ed4daa8b8ddcbeae43bc4a P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } }
I20260203 21:10:32.038430 3524 leader_election.cc:290] T f8f173ff52ed4daa8b8ddcbeae43bc4a P 185c63f61a2645928eeb807d145026b1 [CANDIDATE]: Term 1 election: Requested vote from peers 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335), 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897)
I20260203 21:10:32.038734 2922 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f8f173ff52ed4daa8b8ddcbeae43bc4a" candidate_uuid: "185c63f61a2645928eeb807d145026b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d9e0cecab784cc0acc050ca1c89c5be"
I20260203 21:10:32.038836 2922 raft_consensus.cc:3060] T f8f173ff52ed4daa8b8ddcbeae43bc4a P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Advancing to term 1
W20260203 21:10:32.038883 2993 leader_election.cc:343] T f8f173ff52ed4daa8b8ddcbeae43bc4a P 185c63f61a2645928eeb807d145026b1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335): Not found: Tablet not found: f8f173ff52ed4daa8b8ddcbeae43bc4a
I20260203 21:10:32.039577 2922 raft_consensus.cc:2468] T f8f173ff52ed4daa8b8ddcbeae43bc4a P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 185c63f61a2645928eeb807d145026b1 in term 1.
I20260203 21:10:32.039852 2995 leader_election.cc:304] T f8f173ff52ed4daa8b8ddcbeae43bc4a P 185c63f61a2645928eeb807d145026b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be; no voters: 02bdf326542e474cbe62434dd59087dc
I20260203 21:10:32.039994 3524 raft_consensus.cc:2804] T f8f173ff52ed4daa8b8ddcbeae43bc4a P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260203 21:10:32.040102 3524 raft_consensus.cc:697] T f8f173ff52ed4daa8b8ddcbeae43bc4a P 185c63f61a2645928eeb807d145026b1 [term 1 LEADER]: Becoming Leader. State: Replica: 185c63f61a2645928eeb807d145026b1, State: Running, Role: LEADER
I20260203 21:10:32.040237 3524 consensus_queue.cc:237] T f8f173ff52ed4daa8b8ddcbeae43bc4a P 185c63f61a2645928eeb807d145026b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } }
I20260203 21:10:32.147248 3678 consensus_queue.cc:1048] T 6606bf5d7de047cda4a0523197210c1a P 6d9e0cecab784cc0acc050ca1c89c5be [LEADER]: Connected to new peer: Peer: permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260203 21:10:32.151067 2857 consensus_peers.cc:597] T 6606bf5d7de047cda4a0523197210c1a P 6d9e0cecab784cc0acc050ca1c89c5be -> Peer 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335): Couldn't send request to peer 02bdf326542e474cbe62434dd59087dc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6606bf5d7de047cda4a0523197210c1a. This is attempt 1: this message will repeat every 5th retry.
I20260203 21:10:32.203346 3689 raft_consensus.cc:493] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7344d7cd8dea4fa2ae705320daacaf49)
I20260203 21:10:32.203469 3689 raft_consensus.cc:515] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:10:32.203876 3689 leader_election.cc:290] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419), 8a7e51013f5041898fe34f4b64a59260 (127.2.32.188:33665)
W20260203 21:10:32.204890 2507 leader_election.cc:336] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 8a7e51013f5041898fe34f4b64a59260 (127.2.32.188:33665): Network error: Client connection negotiation failed: client connection to 127.2.32.188:33665: connect: Connection refused (error 111)
W20260203 21:10:32.204982 2510 leader_election.cc:336] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419): Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111)
I20260203 21:10:32.205065 2510 leader_election.cc:304] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35397be7e61f4b27a49e9449b9fdf085; no voters: 7344d7cd8dea4fa2ae705320daacaf49, 8a7e51013f5041898fe34f4b64a59260
I20260203 21:10:32.205202 3689 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260203 21:10:32.402482 3524 consensus_queue.cc:1048] T 576be22c2477419192cc271e46b8e57e P 185c63f61a2645928eeb807d145026b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260203 21:10:32.405999 2993 consensus_peers.cc:597] T 576be22c2477419192cc271e46b8e57e P 185c63f61a2645928eeb807d145026b1 -> Peer 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335): Couldn't send request to peer 02bdf326542e474cbe62434dd59087dc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 576be22c2477419192cc271e46b8e57e. This is attempt 1: this message will repeat every 5th retry.
W20260203 21:10:32.514933 2993 consensus_peers.cc:597] T f8f173ff52ed4daa8b8ddcbeae43bc4a P 185c63f61a2645928eeb807d145026b1 -> Peer 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335): Couldn't send request to peer 02bdf326542e474cbe62434dd59087dc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f8f173ff52ed4daa8b8ddcbeae43bc4a. This is attempt 1: this message will repeat every 5th retry.
I20260203 21:10:32.590885 3700 consensus_queue.cc:1048] T f8f173ff52ed4daa8b8ddcbeae43bc4a P 185c63f61a2645928eeb807d145026b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 21:10:32.673013 3703 ts_tablet_manager.cc:933] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc: Initiating tablet copy from peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897)
I20260203 21:10:32.673621 3703 tablet_copy_client.cc:323] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc: tablet copy: Beginning tablet copy session from remote peer at address 127.2.32.130:38897
I20260203 21:10:32.674386 2943 tablet_copy_service.cc:140] P 6d9e0cecab784cc0acc050ca1c89c5be: Received BeginTabletCopySession request for tablet 6606bf5d7de047cda4a0523197210c1a from peer 02bdf326542e474cbe62434dd59087dc ({username='slave'} at 127.2.32.129:38951)
I20260203 21:10:32.674533 2943 tablet_copy_service.cc:161] P 6d9e0cecab784cc0acc050ca1c89c5be: Beginning new tablet copy session on tablet 6606bf5d7de047cda4a0523197210c1a from peer 02bdf326542e474cbe62434dd59087dc at {username='slave'} at 127.2.32.129:38951: session id = 02bdf326542e474cbe62434dd59087dc-6606bf5d7de047cda4a0523197210c1a
I20260203 21:10:32.675897 2943 tablet_copy_source_session.cc:215] T 6606bf5d7de047cda4a0523197210c1a P 6d9e0cecab784cc0acc050ca1c89c5be: Tablet Copy: opened 0 blocks and 1 log segments
I20260203 21:10:32.677464 3703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6606bf5d7de047cda4a0523197210c1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:32.679394 3703 tablet_copy_client.cc:806] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc: tablet copy: Starting download of 0 data blocks...
I20260203 21:10:32.679570 3703 tablet_copy_client.cc:670] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc: tablet copy: Starting download of 1 WAL segments...
I20260203 21:10:32.681241 3703 tablet_copy_client.cc:538] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260203 21:10:32.682619 3703 tablet_bootstrap.cc:492] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc: Bootstrap starting.
I20260203 21:10:32.686125 3703 tablet_bootstrap.cc:492] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260203 21:10:32.686385 3703 tablet_bootstrap.cc:492] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc: Bootstrap complete.
I20260203 21:10:32.686534 3703 ts_tablet_manager.cc:1403] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc: Time spent bootstrapping tablet: real 0.004s user 0.004s sys 0.000s
I20260203 21:10:32.686954 3703 raft_consensus.cc:359] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:32.687042 3703 raft_consensus.cc:740] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02bdf326542e474cbe62434dd59087dc, State: Initialized, Role: FOLLOWER
I20260203 21:10:32.687186 3703 consensus_queue.cc:260] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:32.687474 3703 ts_tablet_manager.cc:1434] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260203 21:10:32.688280 2943 tablet_copy_service.cc:342] P 6d9e0cecab784cc0acc050ca1c89c5be: Request end of tablet copy session 02bdf326542e474cbe62434dd59087dc-6606bf5d7de047cda4a0523197210c1a received from {username='slave'} at 127.2.32.129:38951
I20260203 21:10:32.688397 2943 tablet_copy_service.cc:434] P 6d9e0cecab784cc0acc050ca1c89c5be: ending tablet copy session 02bdf326542e474cbe62434dd59087dc-6606bf5d7de047cda4a0523197210c1a on tablet 6606bf5d7de047cda4a0523197210c1a with peer 02bdf326542e474cbe62434dd59087dc
I20260203 21:10:32.757966 3706 raft_consensus.cc:493] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7344d7cd8dea4fa2ae705320daacaf49)
I20260203 21:10:32.758090 3706 raft_consensus.cc:515] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:10:32.758533 3706 leader_election.cc:290] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419), 8a7e51013f5041898fe34f4b64a59260 (127.2.32.188:33665)
W20260203 21:10:32.759613 2510 leader_election.cc:336] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419): Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111)
W20260203 21:10:32.759732 2507 leader_election.cc:336] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 8a7e51013f5041898fe34f4b64a59260 (127.2.32.188:33665): Network error: Client connection negotiation failed: client connection to 127.2.32.188:33665: connect: Connection refused (error 111)
I20260203 21:10:32.759814 2507 leader_election.cc:304] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35397be7e61f4b27a49e9449b9fdf085; no voters: 7344d7cd8dea4fa2ae705320daacaf49, 8a7e51013f5041898fe34f4b64a59260
I20260203 21:10:32.759948 3706 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260203 21:10:32.804687 3703 ts_tablet_manager.cc:933] T 576be22c2477419192cc271e46b8e57e P 02bdf326542e474cbe62434dd59087dc: Initiating tablet copy from peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
I20260203 21:10:32.805042 3703 tablet_copy_client.cc:323] T 576be22c2477419192cc271e46b8e57e P 02bdf326542e474cbe62434dd59087dc: tablet copy: Beginning tablet copy session from remote peer at address 127.2.32.131:40223
I20260203 21:10:32.805622 3079 tablet_copy_service.cc:140] P 185c63f61a2645928eeb807d145026b1: Received BeginTabletCopySession request for tablet 576be22c2477419192cc271e46b8e57e from peer 02bdf326542e474cbe62434dd59087dc ({username='slave'} at 127.2.32.129:53319)
I20260203 21:10:32.805743 3079 tablet_copy_service.cc:161] P 185c63f61a2645928eeb807d145026b1: Beginning new tablet copy session on tablet 576be22c2477419192cc271e46b8e57e from peer 02bdf326542e474cbe62434dd59087dc at {username='slave'} at 127.2.32.129:53319: session id = 02bdf326542e474cbe62434dd59087dc-576be22c2477419192cc271e46b8e57e
I20260203 21:10:32.807029 3079 tablet_copy_source_session.cc:215] T 576be22c2477419192cc271e46b8e57e P 185c63f61a2645928eeb807d145026b1: Tablet Copy: opened 0 blocks and 1 log segments
I20260203 21:10:32.808035 3703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 576be22c2477419192cc271e46b8e57e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:32.809700 3703 tablet_copy_client.cc:806] T 576be22c2477419192cc271e46b8e57e P 02bdf326542e474cbe62434dd59087dc: tablet copy: Starting download of 0 data blocks...
I20260203 21:10:32.809839 3703 tablet_copy_client.cc:670] T 576be22c2477419192cc271e46b8e57e P 02bdf326542e474cbe62434dd59087dc: tablet copy: Starting download of 1 WAL segments...
I20260203 21:10:32.811098 3703 tablet_copy_client.cc:538] T 576be22c2477419192cc271e46b8e57e P 02bdf326542e474cbe62434dd59087dc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260203 21:10:32.812103 3703 tablet_bootstrap.cc:492] T 576be22c2477419192cc271e46b8e57e P 02bdf326542e474cbe62434dd59087dc: Bootstrap starting.
I20260203 21:10:32.814538 3703 tablet_bootstrap.cc:492] T 576be22c2477419192cc271e46b8e57e P 02bdf326542e474cbe62434dd59087dc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260203 21:10:32.814767 3703 tablet_bootstrap.cc:492] T 576be22c2477419192cc271e46b8e57e P 02bdf326542e474cbe62434dd59087dc: Bootstrap complete.
I20260203 21:10:32.814913 3703 ts_tablet_manager.cc:1403] T 576be22c2477419192cc271e46b8e57e P 02bdf326542e474cbe62434dd59087dc: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260203 21:10:32.815392 3703 raft_consensus.cc:359] T 576be22c2477419192cc271e46b8e57e P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } }
I20260203 21:10:32.815510 3703 raft_consensus.cc:740] T 576be22c2477419192cc271e46b8e57e P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02bdf326542e474cbe62434dd59087dc, State: Initialized, Role: FOLLOWER
I20260203 21:10:32.815639 3703 consensus_queue.cc:260] T 576be22c2477419192cc271e46b8e57e P 02bdf326542e474cbe62434dd59087dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } }
I20260203 21:10:32.815948 3703 ts_tablet_manager.cc:1434] T 576be22c2477419192cc271e46b8e57e P 02bdf326542e474cbe62434dd59087dc: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
I20260203 21:10:32.817464 3079 tablet_copy_service.cc:342] P 185c63f61a2645928eeb807d145026b1: Request end of tablet copy session 02bdf326542e474cbe62434dd59087dc-576be22c2477419192cc271e46b8e57e received from {username='slave'} at 127.2.32.129:53319
I20260203 21:10:32.817571 3079 tablet_copy_service.cc:434] P 185c63f61a2645928eeb807d145026b1: ending tablet copy session 02bdf326542e474cbe62434dd59087dc-576be22c2477419192cc271e46b8e57e on tablet 576be22c2477419192cc271e46b8e57e with peer 02bdf326542e474cbe62434dd59087dc
I20260203 21:10:32.898289 3694 raft_consensus.cc:493] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d9e0cecab784cc0acc050ca1c89c5be)
I20260203 21:10:32.898439 3694 raft_consensus.cc:515] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:32.898809 3703 ts_tablet_manager.cc:933] T f8f173ff52ed4daa8b8ddcbeae43bc4a P 02bdf326542e474cbe62434dd59087dc: Initiating tablet copy from peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
I20260203 21:10:32.898891 3694 leader_election.cc:290] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
I20260203 21:10:32.899123 3703 tablet_copy_client.cc:323] T f8f173ff52ed4daa8b8ddcbeae43bc4a P 02bdf326542e474cbe62434dd59087dc: tablet copy: Beginning tablet copy session from remote peer at address 127.2.32.131:40223
W20260203 21:10:32.899474 2721 leader_election.cc:343] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 3ae68905ec1942448b444ecd01836805
I20260203 21:10:32.899578 3079 tablet_copy_service.cc:140] P 185c63f61a2645928eeb807d145026b1: Received BeginTabletCopySession request for tablet f8f173ff52ed4daa8b8ddcbeae43bc4a from peer 02bdf326542e474cbe62434dd59087dc ({username='slave'} at 127.2.32.129:53319)
I20260203 21:10:32.899705 3079 tablet_copy_service.cc:161] P 185c63f61a2645928eeb807d145026b1: Beginning new tablet copy session on tablet f8f173ff52ed4daa8b8ddcbeae43bc4a from peer 02bdf326542e474cbe62434dd59087dc at {username='slave'} at 127.2.32.129:53319: session id = 02bdf326542e474cbe62434dd59087dc-f8f173ff52ed4daa8b8ddcbeae43bc4a
W20260203 21:10:32.899698 2720 leader_election.cc:343] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 3ae68905ec1942448b444ecd01836805
I20260203 21:10:32.899762 2720 leader_election.cc:304] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:10:32.899904 3694 raft_consensus.cc:2749] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:10:32.900475 3079 tablet_copy_source_session.cc:215] T f8f173ff52ed4daa8b8ddcbeae43bc4a P 185c63f61a2645928eeb807d145026b1: Tablet Copy: opened 0 blocks and 1 log segments
I20260203 21:10:32.901204 3703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8f173ff52ed4daa8b8ddcbeae43bc4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:32.903138 3703 tablet_copy_client.cc:806] T f8f173ff52ed4daa8b8ddcbeae43bc4a P 02bdf326542e474cbe62434dd59087dc: tablet copy: Starting download of 0 data blocks...
I20260203 21:10:32.903272 3703 tablet_copy_client.cc:670] T f8f173ff52ed4daa8b8ddcbeae43bc4a P 02bdf326542e474cbe62434dd59087dc: tablet copy: Starting download of 1 WAL segments...
I20260203 21:10:32.904191 3703 tablet_copy_client.cc:538] T f8f173ff52ed4daa8b8ddcbeae43bc4a P 02bdf326542e474cbe62434dd59087dc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260203 21:10:32.905181 3703 tablet_bootstrap.cc:492] T f8f173ff52ed4daa8b8ddcbeae43bc4a P 02bdf326542e474cbe62434dd59087dc: Bootstrap starting.
I20260203 21:10:32.907748 3703 tablet_bootstrap.cc:492] T f8f173ff52ed4daa8b8ddcbeae43bc4a P 02bdf326542e474cbe62434dd59087dc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260203 21:10:32.907931 3703 tablet_bootstrap.cc:492] T f8f173ff52ed4daa8b8ddcbeae43bc4a P 02bdf326542e474cbe62434dd59087dc: Bootstrap complete.
I20260203 21:10:32.908056 3703 ts_tablet_manager.cc:1403] T f8f173ff52ed4daa8b8ddcbeae43bc4a P 02bdf326542e474cbe62434dd59087dc: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.003s
I20260203 21:10:32.908601 3703 raft_consensus.cc:359] T f8f173ff52ed4daa8b8ddcbeae43bc4a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } }
I20260203 21:10:32.908689 3703 raft_consensus.cc:740] T f8f173ff52ed4daa8b8ddcbeae43bc4a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02bdf326542e474cbe62434dd59087dc, State: Initialized, Role: FOLLOWER
I20260203 21:10:32.908812 3703 consensus_queue.cc:260] T f8f173ff52ed4daa8b8ddcbeae43bc4a P 02bdf326542e474cbe62434dd59087dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } }
I20260203 21:10:32.909051 3703 ts_tablet_manager.cc:1434] T f8f173ff52ed4daa8b8ddcbeae43bc4a P 02bdf326542e474cbe62434dd59087dc: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260203 21:10:32.909430 3079 tablet_copy_service.cc:342] P 185c63f61a2645928eeb807d145026b1: Request end of tablet copy session 02bdf326542e474cbe62434dd59087dc-f8f173ff52ed4daa8b8ddcbeae43bc4a received from {username='slave'} at 127.2.32.129:53319
I20260203 21:10:32.909507 3079 tablet_copy_service.cc:434] P 185c63f61a2645928eeb807d145026b1: ending tablet copy session 02bdf326542e474cbe62434dd59087dc-f8f173ff52ed4daa8b8ddcbeae43bc4a on tablet f8f173ff52ed4daa8b8ddcbeae43bc4a with peer 02bdf326542e474cbe62434dd59087dc
I20260203 21:10:33.021961 3695 raft_consensus.cc:493] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:10:33.022094 3695 raft_consensus.cc:515] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:33.022516 3695 leader_election.cc:290] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:10:33.023176 2720 leader_election.cc:343] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 7786ef435bbd44daae12d3ee4728efb9
W20260203 21:10:33.023284 2721 leader_election.cc:343] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 7786ef435bbd44daae12d3ee4728efb9
I20260203 21:10:33.023343 2721 leader_election.cc:304] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:10:33.023469 3695 raft_consensus.cc:2749] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:10:33.100328 3695 raft_consensus.cc:493] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d9e0cecab784cc0acc050ca1c89c5be)
I20260203 21:10:33.100445 3695 raft_consensus.cc:515] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:33.100792 3695 leader_election.cc:290] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:10:33.101307 2721 leader_election.cc:343] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: a375114bebc64385827b7b6e0060d1e4
W20260203 21:10:33.101387 2720 leader_election.cc:343] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: a375114bebc64385827b7b6e0060d1e4
I20260203 21:10:33.101476 2720 leader_election.cc:304] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:10:33.101621 3695 raft_consensus.cc:2749] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:10:33.124873 2784 raft_consensus.cc:1217] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Deduplicated request from leader. Original: 0.0->[1.1-1.1] Dedup: 1.1->[]
I20260203 21:10:33.141623 3695 raft_consensus.cc:493] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:10:33.141729 3695 raft_consensus.cc:515] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } }
I20260203 21:10:33.142117 3695 leader_election.cc:290] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223), 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897)
W20260203 21:10:33.142757 2721 leader_election.cc:343] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 06b80064d47349c2830718f553ba3d7d
W20260203 21:10:33.142853 2720 leader_election.cc:343] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 06b80064d47349c2830718f553ba3d7d
I20260203 21:10:33.142941 2720 leader_election.cc:304] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:10:33.143065 3695 raft_consensus.cc:2749] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:10:33.198899 2784 raft_consensus.cc:1217] T 576be22c2477419192cc271e46b8e57e P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Deduplicated request from leader. Original: 0.0->[1.1-1.1] Dedup: 1.1->[]
I20260203 21:10:33.279268 3721 raft_consensus.cc:493] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7344d7cd8dea4fa2ae705320daacaf49)
I20260203 21:10:33.279397 3721 raft_consensus.cc:515] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:10:33.279812 3721 leader_election.cc:290] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419), 8a7e51013f5041898fe34f4b64a59260 (127.2.32.188:33665)
W20260203 21:10:33.281060 2507 leader_election.cc:336] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 8a7e51013f5041898fe34f4b64a59260 (127.2.32.188:33665): Network error: Client connection negotiation failed: client connection to 127.2.32.188:33665: connect: Connection refused (error 111)
W20260203 21:10:33.281157 2510 leader_election.cc:336] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419): Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111)
I20260203 21:10:33.281215 2510 leader_election.cc:304] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35397be7e61f4b27a49e9449b9fdf085; no voters: 7344d7cd8dea4fa2ae705320daacaf49, 8a7e51013f5041898fe34f4b64a59260
I20260203 21:10:33.281351 3721 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260203 21:10:33.360294 2178 external_mini_cluster.cc:1658] Killing /tmp/dist-test-task0vmSZW/build/debug/bin/kudu with pid 2489
I20260203 21:10:33.426898 2784 raft_consensus.cc:1217] T f8f173ff52ed4daa8b8ddcbeae43bc4a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Deduplicated request from leader. Original: 0.0->[1.1-1.1] Dedup: 1.1->[]
I20260203 21:10:34.325894 2178 external_mini_cluster.cc:1366] Running /tmp/dist-test-task0vmSZW/build/debug/bin/kudu
/tmp/dist-test-task0vmSZW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.32.189:42681
--webserver_interface=127.2.32.189
--webserver_port=35415
--builtin_ntp_servers=127.2.32.148:39497
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665
--hive_metastore_uris=thrift://127.0.0.1:33779
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260203 21:10:34.432547 3734 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260203 21:10:34.432760 3734 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260203 21:10:34.432799 3734 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260203 21:10:34.436401 3734 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260203 21:10:34.436476 3734 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260203 21:10:34.436496 3734 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260203 21:10:34.436514 3734 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260203 21:10:34.440660 3734 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.32.148:39497
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-1/wal
--hive_metastore_uris=thrift://127.0.0.1:33779
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.32.189:42681
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.2.32.189
--webserver_port=35415
--never_fsync=true
--heap_profile_path=/tmp/kudu.3734
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 0efbebd487e7d0c7f21ab0d5a91e0fa70046af83
build type DEBUG
built by None at 03 Feb 2026 20:50:43 UTC on 24a791456cd2
build id 10330
I20260203 21:10:34.441744 3734 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260203 21:10:34.442850 3734 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260203 21:10:34.448068 3744 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260203 21:10:34.448078 3743 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260203 21:10:34.448102 3746 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260203 21:10:34.448179 3734 server_base.cc:1060] running on GCE node
I20260203 21:10:34.448750 3734 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260203 21:10:34.449548 3734 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260203 21:10:34.450690 3734 hybrid_clock.cc:648] HybridClock initialized: now 1770153034450679 us; error 24 us; skew 500 ppm
I20260203 21:10:34.452311 3734 webserver.cc:492] Webserver started at http://127.2.32.189:35415/ using document root <none> and password file <none>
I20260203 21:10:34.452833 3734 fs_manager.cc:362] Metadata directory not provided
I20260203 21:10:34.452903 3734 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260203 21:10:34.456007 3734 fs_manager.cc:714] Time spent opening directory manager: real 0.002s user 0.000s sys 0.003s
I20260203 21:10:34.457901 3752 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260203 21:10:34.458851 3734 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260203 21:10:34.458940 3734 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-1/data,/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-1/wal
uuid: "35397be7e61f4b27a49e9449b9fdf085"
format_stamp: "Formatted at 2026-02-03 21:10:25 on dist-test-slave-npns"
I20260203 21:10:34.459290 3734 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260203 21:10:34.469988 3734 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260203 21:10:34.470551 3734 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260203 21:10:34.470685 3734 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260203 21:10:34.477146 3804 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.32.189:42681 every 8 connection(s)
I20260203 21:10:34.477150 3734 rpc_server.cc:307] RPC server started. Bound to: 127.2.32.189:42681
I20260203 21:10:34.478184 3734 server_base.cc:1192] Dumped server information to /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-1/data/info.pb
I20260203 21:10:34.481144 2178 external_mini_cluster.cc:1428] Started /tmp/dist-test-task0vmSZW/build/debug/bin/kudu as pid 3734
I20260203 21:10:34.482861 3805 sys_catalog.cc:263] Verifying existing consensus state
I20260203 21:10:34.484862 3805 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085: Bootstrap starting.
I20260203 21:10:34.495481 3805 log.cc:826] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085: Log is configured to *not* fsync() on all Append() calls
I20260203 21:10:34.502058 2833 heartbeater.cc:344] Connected to a master server at 127.2.32.189:42681
I20260203 21:10:34.543777 3805 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085: Bootstrap replayed 1/1 log segments. Stats: ops{read=100 overwritten=0 applied=99 ignored=0} inserts{seen=63 ignored=0} mutations{seen=81 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260203 21:10:34.544241 3805 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085: Bootstrap complete.
I20260203 21:10:34.546896 3805 raft_consensus.cc:359] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [term 4 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:10:34.548296 3805 raft_consensus.cc:740] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [term 4 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35397be7e61f4b27a49e9449b9fdf085, State: Initialized, Role: FOLLOWER
I20260203 21:10:34.548722 3805 consensus_queue.cc:260] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 99, Last appended: 4.100, Last appended by leader: 100, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:10:34.549131 3810 sys_catalog.cc:455] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 4 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } } }
I20260203 21:10:34.549242 3810 sys_catalog.cc:458] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [sys.catalog]: This master's current role is: FOLLOWER
I20260203 21:10:34.549736 3805 sys_catalog.cc:565] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [sys.catalog]: configured and running, proceeding with master startup.
I20260203 21:10:34.556056 3824 catalog_manager.cc:1269] Loaded cluster ID: f46367a11713484f92c1d2be2585f5a6
I20260203 21:10:34.554661 3734 master_runner.cc:186] Error getting master registration for 127.2.32.190:35419: Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111),
I20260203 21:10:34.557200 3734 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260203 21:10:34.556221 3824 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085: loading cluster ID for follower catalog manager: success
I20260203 21:10:34.560087 3824 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085: acquiring CA information for follower catalog manager: success
I20260203 21:10:34.562152 3824 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260203 21:10:34.631407 2971 heartbeater.cc:344] Connected to a master server at 127.2.32.189:42681
I20260203 21:10:34.633246 3769 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" instance_seqno: 1770153026289802) as {username='slave'} at 127.2.32.130:41271; Asking this server to re-register.
I20260203 21:10:34.633708 2971 heartbeater.cc:461] Registering TS with master...
I20260203 21:10:34.635126 3769 ts_manager.cc:194] Registered new tserver with Master: 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897)
I20260203 21:10:34.802983 3695 raft_consensus.cc:493] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:10:34.803133 3695 raft_consensus.cc:515] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:34.803531 3695 leader_election.cc:290] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:10:34.804239 2721 leader_election.cc:343] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 7786ef435bbd44daae12d3ee4728efb9
W20260203 21:10:34.804327 2720 leader_election.cc:343] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 7786ef435bbd44daae12d3ee4728efb9
I20260203 21:10:34.804422 2720 leader_election.cc:304] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:10:34.804559 3695 raft_consensus.cc:2749] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:10:34.926589 3695 raft_consensus.cc:493] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d9e0cecab784cc0acc050ca1c89c5be)
I20260203 21:10:34.926730 3695 raft_consensus.cc:515] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:34.927143 3695 leader_election.cc:290] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:10:34.927911 2720 leader_election.cc:343] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: a375114bebc64385827b7b6e0060d1e4
W20260203 21:10:34.928023 2721 leader_election.cc:343] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: a375114bebc64385827b7b6e0060d1e4
I20260203 21:10:34.928109 2721 leader_election.cc:304] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:10:34.928242 3695 raft_consensus.cc:2749] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:10:34.933439 3107 heartbeater.cc:344] Connected to a master server at 127.2.32.189:42681
I20260203 21:10:34.934469 3769 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "185c63f61a2645928eeb807d145026b1" instance_seqno: 1770153026474418) as {username='slave'} at 127.2.32.131:47151; Asking this server to re-register.
I20260203 21:10:34.934859 3107 heartbeater.cc:461] Registering TS with master...
I20260203 21:10:34.935819 3769 ts_manager.cc:194] Registered new tserver with Master: 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
I20260203 21:10:34.941980 3769 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "02bdf326542e474cbe62434dd59087dc" instance_seqno: 1770153026114330) as {username='slave'} at 127.2.32.129:60743; Asking this server to re-register.
I20260203 21:10:34.942406 2833 heartbeater.cc:461] Registering TS with master...
I20260203 21:10:34.943295 3769 ts_manager.cc:194] Registered new tserver with Master: 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335)
I20260203 21:10:34.965021 3695 raft_consensus.cc:493] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d9e0cecab784cc0acc050ca1c89c5be)
I20260203 21:10:34.965152 3695 raft_consensus.cc:515] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:34.965555 3695 leader_election.cc:290] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:10:34.966166 2720 leader_election.cc:343] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 3ae68905ec1942448b444ecd01836805
W20260203 21:10:34.966286 2721 leader_election.cc:343] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 3ae68905ec1942448b444ecd01836805
I20260203 21:10:34.966325 2721 leader_election.cc:304] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:10:34.966450 3695 raft_consensus.cc:2749] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:10:35.024886 3695 raft_consensus.cc:493] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:10:35.025024 3695 raft_consensus.cc:515] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } }
I20260203 21:10:35.025421 3695 leader_election.cc:290] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223), 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897)
W20260203 21:10:35.026106 2721 leader_election.cc:343] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 06b80064d47349c2830718f553ba3d7d
W20260203 21:10:35.026211 2720 leader_election.cc:343] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 06b80064d47349c2830718f553ba3d7d
I20260203 21:10:35.026273 2720 leader_election.cc:304] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:10:35.026394 3695 raft_consensus.cc:2749] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:10:35.167774 3834 raft_consensus.cc:493] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 21:10:35.167958 3834 raft_consensus.cc:515] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:10:35.169225 3834 leader_election.cc:290] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419), 8a7e51013f5041898fe34f4b64a59260 (127.2.32.188:33665)
W20260203 21:10:35.169951 3753 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.32.188:33665: connect: Connection refused (error 111)
W20260203 21:10:35.170656 3756 leader_election.cc:336] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419): Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111)
W20260203 21:10:35.170789 3753 leader_election.cc:336] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 8a7e51013f5041898fe34f4b64a59260 (127.2.32.188:33665): Network error: Client connection negotiation failed: client connection to 127.2.32.188:33665: connect: Connection refused (error 111)
I20260203 21:10:35.170851 3753 leader_election.cc:304] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35397be7e61f4b27a49e9449b9fdf085; no voters: 7344d7cd8dea4fa2ae705320daacaf49, 8a7e51013f5041898fe34f4b64a59260
I20260203 21:10:35.171025 3834 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260203 21:10:35.698086 3846 raft_consensus.cc:493] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 21:10:35.698237 3846 raft_consensus.cc:515] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:10:35.698709 3846 leader_election.cc:290] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419), 8a7e51013f5041898fe34f4b64a59260 (127.2.32.188:33665)
W20260203 21:10:35.699929 3756 leader_election.cc:336] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419): Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111)
W20260203 21:10:35.700029 3753 leader_election.cc:336] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 8a7e51013f5041898fe34f4b64a59260 (127.2.32.188:33665): Network error: Client connection negotiation failed: client connection to 127.2.32.188:33665: connect: Connection refused (error 111)
I20260203 21:10:35.700121 3753 leader_election.cc:304] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35397be7e61f4b27a49e9449b9fdf085; no voters: 7344d7cd8dea4fa2ae705320daacaf49, 8a7e51013f5041898fe34f4b64a59260
I20260203 21:10:35.700304 3846 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260203 21:10:36.534590 3862 raft_consensus.cc:493] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 21:10:36.534734 3862 raft_consensus.cc:515] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:10:36.535202 3862 leader_election.cc:290] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419), 8a7e51013f5041898fe34f4b64a59260 (127.2.32.188:33665)
W20260203 21:10:36.536453 3753 leader_election.cc:336] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 8a7e51013f5041898fe34f4b64a59260 (127.2.32.188:33665): Network error: Client connection negotiation failed: client connection to 127.2.32.188:33665: connect: Connection refused (error 111)
W20260203 21:10:36.536636 3756 leader_election.cc:336] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419): Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111)
I20260203 21:10:36.536744 3756 leader_election.cc:304] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35397be7e61f4b27a49e9449b9fdf085; no voters: 7344d7cd8dea4fa2ae705320daacaf49, 8a7e51013f5041898fe34f4b64a59260
I20260203 21:10:36.536895 3862 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260203 21:10:36.614892 2720 consensus_peers.cc:597] T 2f8e36b89ebf456d964c9a31f7c7636a P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2f8e36b89ebf456d964c9a31f7c7636a. This is attempt 6: this message will repeat every 5th retry.
W20260203 21:10:36.910954 2721 consensus_peers.cc:597] T 2f8e36b89ebf456d964c9a31f7c7636a P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2f8e36b89ebf456d964c9a31f7c7636a. This is attempt 6: this message will repeat every 5th retry.
I20260203 21:10:37.285894 3854 raft_consensus.cc:493] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:10:37.286037 3854 raft_consensus.cc:515] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:37.286441 3854 leader_election.cc:290] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:10:37.287145 2720 leader_election.cc:343] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 7786ef435bbd44daae12d3ee4728efb9
W20260203 21:10:37.287261 2721 leader_election.cc:343] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 7786ef435bbd44daae12d3ee4728efb9
I20260203 21:10:37.287338 2721 leader_election.cc:304] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:10:37.287472 3854 raft_consensus.cc:2749] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:10:37.635648 3852 raft_consensus.cc:493] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d9e0cecab784cc0acc050ca1c89c5be)
I20260203 21:10:37.635809 3852 raft_consensus.cc:515] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:37.636181 3852 leader_election.cc:290] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:10:37.636693 2721 leader_election.cc:343] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 3ae68905ec1942448b444ecd01836805
W20260203 21:10:37.636776 2720 leader_election.cc:343] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 3ae68905ec1942448b444ecd01836805
I20260203 21:10:37.636840 2720 leader_election.cc:304] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:10:37.636977 3852 raft_consensus.cc:2749] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:10:37.696641 2178 external_mini_cluster.cc:1366] Running /tmp/dist-test-task0vmSZW/build/debug/bin/kudu
/tmp/dist-test-task0vmSZW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.32.188:33665
--webserver_interface=127.2.32.188
--webserver_port=39751
--builtin_ntp_servers=127.2.32.148:39497
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665
--hive_metastore_uris=thrift://127.0.0.1:33779
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260203 21:10:37.802621 3879 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260203 21:10:37.802906 3879 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260203 21:10:37.802973 3879 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260203 21:10:37.807130 3879 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260203 21:10:37.807189 3879 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260203 21:10:37.807209 3879 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260203 21:10:37.807224 3879 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260203 21:10:37.811064 3879 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.32.148:39497
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-2/wal
--hive_metastore_uris=thrift://127.0.0.1:33779
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.32.188:33665
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.2.32.188
--webserver_port=39751
--never_fsync=true
--heap_profile_path=/tmp/kudu.3879
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 0efbebd487e7d0c7f21ab0d5a91e0fa70046af83
build type DEBUG
built by None at 03 Feb 2026 20:50:43 UTC on 24a791456cd2
build id 10330
I20260203 21:10:37.812204 3879 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260203 21:10:37.813472 3879 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260203 21:10:37.819833 3884 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260203 21:10:37.819981 3887 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260203 21:10:37.820091 3879 server_base.cc:1060] running on GCE node
W20260203 21:10:37.819833 3885 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260203 21:10:37.820608 3879 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260203 21:10:37.821507 3879 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260203 21:10:37.822698 3879 hybrid_clock.cc:648] HybridClock initialized: now 1770153037822689 us; error 25 us; skew 500 ppm
I20260203 21:10:37.824831 3879 webserver.cc:492] Webserver started at http://127.2.32.188:39751/ using document root <none> and password file <none>
I20260203 21:10:37.825488 3879 fs_manager.cc:362] Metadata directory not provided
I20260203 21:10:37.825557 3879 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260203 21:10:37.829435 3879 fs_manager.cc:714] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260203 21:10:37.831301 3893 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260203 21:10:37.832343 3879 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260203 21:10:37.832442 3879 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-2/data,/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-2/wal
uuid: "8a7e51013f5041898fe34f4b64a59260"
format_stamp: "Formatted at 2026-02-03 21:10:25 on dist-test-slave-npns"
I20260203 21:10:37.832823 3879 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260203 21:10:37.867503 3879 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260203 21:10:37.868220 3879 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260203 21:10:37.868383 3879 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260203 21:10:37.875362 3879 rpc_server.cc:307] RPC server started. Bound to: 127.2.32.188:33665
I20260203 21:10:37.875361 3945 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.32.188:33665 every 8 connection(s)
I20260203 21:10:37.876417 3879 server_base.cc:1192] Dumped server information to /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-2/data/info.pb
I20260203 21:10:37.880491 3946 sys_catalog.cc:263] Verifying existing consensus state
I20260203 21:10:37.882424 3946 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260: Bootstrap starting.
I20260203 21:10:37.882524 2178 external_mini_cluster.cc:1428] Started /tmp/dist-test-task0vmSZW/build/debug/bin/kudu as pid 3879
I20260203 21:10:37.893282 3946 log.cc:826] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260: Log is configured to *not* fsync() on all Append() calls
I20260203 21:10:37.901563 3852 raft_consensus.cc:493] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:10:37.901695 3852 raft_consensus.cc:515] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } }
I20260203 21:10:37.902084 3852 leader_election.cc:290] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223), 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897)
W20260203 21:10:37.902729 2720 leader_election.cc:343] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 06b80064d47349c2830718f553ba3d7d
W20260203 21:10:37.903120 2721 leader_election.cc:343] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 06b80064d47349c2830718f553ba3d7d
I20260203 21:10:37.903188 2721 leader_election.cc:304] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:10:37.903339 3852 raft_consensus.cc:2749] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:10:37.933131 2831 heartbeater.cc:344] Connected to a master server at 127.2.32.188:33665
I20260203 21:10:37.939474 3105 heartbeater.cc:344] Connected to a master server at 127.2.32.188:33665
I20260203 21:10:37.943041 3946 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260: Bootstrap replayed 1/1 log segments. Stats: ops{read=92 overwritten=0 applied=92 ignored=0} inserts{seen=58 ignored=0} mutations{seen=73 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260203 21:10:37.943396 3946 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260: Bootstrap complete.
I20260203 21:10:37.946190 3946 raft_consensus.cc:359] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:10:37.946520 3946 raft_consensus.cc:740] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a7e51013f5041898fe34f4b64a59260, State: Initialized, Role: FOLLOWER
I20260203 21:10:37.946952 3946 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 92, Last appended: 3.92, Last appended by leader: 92, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:10:37.947382 3953 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } } }
I20260203 21:10:37.947506 3953 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [sys.catalog]: This master's current role is: FOLLOWER
I20260203 21:10:37.948067 3946 sys_catalog.cc:565] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [sys.catalog]: configured and running, proceeding with master startup.
I20260203 21:10:37.955070 3879 master_runner.cc:186] Error getting master registration for 127.2.32.190:35419: Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111),
I20260203 21:10:37.957190 3879 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260203 21:10:37.959158 3967 catalog_manager.cc:1269] Loaded cluster ID: f46367a11713484f92c1d2be2585f5a6
I20260203 21:10:37.959267 3967 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260: loading cluster ID for follower catalog manager: success
I20260203 21:10:37.962410 3967 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260: acquiring CA information for follower catalog manager: success
I20260203 21:10:37.964636 3967 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260203 21:10:38.060354 2831 heartbeater.cc:344] Connected to a master server at 127.2.32.188:33665
I20260203 21:10:38.062019 3910 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "02bdf326542e474cbe62434dd59087dc" instance_seqno: 1770153026114330) as {username='slave'} at 127.2.32.129:52997; Asking this server to re-register.
I20260203 21:10:38.062510 2831 heartbeater.cc:461] Registering TS with master...
I20260203 21:10:38.063723 3910 ts_manager.cc:194] Registered new tserver with Master: 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335)
I20260203 21:10:38.137593 2969 heartbeater.cc:344] Connected to a master server at 127.2.32.188:33665
I20260203 21:10:38.138819 3910 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" instance_seqno: 1770153026289802) as {username='slave'} at 127.2.32.130:57805; Asking this server to re-register.
I20260203 21:10:38.139228 2969 heartbeater.cc:461] Registering TS with master...
I20260203 21:10:38.140070 3910 ts_manager.cc:194] Registered new tserver with Master: 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897)
I20260203 21:10:38.202159 3973 raft_consensus.cc:493] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 21:10:38.202327 3973 raft_consensus.cc:515] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:10:38.202780 3973 leader_election.cc:290] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419), 8a7e51013f5041898fe34f4b64a59260 (127.2.32.188:33665)
W20260203 21:10:38.203949 3756 leader_election.cc:336] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419): Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111)
I20260203 21:10:38.206645 3920 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "35397be7e61f4b27a49e9449b9fdf085" candidate_term: 5 candidate_status { last_received { term: 4 index: 100 } } ignore_live_leader: false dest_uuid: "8a7e51013f5041898fe34f4b64a59260" is_pre_election: true
I20260203 21:10:38.206991 3920 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35397be7e61f4b27a49e9449b9fdf085 in term 3.
I20260203 21:10:38.207444 3753 leader_election.cc:304] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35397be7e61f4b27a49e9449b9fdf085, 8a7e51013f5041898fe34f4b64a59260; no voters: 7344d7cd8dea4fa2ae705320daacaf49
I20260203 21:10:38.207615 3973 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260203 21:10:38.207697 3973 raft_consensus.cc:493] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 21:10:38.207748 3973 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [term 4 FOLLOWER]: Advancing to term 5
I20260203 21:10:38.209401 3973 raft_consensus.cc:515] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:10:38.209718 3973 leader_election.cc:290] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [CANDIDATE]: Term 5 election: Requested vote from peers 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419), 8a7e51013f5041898fe34f4b64a59260 (127.2.32.188:33665)
I20260203 21:10:38.210059 3920 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "35397be7e61f4b27a49e9449b9fdf085" candidate_term: 5 candidate_status { last_received { term: 4 index: 100 } } ignore_live_leader: false dest_uuid: "8a7e51013f5041898fe34f4b64a59260"
I20260203 21:10:38.210202 3920 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 3 FOLLOWER]: Advancing to term 5
W20260203 21:10:38.210542 3756 leader_election.cc:336] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419): Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111)
I20260203 21:10:38.211778 3920 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35397be7e61f4b27a49e9449b9fdf085 in term 5.
I20260203 21:10:38.212044 3753 leader_election.cc:304] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35397be7e61f4b27a49e9449b9fdf085, 8a7e51013f5041898fe34f4b64a59260; no voters: 7344d7cd8dea4fa2ae705320daacaf49
I20260203 21:10:38.212209 3973 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [term 5 FOLLOWER]: Leader election won for term 5
I20260203 21:10:38.212391 3973 raft_consensus.cc:697] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [term 5 LEADER]: Becoming Leader. State: Replica: 35397be7e61f4b27a49e9449b9fdf085, State: Running, Role: LEADER
I20260203 21:10:38.212656 3973 consensus_queue.cc:237] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 99, Committed index: 99, Last appended: 4.100, Last appended by leader: 100, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:10:38.214119 3977 sys_catalog.cc:455] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 35397be7e61f4b27a49e9449b9fdf085. Latest consensus state: current_term: 5 leader_uuid: "35397be7e61f4b27a49e9449b9fdf085" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } } }
I20260203 21:10:38.214227 3977 sys_catalog.cc:458] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [sys.catalog]: This master's current role is: LEADER
I20260203 21:10:38.294282 3854 raft_consensus.cc:493] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d9e0cecab784cc0acc050ca1c89c5be)
I20260203 21:10:38.294420 3854 raft_consensus.cc:515] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:38.294878 3854 leader_election.cc:290] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:10:38.295637 2720 leader_election.cc:343] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: a375114bebc64385827b7b6e0060d1e4
W20260203 21:10:38.295761 2721 leader_election.cc:343] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: a375114bebc64385827b7b6e0060d1e4
I20260203 21:10:38.295845 2721 leader_election.cc:304] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:10:38.295991 3854 raft_consensus.cc:2749] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:10:38.442708 3910 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "185c63f61a2645928eeb807d145026b1" instance_seqno: 1770153026474418) as {username='slave'} at 127.2.32.131:41665; Asking this server to re-register.
I20260203 21:10:38.443192 3105 heartbeater.cc:461] Registering TS with master...
I20260203 21:10:38.444169 3909 ts_manager.cc:194] Registered new tserver with Master: 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
I20260203 21:10:38.634862 3920 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 5 FOLLOWER]: Refusing update from remote peer 35397be7e61f4b27a49e9449b9fdf085: Log matching property violated. Preceding OpId in replica: term: 3 index: 92. Preceding OpId from leader: term: 5 index: 101. (index mismatch)
I20260203 21:10:38.635478 3977 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 101, Last known committed idx: 92, Time since last communication: 0.000s
I20260203 21:10:38.641511 3980 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 35397be7e61f4b27a49e9449b9fdf085. Latest consensus state: current_term: 5 leader_uuid: "35397be7e61f4b27a49e9449b9fdf085" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } } }
I20260203 21:10:38.641646 3980 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [sys.catalog]: This master's current role is: FOLLOWER
I20260203 21:10:38.641713 3983 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 5 leader_uuid: "35397be7e61f4b27a49e9449b9fdf085" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } } }
I20260203 21:10:38.641806 3983 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [sys.catalog]: This master's current role is: FOLLOWER
I20260203 21:10:38.642885 3981 mvcc.cc:204] Tried to move back new op lower bound from 7250546817745158144 to 7250546817411624960. Current Snapshot: MvccSnapshot[applied={T|T < 7250546817745158144 or (T in {7250546817745158144})}]
I20260203 21:10:38.643407 3977 sys_catalog.cc:455] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 5 leader_uuid: "35397be7e61f4b27a49e9449b9fdf085" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } } }
I20260203 21:10:38.643525 3977 sys_catalog.cc:458] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [sys.catalog]: This master's current role is: LEADER
I20260203 21:10:38.643798 3983 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 5 leader_uuid: "35397be7e61f4b27a49e9449b9fdf085" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } } }
I20260203 21:10:38.643895 3983 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [sys.catalog]: This master's current role is: FOLLOWER
W20260203 21:10:38.644627 3756 consensus_peers.cc:597] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 -> Peer 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419): Couldn't send request to peer 7344d7cd8dea4fa2ae705320daacaf49. Status: Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260203 21:10:38.730094 3979 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260203 21:10:38.731986 3979 catalog_manager.cc:679] Loaded metadata for table default.table_3397dfe4625e42cf8cb5f4d45116d7b1 [id=1047aea4c6eb42f4994b72f5cafef147]
I20260203 21:10:38.732307 3979 catalog_manager.cc:679] Loaded metadata for table default.table_675a6f7413004a62bce7c460e7b6da3b [id=1df0a5e5434d4c00a3dfe92d216cfb54]
I20260203 21:10:38.732528 3979 catalog_manager.cc:679] Loaded metadata for table default.table_547d99db0d3043499a26ee8c6df4c443 [id=333213fed7234610bc20c7d92124182b]
I20260203 21:10:38.732728 3979 catalog_manager.cc:679] Loaded metadata for table default.table_98e2e0221eb0485fb87bee758843d37e [id=42eb95ae2b9442b18dac664ea886b4b3]
I20260203 21:10:38.732923 3979 catalog_manager.cc:679] Loaded metadata for table default.table_b7c2ca72f69c49a0b39163d2fcb69341 [id=467e79ec835d45669e3155e07b8ba81f]
I20260203 21:10:38.733111 3979 catalog_manager.cc:679] Loaded metadata for table default.table_a029ba95c22e421585ca4ce640aa9658 [id=73eae179f2ad481d932a5b3c95b1a4ab]
I20260203 21:10:38.733305 3979 catalog_manager.cc:679] Loaded metadata for table default.table_72135cb0d98246739f6b8c9aee17c8ba [id=7402e05c90cf4b15be6effde36465fff]
I20260203 21:10:38.733492 3979 catalog_manager.cc:679] Loaded metadata for table default.table_7e73ff80019543888e0b8afa9b7a6660 [id=82ec5c95acc84e509c0803db74b626b4]
I20260203 21:10:38.733673 3979 catalog_manager.cc:679] Loaded metadata for table default.table_c2985ddec2e045cba153900329fe9331 [id=85725aeaace648d9ac1bb5d3940d0ad0]
I20260203 21:10:38.734005 3979 catalog_manager.cc:679] Loaded metadata for table default.table_4c9a68305b5e4d4aa45e3a351c35eee7 [id=8f8f5b53d1204b56979a8db32be6ee89]
I20260203 21:10:38.734306 3979 catalog_manager.cc:679] Loaded metadata for table default.table_09e62d0aaa0f48ad9ed818ba967be542 [id=a26f4a67278a4929b2378fbbe9baaf52]
I20260203 21:10:38.734529 3979 catalog_manager.cc:679] Loaded metadata for table default.table_800a192f4e9e4ca5806a324b36234706 [id=a995c742bb2942838a2385b05a4d4d57]
I20260203 21:10:38.734736 3979 catalog_manager.cc:679] Loaded metadata for table default.table_8da179b3ec0b4c898eb890f89d54cb6a [id=ad58be29e80345e1afe7f5a55e129af2]
I20260203 21:10:38.734977 3979 catalog_manager.cc:679] Loaded metadata for table default.table_66c508c8dbdd4e7ea9283cabe65b62c0 [id=b62df06982124a70936068823e4b2324]
I20260203 21:10:38.735374 3979 catalog_manager.cc:679] Loaded metadata for table default.table_4f93e096d30349908a32a33e024543d6 [id=fa8fb788ff754fcd8641964a9d894664]
I20260203 21:10:38.737174 3979 tablet_loader.cc:96] loaded metadata for tablet 387f8e87a39f402e9a6416d5408427df (table default.table_b7c2ca72f69c49a0b39163d2fcb69341 [id=467e79ec835d45669e3155e07b8ba81f])
I20260203 21:10:38.737483 3979 tablet_loader.cc:96] loaded metadata for tablet 4c8edfa3d555490f953a3ec7bef314ae (table default.table_a029ba95c22e421585ca4ce640aa9658 [id=73eae179f2ad481d932a5b3c95b1a4ab])
I20260203 21:10:38.737699 3979 tablet_loader.cc:96] loaded metadata for tablet 4d6ed92d766244489541e1c280afacb5 (table default.table_09e62d0aaa0f48ad9ed818ba967be542 [id=a26f4a67278a4929b2378fbbe9baaf52])
I20260203 21:10:38.737876 3979 tablet_loader.cc:96] loaded metadata for tablet 4de1de23650548c2a078b51c9bf4d031 (table default.table_4f93e096d30349908a32a33e024543d6 [id=fa8fb788ff754fcd8641964a9d894664])
I20260203 21:10:38.738049 3979 tablet_loader.cc:96] loaded metadata for tablet 576be22c2477419192cc271e46b8e57e (table default.table_547d99db0d3043499a26ee8c6df4c443 [id=333213fed7234610bc20c7d92124182b])
I20260203 21:10:38.738224 3979 tablet_loader.cc:96] loaded metadata for tablet 62542a22943242c7987cc65423f548b4 (table default.table_72135cb0d98246739f6b8c9aee17c8ba [id=7402e05c90cf4b15be6effde36465fff])
I20260203 21:10:38.738392 3979 tablet_loader.cc:96] loaded metadata for tablet 6606bf5d7de047cda4a0523197210c1a (table default.table_66c508c8dbdd4e7ea9283cabe65b62c0 [id=b62df06982124a70936068823e4b2324])
I20260203 21:10:38.738561 3979 tablet_loader.cc:96] loaded metadata for tablet 739e31c065d94d7badfe9097b04ca0a9 (table default.table_7e73ff80019543888e0b8afa9b7a6660 [id=82ec5c95acc84e509c0803db74b626b4])
I20260203 21:10:38.738905 3979 tablet_loader.cc:96] loaded metadata for tablet 8df16fd039bf4d9b91ee2e49151c18c2 (table default.table_675a6f7413004a62bce7c460e7b6da3b [id=1df0a5e5434d4c00a3dfe92d216cfb54])
I20260203 21:10:38.739166 3979 tablet_loader.cc:96] loaded metadata for tablet 98cd2089483c4121944152e5cee8ca30 (table default.table_4c9a68305b5e4d4aa45e3a351c35eee7 [id=8f8f5b53d1204b56979a8db32be6ee89])
I20260203 21:10:38.739334 3979 tablet_loader.cc:96] loaded metadata for tablet 9c19a7b6dba6432f91e68164734a7e6d (table default.table_800a192f4e9e4ca5806a324b36234706 [id=a995c742bb2942838a2385b05a4d4d57])
I20260203 21:10:38.739688 3979 tablet_loader.cc:96] loaded metadata for tablet b20e604665624843b957080dc6016d78 (table default.table_8da179b3ec0b4c898eb890f89d54cb6a [id=ad58be29e80345e1afe7f5a55e129af2])
I20260203 21:10:38.739856 3979 tablet_loader.cc:96] loaded metadata for tablet ba8723a952564816a5c1f7945c448db9 (table default.table_3397dfe4625e42cf8cb5f4d45116d7b1 [id=1047aea4c6eb42f4994b72f5cafef147])
I20260203 21:10:38.740280 3979 tablet_loader.cc:96] loaded metadata for tablet dd27d2dc29364e1b87fb1936bae8d2a1 (table default.table_c2985ddec2e045cba153900329fe9331 [id=85725aeaace648d9ac1bb5d3940d0ad0])
I20260203 21:10:38.740845 3979 tablet_loader.cc:96] loaded metadata for tablet f8f173ff52ed4daa8b8ddcbeae43bc4a (table default.table_98e2e0221eb0485fb87bee758843d37e [id=42eb95ae2b9442b18dac664ea886b4b3])
I20260203 21:10:38.740979 3979 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260203 21:10:38.741734 3979 catalog_manager.cc:1269] Loaded cluster ID: f46367a11713484f92c1d2be2585f5a6
I20260203 21:10:38.741786 3979 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260203 21:10:38.742686 3979 catalog_manager.cc:1514] Loading token signing keys...
I20260203 21:10:38.743356 3979 catalog_manager.cc:6038] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085: Loaded TSK: 0
I20260203 21:10:38.744119 3979 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260203 21:10:38.744797 3979 catalog_manager.cc:1537] Loading latest processed Hive Metastore notification log event ID...
I20260203 21:10:38.745442 3979 catalog_manager.cc:5876] Last processed Hive Metastore notification event ID: 21
I20260203 21:10:38.817772 3769 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:53184:
table { table_name: "default.Table_a029ba95c22e421585ca4ce640aa9658" } modify_external_catalogs: true
I20260203 21:10:38.817907 3766 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:53184:
table { table_name: "default.Table_66c508c8dbdd4e7ea9283cabe65b62c0" } modify_external_catalogs: true
I20260203 21:10:38.818048 3769 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:53184:
table { table_name: "default.Table_a029ba95c22e421585ca4ce640aa9658" } modify_external_catalogs: true
I20260203 21:10:38.818151 3767 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:53184:
table { table_name: "default.Table_c2985ddec2e045cba153900329fe9331" } modify_external_catalogs: true
I20260203 21:10:38.817762 3768 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:53184:
table { table_name: "default.Table_547d99db0d3043499a26ee8c6df4c443" } modify_external_catalogs: true
I20260203 21:10:38.818353 3768 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:53184:
table { table_name: "default.Table_547d99db0d3043499a26ee8c6df4c443" } modify_external_catalogs: true
I20260203 21:10:38.818603 3760 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53184:
name: "default.Table_e694e6681f2a426c9b583f4567326376"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260203 21:10:38.818709 3765 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:53184:
table { table_name: "default.Table_800a192f4e9e4ca5806a324b36234706" } new_table_name: "default.Table_9f9f33407af144ea8957cb4f76b5ac87" modify_external_catalogs: true
I20260203 21:10:38.818957 3764 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:53184:
table { table_name: "default.Table_09e62d0aaa0f48ad9ed818ba967be542" } modify_external_catalogs: true
I20260203 21:10:38.819021 3762 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:53184:
table { table_name: "default.Table_b7c2ca72f69c49a0b39163d2fcb69341" } new_table_name: "default.Table_18c764c9748848f7b81aa13d7cae0ead" modify_external_catalogs: true
I20260203 21:10:38.819074 3764 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:53184:
table { table_name: "default.Table_09e62d0aaa0f48ad9ed818ba967be542" } modify_external_catalogs: true
I20260203 21:10:38.819221 3763 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:53184:
table { table_name: "default.Table_7e73ff80019543888e0b8afa9b7a6660" } new_table_name: "default.Table_6c687150b16c40cb8fb3e90a5cb19c16" modify_external_catalogs: true
I20260203 21:10:38.818957 3761 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:53184:
table { table_name: "default.Table_4f93e096d30349908a32a33e024543d6" } new_table_name: "default.Table_65ec2660e3164688879b576a359a84c1" modify_external_catalogs: true
I20260203 21:10:38.818243 3767 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:53184:
table { table_name: "default.Table_c2985ddec2e045cba153900329fe9331" } modify_external_catalogs: true
I20260203 21:10:38.818053 3766 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:53184:
table { table_name: "default.Table_66c508c8dbdd4e7ea9283cabe65b62c0" } modify_external_catalogs: true
F20260203 21:10:38.824023 3823 hms_notification_log_listener.cc:287] non-monotonous event IDs from HMS: current 22, previous 22; dumping first 2 out of 12 received events: NotificationEvent(eventId=22, eventTime=1770153029, eventType=DROP_TABLE, dbName=default, tableName=table_76bef700d9b64243b6b4e93ffbc64f7a, message={"server":"","servicePrincipal":"","db":"default","table":"table_76bef700d9b64243b6b4e93ffbc64f7a","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_76bef700d9b64243b6b4e93ffbc64f7a\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1770153028},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/warehouse/table_76bef700d9b64243b6b4e93ffbc64f7a\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_76bef700d9b64243b6b4e93ffbc64f7a\",\"kudu.table_id\":\"f6e23f2505784c6f98a18a43b9917c06\",\"transient_lastDdlTime\":\"1770153028\",\"comment\":\"\",\"kudu.master_addresses\":\"127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"f46367a11713484f92c1d2be2585f5a6\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1770153029}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=22, eventTime=1770153029, eventType=CREATE_TABLE, dbName=default, tableName=table_4f93e096d30349908a32a33e024543d6, message={"server":"","servicePrincipal":"","db":"default","table":"table_4f93e096d30349908a32a33e024543d6","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_4f93e096d30349908a32a33e024543d6\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1770153029},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/warehouse/table_4f93e096d30349908a32a33e024543d6\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_4f93e096d30349908a32a33e024543d6\",\"kudu.table_id\":\"fa8fb788ff754fcd8641964a9d894664\",\"transient_lastDdlTime\":\"1770153029\",\"comment\":\"\",\"kudu.master_addresses\":\"127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"f46367a11713484f92c1d2be2585f5a6\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1770153029,"files":[]}, messageFormat=json-0.2, catName=hive);
*** Check failure stack trace: ***
@ 0x7f9026860dcd google::LogMessage::Fail() at ??:0
@ 0x7f9026864b93 google::LogMessage::SendToLog() at ??:0
@ 0x7f90268607cc google::LogMessage::Flush() at ??:0
@ 0x7f9026860a11 google::LogMessage::~LogMessage() at ??:0
@ 0x7f902b9d6ef9 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
@ 0x7f902b9d5e10 kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
@ 0x7f902b9d5573 _ZZN4kudu6master30HmsNotificationLogListenerTask4InitEvENKUlvE_clEv at ??:0
@ 0x7f902b9dac7a _ZNSt17_Function_handlerIFvvEZN4kudu6master30HmsNotificationLogListenerTask4InitEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x562ee1889a0a std::function<>::operator()() at ??:0
@ 0x7f9027cbab04 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f90285546db start_thread at ??:0
@ 0x7f9025a1771f clone at ??:0
W20260203 21:10:39.020529 2994 connection.cc:537] client connection to 127.2.32.189:42681 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260203 21:10:39.020722 3114 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.2.32.189:42681)
W20260203 21:10:39.021032 3114 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.2.32.189:42681)
W20260203 21:10:39.021131 3114 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.2.32.189:42681)
W20260203 21:10:39.021323 3114 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.2.32.189:42681)
W20260203 21:10:39.021677 2720 connection.cc:537] client connection to 127.2.32.189:42681 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260203 21:10:39.143716 3983 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 35397be7e61f4b27a49e9449b9fdf085)
I20260203 21:10:39.143870 3983 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:10:39.144987 3983 leader_election.cc:290] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419), 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681)
W20260203 21:10:39.145453 3897 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111)
W20260203 21:10:39.146167 3896 leader_election.cc:336] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681): Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)
W20260203 21:10:39.146291 3897 leader_election.cc:336] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419): Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111)
I20260203 21:10:39.146376 3897 leader_election.cc:304] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a7e51013f5041898fe34f4b64a59260; no voters: 35397be7e61f4b27a49e9449b9fdf085, 7344d7cd8dea4fa2ae705320daacaf49
I20260203 21:10:39.146556 3983 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260203 21:10:39.693579 4013 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 35397be7e61f4b27a49e9449b9fdf085)
I20260203 21:10:39.693718 4013 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:10:39.694147 4013 leader_election.cc:290] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419), 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681)
W20260203 21:10:39.695237 3897 leader_election.cc:336] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419): Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111)
W20260203 21:10:39.695338 3896 leader_election.cc:336] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681): Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)
I20260203 21:10:39.695421 3896 leader_election.cc:304] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a7e51013f5041898fe34f4b64a59260; no voters: 35397be7e61f4b27a49e9449b9fdf085, 7344d7cd8dea4fa2ae705320daacaf49
I20260203 21:10:39.695551 4013 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260203 21:10:39.857846 3695 raft_consensus.cc:493] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d9e0cecab784cc0acc050ca1c89c5be)
I20260203 21:10:39.857971 3695 raft_consensus.cc:515] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:39.858371 3695 leader_election.cc:290] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:10:39.859048 2720 leader_election.cc:343] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 3ae68905ec1942448b444ecd01836805
W20260203 21:10:39.859185 2721 leader_election.cc:343] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 3ae68905ec1942448b444ecd01836805
I20260203 21:10:39.859269 2721 leader_election.cc:304] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:10:39.859465 3695 raft_consensus.cc:2749] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:10:39.930768 3695 raft_consensus.cc:493] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:10:39.930922 3695 raft_consensus.cc:515] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } }
I20260203 21:10:39.931370 3695 leader_election.cc:290] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223), 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897)
W20260203 21:10:39.932054 2720 leader_election.cc:343] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 06b80064d47349c2830718f553ba3d7d
W20260203 21:10:39.932152 2721 leader_election.cc:343] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 06b80064d47349c2830718f553ba3d7d
I20260203 21:10:39.932247 2721 leader_election.cc:304] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:10:39.932402 3695 raft_consensus.cc:2749] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:10:40.195560 3852 raft_consensus.cc:493] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:10:40.195716 3852 raft_consensus.cc:515] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:40.196132 3852 leader_election.cc:290] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:10:40.196710 2721 leader_election.cc:343] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 7786ef435bbd44daae12d3ee4728efb9
W20260203 21:10:40.196802 2720 leader_election.cc:343] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 7786ef435bbd44daae12d3ee4728efb9
I20260203 21:10:40.196923 2720 leader_election.cc:304] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:10:40.197085 3852 raft_consensus.cc:2749] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:10:40.683832 4018 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 35397be7e61f4b27a49e9449b9fdf085)
I20260203 21:10:40.683970 4018 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:10:40.684398 4018 leader_election.cc:290] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419), 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681)
W20260203 21:10:40.685796 3897 leader_election.cc:336] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419): Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111)
W20260203 21:10:40.685909 3896 leader_election.cc:336] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681): Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)
I20260203 21:10:40.685990 3896 leader_election.cc:304] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a7e51013f5041898fe34f4b64a59260; no voters: 35397be7e61f4b27a49e9449b9fdf085, 7344d7cd8dea4fa2ae705320daacaf49
I20260203 21:10:40.686234 4018 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260203 21:10:41.049583 2178 external_mini_cluster.cc:1366] Running /tmp/dist-test-task0vmSZW/build/debug/bin/kudu
/tmp/dist-test-task0vmSZW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.32.189:42681
--webserver_interface=127.2.32.189
--webserver_port=35415
--builtin_ntp_servers=127.2.32.148:39497
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665
--hive_metastore_uris=thrift://127.0.0.1:33779
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260203 21:10:41.159269 4026 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260203 21:10:41.159490 4026 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260203 21:10:41.159546 4026 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260203 21:10:41.162757 4026 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260203 21:10:41.162817 4026 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260203 21:10:41.162844 4026 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260203 21:10:41.162868 4026 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260203 21:10:41.166590 4026 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.32.148:39497
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-1/wal
--hive_metastore_uris=thrift://127.0.0.1:33779
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.32.189:42681
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.2.32.189
--webserver_port=35415
--never_fsync=true
--heap_profile_path=/tmp/kudu.4026
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 0efbebd487e7d0c7f21ab0d5a91e0fa70046af83
build type DEBUG
built by None at 03 Feb 2026 20:50:43 UTC on 24a791456cd2
build id 10330
I20260203 21:10:41.167651 4026 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260203 21:10:41.168788 4026 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260203 21:10:41.174031 4032 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260203 21:10:41.174168 4031 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260203 21:10:41.174036 4034 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260203 21:10:41.174286 4026 server_base.cc:1060] running on GCE node
I20260203 21:10:41.174741 4026 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260203 21:10:41.175565 4026 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260203 21:10:41.176718 4026 hybrid_clock.cc:648] HybridClock initialized: now 1770153041176706 us; error 28 us; skew 500 ppm
I20260203 21:10:41.178262 4026 webserver.cc:492] Webserver started at http://127.2.32.189:35415/ using document root <none> and password file <none>
I20260203 21:10:41.178776 4026 fs_manager.cc:362] Metadata directory not provided
I20260203 21:10:41.178838 4026 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260203 21:10:41.181962 4026 fs_manager.cc:714] Time spent opening directory manager: real 0.002s user 0.001s sys 0.000s
I20260203 21:10:41.183701 4040 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260203 21:10:41.184587 4026 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260203 21:10:41.184684 4026 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-1/data,/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-1/wal
uuid: "35397be7e61f4b27a49e9449b9fdf085"
format_stamp: "Formatted at 2026-02-03 21:10:25 on dist-test-slave-npns"
I20260203 21:10:41.185034 4026 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260203 21:10:41.200966 4026 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260203 21:10:41.201587 4026 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260203 21:10:41.201741 4026 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260203 21:10:41.208537 4026 rpc_server.cc:307] RPC server started. Bound to: 127.2.32.189:42681
I20260203 21:10:41.208544 4092 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.32.189:42681 every 8 connection(s)
I20260203 21:10:41.209587 4026 server_base.cc:1192] Dumped server information to /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-1/data/info.pb
I20260203 21:10:41.213559 4093 sys_catalog.cc:263] Verifying existing consensus state
I20260203 21:10:41.215044 2178 external_mini_cluster.cc:1428] Started /tmp/dist-test-task0vmSZW/build/debug/bin/kudu as pid 4026
I20260203 21:10:41.215415 4093 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085: Bootstrap starting.
I20260203 21:10:41.226287 4093 log.cc:826] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085: Log is configured to *not* fsync() on all Append() calls
I20260203 21:10:41.275274 4093 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085: Bootstrap replayed 1/1 log segments. Stats: ops{read=101 overwritten=0 applied=101 ignored=0} inserts{seen=63 ignored=0} mutations{seen=83 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260203 21:10:41.275701 4093 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085: Bootstrap complete.
I20260203 21:10:41.278317 4093 raft_consensus.cc:359] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [term 5 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:10:41.278659 4093 raft_consensus.cc:740] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [term 5 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35397be7e61f4b27a49e9449b9fdf085, State: Initialized, Role: FOLLOWER
I20260203 21:10:41.279090 4093 consensus_queue.cc:260] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 101, Last appended: 5.101, Last appended by leader: 101, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:10:41.279501 4097 sys_catalog.cc:455] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 5 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } } }
I20260203 21:10:41.279613 4097 sys_catalog.cc:458] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [sys.catalog]: This master's current role is: FOLLOWER
I20260203 21:10:41.280189 4093 sys_catalog.cc:565] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [sys.catalog]: configured and running, proceeding with master startup.
I20260203 21:10:41.286273 4111 catalog_manager.cc:1269] Loaded cluster ID: f46367a11713484f92c1d2be2585f5a6
I20260203 21:10:41.286405 4111 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085: loading cluster ID for follower catalog manager: success
I20260203 21:10:41.284516 4026 master_runner.cc:186] Error getting master registration for 127.2.32.190:35419: Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111),
I20260203 21:10:41.286991 4026 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260203 21:10:41.289945 4111 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085: acquiring CA information for follower catalog manager: success
I20260203 21:10:41.292054 4111 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260203 21:10:41.302196 2833 heartbeater.cc:344] Connected to a master server at 127.2.32.189:42681
I20260203 21:10:41.304370 4057 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "02bdf326542e474cbe62434dd59087dc" instance_seqno: 1770153026114330) as {username='slave'} at 127.2.32.129:36429; Asking this server to re-register.
I20260203 21:10:41.304862 2833 heartbeater.cc:461] Registering TS with master...
I20260203 21:10:41.306342 4057 ts_manager.cc:194] Registered new tserver with Master: 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335)
W20260203 21:10:41.442358 2720 consensus_peers.cc:597] T 2f8e36b89ebf456d964c9a31f7c7636a P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2f8e36b89ebf456d964c9a31f7c7636a. This is attempt 11: this message will repeat every 5th retry.
I20260203 21:10:41.528328 3107 heartbeater.cc:344] Connected to a master server at 127.2.32.189:42681
I20260203 21:10:41.529373 4057 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "185c63f61a2645928eeb807d145026b1" instance_seqno: 1770153026474418) as {username='slave'} at 127.2.32.131:41985; Asking this server to re-register.
I20260203 21:10:41.529781 3107 heartbeater.cc:461] Registering TS with master...
I20260203 21:10:41.530682 4057 ts_manager.cc:194] Registered new tserver with Master: 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
I20260203 21:10:41.645246 2971 heartbeater.cc:344] Connected to a master server at 127.2.32.189:42681
I20260203 21:10:41.646166 4057 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" instance_seqno: 1770153026289802) as {username='slave'} at 127.2.32.130:56807; Asking this server to re-register.
I20260203 21:10:41.646529 2971 heartbeater.cc:461] Registering TS with master...
I20260203 21:10:41.647418 4057 ts_manager.cc:194] Registered new tserver with Master: 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897)
I20260203 21:10:41.689615 3695 raft_consensus.cc:493] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d9e0cecab784cc0acc050ca1c89c5be)
I20260203 21:10:41.689745 3695 raft_consensus.cc:515] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:41.690145 3695 leader_election.cc:290] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:10:41.690872 2720 leader_election.cc:343] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 3ae68905ec1942448b444ecd01836805
W20260203 21:10:41.690980 2721 leader_election.cc:343] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 3ae68905ec1942448b444ecd01836805
I20260203 21:10:41.691042 2721 leader_election.cc:304] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:10:41.691191 3695 raft_consensus.cc:2749] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:10:41.821096 4116 raft_consensus.cc:493] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 21:10:41.821311 4116 raft_consensus.cc:515] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:10:41.822613 4116 leader_election.cc:290] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419), 8a7e51013f5041898fe34f4b64a59260 (127.2.32.188:33665)
W20260203 21:10:41.823207 4044 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111)
W20260203 21:10:41.824082 4044 leader_election.cc:336] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419): Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111)
I20260203 21:10:41.826318 3920 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "35397be7e61f4b27a49e9449b9fdf085" candidate_term: 6 candidate_status { last_received { term: 5 index: 101 } } ignore_live_leader: false dest_uuid: "8a7e51013f5041898fe34f4b64a59260" is_pre_election: true
I20260203 21:10:41.826462 3920 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35397be7e61f4b27a49e9449b9fdf085 in term 5.
I20260203 21:10:41.827004 4041 leader_election.cc:304] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35397be7e61f4b27a49e9449b9fdf085, 8a7e51013f5041898fe34f4b64a59260; no voters: 7344d7cd8dea4fa2ae705320daacaf49
I20260203 21:10:41.827211 4116 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260203 21:10:41.827280 4116 raft_consensus.cc:493] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 21:10:41.827325 4116 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [term 5 FOLLOWER]: Advancing to term 6
I20260203 21:10:41.829213 4116 raft_consensus.cc:515] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:10:41.829567 4116 leader_election.cc:290] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [CANDIDATE]: Term 6 election: Requested vote from peers 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419), 8a7e51013f5041898fe34f4b64a59260 (127.2.32.188:33665)
I20260203 21:10:41.829898 3920 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "35397be7e61f4b27a49e9449b9fdf085" candidate_term: 6 candidate_status { last_received { term: 5 index: 101 } } ignore_live_leader: false dest_uuid: "8a7e51013f5041898fe34f4b64a59260"
I20260203 21:10:41.830076 3920 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 5 FOLLOWER]: Advancing to term 6
W20260203 21:10:41.830401 4044 leader_election.cc:336] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419): Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111)
I20260203 21:10:41.830999 3920 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35397be7e61f4b27a49e9449b9fdf085 in term 6.
I20260203 21:10:41.831249 4041 leader_election.cc:304] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35397be7e61f4b27a49e9449b9fdf085, 8a7e51013f5041898fe34f4b64a59260; no voters: 7344d7cd8dea4fa2ae705320daacaf49
I20260203 21:10:41.831439 4116 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [term 6 FOLLOWER]: Leader election won for term 6
I20260203 21:10:41.831713 4116 raft_consensus.cc:697] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [term 6 LEADER]: Becoming Leader. State: Replica: 35397be7e61f4b27a49e9449b9fdf085, State: Running, Role: LEADER
I20260203 21:10:41.831987 4116 consensus_queue.cc:237] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 101, Committed index: 101, Last appended: 5.101, Last appended by leader: 101, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:10:41.833571 4121 sys_catalog.cc:455] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 35397be7e61f4b27a49e9449b9fdf085. Latest consensus state: current_term: 6 leader_uuid: "35397be7e61f4b27a49e9449b9fdf085" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } } }
I20260203 21:10:41.833691 4121 sys_catalog.cc:458] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [sys.catalog]: This master's current role is: LEADER
I20260203 21:10:41.833966 4123 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260203 21:10:41.835577 4123 catalog_manager.cc:679] Loaded metadata for table default.table_3397dfe4625e42cf8cb5f4d45116d7b1 [id=1047aea4c6eb42f4994b72f5cafef147]
I20260203 21:10:41.835889 4123 catalog_manager.cc:679] Loaded metadata for table default.table_675a6f7413004a62bce7c460e7b6da3b [id=1df0a5e5434d4c00a3dfe92d216cfb54]
I20260203 21:10:41.836100 4123 catalog_manager.cc:679] Loaded metadata for table default.table_547d99db0d3043499a26ee8c6df4c443 [id=333213fed7234610bc20c7d92124182b]
I20260203 21:10:41.836297 4123 catalog_manager.cc:679] Loaded metadata for table default.table_98e2e0221eb0485fb87bee758843d37e [id=42eb95ae2b9442b18dac664ea886b4b3]
I20260203 21:10:41.836495 4123 catalog_manager.cc:679] Loaded metadata for table default.table_b7c2ca72f69c49a0b39163d2fcb69341 [id=467e79ec835d45669e3155e07b8ba81f]
I20260203 21:10:41.836699 4123 catalog_manager.cc:679] Loaded metadata for table default.table_a029ba95c22e421585ca4ce640aa9658 [id=73eae179f2ad481d932a5b3c95b1a4ab]
I20260203 21:10:41.836896 4123 catalog_manager.cc:679] Loaded metadata for table default.table_72135cb0d98246739f6b8c9aee17c8ba [id=7402e05c90cf4b15be6effde36465fff]
I20260203 21:10:41.837085 4123 catalog_manager.cc:679] Loaded metadata for table default.table_7e73ff80019543888e0b8afa9b7a6660 [id=82ec5c95acc84e509c0803db74b626b4]
I20260203 21:10:41.837268 4123 catalog_manager.cc:679] Loaded metadata for table default.table_c2985ddec2e045cba153900329fe9331 [id=85725aeaace648d9ac1bb5d3940d0ad0]
I20260203 21:10:41.837488 4123 catalog_manager.cc:679] Loaded metadata for table default.table_4c9a68305b5e4d4aa45e3a351c35eee7 [id=8f8f5b53d1204b56979a8db32be6ee89]
I20260203 21:10:41.837788 4123 catalog_manager.cc:679] Loaded metadata for table default.table_09e62d0aaa0f48ad9ed818ba967be542 [id=a26f4a67278a4929b2378fbbe9baaf52]
I20260203 21:10:41.838011 4123 catalog_manager.cc:679] Loaded metadata for table default.table_800a192f4e9e4ca5806a324b36234706 [id=a995c742bb2942838a2385b05a4d4d57]
I20260203 21:10:41.838199 4123 catalog_manager.cc:679] Loaded metadata for table default.table_8da179b3ec0b4c898eb890f89d54cb6a [id=ad58be29e80345e1afe7f5a55e129af2]
I20260203 21:10:41.838382 4123 catalog_manager.cc:679] Loaded metadata for table default.table_66c508c8dbdd4e7ea9283cabe65b62c0 [id=b62df06982124a70936068823e4b2324]
I20260203 21:10:41.838766 4123 catalog_manager.cc:679] Loaded metadata for table default.table_4f93e096d30349908a32a33e024543d6 [id=fa8fb788ff754fcd8641964a9d894664]
I20260203 21:10:41.840291 4123 tablet_loader.cc:96] loaded metadata for tablet 387f8e87a39f402e9a6416d5408427df (table default.table_b7c2ca72f69c49a0b39163d2fcb69341 [id=467e79ec835d45669e3155e07b8ba81f])
I20260203 21:10:41.840551 4123 tablet_loader.cc:96] loaded metadata for tablet 4c8edfa3d555490f953a3ec7bef314ae (table default.table_a029ba95c22e421585ca4ce640aa9658 [id=73eae179f2ad481d932a5b3c95b1a4ab])
I20260203 21:10:41.840704 4123 tablet_loader.cc:96] loaded metadata for tablet 4d6ed92d766244489541e1c280afacb5 (table default.table_09e62d0aaa0f48ad9ed818ba967be542 [id=a26f4a67278a4929b2378fbbe9baaf52])
I20260203 21:10:41.840852 4123 tablet_loader.cc:96] loaded metadata for tablet 4de1de23650548c2a078b51c9bf4d031 (table default.table_4f93e096d30349908a32a33e024543d6 [id=fa8fb788ff754fcd8641964a9d894664])
I20260203 21:10:41.840994 4123 tablet_loader.cc:96] loaded metadata for tablet 576be22c2477419192cc271e46b8e57e (table default.table_547d99db0d3043499a26ee8c6df4c443 [id=333213fed7234610bc20c7d92124182b])
I20260203 21:10:41.841148 4123 tablet_loader.cc:96] loaded metadata for tablet 62542a22943242c7987cc65423f548b4 (table default.table_72135cb0d98246739f6b8c9aee17c8ba [id=7402e05c90cf4b15be6effde36465fff])
I20260203 21:10:41.841311 4123 tablet_loader.cc:96] loaded metadata for tablet 6606bf5d7de047cda4a0523197210c1a (table default.table_66c508c8dbdd4e7ea9283cabe65b62c0 [id=b62df06982124a70936068823e4b2324])
I20260203 21:10:41.841477 4123 tablet_loader.cc:96] loaded metadata for tablet 739e31c065d94d7badfe9097b04ca0a9 (table default.table_7e73ff80019543888e0b8afa9b7a6660 [id=82ec5c95acc84e509c0803db74b626b4])
I20260203 21:10:41.841787 4123 tablet_loader.cc:96] loaded metadata for tablet 8df16fd039bf4d9b91ee2e49151c18c2 (table default.table_675a6f7413004a62bce7c460e7b6da3b [id=1df0a5e5434d4c00a3dfe92d216cfb54])
I20260203 21:10:41.842008 4123 tablet_loader.cc:96] loaded metadata for tablet 98cd2089483c4121944152e5cee8ca30 (table default.table_4c9a68305b5e4d4aa45e3a351c35eee7 [id=8f8f5b53d1204b56979a8db32be6ee89])
I20260203 21:10:41.842152 4123 tablet_loader.cc:96] loaded metadata for tablet 9c19a7b6dba6432f91e68164734a7e6d (table default.table_800a192f4e9e4ca5806a324b36234706 [id=a995c742bb2942838a2385b05a4d4d57])
I20260203 21:10:41.842458 4123 tablet_loader.cc:96] loaded metadata for tablet b20e604665624843b957080dc6016d78 (table default.table_8da179b3ec0b4c898eb890f89d54cb6a [id=ad58be29e80345e1afe7f5a55e129af2])
I20260203 21:10:41.842607 4123 tablet_loader.cc:96] loaded metadata for tablet ba8723a952564816a5c1f7945c448db9 (table default.table_3397dfe4625e42cf8cb5f4d45116d7b1 [id=1047aea4c6eb42f4994b72f5cafef147])
I20260203 21:10:41.843067 4123 tablet_loader.cc:96] loaded metadata for tablet dd27d2dc29364e1b87fb1936bae8d2a1 (table default.table_c2985ddec2e045cba153900329fe9331 [id=85725aeaace648d9ac1bb5d3940d0ad0])
I20260203 21:10:41.843770 4123 tablet_loader.cc:96] loaded metadata for tablet f8f173ff52ed4daa8b8ddcbeae43bc4a (table default.table_98e2e0221eb0485fb87bee758843d37e [id=42eb95ae2b9442b18dac664ea886b4b3])
I20260203 21:10:41.843897 4123 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260203 21:10:41.844583 4123 catalog_manager.cc:1269] Loaded cluster ID: f46367a11713484f92c1d2be2585f5a6
I20260203 21:10:41.844624 4123 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260203 21:10:41.845355 4123 catalog_manager.cc:1514] Loading token signing keys...
I20260203 21:10:41.845952 4123 catalog_manager.cc:6038] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085: Loaded TSK: 0
I20260203 21:10:41.846638 4123 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260203 21:10:41.847211 4123 catalog_manager.cc:1537] Loading latest processed Hive Metastore notification log event ID...
I20260203 21:10:41.847805 4123 catalog_manager.cc:5876] Last processed Hive Metastore notification event ID: 21
I20260203 21:10:41.858877 3695 raft_consensus.cc:493] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d9e0cecab784cc0acc050ca1c89c5be)
I20260203 21:10:41.859009 3695 raft_consensus.cc:515] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:41.859378 3695 leader_election.cc:290] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:10:41.860183 2720 leader_election.cc:343] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: a375114bebc64385827b7b6e0060d1e4
W20260203 21:10:41.860289 2721 leader_election.cc:343] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: a375114bebc64385827b7b6e0060d1e4
I20260203 21:10:41.860347 2721 leader_election.cc:304] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:10:41.860482 3695 raft_consensus.cc:2749] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:10:41.903424 2765 tablet_service.cc:1552] Processing DeleteTablet for tablet 2f8e36b89ebf456d964c9a31f7c7636a with delete_type TABLET_DATA_DELETED (replaced by tablet f8f173ff52ed4daa8b8ddcbeae43bc4a) from {username='slave'} at 127.0.0.1:57232
I20260203 21:10:41.903782 4126 tablet_replica.cc:333] T 2f8e36b89ebf456d964c9a31f7c7636a P 02bdf326542e474cbe62434dd59087dc: stopping tablet replica
I20260203 21:10:41.903924 4126 raft_consensus.cc:2243] T 2f8e36b89ebf456d964c9a31f7c7636a P 02bdf326542e474cbe62434dd59087dc [term 1 LEADER]: Raft consensus shutting down.
I20260203 21:10:41.904141 4126 raft_consensus.cc:2272] T 2f8e36b89ebf456d964c9a31f7c7636a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 21:10:41.904599 4126 ts_tablet_manager.cc:1916] T 2f8e36b89ebf456d964c9a31f7c7636a P 02bdf326542e474cbe62434dd59087dc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260203 21:10:41.906790 4126 ts_tablet_manager.cc:1929] T 2f8e36b89ebf456d964c9a31f7c7636a P 02bdf326542e474cbe62434dd59087dc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260203 21:10:41.906893 4126 log.cc:1199] T 2f8e36b89ebf456d964c9a31f7c7636a P 02bdf326542e474cbe62434dd59087dc: Deleting WAL directory at /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-0/wal/wals/2f8e36b89ebf456d964c9a31f7c7636a
I20260203 21:10:41.907153 4126 ts_tablet_manager.cc:1950] T 2f8e36b89ebf456d964c9a31f7c7636a P 02bdf326542e474cbe62434dd59087dc: Deleting consensus metadata
I20260203 21:10:41.907795 4042 catalog_manager.cc:4985] TS 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335): tablet 2f8e36b89ebf456d964c9a31f7c7636a (table default.table_98e2e0221eb0485fb87bee758843d37e [id=42eb95ae2b9442b18dac664ea886b4b3]) successfully deleted
I20260203 21:10:41.909236 4057 master_service.cc:954] ReplaceTablet: received request to replace tablet 62542a22943242c7987cc65423f548b4 from {username='slave'} at 127.0.0.1:59972
I20260203 21:10:41.909288 4052 master_service.cc:954] ReplaceTablet: received request to replace tablet 387f8e87a39f402e9a6416d5408427df from {username='slave'} at 127.0.0.1:59972
I20260203 21:10:41.909505 4056 master_service.cc:954] ReplaceTablet: received request to replace tablet 4de1de23650548c2a078b51c9bf4d031 from {username='slave'} at 127.0.0.1:59972
I20260203 21:10:41.909950 4049 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59972:
name: "default.Table_002112ac16a246d19bd71fd9b416c635"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260203 21:10:41.910422 4051 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59972:
name: "default.Table_75f7568b9f28464e8d4ce934087b320e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260203 21:10:41.910512 4054 master_service.cc:954] ReplaceTablet: received request to replace tablet 739e31c065d94d7badfe9097b04ca0a9 from {username='slave'} at 127.0.0.1:59972
I20260203 21:10:41.910846 4055 master_service.cc:954] ReplaceTablet: received request to replace tablet 739e31c065d94d7badfe9097b04ca0a9 from {username='slave'} at 127.0.0.1:59972
I20260203 21:10:41.911087 4053 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59972:
table { table_name: "default.Table_4c9a68305b5e4d4aa45e3a351c35eee7" } new_table_name: "default.Table_23a38bddaee24e5fa7bfe16e5af12fb5" modify_external_catalogs: true
I20260203 21:10:41.911159 4050 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59972:
name: "default.Table_76bef700d9b64243b6b4e93ffbc64f7a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260203 21:10:41.911367 4048 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59972:
table { table_name: "default.Table_09e62d0aaa0f48ad9ed818ba967be542" } modify_external_catalogs: true
I20260203 21:10:41.911482 4048 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59972:
table { table_name: "default.Table_09e62d0aaa0f48ad9ed818ba967be542" } modify_external_catalogs: true
I20260203 21:10:41.913734 3920 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 6 FOLLOWER]: Refusing update from remote peer 35397be7e61f4b27a49e9449b9fdf085: Log matching property violated. Preceding OpId in replica: term: 5 index: 101. Preceding OpId from leader: term: 6 index: 103. (index mismatch)
W20260203 21:10:41.914037 4044 consensus_peers.cc:597] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 -> Peer 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419): Couldn't send request to peer 7344d7cd8dea4fa2ae705320daacaf49. Status: Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260203 21:10:41.914278 4116 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 102, Last known committed idx: 101, Time since last communication: 0.000s
I20260203 21:10:41.916965 4128 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 35397be7e61f4b27a49e9449b9fdf085. Latest consensus state: current_term: 6 leader_uuid: "35397be7e61f4b27a49e9449b9fdf085" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } } }
I20260203 21:10:41.917192 4128 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [sys.catalog]: This master's current role is: FOLLOWER
F20260203 21:10:41.917526 4110 hms_notification_log_listener.cc:287] non-monotonous event IDs from HMS: current 22, previous 22; dumping first 2 out of 12 received events: NotificationEvent(eventId=22, eventTime=1770153029, eventType=DROP_TABLE, dbName=default, tableName=table_76bef700d9b64243b6b4e93ffbc64f7a, message={"server":"","servicePrincipal":"","db":"default","table":"table_76bef700d9b64243b6b4e93ffbc64f7a","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_76bef700d9b64243b6b4e93ffbc64f7a\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1770153028},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/warehouse/table_76bef700d9b64243b6b4e93ffbc64f7a\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_76bef700d9b64243b6b4e93ffbc64f7a\",\"kudu.table_id\":\"f6e23f2505784c6f98a18a43b9917c06\",\"transient_lastDdlTime\":\"1770153028\",\"comment\":\"\",\"kudu.master_addresses\":\"127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"f46367a11713484f92c1d2be2585f5a6\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1770153029}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=22, eventTime=1770153029, eventType=CREATE_TABLE, dbName=default, tableName=table_4f93e096d30349908a32a33e024543d6, message={"server":"","servicePrincipal":"","db":"default","table":"table_4f93e096d30349908a32a33e024543d6","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_4f93e096d30349908a32a33e024543d6\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1770153029},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/warehouse/table_4f93e096d30349908a32a33e024543d6\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_4f93e096d30349908a32a33e024543d6\",\"kudu.table_id\":\"fa8fb788ff754fcd8641964a9d894664\",\"transient_lastDdlTime\":\"1770153029\",\"comment\":\"\",\"kudu.master_addresses\":\"127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"f46367a11713484f92c1d2be2585f5a6\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1770153029,"files":[]}, messageFormat=json-0.2, catName=hive);
*** Check failure stack trace: ***
I20260203 21:10:41.918980 4116 sys_catalog.cc:455] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 6 leader_uuid: "35397be7e61f4b27a49e9449b9fdf085" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } } }
I20260203 21:10:41.919099 4116 sys_catalog.cc:458] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [sys.catalog]: This master's current role is: LEADER
@ 0x7f4164a5cdcd google::LogMessage::Fail() at ??:0
I20260203 21:10:41.921573 4054 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085: Sending DeleteTablet for 3 replicas of tablet 739e31c065d94d7badfe9097b04ca0a9
I20260203 21:10:41.921955 4055 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59972:
table { table_name: "default.Table_800a192f4e9e4ca5806a324b36234706" } new_table_name: "default.Table_9f9f33407af144ea8957cb4f76b5ac87" modify_external_catalogs: true
I20260203 21:10:41.922185 4054 catalog_manager.cc:6724] ReplaceTablet: tablet 739e31c065d94d7badfe9097b04ca0a9 deleted and replaced by tablet fe117dd96d8a4c46888743223c6e385d
@ 0x7f4164a60b93 google::LogMessage::SendToLog() at ??:0
I20260203 21:10:41.922366 4054 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59972:
table { table_name: "default.Table_66c508c8dbdd4e7ea9283cabe65b62c0" } modify_external_catalogs: true
I20260203 21:10:41.922462 4054 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59972:
table { table_name: "default.Table_66c508c8dbdd4e7ea9283cabe65b62c0" } modify_external_catalogs: true
I20260203 21:10:41.923496 2765 tablet_service.cc:1552] Processing DeleteTablet for tablet 739e31c065d94d7badfe9097b04ca0a9 with delete_type TABLET_DATA_DELETED (replaced by tablet fe117dd96d8a4c46888743223c6e385d) from {username='slave'} at 127.0.0.1:57232
@ 0x7f4164a5c7cc google::LogMessage::Flush() at ??:0
I20260203 21:10:41.924901 4057 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085: Sending DeleteTablet for 3 replicas of tablet 62542a22943242c7987cc65423f548b4
I20260203 21:10:41.925168 4057 catalog_manager.cc:6724] ReplaceTablet: tablet 62542a22943242c7987cc65423f548b4 deleted and replaced by tablet 0b97240f69584c82abbe51996eda51f9
I20260203 21:10:41.925208 4056 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085: Sending DeleteTablet for 3 replicas of tablet 4de1de23650548c2a078b51c9bf4d031
I20260203 21:10:41.925328 4057 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59972:
table { table_name: "default.Table_c2985ddec2e045cba153900329fe9331" } modify_external_catalogs: true
I20260203 21:10:41.925436 4057 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59972:
table { table_name: "default.Table_c2985ddec2e045cba153900329fe9331" } modify_external_catalogs: true
@ 0x7f4164a5ca11 google::LogMessage::~LogMessage() at ??:0
I20260203 21:10:41.925647 4052 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085: Sending DeleteTablet for 3 replicas of tablet 387f8e87a39f402e9a6416d5408427df
I20260203 21:10:41.925905 4052 catalog_manager.cc:6724] ReplaceTablet: tablet 387f8e87a39f402e9a6416d5408427df deleted and replaced by tablet d14e0fd61df846fb85bafa17ee900f15
I20260203 21:10:41.926064 2759 tablet_service.cc:1552] Processing DeleteTablet for tablet 4de1de23650548c2a078b51c9bf4d031 with delete_type TABLET_DATA_DELETED (replaced by tablet 8a206d0a0a1947bdabc1123ff6c281f0) from {username='slave'} at 127.0.0.1:57232
I20260203 21:10:41.926085 4052 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59972:
table { table_name: "default.Table_547d99db0d3043499a26ee8c6df4c443" } modify_external_catalogs: true
I20260203 21:10:41.926168 4052 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59972:
table { table_name: "default.Table_547d99db0d3043499a26ee8c6df4c443" } modify_external_catalogs: true
I20260203 21:10:41.926403 2765 tablet_service.cc:1552] Processing DeleteTablet for tablet 62542a22943242c7987cc65423f548b4 with delete_type TABLET_DATA_DELETED (replaced by tablet 0b97240f69584c82abbe51996eda51f9) from {username='slave'} at 127.0.0.1:57232
I20260203 21:10:41.925439 4056 catalog_manager.cc:6724] ReplaceTablet: tablet 4de1de23650548c2a078b51c9bf4d031 deleted and replaced by tablet 8a206d0a0a1947bdabc1123ff6c281f0
I20260203 21:10:41.926674 4056 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59972:
table { table_name: "default.Table_a029ba95c22e421585ca4ce640aa9658" } modify_external_catalogs: true
I20260203 21:10:41.926724 4126 tablet_replica.cc:333] T 739e31c065d94d7badfe9097b04ca0a9 P 02bdf326542e474cbe62434dd59087dc: stopping tablet replica
I20260203 21:10:41.926764 4056 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59972:
table { table_name: "default.Table_a029ba95c22e421585ca4ce640aa9658" } modify_external_catalogs: true
I20260203 21:10:41.926851 4126 raft_consensus.cc:2243] T 739e31c065d94d7badfe9097b04ca0a9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 21:10:41.926982 4126 raft_consensus.cc:2272] T 739e31c065d94d7badfe9097b04ca0a9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 21:10:41.927300 4126 ts_tablet_manager.cc:1916] T 739e31c065d94d7badfe9097b04ca0a9 P 02bdf326542e474cbe62434dd59087dc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260203 21:10:41.928390 4127 mvcc.cc:204] Tried to move back new op lower bound from 7250546859675205632 to 7250546859346190336. Current Snapshot: MvccSnapshot[applied={T|T < 7250546859675205632 or (T in {7250546859675205632})}]
I20260203 21:10:41.928788 2765 tablet_service.cc:1552] Processing DeleteTablet for tablet 387f8e87a39f402e9a6416d5408427df with delete_type TABLET_DATA_DELETED (replaced by tablet d14e0fd61df846fb85bafa17ee900f15) from {username='slave'} at 127.0.0.1:57232
I20260203 21:10:41.929646 4126 ts_tablet_manager.cc:1929] T 739e31c065d94d7badfe9097b04ca0a9 P 02bdf326542e474cbe62434dd59087dc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260203 21:10:41.929709 4126 log.cc:1199] T 739e31c065d94d7badfe9097b04ca0a9 P 02bdf326542e474cbe62434dd59087dc: Deleting WAL directory at /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-0/wal/wals/739e31c065d94d7badfe9097b04ca0a9
I20260203 21:10:41.929948 4126 ts_tablet_manager.cc:1950] T 739e31c065d94d7badfe9097b04ca0a9 P 02bdf326542e474cbe62434dd59087dc: Deleting consensus metadata
I20260203 21:10:41.930619 4042 catalog_manager.cc:4985] TS 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335): tablet 739e31c065d94d7badfe9097b04ca0a9 (table default.table_7e73ff80019543888e0b8afa9b7a6660 [id=82ec5c95acc84e509c0803db74b626b4]) successfully deleted
I20260203 21:10:41.930872 4126 tablet_replica.cc:333] T 4de1de23650548c2a078b51c9bf4d031 P 02bdf326542e474cbe62434dd59087dc: stopping tablet replica
I20260203 21:10:41.931032 4128 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 6 leader_uuid: "35397be7e61f4b27a49e9449b9fdf085" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } } }
I20260203 21:10:41.931136 4128 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [sys.catalog]: This master's current role is: FOLLOWER
I20260203 21:10:41.931440 4126 raft_consensus.cc:2243] T 4de1de23650548c2a078b51c9bf4d031 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 21:10:41.931550 4126 raft_consensus.cc:2272] T 4de1de23650548c2a078b51c9bf4d031 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 21:10:41.931959 4126 ts_tablet_manager.cc:1916] T 4de1de23650548c2a078b51c9bf4d031 P 02bdf326542e474cbe62434dd59087dc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260203 21:10:41.933531 2765 tablet_service.cc:1505] Processing CreateTablet for tablet fe117dd96d8a4c46888743223c6e385d (DEFAULT_TABLE table=default.table_7e73ff80019543888e0b8afa9b7a6660 [id=82ec5c95acc84e509c0803db74b626b4]), partition=RANGE (key) PARTITION UNBOUNDED
@ 0x7f4169bd2ef9 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
W20260203 21:10:41.935094 2857 consensus_peers.cc:597] T 739e31c065d94d7badfe9097b04ca0a9 P 6d9e0cecab784cc0acc050ca1c89c5be -> Peer 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335): Couldn't send request to peer 02bdf326542e474cbe62434dd59087dc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 739e31c065d94d7badfe9097b04ca0a9. This is attempt 1: this message will repeat every 5th retry.
I20260203 21:10:41.936390 2765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe117dd96d8a4c46888743223c6e385d. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7f4169bd1e10 kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
I20260203 21:10:41.939884 4126 ts_tablet_manager.cc:1929] T 4de1de23650548c2a078b51c9bf4d031 P 02bdf326542e474cbe62434dd59087dc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260203 21:10:41.939954 4126 log.cc:1199] T 4de1de23650548c2a078b51c9bf4d031 P 02bdf326542e474cbe62434dd59087dc: Deleting WAL directory at /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-0/wal/wals/4de1de23650548c2a078b51c9bf4d031
I20260203 21:10:41.940191 2765 tablet_service.cc:1505] Processing CreateTablet for tablet 8a206d0a0a1947bdabc1123ff6c281f0 (DEFAULT_TABLE table=default.table_4f93e096d30349908a32a33e024543d6 [id=fa8fb788ff754fcd8641964a9d894664]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:41.940402 2765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a206d0a0a1947bdabc1123ff6c281f0. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7f4169bd1573 _ZZN4kudu6master30HmsNotificationLogListenerTask4InitEvENKUlvE_clEv at ??:0
I20260203 21:10:41.940896 2759 tablet_service.cc:1505] Processing CreateTablet for tablet d14e0fd61df846fb85bafa17ee900f15 (DEFAULT_TABLE table=default.table_b7c2ca72f69c49a0b39163d2fcb69341 [id=467e79ec835d45669e3155e07b8ba81f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:41.941080 2759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d14e0fd61df846fb85bafa17ee900f15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:41.942538 4126 ts_tablet_manager.cc:1950] T 4de1de23650548c2a078b51c9bf4d031 P 02bdf326542e474cbe62434dd59087dc: Deleting consensus metadata
I20260203 21:10:41.943137 4126 tablet_replica.cc:333] T 62542a22943242c7987cc65423f548b4 P 02bdf326542e474cbe62434dd59087dc: stopping tablet replica
I20260203 21:10:41.943255 4126 raft_consensus.cc:2243] T 62542a22943242c7987cc65423f548b4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 21:10:41.943298 4042 catalog_manager.cc:4985] TS 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335): tablet 4de1de23650548c2a078b51c9bf4d031 (table default.table_4f93e096d30349908a32a33e024543d6 [id=fa8fb788ff754fcd8641964a9d894664]) successfully deleted
I20260203 21:10:41.943351 4126 raft_consensus.cc:2272] T 62542a22943242c7987cc65423f548b4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 21:10:41.943414 2759 tablet_service.cc:1505] Processing CreateTablet for tablet 0b97240f69584c82abbe51996eda51f9 (DEFAULT_TABLE table=default.table_72135cb0d98246739f6b8c9aee17c8ba [id=7402e05c90cf4b15be6effde36465fff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:41.943612 2759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b97240f69584c82abbe51996eda51f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:41.943723 4126 ts_tablet_manager.cc:1916] T 62542a22943242c7987cc65423f548b4 P 02bdf326542e474cbe62434dd59087dc: Deleting tablet data with delete state TABLET_DATA_DELETED
@ 0x7f4169bd6c7a _ZNSt17_Function_handlerIFvvEZN4kudu6master30HmsNotificationLogListenerTask4InitEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x55c1a4197a0a std::function<>::operator()() at ??:0
I20260203 21:10:41.949074 4126 ts_tablet_manager.cc:1929] T 62542a22943242c7987cc65423f548b4 P 02bdf326542e474cbe62434dd59087dc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260203 21:10:41.949156 4126 log.cc:1199] T 62542a22943242c7987cc65423f548b4 P 02bdf326542e474cbe62434dd59087dc: Deleting WAL directory at /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-0/wal/wals/62542a22943242c7987cc65423f548b4
I20260203 21:10:41.949397 4126 ts_tablet_manager.cc:1950] T 62542a22943242c7987cc65423f548b4 P 02bdf326542e474cbe62434dd59087dc: Deleting consensus metadata
@ 0x7f4165eb6b04 kudu::Thread::SuperviseThread() at ??:0
I20260203 21:10:41.949993 4126 tablet_replica.cc:333] T 387f8e87a39f402e9a6416d5408427df P 02bdf326542e474cbe62434dd59087dc: stopping tablet replica
I20260203 21:10:41.950114 4126 raft_consensus.cc:2243] T 387f8e87a39f402e9a6416d5408427df P 02bdf326542e474cbe62434dd59087dc [term 1 LEADER]: Raft consensus shutting down.
I20260203 21:10:41.950136 4042 catalog_manager.cc:4985] TS 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335): tablet 62542a22943242c7987cc65423f548b4 (table default.table_72135cb0d98246739f6b8c9aee17c8ba [id=7402e05c90cf4b15be6effde36465fff]) successfully deleted
I20260203 21:10:41.950405 4144 tablet_bootstrap.cc:492] T fe117dd96d8a4c46888743223c6e385d P 02bdf326542e474cbe62434dd59087dc: Bootstrap starting.
I20260203 21:10:41.951148 2902 tablet_service.cc:1552] Processing DeleteTablet for tablet 62542a22943242c7987cc65423f548b4 with delete_type TABLET_DATA_DELETED (replaced by tablet 0b97240f69584c82abbe51996eda51f9) from {username='slave'} at 127.0.0.1:33942
I20260203 21:10:41.951484 4144 tablet_bootstrap.cc:654] T fe117dd96d8a4c46888743223c6e385d P 02bdf326542e474cbe62434dd59087dc: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:41.951500 2900 tablet_service.cc:1552] Processing DeleteTablet for tablet 739e31c065d94d7badfe9097b04ca0a9 with delete_type TABLET_DATA_DELETED (replaced by tablet fe117dd96d8a4c46888743223c6e385d) from {username='slave'} at 127.0.0.1:33942
I20260203 21:10:41.951676 2897 tablet_service.cc:1552] Processing DeleteTablet for tablet 4de1de23650548c2a078b51c9bf4d031 with delete_type TABLET_DATA_DELETED (replaced by tablet 8a206d0a0a1947bdabc1123ff6c281f0) from {username='slave'} at 127.0.0.1:33942
I20260203 21:10:41.951699 2902 tablet_service.cc:1505] Processing CreateTablet for tablet 0b97240f69584c82abbe51996eda51f9 (DEFAULT_TABLE table=default.table_72135cb0d98246739f6b8c9aee17c8ba [id=7402e05c90cf4b15be6effde36465fff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:41.951778 2895 tablet_service.cc:1552] Processing DeleteTablet for tablet 387f8e87a39f402e9a6416d5408427df with delete_type TABLET_DATA_DELETED (replaced by tablet d14e0fd61df846fb85bafa17ee900f15) from {username='slave'} at 127.0.0.1:33942
I20260203 21:10:41.951953 2902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b97240f69584c82abbe51996eda51f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:41.952008 2896 tablet_service.cc:1505] Processing CreateTablet for tablet fe117dd96d8a4c46888743223c6e385d (DEFAULT_TABLE table=default.table_7e73ff80019543888e0b8afa9b7a6660 [id=82ec5c95acc84e509c0803db74b626b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:41.952271 2896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe117dd96d8a4c46888743223c6e385d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:41.953534 4126 raft_consensus.cc:2272] T 387f8e87a39f402e9a6416d5408427df P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 21:10:41.953933 4126 ts_tablet_manager.cc:1916] T 387f8e87a39f402e9a6416d5408427df P 02bdf326542e474cbe62434dd59087dc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260203 21:10:41.954423 2898 tablet_service.cc:1505] Processing CreateTablet for tablet 8a206d0a0a1947bdabc1123ff6c281f0 (DEFAULT_TABLE table=default.table_4f93e096d30349908a32a33e024543d6 [id=fa8fb788ff754fcd8641964a9d894664]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:41.954653 2898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a206d0a0a1947bdabc1123ff6c281f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:41.955202 3032 tablet_service.cc:1552] Processing DeleteTablet for tablet 739e31c065d94d7badfe9097b04ca0a9 with delete_type TABLET_DATA_DELETED (replaced by tablet fe117dd96d8a4c46888743223c6e385d) from {username='slave'} at 127.0.0.1:44690
I20260203 21:10:41.955528 4149 tablet_replica.cc:333] T 739e31c065d94d7badfe9097b04ca0a9 P 185c63f61a2645928eeb807d145026b1: stopping tablet replica
I20260203 21:10:41.955693 4149 raft_consensus.cc:2243] T 739e31c065d94d7badfe9097b04ca0a9 P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 21:10:41.955821 4149 raft_consensus.cc:2272] T 739e31c065d94d7badfe9097b04ca0a9 P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 21:10:41.956048 3033 tablet_service.cc:1552] Processing DeleteTablet for tablet 4de1de23650548c2a078b51c9bf4d031 with delete_type TABLET_DATA_DELETED (replaced by tablet 8a206d0a0a1947bdabc1123ff6c281f0) from {username='slave'} at 127.0.0.1:44690
I20260203 21:10:41.956172 3034 tablet_service.cc:1552] Processing DeleteTablet for tablet 387f8e87a39f402e9a6416d5408427df with delete_type TABLET_DATA_DELETED (replaced by tablet d14e0fd61df846fb85bafa17ee900f15) from {username='slave'} at 127.0.0.1:44690
I20260203 21:10:41.956190 4149 ts_tablet_manager.cc:1916] T 739e31c065d94d7badfe9097b04ca0a9 P 185c63f61a2645928eeb807d145026b1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260203 21:10:41.956404 3038 tablet_service.cc:1505] Processing CreateTablet for tablet fe117dd96d8a4c46888743223c6e385d (DEFAULT_TABLE table=default.table_7e73ff80019543888e0b8afa9b7a6660 [id=82ec5c95acc84e509c0803db74b626b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:41.956619 3038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe117dd96d8a4c46888743223c6e385d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:41.956636 2899 tablet_service.cc:1505] Processing CreateTablet for tablet d14e0fd61df846fb85bafa17ee900f15 (DEFAULT_TABLE table=default.table_b7c2ca72f69c49a0b39163d2fcb69341 [id=467e79ec835d45669e3155e07b8ba81f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:41.956840 2899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d14e0fd61df846fb85bafa17ee900f15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:41.957834 4126 ts_tablet_manager.cc:1929] T 387f8e87a39f402e9a6416d5408427df P 02bdf326542e474cbe62434dd59087dc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260203 21:10:41.957893 4126 log.cc:1199] T 387f8e87a39f402e9a6416d5408427df P 02bdf326542e474cbe62434dd59087dc: Deleting WAL directory at /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-0/wal/wals/387f8e87a39f402e9a6416d5408427df
I20260203 21:10:41.958105 4126 ts_tablet_manager.cc:1950] T 387f8e87a39f402e9a6416d5408427df P 02bdf326542e474cbe62434dd59087dc: Deleting consensus metadata
I20260203 21:10:41.958302 4149 ts_tablet_manager.cc:1929] T 739e31c065d94d7badfe9097b04ca0a9 P 185c63f61a2645928eeb807d145026b1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260203 21:10:41.958364 4149 log.cc:1199] T 739e31c065d94d7badfe9097b04ca0a9 P 185c63f61a2645928eeb807d145026b1: Deleting WAL directory at /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-2/wal/wals/739e31c065d94d7badfe9097b04ca0a9
I20260203 21:10:41.958607 4149 ts_tablet_manager.cc:1950] T 739e31c065d94d7badfe9097b04ca0a9 P 185c63f61a2645928eeb807d145026b1: Deleting consensus metadata
I20260203 21:10:41.958642 3037 tablet_service.cc:1505] Processing CreateTablet for tablet 8a206d0a0a1947bdabc1123ff6c281f0 (DEFAULT_TABLE table=default.table_4f93e096d30349908a32a33e024543d6 [id=fa8fb788ff754fcd8641964a9d894664]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:41.958762 4042 catalog_manager.cc:4985] TS 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335): tablet 387f8e87a39f402e9a6416d5408427df (table default.table_b7c2ca72f69c49a0b39163d2fcb69341 [id=467e79ec835d45669e3155e07b8ba81f]) successfully deleted
I20260203 21:10:41.958834 3037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a206d0a0a1947bdabc1123ff6c281f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:41.959501 4149 tablet_replica.cc:333] T 4de1de23650548c2a078b51c9bf4d031 P 185c63f61a2645928eeb807d145026b1: stopping tablet replica
I20260203 21:10:41.959620 4149 raft_consensus.cc:2243] T 4de1de23650548c2a078b51c9bf4d031 P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 21:10:41.959750 4149 raft_consensus.cc:2272] T 4de1de23650548c2a078b51c9bf4d031 P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 21:10:41.960100 4149 ts_tablet_manager.cc:1916] T 4de1de23650548c2a078b51c9bf4d031 P 185c63f61a2645928eeb807d145026b1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260203 21:10:41.960613 4144 tablet_bootstrap.cc:492] T fe117dd96d8a4c46888743223c6e385d P 02bdf326542e474cbe62434dd59087dc: No bootstrap required, opened a new log
I20260203 21:10:41.960704 4144 ts_tablet_manager.cc:1403] T fe117dd96d8a4c46888743223c6e385d P 02bdf326542e474cbe62434dd59087dc: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.002s
I20260203 21:10:41.960722 3036 tablet_service.cc:1505] Processing CreateTablet for tablet d14e0fd61df846fb85bafa17ee900f15 (DEFAULT_TABLE table=default.table_b7c2ca72f69c49a0b39163d2fcb69341 [id=467e79ec835d45669e3155e07b8ba81f]), partition=RANGE (key) PARTITION UNBOUNDED
@ 0x7f41667506db start_thread at ??:0
I20260203 21:10:41.961006 3036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d14e0fd61df846fb85bafa17ee900f15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:41.961191 4144 raft_consensus.cc:359] T fe117dd96d8a4c46888743223c6e385d P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:41.961294 4144 raft_consensus.cc:385] T fe117dd96d8a4c46888743223c6e385d P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:41.961323 4144 raft_consensus.cc:740] T fe117dd96d8a4c46888743223c6e385d P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02bdf326542e474cbe62434dd59087dc, State: Initialized, Role: FOLLOWER
I20260203 21:10:41.961472 4144 consensus_queue.cc:260] T fe117dd96d8a4c46888743223c6e385d P 02bdf326542e474cbe62434dd59087dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:41.961756 4144 ts_tablet_manager.cc:1434] T fe117dd96d8a4c46888743223c6e385d P 02bdf326542e474cbe62434dd59087dc: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260203 21:10:41.962050 2833 heartbeater.cc:499] Master 127.2.32.189:42681 was elected leader, sending a full tablet report...
@ 0x7f4163c1371f clone at ??:0
I20260203 21:10:41.962915 3035 tablet_service.cc:1505] Processing CreateTablet for tablet 0b97240f69584c82abbe51996eda51f9 (DEFAULT_TABLE table=default.table_72135cb0d98246739f6b8c9aee17c8ba [id=7402e05c90cf4b15be6effde36465fff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:41.963127 3035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b97240f69584c82abbe51996eda51f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:41.963400 4144 tablet_bootstrap.cc:492] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc: Bootstrap starting.
I20260203 21:10:41.965022 4144 tablet_bootstrap.cc:654] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:41.965174 3032 tablet_service.cc:1552] Processing DeleteTablet for tablet 62542a22943242c7987cc65423f548b4 with delete_type TABLET_DATA_DELETED (replaced by tablet 0b97240f69584c82abbe51996eda51f9) from {username='slave'} at 127.0.0.1:44690
I20260203 21:10:41.965416 4145 tablet_replica.cc:333] T 62542a22943242c7987cc65423f548b4 P 6d9e0cecab784cc0acc050ca1c89c5be: stopping tablet replica
I20260203 21:10:41.965565 4145 raft_consensus.cc:2243] T 62542a22943242c7987cc65423f548b4 P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 LEADER]: Raft consensus shutting down.
I20260203 21:10:41.965785 4145 raft_consensus.cc:2272] T 62542a22943242c7987cc65423f548b4 P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 21:10:41.966140 4145 ts_tablet_manager.cc:1916] T 62542a22943242c7987cc65423f548b4 P 6d9e0cecab784cc0acc050ca1c89c5be: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260203 21:10:41.966634 4149 ts_tablet_manager.cc:1929] T 4de1de23650548c2a078b51c9bf4d031 P 185c63f61a2645928eeb807d145026b1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260203 21:10:41.966703 4149 log.cc:1199] T 4de1de23650548c2a078b51c9bf4d031 P 185c63f61a2645928eeb807d145026b1: Deleting WAL directory at /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-2/wal/wals/4de1de23650548c2a078b51c9bf4d031
I20260203 21:10:41.966918 4149 ts_tablet_manager.cc:1950] T 4de1de23650548c2a078b51c9bf4d031 P 185c63f61a2645928eeb807d145026b1: Deleting consensus metadata
I20260203 21:10:41.967519 4149 tablet_replica.cc:333] T 387f8e87a39f402e9a6416d5408427df P 185c63f61a2645928eeb807d145026b1: stopping tablet replica
I20260203 21:10:41.967640 4149 raft_consensus.cc:2243] T 387f8e87a39f402e9a6416d5408427df P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 21:10:41.967764 4149 raft_consensus.cc:2272] T 387f8e87a39f402e9a6416d5408427df P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 21:10:41.967873 4150 tablet_bootstrap.cc:492] T fe117dd96d8a4c46888743223c6e385d P 185c63f61a2645928eeb807d145026b1: Bootstrap starting.
I20260203 21:10:41.968084 4149 ts_tablet_manager.cc:1916] T 387f8e87a39f402e9a6416d5408427df P 185c63f61a2645928eeb807d145026b1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260203 21:10:41.968104 4145 ts_tablet_manager.cc:1929] T 62542a22943242c7987cc65423f548b4 P 6d9e0cecab784cc0acc050ca1c89c5be: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260203 21:10:41.968164 4145 log.cc:1199] T 62542a22943242c7987cc65423f548b4 P 6d9e0cecab784cc0acc050ca1c89c5be: Deleting WAL directory at /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-1/wal/wals/62542a22943242c7987cc65423f548b4
I20260203 21:10:41.968915 4150 tablet_bootstrap.cc:654] T fe117dd96d8a4c46888743223c6e385d P 185c63f61a2645928eeb807d145026b1: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:41.969622 4147 tablet_bootstrap.cc:492] T 0b97240f69584c82abbe51996eda51f9 P 6d9e0cecab784cc0acc050ca1c89c5be: Bootstrap starting.
I20260203 21:10:41.969964 4149 ts_tablet_manager.cc:1929] T 387f8e87a39f402e9a6416d5408427df P 185c63f61a2645928eeb807d145026b1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260203 21:10:41.970023 4149 log.cc:1199] T 387f8e87a39f402e9a6416d5408427df P 185c63f61a2645928eeb807d145026b1: Deleting WAL directory at /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-2/wal/wals/387f8e87a39f402e9a6416d5408427df
I20260203 21:10:41.970232 4149 ts_tablet_manager.cc:1950] T 387f8e87a39f402e9a6416d5408427df P 185c63f61a2645928eeb807d145026b1: Deleting consensus metadata
I20260203 21:10:41.970674 4147 tablet_bootstrap.cc:654] T 0b97240f69584c82abbe51996eda51f9 P 6d9e0cecab784cc0acc050ca1c89c5be: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:41.970862 4149 tablet_replica.cc:333] T 62542a22943242c7987cc65423f548b4 P 185c63f61a2645928eeb807d145026b1: stopping tablet replica
I20260203 21:10:41.970969 4149 raft_consensus.cc:2243] T 62542a22943242c7987cc65423f548b4 P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 21:10:41.971063 4149 raft_consensus.cc:2272] T 62542a22943242c7987cc65423f548b4 P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 21:10:41.971367 4149 ts_tablet_manager.cc:1916] T 62542a22943242c7987cc65423f548b4 P 185c63f61a2645928eeb807d145026b1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260203 21:10:41.973176 4149 ts_tablet_manager.cc:1929] T 62542a22943242c7987cc65423f548b4 P 185c63f61a2645928eeb807d145026b1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260203 21:10:41.973233 4149 log.cc:1199] T 62542a22943242c7987cc65423f548b4 P 185c63f61a2645928eeb807d145026b1: Deleting WAL directory at /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-2/wal/wals/62542a22943242c7987cc65423f548b4
I20260203 21:10:41.973443 4149 ts_tablet_manager.cc:1950] T 62542a22943242c7987cc65423f548b4 P 185c63f61a2645928eeb807d145026b1: Deleting consensus metadata
I20260203 21:10:41.974584 4144 tablet_bootstrap.cc:492] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc: No bootstrap required, opened a new log
I20260203 21:10:41.974650 4150 tablet_bootstrap.cc:492] T fe117dd96d8a4c46888743223c6e385d P 185c63f61a2645928eeb807d145026b1: No bootstrap required, opened a new log
I20260203 21:10:41.974676 4144 ts_tablet_manager.cc:1403] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.000s
I20260203 21:10:41.974740 4150 ts_tablet_manager.cc:1403] T fe117dd96d8a4c46888743223c6e385d P 185c63f61a2645928eeb807d145026b1: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260203 21:10:41.975190 4144 raft_consensus.cc:359] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:41.975306 4144 raft_consensus.cc:385] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:41.975337 4144 raft_consensus.cc:740] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02bdf326542e474cbe62434dd59087dc, State: Initialized, Role: FOLLOWER
I20260203 21:10:41.975355 4150 raft_consensus.cc:359] T fe117dd96d8a4c46888743223c6e385d P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:41.975452 4150 raft_consensus.cc:385] T fe117dd96d8a4c46888743223c6e385d P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:41.975481 4150 raft_consensus.cc:740] T fe117dd96d8a4c46888743223c6e385d P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 185c63f61a2645928eeb807d145026b1, State: Initialized, Role: FOLLOWER
I20260203 21:10:41.975488 4144 consensus_queue.cc:260] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:41.975802 4144 ts_tablet_manager.cc:1434] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260203 21:10:41.975986 4144 tablet_bootstrap.cc:492] T d14e0fd61df846fb85bafa17ee900f15 P 02bdf326542e474cbe62434dd59087dc: Bootstrap starting.
I20260203 21:10:41.976996 4144 tablet_bootstrap.cc:654] T d14e0fd61df846fb85bafa17ee900f15 P 02bdf326542e474cbe62434dd59087dc: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:41.977864 4150 consensus_queue.cc:260] T fe117dd96d8a4c46888743223c6e385d P 185c63f61a2645928eeb807d145026b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:41.980077 4145 ts_tablet_manager.cc:1950] T 62542a22943242c7987cc65423f548b4 P 6d9e0cecab784cc0acc050ca1c89c5be: Deleting consensus metadata
I20260203 21:10:41.980639 4145 tablet_replica.cc:333] T 739e31c065d94d7badfe9097b04ca0a9 P 6d9e0cecab784cc0acc050ca1c89c5be: stopping tablet replica
I20260203 21:10:41.980737 4150 ts_tablet_manager.cc:1434] T fe117dd96d8a4c46888743223c6e385d P 185c63f61a2645928eeb807d145026b1: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260203 21:10:41.980764 4145 raft_consensus.cc:2243] T 739e31c065d94d7badfe9097b04ca0a9 P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 LEADER]: Raft consensus shutting down.
I20260203 21:10:41.980942 4145 raft_consensus.cc:2272] T 739e31c065d94d7badfe9097b04ca0a9 P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 21:10:41.981308 4145 ts_tablet_manager.cc:1916] T 739e31c065d94d7badfe9097b04ca0a9 P 6d9e0cecab784cc0acc050ca1c89c5be: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260203 21:10:41.981981 4150 tablet_bootstrap.cc:492] T 8a206d0a0a1947bdabc1123ff6c281f0 P 185c63f61a2645928eeb807d145026b1: Bootstrap starting.
I20260203 21:10:41.982633 4147 tablet_bootstrap.cc:492] T 0b97240f69584c82abbe51996eda51f9 P 6d9e0cecab784cc0acc050ca1c89c5be: No bootstrap required, opened a new log
I20260203 21:10:41.982707 4147 ts_tablet_manager.cc:1403] T 0b97240f69584c82abbe51996eda51f9 P 6d9e0cecab784cc0acc050ca1c89c5be: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.000s
I20260203 21:10:41.982721 4144 tablet_bootstrap.cc:492] T d14e0fd61df846fb85bafa17ee900f15 P 02bdf326542e474cbe62434dd59087dc: No bootstrap required, opened a new log
I20260203 21:10:41.982800 4144 ts_tablet_manager.cc:1403] T d14e0fd61df846fb85bafa17ee900f15 P 02bdf326542e474cbe62434dd59087dc: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260203 21:10:41.982982 4150 tablet_bootstrap.cc:654] T 8a206d0a0a1947bdabc1123ff6c281f0 P 185c63f61a2645928eeb807d145026b1: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:41.983140 4147 raft_consensus.cc:359] T 0b97240f69584c82abbe51996eda51f9 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:41.983233 4147 raft_consensus.cc:385] T 0b97240f69584c82abbe51996eda51f9 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:41.983261 4147 raft_consensus.cc:740] T 0b97240f69584c82abbe51996eda51f9 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d9e0cecab784cc0acc050ca1c89c5be, State: Initialized, Role: FOLLOWER
I20260203 21:10:41.983276 4145 ts_tablet_manager.cc:1929] T 739e31c065d94d7badfe9097b04ca0a9 P 6d9e0cecab784cc0acc050ca1c89c5be: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260203 21:10:41.983247 4144 raft_consensus.cc:359] T d14e0fd61df846fb85bafa17ee900f15 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:41.983325 4145 log.cc:1199] T 739e31c065d94d7badfe9097b04ca0a9 P 6d9e0cecab784cc0acc050ca1c89c5be: Deleting WAL directory at /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-1/wal/wals/739e31c065d94d7badfe9097b04ca0a9
I20260203 21:10:41.983346 4144 raft_consensus.cc:385] T d14e0fd61df846fb85bafa17ee900f15 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:41.983381 4144 raft_consensus.cc:740] T d14e0fd61df846fb85bafa17ee900f15 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02bdf326542e474cbe62434dd59087dc, State: Initialized, Role: FOLLOWER
I20260203 21:10:41.983420 4147 consensus_queue.cc:260] T 0b97240f69584c82abbe51996eda51f9 P 6d9e0cecab784cc0acc050ca1c89c5be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:41.983538 4145 ts_tablet_manager.cc:1950] T 739e31c065d94d7badfe9097b04ca0a9 P 6d9e0cecab784cc0acc050ca1c89c5be: Deleting consensus metadata
I20260203 21:10:41.983537 4144 consensus_queue.cc:260] T d14e0fd61df846fb85bafa17ee900f15 P 02bdf326542e474cbe62434dd59087dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:41.983883 4144 ts_tablet_manager.cc:1434] T d14e0fd61df846fb85bafa17ee900f15 P 02bdf326542e474cbe62434dd59087dc: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260203 21:10:41.984186 4144 tablet_bootstrap.cc:492] T 0b97240f69584c82abbe51996eda51f9 P 02bdf326542e474cbe62434dd59087dc: Bootstrap starting.
I20260203 21:10:41.984319 4150 tablet_bootstrap.cc:492] T 8a206d0a0a1947bdabc1123ff6c281f0 P 185c63f61a2645928eeb807d145026b1: No bootstrap required, opened a new log
I20260203 21:10:41.984383 4150 ts_tablet_manager.cc:1403] T 8a206d0a0a1947bdabc1123ff6c281f0 P 185c63f61a2645928eeb807d145026b1: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260203 21:10:41.984802 4150 raft_consensus.cc:359] T 8a206d0a0a1947bdabc1123ff6c281f0 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:41.984894 4150 raft_consensus.cc:385] T 8a206d0a0a1947bdabc1123ff6c281f0 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:41.984926 4150 raft_consensus.cc:740] T 8a206d0a0a1947bdabc1123ff6c281f0 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 185c63f61a2645928eeb807d145026b1, State: Initialized, Role: FOLLOWER
I20260203 21:10:41.985033 4150 consensus_queue.cc:260] T 8a206d0a0a1947bdabc1123ff6c281f0 P 185c63f61a2645928eeb807d145026b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:41.985105 4144 tablet_bootstrap.cc:654] T 0b97240f69584c82abbe51996eda51f9 P 02bdf326542e474cbe62434dd59087dc: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:41.985291 4150 ts_tablet_manager.cc:1434] T 8a206d0a0a1947bdabc1123ff6c281f0 P 185c63f61a2645928eeb807d145026b1: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260203 21:10:41.985453 4150 tablet_bootstrap.cc:492] T d14e0fd61df846fb85bafa17ee900f15 P 185c63f61a2645928eeb807d145026b1: Bootstrap starting.
I20260203 21:10:41.985597 4147 ts_tablet_manager.cc:1434] T 0b97240f69584c82abbe51996eda51f9 P 6d9e0cecab784cc0acc050ca1c89c5be: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260203 21:10:41.986328 4150 tablet_bootstrap.cc:654] T d14e0fd61df846fb85bafa17ee900f15 P 185c63f61a2645928eeb807d145026b1: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:41.988011 4144 tablet_bootstrap.cc:492] T 0b97240f69584c82abbe51996eda51f9 P 02bdf326542e474cbe62434dd59087dc: No bootstrap required, opened a new log
I20260203 21:10:41.988086 4144 ts_tablet_manager.cc:1403] T 0b97240f69584c82abbe51996eda51f9 P 02bdf326542e474cbe62434dd59087dc: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260203 21:10:41.988521 4144 raft_consensus.cc:359] T 0b97240f69584c82abbe51996eda51f9 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:41.988615 4144 raft_consensus.cc:385] T 0b97240f69584c82abbe51996eda51f9 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:41.988646 4144 raft_consensus.cc:740] T 0b97240f69584c82abbe51996eda51f9 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02bdf326542e474cbe62434dd59087dc, State: Initialized, Role: FOLLOWER
I20260203 21:10:41.988755 4144 consensus_queue.cc:260] T 0b97240f69584c82abbe51996eda51f9 P 02bdf326542e474cbe62434dd59087dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:41.989022 4144 ts_tablet_manager.cc:1434] T 0b97240f69584c82abbe51996eda51f9 P 02bdf326542e474cbe62434dd59087dc: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260203 21:10:41.989035 4150 tablet_bootstrap.cc:492] T d14e0fd61df846fb85bafa17ee900f15 P 185c63f61a2645928eeb807d145026b1: No bootstrap required, opened a new log
I20260203 21:10:41.989099 4150 ts_tablet_manager.cc:1403] T d14e0fd61df846fb85bafa17ee900f15 P 185c63f61a2645928eeb807d145026b1: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260203 21:10:41.989507 4150 raft_consensus.cc:359] T d14e0fd61df846fb85bafa17ee900f15 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:41.989598 4150 raft_consensus.cc:385] T d14e0fd61df846fb85bafa17ee900f15 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:41.989629 4150 raft_consensus.cc:740] T d14e0fd61df846fb85bafa17ee900f15 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 185c63f61a2645928eeb807d145026b1, State: Initialized, Role: FOLLOWER
I20260203 21:10:41.989755 4150 consensus_queue.cc:260] T d14e0fd61df846fb85bafa17ee900f15 P 185c63f61a2645928eeb807d145026b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:41.990016 4150 ts_tablet_manager.cc:1434] T d14e0fd61df846fb85bafa17ee900f15 P 185c63f61a2645928eeb807d145026b1: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260203 21:10:41.990173 4150 tablet_bootstrap.cc:492] T 0b97240f69584c82abbe51996eda51f9 P 185c63f61a2645928eeb807d145026b1: Bootstrap starting.
I20260203 21:10:41.991061 4150 tablet_bootstrap.cc:654] T 0b97240f69584c82abbe51996eda51f9 P 185c63f61a2645928eeb807d145026b1: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:41.992206 4150 tablet_bootstrap.cc:492] T 0b97240f69584c82abbe51996eda51f9 P 185c63f61a2645928eeb807d145026b1: No bootstrap required, opened a new log
I20260203 21:10:41.992285 4150 ts_tablet_manager.cc:1403] T 0b97240f69584c82abbe51996eda51f9 P 185c63f61a2645928eeb807d145026b1: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260203 21:10:41.992791 4150 raft_consensus.cc:359] T 0b97240f69584c82abbe51996eda51f9 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:41.992882 4150 raft_consensus.cc:385] T 0b97240f69584c82abbe51996eda51f9 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:41.992911 4150 raft_consensus.cc:740] T 0b97240f69584c82abbe51996eda51f9 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 185c63f61a2645928eeb807d145026b1, State: Initialized, Role: FOLLOWER
I20260203 21:10:41.992928 4145 tablet_replica.cc:333] T 4de1de23650548c2a078b51c9bf4d031 P 6d9e0cecab784cc0acc050ca1c89c5be: stopping tablet replica
I20260203 21:10:41.993009 4150 consensus_queue.cc:260] T 0b97240f69584c82abbe51996eda51f9 P 185c63f61a2645928eeb807d145026b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:41.993258 4150 ts_tablet_manager.cc:1434] T 0b97240f69584c82abbe51996eda51f9 P 185c63f61a2645928eeb807d145026b1: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260203 21:10:41.993287 4147 tablet_bootstrap.cc:492] T fe117dd96d8a4c46888743223c6e385d P 6d9e0cecab784cc0acc050ca1c89c5be: Bootstrap starting.
I20260203 21:10:41.993610 4145 raft_consensus.cc:2243] T 4de1de23650548c2a078b51c9bf4d031 P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 LEADER]: Raft consensus shutting down.
I20260203 21:10:41.994805 4145 raft_consensus.cc:2272] T 4de1de23650548c2a078b51c9bf4d031 P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 21:10:41.995170 4145 ts_tablet_manager.cc:1916] T 4de1de23650548c2a078b51c9bf4d031 P 6d9e0cecab784cc0acc050ca1c89c5be: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260203 21:10:41.997434 4145 ts_tablet_manager.cc:1929] T 4de1de23650548c2a078b51c9bf4d031 P 6d9e0cecab784cc0acc050ca1c89c5be: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260203 21:10:41.997496 4145 log.cc:1199] T 4de1de23650548c2a078b51c9bf4d031 P 6d9e0cecab784cc0acc050ca1c89c5be: Deleting WAL directory at /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-1/wal/wals/4de1de23650548c2a078b51c9bf4d031
I20260203 21:10:41.997717 4145 ts_tablet_manager.cc:1950] T 4de1de23650548c2a078b51c9bf4d031 P 6d9e0cecab784cc0acc050ca1c89c5be: Deleting consensus metadata
I20260203 21:10:41.998322 4145 tablet_replica.cc:333] T 387f8e87a39f402e9a6416d5408427df P 6d9e0cecab784cc0acc050ca1c89c5be: stopping tablet replica
I20260203 21:10:41.998450 4145 raft_consensus.cc:2243] T 387f8e87a39f402e9a6416d5408427df P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 21:10:41.998558 4145 raft_consensus.cc:2272] T 387f8e87a39f402e9a6416d5408427df P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 21:10:41.998565 4147 tablet_bootstrap.cc:654] T fe117dd96d8a4c46888743223c6e385d P 6d9e0cecab784cc0acc050ca1c89c5be: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:41.998912 4145 ts_tablet_manager.cc:1916] T 387f8e87a39f402e9a6416d5408427df P 6d9e0cecab784cc0acc050ca1c89c5be: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260203 21:10:42.000047 4147 tablet_bootstrap.cc:492] T fe117dd96d8a4c46888743223c6e385d P 6d9e0cecab784cc0acc050ca1c89c5be: No bootstrap required, opened a new log
I20260203 21:10:42.000116 4147 ts_tablet_manager.cc:1403] T fe117dd96d8a4c46888743223c6e385d P 6d9e0cecab784cc0acc050ca1c89c5be: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260203 21:10:42.000531 4147 raft_consensus.cc:359] T fe117dd96d8a4c46888743223c6e385d P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:42.000625 4147 raft_consensus.cc:385] T fe117dd96d8a4c46888743223c6e385d P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:42.000669 4147 raft_consensus.cc:740] T fe117dd96d8a4c46888743223c6e385d P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d9e0cecab784cc0acc050ca1c89c5be, State: Initialized, Role: FOLLOWER
I20260203 21:10:42.000710 4145 ts_tablet_manager.cc:1929] T 387f8e87a39f402e9a6416d5408427df P 6d9e0cecab784cc0acc050ca1c89c5be: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260203 21:10:42.000756 4145 log.cc:1199] T 387f8e87a39f402e9a6416d5408427df P 6d9e0cecab784cc0acc050ca1c89c5be: Deleting WAL directory at /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-1/wal/wals/387f8e87a39f402e9a6416d5408427df
I20260203 21:10:42.000808 4147 consensus_queue.cc:260] T fe117dd96d8a4c46888743223c6e385d P 6d9e0cecab784cc0acc050ca1c89c5be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:42.000970 4145 ts_tablet_manager.cc:1950] T 387f8e87a39f402e9a6416d5408427df P 6d9e0cecab784cc0acc050ca1c89c5be: Deleting consensus metadata
I20260203 21:10:42.001075 4147 ts_tablet_manager.cc:1434] T fe117dd96d8a4c46888743223c6e385d P 6d9e0cecab784cc0acc050ca1c89c5be: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260203 21:10:42.001631 4147 tablet_bootstrap.cc:492] T 8a206d0a0a1947bdabc1123ff6c281f0 P 6d9e0cecab784cc0acc050ca1c89c5be: Bootstrap starting.
I20260203 21:10:42.002486 4147 tablet_bootstrap.cc:654] T 8a206d0a0a1947bdabc1123ff6c281f0 P 6d9e0cecab784cc0acc050ca1c89c5be: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:42.004519 4147 tablet_bootstrap.cc:492] T 8a206d0a0a1947bdabc1123ff6c281f0 P 6d9e0cecab784cc0acc050ca1c89c5be: No bootstrap required, opened a new log
I20260203 21:10:42.004601 4147 ts_tablet_manager.cc:1403] T 8a206d0a0a1947bdabc1123ff6c281f0 P 6d9e0cecab784cc0acc050ca1c89c5be: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260203 21:10:42.005090 4147 raft_consensus.cc:359] T 8a206d0a0a1947bdabc1123ff6c281f0 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:42.005187 4147 raft_consensus.cc:385] T 8a206d0a0a1947bdabc1123ff6c281f0 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:42.005216 4147 raft_consensus.cc:740] T 8a206d0a0a1947bdabc1123ff6c281f0 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d9e0cecab784cc0acc050ca1c89c5be, State: Initialized, Role: FOLLOWER
I20260203 21:10:42.005367 4147 consensus_queue.cc:260] T 8a206d0a0a1947bdabc1123ff6c281f0 P 6d9e0cecab784cc0acc050ca1c89c5be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:42.005707 4147 ts_tablet_manager.cc:1434] T 8a206d0a0a1947bdabc1123ff6c281f0 P 6d9e0cecab784cc0acc050ca1c89c5be: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260203 21:10:42.005961 4147 tablet_bootstrap.cc:492] T d14e0fd61df846fb85bafa17ee900f15 P 6d9e0cecab784cc0acc050ca1c89c5be: Bootstrap starting.
I20260203 21:10:42.006893 4147 tablet_bootstrap.cc:654] T d14e0fd61df846fb85bafa17ee900f15 P 6d9e0cecab784cc0acc050ca1c89c5be: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:42.008126 4147 tablet_bootstrap.cc:492] T d14e0fd61df846fb85bafa17ee900f15 P 6d9e0cecab784cc0acc050ca1c89c5be: No bootstrap required, opened a new log
I20260203 21:10:42.008204 4147 ts_tablet_manager.cc:1403] T d14e0fd61df846fb85bafa17ee900f15 P 6d9e0cecab784cc0acc050ca1c89c5be: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260203 21:10:42.008641 4147 raft_consensus.cc:359] T d14e0fd61df846fb85bafa17ee900f15 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:42.008742 4147 raft_consensus.cc:385] T d14e0fd61df846fb85bafa17ee900f15 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:42.008773 4147 raft_consensus.cc:740] T d14e0fd61df846fb85bafa17ee900f15 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d9e0cecab784cc0acc050ca1c89c5be, State: Initialized, Role: FOLLOWER
I20260203 21:10:42.008882 4147 consensus_queue.cc:260] T d14e0fd61df846fb85bafa17ee900f15 P 6d9e0cecab784cc0acc050ca1c89c5be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:42.009145 4147 ts_tablet_manager.cc:1434] T d14e0fd61df846fb85bafa17ee900f15 P 6d9e0cecab784cc0acc050ca1c89c5be: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260203 21:10:42.009763 3852 raft_consensus.cc:493] T d14e0fd61df846fb85bafa17ee900f15 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 21:10:42.009874 3852 raft_consensus.cc:515] T d14e0fd61df846fb85bafa17ee900f15 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:42.010277 3852 leader_election.cc:290] T d14e0fd61df846fb85bafa17ee900f15 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223), 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897)
I20260203 21:10:42.010605 2922 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d14e0fd61df846fb85bafa17ee900f15" candidate_uuid: "02bdf326542e474cbe62434dd59087dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" is_pre_election: true
I20260203 21:10:42.010718 2922 raft_consensus.cc:2468] T d14e0fd61df846fb85bafa17ee900f15 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02bdf326542e474cbe62434dd59087dc in term 0.
I20260203 21:10:42.010975 2721 leader_election.cc:304] T d14e0fd61df846fb85bafa17ee900f15 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc, 6d9e0cecab784cc0acc050ca1c89c5be; no voters:
I20260203 21:10:42.011039 3058 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d14e0fd61df846fb85bafa17ee900f15" candidate_uuid: "02bdf326542e474cbe62434dd59087dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "185c63f61a2645928eeb807d145026b1" is_pre_election: true
I20260203 21:10:42.011153 3058 raft_consensus.cc:2468] T d14e0fd61df846fb85bafa17ee900f15 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02bdf326542e474cbe62434dd59087dc in term 0.
I20260203 21:10:42.011529 3852 raft_consensus.cc:2804] T d14e0fd61df846fb85bafa17ee900f15 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 21:10:42.011585 3852 raft_consensus.cc:493] T d14e0fd61df846fb85bafa17ee900f15 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 21:10:42.011620 3852 raft_consensus.cc:3060] T d14e0fd61df846fb85bafa17ee900f15 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:42.012684 3852 raft_consensus.cc:515] T d14e0fd61df846fb85bafa17ee900f15 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:42.013023 3852 leader_election.cc:290] T d14e0fd61df846fb85bafa17ee900f15 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 1 election: Requested vote from peers 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223), 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897)
I20260203 21:10:42.013334 3058 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d14e0fd61df846fb85bafa17ee900f15" candidate_uuid: "02bdf326542e474cbe62434dd59087dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "185c63f61a2645928eeb807d145026b1"
I20260203 21:10:42.013423 2922 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d14e0fd61df846fb85bafa17ee900f15" candidate_uuid: "02bdf326542e474cbe62434dd59087dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d9e0cecab784cc0acc050ca1c89c5be"
I20260203 21:10:42.013453 3058 raft_consensus.cc:3060] T d14e0fd61df846fb85bafa17ee900f15 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:42.013520 2922 raft_consensus.cc:3060] T d14e0fd61df846fb85bafa17ee900f15 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:42.014391 2922 raft_consensus.cc:2468] T d14e0fd61df846fb85bafa17ee900f15 P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02bdf326542e474cbe62434dd59087dc in term 1.
I20260203 21:10:42.014387 3058 raft_consensus.cc:2468] T d14e0fd61df846fb85bafa17ee900f15 P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02bdf326542e474cbe62434dd59087dc in term 1.
I20260203 21:10:42.014673 2721 leader_election.cc:304] T d14e0fd61df846fb85bafa17ee900f15 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc, 6d9e0cecab784cc0acc050ca1c89c5be; no voters:
I20260203 21:10:42.014958 3852 raft_consensus.cc:2804] T d14e0fd61df846fb85bafa17ee900f15 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader election won for term 1
I20260203 21:10:42.015031 3852 raft_consensus.cc:697] T d14e0fd61df846fb85bafa17ee900f15 P 02bdf326542e474cbe62434dd59087dc [term 1 LEADER]: Becoming Leader. State: Replica: 02bdf326542e474cbe62434dd59087dc, State: Running, Role: LEADER
I20260203 21:10:42.015144 3852 consensus_queue.cc:237] T d14e0fd61df846fb85bafa17ee900f15 P 02bdf326542e474cbe62434dd59087dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:42.053751 4166 raft_consensus.cc:493] T fe117dd96d8a4c46888743223c6e385d P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 21:10:42.053900 4166 raft_consensus.cc:515] T fe117dd96d8a4c46888743223c6e385d P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:42.054342 4166 leader_election.cc:290] T fe117dd96d8a4c46888743223c6e385d P 6d9e0cecab784cc0acc050ca1c89c5be [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223), 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335)
I20260203 21:10:42.054845 3058 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe117dd96d8a4c46888743223c6e385d" candidate_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "185c63f61a2645928eeb807d145026b1" is_pre_election: true
I20260203 21:10:42.054845 2785 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe117dd96d8a4c46888743223c6e385d" candidate_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02bdf326542e474cbe62434dd59087dc" is_pre_election: true
I20260203 21:10:42.054992 2785 raft_consensus.cc:2468] T fe117dd96d8a4c46888743223c6e385d P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d9e0cecab784cc0acc050ca1c89c5be in term 0.
I20260203 21:10:42.054992 3058 raft_consensus.cc:2468] T fe117dd96d8a4c46888743223c6e385d P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d9e0cecab784cc0acc050ca1c89c5be in term 0.
I20260203 21:10:42.055318 2858 leader_election.cc:304] T fe117dd96d8a4c46888743223c6e385d P 6d9e0cecab784cc0acc050ca1c89c5be [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be; no voters:
I20260203 21:10:42.055507 4166 raft_consensus.cc:2804] T fe117dd96d8a4c46888743223c6e385d P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 21:10:42.055567 4166 raft_consensus.cc:493] T fe117dd96d8a4c46888743223c6e385d P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 21:10:42.055605 4166 raft_consensus.cc:3060] T fe117dd96d8a4c46888743223c6e385d P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:42.056460 4166 raft_consensus.cc:515] T fe117dd96d8a4c46888743223c6e385d P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:42.056798 4166 leader_election.cc:290] T fe117dd96d8a4c46888743223c6e385d P 6d9e0cecab784cc0acc050ca1c89c5be [CANDIDATE]: Term 1 election: Requested vote from peers 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223), 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335)
I20260203 21:10:42.057086 3058 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe117dd96d8a4c46888743223c6e385d" candidate_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "185c63f61a2645928eeb807d145026b1"
I20260203 21:10:42.057206 3058 raft_consensus.cc:3060] T fe117dd96d8a4c46888743223c6e385d P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:42.057201 2785 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe117dd96d8a4c46888743223c6e385d" candidate_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02bdf326542e474cbe62434dd59087dc"
I20260203 21:10:42.057356 2785 raft_consensus.cc:3060] T fe117dd96d8a4c46888743223c6e385d P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:42.057966 3058 raft_consensus.cc:2468] T fe117dd96d8a4c46888743223c6e385d P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d9e0cecab784cc0acc050ca1c89c5be in term 1.
I20260203 21:10:42.058233 2858 leader_election.cc:304] T fe117dd96d8a4c46888743223c6e385d P 6d9e0cecab784cc0acc050ca1c89c5be [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be; no voters:
I20260203 21:10:42.058363 2785 raft_consensus.cc:2468] T fe117dd96d8a4c46888743223c6e385d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d9e0cecab784cc0acc050ca1c89c5be in term 1.
I20260203 21:10:42.058395 4166 raft_consensus.cc:2804] T fe117dd96d8a4c46888743223c6e385d P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 FOLLOWER]: Leader election won for term 1
I20260203 21:10:42.058468 4166 raft_consensus.cc:697] T fe117dd96d8a4c46888743223c6e385d P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 LEADER]: Becoming Leader. State: Replica: 6d9e0cecab784cc0acc050ca1c89c5be, State: Running, Role: LEADER
I20260203 21:10:42.058627 4166 consensus_queue.cc:237] T fe117dd96d8a4c46888743223c6e385d P 6d9e0cecab784cc0acc050ca1c89c5be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:42.112862 3852 raft_consensus.cc:493] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 21:10:42.113026 3852 raft_consensus.cc:515] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:42.113540 3852 leader_election.cc:290] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223), 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897)
I20260203 21:10:42.114023 3058 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8a206d0a0a1947bdabc1123ff6c281f0" candidate_uuid: "02bdf326542e474cbe62434dd59087dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "185c63f61a2645928eeb807d145026b1" is_pre_election: true
I20260203 21:10:42.114059 2922 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8a206d0a0a1947bdabc1123ff6c281f0" candidate_uuid: "02bdf326542e474cbe62434dd59087dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" is_pre_election: true
I20260203 21:10:42.114180 3058 raft_consensus.cc:2468] T 8a206d0a0a1947bdabc1123ff6c281f0 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02bdf326542e474cbe62434dd59087dc in term 0.
I20260203 21:10:42.114223 2922 raft_consensus.cc:2468] T 8a206d0a0a1947bdabc1123ff6c281f0 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02bdf326542e474cbe62434dd59087dc in term 0.
I20260203 21:10:42.114496 2720 leader_election.cc:304] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc, 185c63f61a2645928eeb807d145026b1; no voters:
I20260203 21:10:42.114692 3852 raft_consensus.cc:2804] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 21:10:42.114749 3852 raft_consensus.cc:493] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 21:10:42.114787 3852 raft_consensus.cc:3060] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:42.115721 3852 raft_consensus.cc:515] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:42.116034 3852 leader_election.cc:290] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 1 election: Requested vote from peers 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223), 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897)
I20260203 21:10:42.116370 2922 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8a206d0a0a1947bdabc1123ff6c281f0" candidate_uuid: "02bdf326542e474cbe62434dd59087dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d9e0cecab784cc0acc050ca1c89c5be"
I20260203 21:10:42.116402 3058 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8a206d0a0a1947bdabc1123ff6c281f0" candidate_uuid: "02bdf326542e474cbe62434dd59087dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "185c63f61a2645928eeb807d145026b1"
I20260203 21:10:42.116480 2922 raft_consensus.cc:3060] T 8a206d0a0a1947bdabc1123ff6c281f0 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:42.116516 3058 raft_consensus.cc:3060] T 8a206d0a0a1947bdabc1123ff6c281f0 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:42.117453 2922 raft_consensus.cc:2468] T 8a206d0a0a1947bdabc1123ff6c281f0 P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02bdf326542e474cbe62434dd59087dc in term 1.
I20260203 21:10:42.117471 3058 raft_consensus.cc:2468] T 8a206d0a0a1947bdabc1123ff6c281f0 P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02bdf326542e474cbe62434dd59087dc in term 1.
I20260203 21:10:42.117724 2721 leader_election.cc:304] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc, 6d9e0cecab784cc0acc050ca1c89c5be; no voters:
I20260203 21:10:42.117893 3852 raft_consensus.cc:2804] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader election won for term 1
I20260203 21:10:42.117973 3852 raft_consensus.cc:697] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc [term 1 LEADER]: Becoming Leader. State: Replica: 02bdf326542e474cbe62434dd59087dc, State: Running, Role: LEADER
I20260203 21:10:42.118264 3852 consensus_queue.cc:237] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
W20260203 21:10:42.145205 2859 connection.cc:537] server connection from 127.0.0.1:33942 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260203 21:10:42.145247 2992 connection.cc:537] server connection from 127.0.0.1:44690 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260203 21:10:42.145388 2858 connection.cc:537] client connection to 127.2.32.189:42681 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260203 21:10:42.145642 2994 connection.cc:537] client connection to 127.2.32.189:42681 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260203 21:10:42.145675 2720 connection.cc:537] client connection to 127.2.32.189:42681 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260203 21:10:42.146238 3114 connection.cc:537] client connection to 127.2.32.189:42681 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260203 21:10:42.146867 3114 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.2.32.189:42681)
W20260203 21:10:42.147178 3114 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.2.32.189:42681)
W20260203 21:10:42.147511 3114 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.2.32.189:42681)
W20260203 21:10:42.147799 3114 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.2.32.189:42681)
W20260203 21:10:42.148243 4007 negotiation.cc:337] Failed RPC negotiation. Trace:
0203 21:10:42.146009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.32.189:42681 (local address 127.2.32.130:33603)
0203 21:10:42.146128 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0203 21:10:42.146142 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0203 21:10:42.146229 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0203 21:10:42.147502 (+ 1273us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":29}
W20260203 21:10:42.148545 4011 negotiation.cc:337] Failed RPC negotiation. Trace:
0203 21:10:42.146491 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.32.189:42681 (local address 127.2.32.131:35617)
0203 21:10:42.146671 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0203 21:10:42.146683 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0203 21:10:42.146762 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0203 21:10:42.148132 (+ 1370us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":106}
W20260203 21:10:42.149307 4022 negotiation.cc:337] Failed RPC negotiation. Trace:
0203 21:10:42.147011 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.32.189:42681 (local address 127.2.32.129:53975)
0203 21:10:42.147192 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0203 21:10:42.147206 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0203 21:10:42.147281 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0203 21:10:42.148902 (+ 1621us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":107}
I20260203 21:10:42.309119 4143 raft_consensus.cc:493] T 0b97240f69584c82abbe51996eda51f9 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 21:10:42.309247 4143 raft_consensus.cc:515] T 0b97240f69584c82abbe51996eda51f9 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:42.309702 4143 leader_election.cc:290] T 0b97240f69584c82abbe51996eda51f9 P 185c63f61a2645928eeb807d145026b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335)
I20260203 21:10:42.310123 2922 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0b97240f69584c82abbe51996eda51f9" candidate_uuid: "185c63f61a2645928eeb807d145026b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" is_pre_election: true
I20260203 21:10:42.310148 2785 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0b97240f69584c82abbe51996eda51f9" candidate_uuid: "185c63f61a2645928eeb807d145026b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02bdf326542e474cbe62434dd59087dc" is_pre_election: true
I20260203 21:10:42.310248 2922 raft_consensus.cc:2468] T 0b97240f69584c82abbe51996eda51f9 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 185c63f61a2645928eeb807d145026b1 in term 0.
I20260203 21:10:42.310299 2785 raft_consensus.cc:2468] T 0b97240f69584c82abbe51996eda51f9 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 185c63f61a2645928eeb807d145026b1 in term 0.
I20260203 21:10:42.310577 2993 leader_election.cc:304] T 0b97240f69584c82abbe51996eda51f9 P 185c63f61a2645928eeb807d145026b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc, 185c63f61a2645928eeb807d145026b1; no voters:
I20260203 21:10:42.310745 4143 raft_consensus.cc:2804] T 0b97240f69584c82abbe51996eda51f9 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 21:10:42.310811 4143 raft_consensus.cc:493] T 0b97240f69584c82abbe51996eda51f9 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 21:10:42.310842 4143 raft_consensus.cc:3060] T 0b97240f69584c82abbe51996eda51f9 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:42.311631 4143 raft_consensus.cc:515] T 0b97240f69584c82abbe51996eda51f9 P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:42.311998 4143 leader_election.cc:290] T 0b97240f69584c82abbe51996eda51f9 P 185c63f61a2645928eeb807d145026b1 [CANDIDATE]: Term 1 election: Requested vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335)
I20260203 21:10:42.312433 2785 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0b97240f69584c82abbe51996eda51f9" candidate_uuid: "185c63f61a2645928eeb807d145026b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02bdf326542e474cbe62434dd59087dc"
I20260203 21:10:42.312542 2785 raft_consensus.cc:3060] T 0b97240f69584c82abbe51996eda51f9 P 02bdf326542e474cbe62434dd59087dc [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:42.312680 2922 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0b97240f69584c82abbe51996eda51f9" candidate_uuid: "185c63f61a2645928eeb807d145026b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d9e0cecab784cc0acc050ca1c89c5be"
I20260203 21:10:42.312783 2922 raft_consensus.cc:3060] T 0b97240f69584c82abbe51996eda51f9 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:42.313447 2785 raft_consensus.cc:2468] T 0b97240f69584c82abbe51996eda51f9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 185c63f61a2645928eeb807d145026b1 in term 1.
I20260203 21:10:42.313647 2922 raft_consensus.cc:2468] T 0b97240f69584c82abbe51996eda51f9 P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 185c63f61a2645928eeb807d145026b1 in term 1.
I20260203 21:10:42.313732 2993 leader_election.cc:304] T 0b97240f69584c82abbe51996eda51f9 P 185c63f61a2645928eeb807d145026b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc, 185c63f61a2645928eeb807d145026b1; no voters:
I20260203 21:10:42.313890 4143 raft_consensus.cc:2804] T 0b97240f69584c82abbe51996eda51f9 P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260203 21:10:42.314007 4143 raft_consensus.cc:697] T 0b97240f69584c82abbe51996eda51f9 P 185c63f61a2645928eeb807d145026b1 [term 1 LEADER]: Becoming Leader. State: Replica: 185c63f61a2645928eeb807d145026b1, State: Running, Role: LEADER
I20260203 21:10:42.314162 4143 consensus_queue.cc:237] T 0b97240f69584c82abbe51996eda51f9 P 185c63f61a2645928eeb807d145026b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:42.440346 4178 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 35397be7e61f4b27a49e9449b9fdf085)
I20260203 21:10:42.440471 4178 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:10:42.440908 4178 leader_election.cc:290] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419), 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681)
W20260203 21:10:42.442374 3896 leader_election.cc:336] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681): Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)
W20260203 21:10:42.442502 3897 leader_election.cc:336] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419): Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111)
I20260203 21:10:42.442561 3897 leader_election.cc:304] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a7e51013f5041898fe34f4b64a59260; no voters: 35397be7e61f4b27a49e9449b9fdf085, 7344d7cd8dea4fa2ae705320daacaf49
I20260203 21:10:42.442728 4178 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260203 21:10:42.449812 3854 consensus_queue.cc:1048] T d14e0fd61df846fb85bafa17ee900f15 P 02bdf326542e474cbe62434dd59087dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 21:10:42.454116 3854 consensus_queue.cc:1048] T d14e0fd61df846fb85bafa17ee900f15 P 02bdf326542e474cbe62434dd59087dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 21:10:42.499414 4166 consensus_queue.cc:1048] T fe117dd96d8a4c46888743223c6e385d P 6d9e0cecab784cc0acc050ca1c89c5be [LEADER]: Connected to new peer: Peer: permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 21:10:42.502887 4190 consensus_queue.cc:1048] T fe117dd96d8a4c46888743223c6e385d P 6d9e0cecab784cc0acc050ca1c89c5be [LEADER]: Connected to new peer: Peer: permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 21:10:42.542506 3854 consensus_queue.cc:1048] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 21:10:42.545962 3852 consensus_queue.cc:1048] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 21:10:42.828830 4143 consensus_queue.cc:1048] T 0b97240f69584c82abbe51996eda51f9 P 185c63f61a2645928eeb807d145026b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 21:10:42.833329 4143 consensus_queue.cc:1048] T 0b97240f69584c82abbe51996eda51f9 P 185c63f61a2645928eeb807d145026b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 21:10:42.958288 3879 master_runner.cc:186] Error getting master registration for 127.2.32.190:35419: Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111),
I20260203 21:10:42.958434 3879 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260203 21:10:43.156566 4200 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 35397be7e61f4b27a49e9449b9fdf085)
I20260203 21:10:43.156688 4200 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:10:43.157212 4200 leader_election.cc:290] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419), 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681)
W20260203 21:10:43.158128 3897 leader_election.cc:336] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419): Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111)
W20260203 21:10:43.158468 3896 leader_election.cc:336] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681): Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)
I20260203 21:10:43.158545 3896 leader_election.cc:304] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a7e51013f5041898fe34f4b64a59260; no voters: 35397be7e61f4b27a49e9449b9fdf085, 7344d7cd8dea4fa2ae705320daacaf49
I20260203 21:10:43.158715 4200 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260203 21:10:43.323328 3854 raft_consensus.cc:493] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:10:43.323472 3854 raft_consensus.cc:515] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } }
I20260203 21:10:43.324002 3854 leader_election.cc:290] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223), 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897)
W20260203 21:10:43.324682 2721 leader_election.cc:343] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 06b80064d47349c2830718f553ba3d7d
W20260203 21:10:43.324781 2720 leader_election.cc:343] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 06b80064d47349c2830718f553ba3d7d
I20260203 21:10:43.324870 2720 leader_election.cc:304] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:10:43.325016 3854 raft_consensus.cc:2749] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:10:44.170310 4216 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 35397be7e61f4b27a49e9449b9fdf085)
I20260203 21:10:44.170447 4216 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:10:44.170885 4216 leader_election.cc:290] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419), 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681)
W20260203 21:10:44.171496 3896 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111) [suppressed 9 similar messages]
W20260203 21:10:44.172223 3896 leader_election.cc:336] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681): Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)
W20260203 21:10:44.172309 3897 leader_election.cc:336] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419): Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111)
I20260203 21:10:44.172384 3897 leader_election.cc:304] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a7e51013f5041898fe34f4b64a59260; no voters: 35397be7e61f4b27a49e9449b9fdf085, 7344d7cd8dea4fa2ae705320daacaf49
I20260203 21:10:44.172523 4216 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260203 21:10:44.706368 2178 external_mini_cluster.cc:1366] Running /tmp/dist-test-task0vmSZW/build/debug/bin/kudu
/tmp/dist-test-task0vmSZW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.32.189:42681
--webserver_interface=127.2.32.189
--webserver_port=35415
--builtin_ntp_servers=127.2.32.148:39497
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665
--hive_metastore_uris=thrift://127.0.0.1:33779
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260203 21:10:44.813388 4227 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260203 21:10:44.813622 4227 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260203 21:10:44.813663 4227 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260203 21:10:44.817106 4227 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260203 21:10:44.817171 4227 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260203 21:10:44.817191 4227 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260203 21:10:44.817209 4227 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260203 21:10:44.821122 4227 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.32.148:39497
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-1/wal
--hive_metastore_uris=thrift://127.0.0.1:33779
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.32.189:42681
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.2.32.189
--webserver_port=35415
--never_fsync=true
--heap_profile_path=/tmp/kudu.4227
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 0efbebd487e7d0c7f21ab0d5a91e0fa70046af83
build type DEBUG
built by None at 03 Feb 2026 20:50:43 UTC on 24a791456cd2
build id 10330
I20260203 21:10:44.822180 4227 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260203 21:10:44.823246 4227 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260203 21:10:44.828531 4235 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260203 21:10:44.828464 4232 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260203 21:10:44.828464 4233 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260203 21:10:44.828933 4227 server_base.cc:1060] running on GCE node
I20260203 21:10:44.829401 4227 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260203 21:10:44.830277 4227 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260203 21:10:44.831434 4227 hybrid_clock.cc:648] HybridClock initialized: now 1770153044831412 us; error 41 us; skew 500 ppm
I20260203 21:10:44.833200 4227 webserver.cc:492] Webserver started at http://127.2.32.189:35415/ using document root <none> and password file <none>
I20260203 21:10:44.833745 4227 fs_manager.cc:362] Metadata directory not provided
I20260203 21:10:44.833802 4227 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260203 21:10:44.837232 4227 fs_manager.cc:714] Time spent opening directory manager: real 0.002s user 0.000s sys 0.003s
I20260203 21:10:44.839246 4241 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260203 21:10:44.840233 4227 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260203 21:10:44.840342 4227 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-1/data,/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-1/wal
uuid: "35397be7e61f4b27a49e9449b9fdf085"
format_stamp: "Formatted at 2026-02-03 21:10:25 on dist-test-slave-npns"
I20260203 21:10:44.840719 4227 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260203 21:10:44.857815 4227 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260203 21:10:44.858487 4227 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260203 21:10:44.858654 4227 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260203 21:10:44.865577 4227 rpc_server.cc:307] RPC server started. Bound to: 127.2.32.189:42681
I20260203 21:10:44.865610 4293 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.32.189:42681 every 8 connection(s)
I20260203 21:10:44.866597 4227 server_base.cc:1192] Dumped server information to /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-1/data/info.pb
I20260203 21:10:44.870966 4294 sys_catalog.cc:263] Verifying existing consensus state
I20260203 21:10:44.872213 2178 external_mini_cluster.cc:1428] Started /tmp/dist-test-task0vmSZW/build/debug/bin/kudu as pid 4227
I20260203 21:10:44.873309 4294 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085: Bootstrap starting.
I20260203 21:10:44.885584 4294 log.cc:826] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085: Log is configured to *not* fsync() on all Append() calls
I20260203 21:10:44.902819 2971 heartbeater.cc:344] Connected to a master server at 127.2.32.189:42681
I20260203 21:10:44.938812 4294 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085: Bootstrap replayed 1/1 log segments. Stats: ops{read=108 overwritten=0 applied=108 ignored=0} inserts{seen=67 ignored=0} mutations{seen=91 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260203 21:10:44.939328 4294 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085: Bootstrap complete.
I20260203 21:10:44.942678 3107 heartbeater.cc:344] Connected to a master server at 127.2.32.189:42681
I20260203 21:10:44.942806 4294 raft_consensus.cc:359] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [term 6 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:10:44.943200 4294 raft_consensus.cc:740] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [term 6 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35397be7e61f4b27a49e9449b9fdf085, State: Initialized, Role: FOLLOWER
I20260203 21:10:44.943708 4294 consensus_queue.cc:260] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 108, Last appended: 6.108, Last appended by leader: 108, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:10:44.944380 4302 sys_catalog.cc:455] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 6 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } } }
I20260203 21:10:44.944489 4302 sys_catalog.cc:458] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [sys.catalog]: This master's current role is: FOLLOWER
I20260203 21:10:44.944833 4294 sys_catalog.cc:565] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [sys.catalog]: configured and running, proceeding with master startup.
I20260203 21:10:44.951228 4316 catalog_manager.cc:1269] Loaded cluster ID: f46367a11713484f92c1d2be2585f5a6
I20260203 21:10:44.949461 4227 master_runner.cc:186] Error getting master registration for 127.2.32.190:35419: Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111),
I20260203 21:10:44.951336 4316 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085: loading cluster ID for follower catalog manager: success
I20260203 21:10:44.951481 4227 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260203 21:10:44.953511 4316 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085: acquiring CA information for follower catalog manager: success
I20260203 21:10:44.955610 4316 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260203 21:10:45.107575 2833 heartbeater.cc:344] Connected to a master server at 127.2.32.189:42681
I20260203 21:10:45.107766 2833 heartbeater.cc:499] Master 127.2.32.189:42681 was elected leader, sending a full tablet report...
I20260203 21:10:45.109388 4258 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "02bdf326542e474cbe62434dd59087dc" instance_seqno: 1770153026114330) as {username='slave'} at 127.2.32.129:37985; Asking this server to re-register.
I20260203 21:10:45.109882 2833 heartbeater.cc:461] Registering TS with master...
I20260203 21:10:45.111146 4258 ts_manager.cc:194] Registered new tserver with Master: 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335)
I20260203 21:10:45.406072 4258 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" instance_seqno: 1770153026289802) as {username='slave'} at 127.2.32.130:56487; Asking this server to re-register.
I20260203 21:10:45.406515 2971 heartbeater.cc:461] Registering TS with master...
I20260203 21:10:45.407380 4258 ts_manager.cc:194] Registered new tserver with Master: 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897)
I20260203 21:10:45.445561 4258 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "185c63f61a2645928eeb807d145026b1" instance_seqno: 1770153026474418) as {username='slave'} at 127.2.32.131:39955; Asking this server to re-register.
I20260203 21:10:45.446010 3107 heartbeater.cc:461] Registering TS with master...
I20260203 21:10:45.447044 4258 ts_manager.cc:194] Registered new tserver with Master: 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
I20260203 21:10:45.477785 4322 raft_consensus.cc:493] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 21:10:45.477967 4322 raft_consensus.cc:515] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:10:45.479250 4322 leader_election.cc:290] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419), 8a7e51013f5041898fe34f4b64a59260 (127.2.32.188:33665)
W20260203 21:10:45.479945 4245 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111)
W20260203 21:10:45.480794 4245 leader_election.cc:336] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419): Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111)
I20260203 21:10:45.483445 3920 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "35397be7e61f4b27a49e9449b9fdf085" candidate_term: 7 candidate_status { last_received { term: 6 index: 108 } } ignore_live_leader: false dest_uuid: "8a7e51013f5041898fe34f4b64a59260" is_pre_election: true
I20260203 21:10:45.483594 3920 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35397be7e61f4b27a49e9449b9fdf085 in term 6.
I20260203 21:10:45.484089 4242 leader_election.cc:304] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35397be7e61f4b27a49e9449b9fdf085, 8a7e51013f5041898fe34f4b64a59260; no voters: 7344d7cd8dea4fa2ae705320daacaf49
I20260203 21:10:45.484319 4322 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260203 21:10:45.484406 4322 raft_consensus.cc:493] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 21:10:45.484458 4322 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [term 6 FOLLOWER]: Advancing to term 7
I20260203 21:10:45.486128 4322 raft_consensus.cc:515] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:10:45.486498 4322 leader_election.cc:290] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [CANDIDATE]: Term 7 election: Requested vote from peers 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419), 8a7e51013f5041898fe34f4b64a59260 (127.2.32.188:33665)
I20260203 21:10:45.486878 3920 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "35397be7e61f4b27a49e9449b9fdf085" candidate_term: 7 candidate_status { last_received { term: 6 index: 108 } } ignore_live_leader: false dest_uuid: "8a7e51013f5041898fe34f4b64a59260"
I20260203 21:10:45.486995 3920 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 6 FOLLOWER]: Advancing to term 7
W20260203 21:10:45.487391 4245 leader_election.cc:336] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419): Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111)
I20260203 21:10:45.487982 3920 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35397be7e61f4b27a49e9449b9fdf085 in term 7.
I20260203 21:10:45.488284 4242 leader_election.cc:304] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35397be7e61f4b27a49e9449b9fdf085, 8a7e51013f5041898fe34f4b64a59260; no voters: 7344d7cd8dea4fa2ae705320daacaf49
I20260203 21:10:45.488441 4322 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [term 7 FOLLOWER]: Leader election won for term 7
I20260203 21:10:45.488708 4322 raft_consensus.cc:697] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [term 7 LEADER]: Becoming Leader. State: Replica: 35397be7e61f4b27a49e9449b9fdf085, State: Running, Role: LEADER
I20260203 21:10:45.489140 4322 consensus_queue.cc:237] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 108, Committed index: 108, Last appended: 6.108, Last appended by leader: 108, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:10:45.490794 4327 sys_catalog.cc:455] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 35397be7e61f4b27a49e9449b9fdf085. Latest consensus state: current_term: 7 leader_uuid: "35397be7e61f4b27a49e9449b9fdf085" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } } }
I20260203 21:10:45.490914 4327 sys_catalog.cc:458] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [sys.catalog]: This master's current role is: LEADER
I20260203 21:10:45.491180 4329 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260203 21:10:45.492921 4329 catalog_manager.cc:679] Loaded metadata for table default.table_3397dfe4625e42cf8cb5f4d45116d7b1 [id=1047aea4c6eb42f4994b72f5cafef147]
I20260203 21:10:45.493204 4329 catalog_manager.cc:679] Loaded metadata for table default.table_675a6f7413004a62bce7c460e7b6da3b [id=1df0a5e5434d4c00a3dfe92d216cfb54]
I20260203 21:10:45.493412 4329 catalog_manager.cc:679] Loaded metadata for table default.table_547d99db0d3043499a26ee8c6df4c443 [id=333213fed7234610bc20c7d92124182b]
I20260203 21:10:45.493599 4329 catalog_manager.cc:679] Loaded metadata for table default.table_98e2e0221eb0485fb87bee758843d37e [id=42eb95ae2b9442b18dac664ea886b4b3]
I20260203 21:10:45.493793 4329 catalog_manager.cc:679] Loaded metadata for table default.table_b7c2ca72f69c49a0b39163d2fcb69341 [id=467e79ec835d45669e3155e07b8ba81f]
I20260203 21:10:45.493983 4329 catalog_manager.cc:679] Loaded metadata for table default.table_a029ba95c22e421585ca4ce640aa9658 [id=73eae179f2ad481d932a5b3c95b1a4ab]
I20260203 21:10:45.494189 4329 catalog_manager.cc:679] Loaded metadata for table default.table_72135cb0d98246739f6b8c9aee17c8ba [id=7402e05c90cf4b15be6effde36465fff]
I20260203 21:10:45.494387 4329 catalog_manager.cc:679] Loaded metadata for table default.table_7e73ff80019543888e0b8afa9b7a6660 [id=82ec5c95acc84e509c0803db74b626b4]
I20260203 21:10:45.494575 4329 catalog_manager.cc:679] Loaded metadata for table default.table_c2985ddec2e045cba153900329fe9331 [id=85725aeaace648d9ac1bb5d3940d0ad0]
I20260203 21:10:45.494761 4329 catalog_manager.cc:679] Loaded metadata for table default.table_4c9a68305b5e4d4aa45e3a351c35eee7 [id=8f8f5b53d1204b56979a8db32be6ee89]
I20260203 21:10:45.494962 4329 catalog_manager.cc:679] Loaded metadata for table default.table_09e62d0aaa0f48ad9ed818ba967be542 [id=a26f4a67278a4929b2378fbbe9baaf52]
I20260203 21:10:45.495148 4329 catalog_manager.cc:679] Loaded metadata for table default.table_800a192f4e9e4ca5806a324b36234706 [id=a995c742bb2942838a2385b05a4d4d57]
I20260203 21:10:45.495333 4329 catalog_manager.cc:679] Loaded metadata for table default.table_8da179b3ec0b4c898eb890f89d54cb6a [id=ad58be29e80345e1afe7f5a55e129af2]
I20260203 21:10:45.495517 4329 catalog_manager.cc:679] Loaded metadata for table default.table_66c508c8dbdd4e7ea9283cabe65b62c0 [id=b62df06982124a70936068823e4b2324]
I20260203 21:10:45.495916 4329 catalog_manager.cc:679] Loaded metadata for table default.table_4f93e096d30349908a32a33e024543d6 [id=fa8fb788ff754fcd8641964a9d894664]
I20260203 21:10:45.497167 4329 tablet_loader.cc:96] loaded metadata for tablet 0b97240f69584c82abbe51996eda51f9 (table default.table_72135cb0d98246739f6b8c9aee17c8ba [id=7402e05c90cf4b15be6effde36465fff])
I20260203 21:10:45.497735 4329 tablet_loader.cc:96] loaded metadata for tablet 4c8edfa3d555490f953a3ec7bef314ae (table default.table_a029ba95c22e421585ca4ce640aa9658 [id=73eae179f2ad481d932a5b3c95b1a4ab])
I20260203 21:10:45.497900 4329 tablet_loader.cc:96] loaded metadata for tablet 4d6ed92d766244489541e1c280afacb5 (table default.table_09e62d0aaa0f48ad9ed818ba967be542 [id=a26f4a67278a4929b2378fbbe9baaf52])
I20260203 21:10:45.498126 4329 tablet_loader.cc:96] loaded metadata for tablet 576be22c2477419192cc271e46b8e57e (table default.table_547d99db0d3043499a26ee8c6df4c443 [id=333213fed7234610bc20c7d92124182b])
I20260203 21:10:45.498345 4329 tablet_loader.cc:96] loaded metadata for tablet 6606bf5d7de047cda4a0523197210c1a (table default.table_66c508c8dbdd4e7ea9283cabe65b62c0 [id=b62df06982124a70936068823e4b2324])
I20260203 21:10:45.498718 4329 tablet_loader.cc:96] loaded metadata for tablet 8a206d0a0a1947bdabc1123ff6c281f0 (table default.table_4f93e096d30349908a32a33e024543d6 [id=fa8fb788ff754fcd8641964a9d894664])
I20260203 21:10:45.498869 4329 tablet_loader.cc:96] loaded metadata for tablet 8df16fd039bf4d9b91ee2e49151c18c2 (table default.table_675a6f7413004a62bce7c460e7b6da3b [id=1df0a5e5434d4c00a3dfe92d216cfb54])
I20260203 21:10:45.499089 4329 tablet_loader.cc:96] loaded metadata for tablet 98cd2089483c4121944152e5cee8ca30 (table default.table_4c9a68305b5e4d4aa45e3a351c35eee7 [id=8f8f5b53d1204b56979a8db32be6ee89])
I20260203 21:10:45.499231 4329 tablet_loader.cc:96] loaded metadata for tablet 9c19a7b6dba6432f91e68164734a7e6d (table default.table_800a192f4e9e4ca5806a324b36234706 [id=a995c742bb2942838a2385b05a4d4d57])
I20260203 21:10:45.499529 4329 tablet_loader.cc:96] loaded metadata for tablet b20e604665624843b957080dc6016d78 (table default.table_8da179b3ec0b4c898eb890f89d54cb6a [id=ad58be29e80345e1afe7f5a55e129af2])
I20260203 21:10:45.499694 4329 tablet_loader.cc:96] loaded metadata for tablet ba8723a952564816a5c1f7945c448db9 (table default.table_3397dfe4625e42cf8cb5f4d45116d7b1 [id=1047aea4c6eb42f4994b72f5cafef147])
I20260203 21:10:45.500015 4329 tablet_loader.cc:96] loaded metadata for tablet d14e0fd61df846fb85bafa17ee900f15 (table default.table_b7c2ca72f69c49a0b39163d2fcb69341 [id=467e79ec835d45669e3155e07b8ba81f])
I20260203 21:10:45.500242 4329 tablet_loader.cc:96] loaded metadata for tablet dd27d2dc29364e1b87fb1936bae8d2a1 (table default.table_c2985ddec2e045cba153900329fe9331 [id=85725aeaace648d9ac1bb5d3940d0ad0])
I20260203 21:10:45.500746 4329 tablet_loader.cc:96] loaded metadata for tablet f8f173ff52ed4daa8b8ddcbeae43bc4a (table default.table_98e2e0221eb0485fb87bee758843d37e [id=42eb95ae2b9442b18dac664ea886b4b3])
I20260203 21:10:45.500921 4329 tablet_loader.cc:96] loaded metadata for tablet fe117dd96d8a4c46888743223c6e385d (table default.table_7e73ff80019543888e0b8afa9b7a6660 [id=82ec5c95acc84e509c0803db74b626b4])
I20260203 21:10:45.501039 4329 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260203 21:10:45.501703 4329 catalog_manager.cc:1269] Loaded cluster ID: f46367a11713484f92c1d2be2585f5a6
I20260203 21:10:45.501747 4329 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260203 21:10:45.502787 4329 catalog_manager.cc:1514] Loading token signing keys...
I20260203 21:10:45.503628 4329 catalog_manager.cc:6038] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085: Loaded TSK: 0
I20260203 21:10:45.504638 4329 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260203 21:10:45.505254 4329 catalog_manager.cc:1537] Loading latest processed Hive Metastore notification log event ID...
I20260203 21:10:45.505824 4329 catalog_manager.cc:5876] Last processed Hive Metastore notification event ID: 21
I20260203 21:10:45.589982 4258 master_service.cc:954] ReplaceTablet: received request to replace tablet 4d6ed92d766244489541e1c280afacb5 from {username='slave'} at 127.0.0.1:60702
I20260203 21:10:45.590142 4256 master_service.cc:954] ReplaceTablet: received request to replace tablet 4d6ed92d766244489541e1c280afacb5 from {username='slave'} at 127.0.0.1:60702
I20260203 21:10:45.590035 4257 master_service.cc:954] ReplaceTablet: received request to replace tablet 8a206d0a0a1947bdabc1123ff6c281f0 from {username='slave'} at 127.0.0.1:60702
I20260203 21:10:45.590453 4255 master_service.cc:954] ReplaceTablet: received request to replace tablet 6606bf5d7de047cda4a0523197210c1a from {username='slave'} at 127.0.0.1:60702
I20260203 21:10:45.590770 4254 master_service.cc:954] ReplaceTablet: received request to replace tablet b20e604665624843b957080dc6016d78 from {username='slave'} at 127.0.0.1:60702
I20260203 21:10:45.592332 4253 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60702:
name: "default.Table_0e7e19b98aa74ff5a094a070317a1555"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260203 21:10:45.592933 4252 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60702:
name: "default.Table_a408ffd16e534530bf3124d504ceb186"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260203 21:10:45.593353 4251 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60702:
name: "default.Table_bd33ab5dd9a44bf2bdfd58475903bbc9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260203 21:10:45.593789 4250 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60702:
name: "default.Table_09ddf2e9b9804049beecd01e88d7f031"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260203 21:10:45.594120 3920 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Refusing update from remote peer 35397be7e61f4b27a49e9449b9fdf085: Log matching property violated. Preceding OpId in replica: term: 6 index: 108. Preceding OpId from leader: term: 7 index: 110. (index mismatch)
I20260203 21:10:45.594237 4249 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60702:
name: "default.Table_447b2216cf154804ab167c592d1437dc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260203 21:10:45.594589 4322 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 109, Last known committed idx: 108, Time since last communication: 0.000s
W20260203 21:10:45.596632 4245 consensus_peers.cc:597] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 -> Peer 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419): Couldn't send request to peer 7344d7cd8dea4fa2ae705320daacaf49. Status: Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
F20260203 21:10:45.598734 4315 hms_notification_log_listener.cc:287] non-monotonous event IDs from HMS: current 22, previous 22; dumping first 2 out of 12 received events: NotificationEvent(eventId=22, eventTime=1770153029, eventType=DROP_TABLE, dbName=default, tableName=table_76bef700d9b64243b6b4e93ffbc64f7a, message={"server":"","servicePrincipal":"","db":"default","table":"table_76bef700d9b64243b6b4e93ffbc64f7a","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_76bef700d9b64243b6b4e93ffbc64f7a\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1770153028},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/warehouse/table_76bef700d9b64243b6b4e93ffbc64f7a\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_76bef700d9b64243b6b4e93ffbc64f7a\",\"kudu.table_id\":\"f6e23f2505784c6f98a18a43b9917c06\",\"transient_lastDdlTime\":\"1770153028\",\"comment\":\"\",\"kudu.master_addresses\":\"127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"f46367a11713484f92c1d2be2585f5a6\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1770153029}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=22, eventTime=1770153029, eventType=CREATE_TABLE, dbName=default, tableName=table_4f93e096d30349908a32a33e024543d6, message={"server":"","servicePrincipal":"","db":"default","table":"table_4f93e096d30349908a32a33e024543d6","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_4f93e096d30349908a32a33e024543d6\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1770153029},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/warehouse/table_4f93e096d30349908a32a33e024543d6\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_4f93e096d30349908a32a33e024543d6\",\"kudu.table_id\":\"fa8fb788ff754fcd8641964a9d894664\",\"transient_lastDdlTime\":\"1770153029\",\"comment\":\"\",\"kudu.master_addresses\":\"127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"f46367a11713484f92c1d2be2585f5a6\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1770153029,"files":[]}, messageFormat=json-0.2, catName=hive);
I20260203 21:10:45.598824 4331 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 35397be7e61f4b27a49e9449b9fdf085. Latest consensus state: current_term: 7 leader_uuid: "35397be7e61f4b27a49e9449b9fdf085" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } } }
I20260203 21:10:45.598927 4331 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [sys.catalog]: This master's current role is: FOLLOWER
*** Check failure stack trace: ***
I20260203 21:10:45.601406 4331 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 7 leader_uuid: "35397be7e61f4b27a49e9449b9fdf085" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } } }
I20260203 21:10:45.601589 4331 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [sys.catalog]: This master's current role is: FOLLOWER
@ 0x7f20d7852dcd google::LogMessage::Fail() at ??:0
I20260203 21:10:45.603255 4327 sys_catalog.cc:455] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 7 leader_uuid: "35397be7e61f4b27a49e9449b9fdf085" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } } }
I20260203 21:10:45.603351 4327 sys_catalog.cc:458] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085 [sys.catalog]: This master's current role is: LEADER
@ 0x7f20d7856b93 google::LogMessage::SendToLog() at ??:0
@ 0x7f20d78527cc google::LogMessage::Flush() at ??:0
@ 0x7f20d7852a11 google::LogMessage::~LogMessage() at ??:0
I20260203 21:10:45.608619 4257 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085: Sending DeleteTablet for 3 replicas of tablet 8a206d0a0a1947bdabc1123ff6c281f0
I20260203 21:10:45.608676 4255 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085: Sending DeleteTablet for 3 replicas of tablet 6606bf5d7de047cda4a0523197210c1a
I20260203 21:10:45.609236 4258 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085: Sending DeleteTablet for 3 replicas of tablet 4d6ed92d766244489541e1c280afacb5
I20260203 21:10:45.609609 4258 catalog_manager.cc:6724] ReplaceTablet: tablet 4d6ed92d766244489541e1c280afacb5 deleted and replaced by tablet 0f866dd1de0849758c55ee78fca2e66d
I20260203 21:10:45.609684 4254 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 35397be7e61f4b27a49e9449b9fdf085: Sending DeleteTablet for 3 replicas of tablet b20e604665624843b957080dc6016d78
I20260203 21:10:45.609899 4254 catalog_manager.cc:6724] ReplaceTablet: tablet b20e604665624843b957080dc6016d78 deleted and replaced by tablet f693a9c7f1cf4af9bf68f1eb43680c95
I20260203 21:10:45.610090 4254 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60702:
name: "default.Table_e694e6681f2a426c9b583f4567326376"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260203 21:10:45.610206 4256 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60702:
table { table_name: "default.Table_4f93e096d30349908a32a33e024543d6" } new_table_name: "default.Table_65ec2660e3164688879b576a359a84c1" modify_external_catalogs: true
I20260203 21:10:45.613288 4257 catalog_manager.cc:6724] ReplaceTablet: tablet 8a206d0a0a1947bdabc1123ff6c281f0 deleted and replaced by tablet b6a9b895d5364efe9f6acb1b3e35db91
@ 0x7f20dc9c8ef9 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
I20260203 21:10:45.613493 4257 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60702:
table { table_name: "default.Table_b7c2ca72f69c49a0b39163d2fcb69341" } new_table_name: "default.Table_18c764c9748848f7b81aa13d7cae0ead" modify_external_catalogs: true
I20260203 21:10:45.614526 4255 catalog_manager.cc:6724] ReplaceTablet: tablet 6606bf5d7de047cda4a0523197210c1a deleted and replaced by tablet b20b6b42ae9c4adcac2d5993abab6e54
I20260203 21:10:45.614686 4255 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60702:
table { table_name: "default.Table_4c9a68305b5e4d4aa45e3a351c35eee7" } new_table_name: "default.Table_23a38bddaee24e5fa7bfe16e5af12fb5" modify_external_catalogs: true
I20260203 21:10:45.609910 4258 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60702:
name: "default.Table_8bbf49750e3f4eccbcf97c6346c65635"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
@ 0x7f20dc9c7e10 kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
I20260203 21:10:45.620635 3037 tablet_service.cc:1552] Processing DeleteTablet for tablet 6606bf5d7de047cda4a0523197210c1a with delete_type TABLET_DATA_DELETED (replaced by tablet b20b6b42ae9c4adcac2d5993abab6e54) from {username='slave'} at 127.0.0.1:44694
I20260203 21:10:45.620779 3032 tablet_service.cc:1552] Processing DeleteTablet for tablet 8a206d0a0a1947bdabc1123ff6c281f0 with delete_type TABLET_DATA_DELETED (replaced by tablet b6a9b895d5364efe9f6acb1b3e35db91) from {username='slave'} at 127.0.0.1:44694
I20260203 21:10:45.620934 3035 tablet_service.cc:1552] Processing DeleteTablet for tablet 4d6ed92d766244489541e1c280afacb5 with delete_type TABLET_DATA_DELETED (replaced by tablet 0f866dd1de0849758c55ee78fca2e66d) from {username='slave'} at 127.0.0.1:44694
I20260203 21:10:45.621053 3036 tablet_service.cc:1552] Processing DeleteTablet for tablet b20e604665624843b957080dc6016d78 with delete_type TABLET_DATA_DELETED (replaced by tablet f693a9c7f1cf4af9bf68f1eb43680c95) from {username='slave'} at 127.0.0.1:44694
I20260203 21:10:45.621073 3038 tablet_service.cc:1505] Processing CreateTablet for tablet b6a9b895d5364efe9f6acb1b3e35db91 (DEFAULT_TABLE table=default.table_4f93e096d30349908a32a33e024543d6 [id=fa8fb788ff754fcd8641964a9d894664]), partition=RANGE (key) PARTITION UNBOUNDED
@ 0x7f20dc9c7573 _ZZN4kudu6master30HmsNotificationLogListenerTask4InitEvENKUlvE_clEv at ??:0
I20260203 21:10:45.621291 3034 tablet_service.cc:1505] Processing CreateTablet for tablet b20b6b42ae9c4adcac2d5993abab6e54 (DEFAULT_TABLE table=default.table_66c508c8dbdd4e7ea9283cabe65b62c0 [id=b62df06982124a70936068823e4b2324]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:45.621340 3036 tablet_service.cc:1505] Processing CreateTablet for tablet 0f866dd1de0849758c55ee78fca2e66d (DEFAULT_TABLE table=default.table_09e62d0aaa0f48ad9ed818ba967be542 [id=a26f4a67278a4929b2378fbbe9baaf52]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:45.621344 3038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6a9b895d5364efe9f6acb1b3e35db91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:45.621662 3033 tablet_service.cc:1505] Processing CreateTablet for tablet f693a9c7f1cf4af9bf68f1eb43680c95 (DEFAULT_TABLE table=default.table_8da179b3ec0b4c898eb890f89d54cb6a [id=ad58be29e80345e1afe7f5a55e129af2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:45.621841 3033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f693a9c7f1cf4af9bf68f1eb43680c95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:45.623416 4351 tablet_bootstrap.cc:492] T f693a9c7f1cf4af9bf68f1eb43680c95 P 185c63f61a2645928eeb807d145026b1: Bootstrap starting.
I20260203 21:10:45.623422 3034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b20b6b42ae9c4adcac2d5993abab6e54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:45.623626 3036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f866dd1de0849758c55ee78fca2e66d. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7f20dc9ccc7a _ZNSt17_Function_handlerIFvvEZN4kudu6master30HmsNotificationLogListenerTask4InitEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
I20260203 21:10:45.624135 4350 tablet_replica.cc:333] T 6606bf5d7de047cda4a0523197210c1a P 185c63f61a2645928eeb807d145026b1: stopping tablet replica
I20260203 21:10:45.624264 4350 raft_consensus.cc:2243] T 6606bf5d7de047cda4a0523197210c1a P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 21:10:45.624375 4350 raft_consensus.cc:2272] T 6606bf5d7de047cda4a0523197210c1a P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Raft consensus is shut down!
@ 0x558d4718da0a std::function<>::operator()() at ??:0
I20260203 21:10:45.624732 4350 ts_tablet_manager.cc:1916] T 6606bf5d7de047cda4a0523197210c1a P 185c63f61a2645928eeb807d145026b1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260203 21:10:45.626509 4351 tablet_bootstrap.cc:654] T f693a9c7f1cf4af9bf68f1eb43680c95 P 185c63f61a2645928eeb807d145026b1: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:45.626750 4350 ts_tablet_manager.cc:1929] T 6606bf5d7de047cda4a0523197210c1a P 185c63f61a2645928eeb807d145026b1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260203 21:10:45.626806 4350 log.cc:1199] T 6606bf5d7de047cda4a0523197210c1a P 185c63f61a2645928eeb807d145026b1: Deleting WAL directory at /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-2/wal/wals/6606bf5d7de047cda4a0523197210c1a
I20260203 21:10:45.626809 2898 tablet_service.cc:1552] Processing DeleteTablet for tablet 4d6ed92d766244489541e1c280afacb5 with delete_type TABLET_DATA_DELETED (replaced by tablet 0f866dd1de0849758c55ee78fca2e66d) from {username='slave'} at 127.0.0.1:33948
@ 0x7f20d8cacb04 kudu::Thread::SuperviseThread() at ??:0
I20260203 21:10:45.627045 4350 ts_tablet_manager.cc:1950] T 6606bf5d7de047cda4a0523197210c1a P 185c63f61a2645928eeb807d145026b1: Deleting consensus metadata
I20260203 21:10:45.627059 2896 tablet_service.cc:1552] Processing DeleteTablet for tablet b20e604665624843b957080dc6016d78 with delete_type TABLET_DATA_DELETED (replaced by tablet f693a9c7f1cf4af9bf68f1eb43680c95) from {username='slave'} at 127.0.0.1:33948
I20260203 21:10:45.627110 2899 tablet_service.cc:1552] Processing DeleteTablet for tablet 8a206d0a0a1947bdabc1123ff6c281f0 with delete_type TABLET_DATA_DELETED (replaced by tablet b6a9b895d5364efe9f6acb1b3e35db91) from {username='slave'} at 127.0.0.1:33948
I20260203 21:10:45.627255 2902 tablet_service.cc:1552] Processing DeleteTablet for tablet 6606bf5d7de047cda4a0523197210c1a with delete_type TABLET_DATA_DELETED (replaced by tablet b20b6b42ae9c4adcac2d5993abab6e54) from {username='slave'} at 127.0.0.1:33948
I20260203 21:10:45.627353 2898 tablet_service.cc:1505] Processing CreateTablet for tablet 0f866dd1de0849758c55ee78fca2e66d (DEFAULT_TABLE table=default.table_09e62d0aaa0f48ad9ed818ba967be542 [id=a26f4a67278a4929b2378fbbe9baaf52]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:45.627499 2895 tablet_service.cc:1505] Processing CreateTablet for tablet b6a9b895d5364efe9f6acb1b3e35db91 (DEFAULT_TABLE table=default.table_4f93e096d30349908a32a33e024543d6 [id=fa8fb788ff754fcd8641964a9d894664]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:45.627560 4350 tablet_replica.cc:333] T 8a206d0a0a1947bdabc1123ff6c281f0 P 185c63f61a2645928eeb807d145026b1: stopping tablet replica
I20260203 21:10:45.627584 2898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f866dd1de0849758c55ee78fca2e66d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:45.627694 4350 raft_consensus.cc:2243] T 8a206d0a0a1947bdabc1123ff6c281f0 P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 21:10:45.627756 2895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6a9b895d5364efe9f6acb1b3e35db91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:45.627784 4350 raft_consensus.cc:2272] T 8a206d0a0a1947bdabc1123ff6c281f0 P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 21:10:45.627923 4244 catalog_manager.cc:4985] TS 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): tablet 6606bf5d7de047cda4a0523197210c1a (table default.table_66c508c8dbdd4e7ea9283cabe65b62c0 [id=b62df06982124a70936068823e4b2324]) successfully deleted
I20260203 21:10:45.628317 4350 ts_tablet_manager.cc:1916] T 8a206d0a0a1947bdabc1123ff6c281f0 P 185c63f61a2645928eeb807d145026b1: Deleting tablet data with delete state TABLET_DATA_DELETED
@ 0x7f20d95466db start_thread at ??:0
I20260203 21:10:45.629959 4350 ts_tablet_manager.cc:1929] T 8a206d0a0a1947bdabc1123ff6c281f0 P 185c63f61a2645928eeb807d145026b1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260203 21:10:45.630020 4350 log.cc:1199] T 8a206d0a0a1947bdabc1123ff6c281f0 P 185c63f61a2645928eeb807d145026b1: Deleting WAL directory at /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-2/wal/wals/8a206d0a0a1947bdabc1123ff6c281f0
I20260203 21:10:45.629979 2897 tablet_service.cc:1505] Processing CreateTablet for tablet b20b6b42ae9c4adcac2d5993abab6e54 (DEFAULT_TABLE table=default.table_66c508c8dbdd4e7ea9283cabe65b62c0 [id=b62df06982124a70936068823e4b2324]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:45.630189 2897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b20b6b42ae9c4adcac2d5993abab6e54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:45.630234 4350 ts_tablet_manager.cc:1950] T 8a206d0a0a1947bdabc1123ff6c281f0 P 185c63f61a2645928eeb807d145026b1: Deleting consensus metadata
@ 0x7f20d6a0971f clone at ??:0
I20260203 21:10:45.630679 4350 tablet_replica.cc:333] T 4d6ed92d766244489541e1c280afacb5 P 185c63f61a2645928eeb807d145026b1: stopping tablet replica
I20260203 21:10:45.631181 4350 raft_consensus.cc:2243] T 4d6ed92d766244489541e1c280afacb5 P 185c63f61a2645928eeb807d145026b1 [term 1 LEADER]: Raft consensus shutting down.
I20260203 21:10:45.631325 4350 raft_consensus.cc:2272] T 4d6ed92d766244489541e1c280afacb5 P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 21:10:45.631352 2900 tablet_service.cc:1505] Processing CreateTablet for tablet f693a9c7f1cf4af9bf68f1eb43680c95 (DEFAULT_TABLE table=default.table_8da179b3ec0b4c898eb890f89d54cb6a [id=ad58be29e80345e1afe7f5a55e129af2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260203 21:10:45.631546 2900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f693a9c7f1cf4af9bf68f1eb43680c95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:45.631567 4350 ts_tablet_manager.cc:1916] T 4d6ed92d766244489541e1c280afacb5 P 185c63f61a2645928eeb807d145026b1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260203 21:10:45.632910 4350 ts_tablet_manager.cc:1929] T 4d6ed92d766244489541e1c280afacb5 P 185c63f61a2645928eeb807d145026b1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260203 21:10:45.632953 4350 log.cc:1199] T 4d6ed92d766244489541e1c280afacb5 P 185c63f61a2645928eeb807d145026b1: Deleting WAL directory at /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-2/wal/wals/4d6ed92d766244489541e1c280afacb5
I20260203 21:10:45.633102 4350 ts_tablet_manager.cc:1950] T 4d6ed92d766244489541e1c280afacb5 P 185c63f61a2645928eeb807d145026b1: Deleting consensus metadata
I20260203 21:10:45.633467 4352 tablet_replica.cc:333] T 4d6ed92d766244489541e1c280afacb5 P 6d9e0cecab784cc0acc050ca1c89c5be: stopping tablet replica
I20260203 21:10:45.633534 4350 tablet_replica.cc:333] T b20e604665624843b957080dc6016d78 P 185c63f61a2645928eeb807d145026b1: stopping tablet replica
I20260203 21:10:45.633579 4352 raft_consensus.cc:2243] T 4d6ed92d766244489541e1c280afacb5 P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 21:10:45.633625 4350 raft_consensus.cc:2243] T b20e604665624843b957080dc6016d78 P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 21:10:45.633677 4352 raft_consensus.cc:2272] T 4d6ed92d766244489541e1c280afacb5 P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 21:10:45.633692 4350 raft_consensus.cc:2272] T b20e604665624843b957080dc6016d78 P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 21:10:45.633931 4350 ts_tablet_manager.cc:1916] T b20e604665624843b957080dc6016d78 P 185c63f61a2645928eeb807d145026b1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260203 21:10:45.634014 4352 ts_tablet_manager.cc:1916] T 4d6ed92d766244489541e1c280afacb5 P 6d9e0cecab784cc0acc050ca1c89c5be: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260203 21:10:45.635119 4350 ts_tablet_manager.cc:1929] T b20e604665624843b957080dc6016d78 P 185c63f61a2645928eeb807d145026b1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260203 21:10:45.635162 4350 log.cc:1199] T b20e604665624843b957080dc6016d78 P 185c63f61a2645928eeb807d145026b1: Deleting WAL directory at /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-2/wal/wals/b20e604665624843b957080dc6016d78
I20260203 21:10:45.635304 4350 ts_tablet_manager.cc:1950] T b20e604665624843b957080dc6016d78 P 185c63f61a2645928eeb807d145026b1: Deleting consensus metadata
I20260203 21:10:45.636099 4353 tablet_bootstrap.cc:492] T 0f866dd1de0849758c55ee78fca2e66d P 6d9e0cecab784cc0acc050ca1c89c5be: Bootstrap starting.
I20260203 21:10:45.637095 4353 tablet_bootstrap.cc:654] T 0f866dd1de0849758c55ee78fca2e66d P 6d9e0cecab784cc0acc050ca1c89c5be: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:45.637707 4352 ts_tablet_manager.cc:1929] T 4d6ed92d766244489541e1c280afacb5 P 6d9e0cecab784cc0acc050ca1c89c5be: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260203 21:10:45.637765 4352 log.cc:1199] T 4d6ed92d766244489541e1c280afacb5 P 6d9e0cecab784cc0acc050ca1c89c5be: Deleting WAL directory at /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-1/wal/wals/4d6ed92d766244489541e1c280afacb5
I20260203 21:10:45.637997 4352 ts_tablet_manager.cc:1950] T 4d6ed92d766244489541e1c280afacb5 P 6d9e0cecab784cc0acc050ca1c89c5be: Deleting consensus metadata
I20260203 21:10:45.638532 4352 tablet_replica.cc:333] T b20e604665624843b957080dc6016d78 P 6d9e0cecab784cc0acc050ca1c89c5be: stopping tablet replica
I20260203 21:10:45.638643 4352 raft_consensus.cc:2243] T b20e604665624843b957080dc6016d78 P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 21:10:45.638727 4352 raft_consensus.cc:2272] T b20e604665624843b957080dc6016d78 P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 21:10:45.639058 4352 ts_tablet_manager.cc:1916] T b20e604665624843b957080dc6016d78 P 6d9e0cecab784cc0acc050ca1c89c5be: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260203 21:10:45.639689 4351 tablet_bootstrap.cc:492] T f693a9c7f1cf4af9bf68f1eb43680c95 P 185c63f61a2645928eeb807d145026b1: No bootstrap required, opened a new log
I20260203 21:10:45.639778 4351 ts_tablet_manager.cc:1403] T f693a9c7f1cf4af9bf68f1eb43680c95 P 185c63f61a2645928eeb807d145026b1: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.000s
I20260203 21:10:45.640236 4351 raft_consensus.cc:359] T f693a9c7f1cf4af9bf68f1eb43680c95 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:45.640347 4351 raft_consensus.cc:385] T f693a9c7f1cf4af9bf68f1eb43680c95 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:45.640376 4351 raft_consensus.cc:740] T f693a9c7f1cf4af9bf68f1eb43680c95 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 185c63f61a2645928eeb807d145026b1, State: Initialized, Role: FOLLOWER
I20260203 21:10:45.640496 4351 consensus_queue.cc:260] T f693a9c7f1cf4af9bf68f1eb43680c95 P 185c63f61a2645928eeb807d145026b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:45.640792 4352 ts_tablet_manager.cc:1929] T b20e604665624843b957080dc6016d78 P 6d9e0cecab784cc0acc050ca1c89c5be: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260203 21:10:45.640846 4352 log.cc:1199] T b20e604665624843b957080dc6016d78 P 6d9e0cecab784cc0acc050ca1c89c5be: Deleting WAL directory at /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-1/wal/wals/b20e604665624843b957080dc6016d78
I20260203 21:10:45.641067 4352 ts_tablet_manager.cc:1950] T b20e604665624843b957080dc6016d78 P 6d9e0cecab784cc0acc050ca1c89c5be: Deleting consensus metadata
I20260203 21:10:45.641527 4352 tablet_replica.cc:333] T 8a206d0a0a1947bdabc1123ff6c281f0 P 6d9e0cecab784cc0acc050ca1c89c5be: stopping tablet replica
I20260203 21:10:45.641628 4352 raft_consensus.cc:2243] T 8a206d0a0a1947bdabc1123ff6c281f0 P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 21:10:45.641716 4352 raft_consensus.cc:2272] T 8a206d0a0a1947bdabc1123ff6c281f0 P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 21:10:45.641999 4352 ts_tablet_manager.cc:1916] T 8a206d0a0a1947bdabc1123ff6c281f0 P 6d9e0cecab784cc0acc050ca1c89c5be: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260203 21:10:45.642464 4351 ts_tablet_manager.cc:1434] T f693a9c7f1cf4af9bf68f1eb43680c95 P 185c63f61a2645928eeb807d145026b1: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260203 21:10:45.642658 4351 tablet_bootstrap.cc:492] T b6a9b895d5364efe9f6acb1b3e35db91 P 185c63f61a2645928eeb807d145026b1: Bootstrap starting.
I20260203 21:10:45.642669 4353 tablet_bootstrap.cc:492] T 0f866dd1de0849758c55ee78fca2e66d P 6d9e0cecab784cc0acc050ca1c89c5be: No bootstrap required, opened a new log
I20260203 21:10:45.642731 4353 ts_tablet_manager.cc:1403] T 0f866dd1de0849758c55ee78fca2e66d P 6d9e0cecab784cc0acc050ca1c89c5be: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260203 21:10:45.643178 4353 raft_consensus.cc:359] T 0f866dd1de0849758c55ee78fca2e66d P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:45.643270 4353 raft_consensus.cc:385] T 0f866dd1de0849758c55ee78fca2e66d P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:45.643296 4353 raft_consensus.cc:740] T 0f866dd1de0849758c55ee78fca2e66d P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d9e0cecab784cc0acc050ca1c89c5be, State: Initialized, Role: FOLLOWER
I20260203 21:10:45.643405 4353 consensus_queue.cc:260] T 0f866dd1de0849758c55ee78fca2e66d P 6d9e0cecab784cc0acc050ca1c89c5be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:45.643802 4353 ts_tablet_manager.cc:1434] T 0f866dd1de0849758c55ee78fca2e66d P 6d9e0cecab784cc0acc050ca1c89c5be: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260203 21:10:45.643973 4353 tablet_bootstrap.cc:492] T b6a9b895d5364efe9f6acb1b3e35db91 P 6d9e0cecab784cc0acc050ca1c89c5be: Bootstrap starting.
I20260203 21:10:45.645339 4353 tablet_bootstrap.cc:654] T b6a9b895d5364efe9f6acb1b3e35db91 P 6d9e0cecab784cc0acc050ca1c89c5be: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:45.646418 4351 tablet_bootstrap.cc:654] T b6a9b895d5364efe9f6acb1b3e35db91 P 185c63f61a2645928eeb807d145026b1: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:45.647317 4352 ts_tablet_manager.cc:1929] T 8a206d0a0a1947bdabc1123ff6c281f0 P 6d9e0cecab784cc0acc050ca1c89c5be: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260203 21:10:45.647375 4352 log.cc:1199] T 8a206d0a0a1947bdabc1123ff6c281f0 P 6d9e0cecab784cc0acc050ca1c89c5be: Deleting WAL directory at /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-1/wal/wals/8a206d0a0a1947bdabc1123ff6c281f0
I20260203 21:10:45.647584 4352 ts_tablet_manager.cc:1950] T 8a206d0a0a1947bdabc1123ff6c281f0 P 6d9e0cecab784cc0acc050ca1c89c5be: Deleting consensus metadata
I20260203 21:10:45.648124 4352 tablet_replica.cc:333] T 6606bf5d7de047cda4a0523197210c1a P 6d9e0cecab784cc0acc050ca1c89c5be: stopping tablet replica
I20260203 21:10:45.648228 4352 raft_consensus.cc:2243] T 6606bf5d7de047cda4a0523197210c1a P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 LEADER]: Raft consensus shutting down.
I20260203 21:10:45.648396 4352 raft_consensus.cc:2272] T 6606bf5d7de047cda4a0523197210c1a P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 21:10:45.648733 4352 ts_tablet_manager.cc:1916] T 6606bf5d7de047cda4a0523197210c1a P 6d9e0cecab784cc0acc050ca1c89c5be: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260203 21:10:45.650399 4351 tablet_bootstrap.cc:492] T b6a9b895d5364efe9f6acb1b3e35db91 P 185c63f61a2645928eeb807d145026b1: No bootstrap required, opened a new log
I20260203 21:10:45.650477 4351 ts_tablet_manager.cc:1403] T b6a9b895d5364efe9f6acb1b3e35db91 P 185c63f61a2645928eeb807d145026b1: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20260203 21:10:45.650576 4352 ts_tablet_manager.cc:1929] T 6606bf5d7de047cda4a0523197210c1a P 6d9e0cecab784cc0acc050ca1c89c5be: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260203 21:10:45.650627 4352 log.cc:1199] T 6606bf5d7de047cda4a0523197210c1a P 6d9e0cecab784cc0acc050ca1c89c5be: Deleting WAL directory at /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/ts-1/wal/wals/6606bf5d7de047cda4a0523197210c1a
I20260203 21:10:45.650833 4352 ts_tablet_manager.cc:1950] T 6606bf5d7de047cda4a0523197210c1a P 6d9e0cecab784cc0acc050ca1c89c5be: Deleting consensus metadata
I20260203 21:10:45.650949 4351 raft_consensus.cc:359] T b6a9b895d5364efe9f6acb1b3e35db91 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:45.651042 4351 raft_consensus.cc:385] T b6a9b895d5364efe9f6acb1b3e35db91 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:45.651072 4351 raft_consensus.cc:740] T b6a9b895d5364efe9f6acb1b3e35db91 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 185c63f61a2645928eeb807d145026b1, State: Initialized, Role: FOLLOWER
I20260203 21:10:45.651202 4351 consensus_queue.cc:260] T b6a9b895d5364efe9f6acb1b3e35db91 P 185c63f61a2645928eeb807d145026b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:45.652135 4353 tablet_bootstrap.cc:492] T b6a9b895d5364efe9f6acb1b3e35db91 P 6d9e0cecab784cc0acc050ca1c89c5be: No bootstrap required, opened a new log
I20260203 21:10:45.652207 4353 ts_tablet_manager.cc:1403] T b6a9b895d5364efe9f6acb1b3e35db91 P 6d9e0cecab784cc0acc050ca1c89c5be: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.000s
I20260203 21:10:45.652611 4353 raft_consensus.cc:359] T b6a9b895d5364efe9f6acb1b3e35db91 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:45.652729 4353 raft_consensus.cc:385] T b6a9b895d5364efe9f6acb1b3e35db91 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:45.652769 4353 raft_consensus.cc:740] T b6a9b895d5364efe9f6acb1b3e35db91 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d9e0cecab784cc0acc050ca1c89c5be, State: Initialized, Role: FOLLOWER
I20260203 21:10:45.652881 4353 consensus_queue.cc:260] T b6a9b895d5364efe9f6acb1b3e35db91 P 6d9e0cecab784cc0acc050ca1c89c5be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:45.652971 4351 ts_tablet_manager.cc:1434] T b6a9b895d5364efe9f6acb1b3e35db91 P 185c63f61a2645928eeb807d145026b1: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260203 21:10:45.653131 4353 ts_tablet_manager.cc:1434] T b6a9b895d5364efe9f6acb1b3e35db91 P 6d9e0cecab784cc0acc050ca1c89c5be: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260203 21:10:45.653280 4353 tablet_bootstrap.cc:492] T b20b6b42ae9c4adcac2d5993abab6e54 P 6d9e0cecab784cc0acc050ca1c89c5be: Bootstrap starting.
I20260203 21:10:45.654188 4353 tablet_bootstrap.cc:654] T b20b6b42ae9c4adcac2d5993abab6e54 P 6d9e0cecab784cc0acc050ca1c89c5be: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:45.654680 4351 tablet_bootstrap.cc:492] T b20b6b42ae9c4adcac2d5993abab6e54 P 185c63f61a2645928eeb807d145026b1: Bootstrap starting.
I20260203 21:10:45.656457 4353 tablet_bootstrap.cc:492] T b20b6b42ae9c4adcac2d5993abab6e54 P 6d9e0cecab784cc0acc050ca1c89c5be: No bootstrap required, opened a new log
I20260203 21:10:45.656528 4353 ts_tablet_manager.cc:1403] T b20b6b42ae9c4adcac2d5993abab6e54 P 6d9e0cecab784cc0acc050ca1c89c5be: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260203 21:10:45.656584 4351 tablet_bootstrap.cc:654] T b20b6b42ae9c4adcac2d5993abab6e54 P 185c63f61a2645928eeb807d145026b1: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:45.656927 4353 raft_consensus.cc:359] T b20b6b42ae9c4adcac2d5993abab6e54 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:45.657022 4353 raft_consensus.cc:385] T b20b6b42ae9c4adcac2d5993abab6e54 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:45.657054 4353 raft_consensus.cc:740] T b20b6b42ae9c4adcac2d5993abab6e54 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d9e0cecab784cc0acc050ca1c89c5be, State: Initialized, Role: FOLLOWER
I20260203 21:10:45.657174 4353 consensus_queue.cc:260] T b20b6b42ae9c4adcac2d5993abab6e54 P 6d9e0cecab784cc0acc050ca1c89c5be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:45.657413 4353 ts_tablet_manager.cc:1434] T b20b6b42ae9c4adcac2d5993abab6e54 P 6d9e0cecab784cc0acc050ca1c89c5be: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260203 21:10:45.657532 4351 tablet_bootstrap.cc:492] T b20b6b42ae9c4adcac2d5993abab6e54 P 185c63f61a2645928eeb807d145026b1: No bootstrap required, opened a new log
I20260203 21:10:45.657585 4353 tablet_bootstrap.cc:492] T f693a9c7f1cf4af9bf68f1eb43680c95 P 6d9e0cecab784cc0acc050ca1c89c5be: Bootstrap starting.
I20260203 21:10:45.657617 4351 ts_tablet_manager.cc:1403] T b20b6b42ae9c4adcac2d5993abab6e54 P 185c63f61a2645928eeb807d145026b1: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260203 21:10:45.658075 4351 raft_consensus.cc:359] T b20b6b42ae9c4adcac2d5993abab6e54 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:45.658172 4351 raft_consensus.cc:385] T b20b6b42ae9c4adcac2d5993abab6e54 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:45.658200 4351 raft_consensus.cc:740] T b20b6b42ae9c4adcac2d5993abab6e54 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 185c63f61a2645928eeb807d145026b1, State: Initialized, Role: FOLLOWER
I20260203 21:10:45.658308 4351 consensus_queue.cc:260] T b20b6b42ae9c4adcac2d5993abab6e54 P 185c63f61a2645928eeb807d145026b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:45.658483 4353 tablet_bootstrap.cc:654] T f693a9c7f1cf4af9bf68f1eb43680c95 P 6d9e0cecab784cc0acc050ca1c89c5be: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:45.658555 4351 ts_tablet_manager.cc:1434] T b20b6b42ae9c4adcac2d5993abab6e54 P 185c63f61a2645928eeb807d145026b1: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260203 21:10:45.658720 4351 tablet_bootstrap.cc:492] T 0f866dd1de0849758c55ee78fca2e66d P 185c63f61a2645928eeb807d145026b1: Bootstrap starting.
I20260203 21:10:45.659595 4351 tablet_bootstrap.cc:654] T 0f866dd1de0849758c55ee78fca2e66d P 185c63f61a2645928eeb807d145026b1: Neither blocks nor log segments found. Creating new log.
I20260203 21:10:45.659725 4353 tablet_bootstrap.cc:492] T f693a9c7f1cf4af9bf68f1eb43680c95 P 6d9e0cecab784cc0acc050ca1c89c5be: No bootstrap required, opened a new log
I20260203 21:10:45.659811 4353 ts_tablet_manager.cc:1403] T f693a9c7f1cf4af9bf68f1eb43680c95 P 6d9e0cecab784cc0acc050ca1c89c5be: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260203 21:10:45.660193 4353 raft_consensus.cc:359] T f693a9c7f1cf4af9bf68f1eb43680c95 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:45.660285 4353 raft_consensus.cc:385] T f693a9c7f1cf4af9bf68f1eb43680c95 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:45.660315 4353 raft_consensus.cc:740] T f693a9c7f1cf4af9bf68f1eb43680c95 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d9e0cecab784cc0acc050ca1c89c5be, State: Initialized, Role: FOLLOWER
I20260203 21:10:45.660422 4353 consensus_queue.cc:260] T f693a9c7f1cf4af9bf68f1eb43680c95 P 6d9e0cecab784cc0acc050ca1c89c5be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:45.660672 4353 ts_tablet_manager.cc:1434] T f693a9c7f1cf4af9bf68f1eb43680c95 P 6d9e0cecab784cc0acc050ca1c89c5be: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260203 21:10:45.661870 4351 tablet_bootstrap.cc:492] T 0f866dd1de0849758c55ee78fca2e66d P 185c63f61a2645928eeb807d145026b1: No bootstrap required, opened a new log
I20260203 21:10:45.661938 4351 ts_tablet_manager.cc:1403] T 0f866dd1de0849758c55ee78fca2e66d P 185c63f61a2645928eeb807d145026b1: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260203 21:10:45.662353 4351 raft_consensus.cc:359] T 0f866dd1de0849758c55ee78fca2e66d P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:45.662441 4351 raft_consensus.cc:385] T 0f866dd1de0849758c55ee78fca2e66d P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 21:10:45.662467 4351 raft_consensus.cc:740] T 0f866dd1de0849758c55ee78fca2e66d P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 185c63f61a2645928eeb807d145026b1, State: Initialized, Role: FOLLOWER
I20260203 21:10:45.663270 4351 consensus_queue.cc:260] T 0f866dd1de0849758c55ee78fca2e66d P 185c63f61a2645928eeb807d145026b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:45.664673 4351 ts_tablet_manager.cc:1434] T 0f866dd1de0849758c55ee78fca2e66d P 185c63f61a2645928eeb807d145026b1: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
I20260203 21:10:45.706391 4143 raft_consensus.cc:493] T 0f866dd1de0849758c55ee78fca2e66d P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 21:10:45.706522 4143 raft_consensus.cc:515] T 0f866dd1de0849758c55ee78fca2e66d P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:45.707113 4143 leader_election.cc:290] T 0f866dd1de0849758c55ee78fca2e66d P 185c63f61a2645928eeb807d145026b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335)
I20260203 21:10:45.707499 2922 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0f866dd1de0849758c55ee78fca2e66d" candidate_uuid: "185c63f61a2645928eeb807d145026b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" is_pre_election: true
I20260203 21:10:45.707676 2922 raft_consensus.cc:2468] T 0f866dd1de0849758c55ee78fca2e66d P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 185c63f61a2645928eeb807d145026b1 in term 0.
W20260203 21:10:45.707755 2993 leader_election.cc:343] T 0f866dd1de0849758c55ee78fca2e66d P 185c63f61a2645928eeb807d145026b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335): Not found: Tablet not found: 0f866dd1de0849758c55ee78fca2e66d
I20260203 21:10:45.707973 2995 leader_election.cc:304] T 0f866dd1de0849758c55ee78fca2e66d P 185c63f61a2645928eeb807d145026b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be; no voters: 02bdf326542e474cbe62434dd59087dc
I20260203 21:10:45.708104 4143 raft_consensus.cc:2804] T 0f866dd1de0849758c55ee78fca2e66d P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 21:10:45.708159 4143 raft_consensus.cc:493] T 0f866dd1de0849758c55ee78fca2e66d P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 21:10:45.708205 4143 raft_consensus.cc:3060] T 0f866dd1de0849758c55ee78fca2e66d P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:45.709055 4143 raft_consensus.cc:515] T 0f866dd1de0849758c55ee78fca2e66d P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:45.709375 4143 leader_election.cc:290] T 0f866dd1de0849758c55ee78fca2e66d P 185c63f61a2645928eeb807d145026b1 [CANDIDATE]: Term 1 election: Requested vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335)
I20260203 21:10:45.709677 2922 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0f866dd1de0849758c55ee78fca2e66d" candidate_uuid: "185c63f61a2645928eeb807d145026b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d9e0cecab784cc0acc050ca1c89c5be"
I20260203 21:10:45.709800 2922 raft_consensus.cc:3060] T 0f866dd1de0849758c55ee78fca2e66d P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Advancing to term 1
W20260203 21:10:45.709966 2993 leader_election.cc:343] T 0f866dd1de0849758c55ee78fca2e66d P 185c63f61a2645928eeb807d145026b1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335): Not found: Tablet not found: 0f866dd1de0849758c55ee78fca2e66d
I20260203 21:10:45.710799 2922 raft_consensus.cc:2468] T 0f866dd1de0849758c55ee78fca2e66d P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 185c63f61a2645928eeb807d145026b1 in term 1.
I20260203 21:10:45.711076 2995 leader_election.cc:304] T 0f866dd1de0849758c55ee78fca2e66d P 185c63f61a2645928eeb807d145026b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be; no voters: 02bdf326542e474cbe62434dd59087dc
I20260203 21:10:45.711273 4143 raft_consensus.cc:2804] T 0f866dd1de0849758c55ee78fca2e66d P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260203 21:10:45.711351 4143 raft_consensus.cc:697] T 0f866dd1de0849758c55ee78fca2e66d P 185c63f61a2645928eeb807d145026b1 [term 1 LEADER]: Becoming Leader. State: Replica: 185c63f61a2645928eeb807d145026b1, State: Running, Role: LEADER
I20260203 21:10:45.711638 4143 consensus_queue.cc:237] T 0f866dd1de0849758c55ee78fca2e66d P 185c63f61a2645928eeb807d145026b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:45.774130 4143 raft_consensus.cc:493] T f693a9c7f1cf4af9bf68f1eb43680c95 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 21:10:45.774300 4143 raft_consensus.cc:515] T f693a9c7f1cf4af9bf68f1eb43680c95 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:45.774839 4143 leader_election.cc:290] T f693a9c7f1cf4af9bf68f1eb43680c95 P 185c63f61a2645928eeb807d145026b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335)
I20260203 21:10:45.775308 2922 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f693a9c7f1cf4af9bf68f1eb43680c95" candidate_uuid: "185c63f61a2645928eeb807d145026b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" is_pre_election: true
I20260203 21:10:45.775460 2922 raft_consensus.cc:2468] T f693a9c7f1cf4af9bf68f1eb43680c95 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 185c63f61a2645928eeb807d145026b1 in term 0.
W20260203 21:10:45.775650 2993 leader_election.cc:343] T f693a9c7f1cf4af9bf68f1eb43680c95 P 185c63f61a2645928eeb807d145026b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335): Not found: Tablet not found: f693a9c7f1cf4af9bf68f1eb43680c95
I20260203 21:10:45.775784 2995 leader_election.cc:304] T f693a9c7f1cf4af9bf68f1eb43680c95 P 185c63f61a2645928eeb807d145026b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be; no voters: 02bdf326542e474cbe62434dd59087dc
I20260203 21:10:45.775944 4143 raft_consensus.cc:2804] T f693a9c7f1cf4af9bf68f1eb43680c95 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 21:10:45.776002 4143 raft_consensus.cc:493] T f693a9c7f1cf4af9bf68f1eb43680c95 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 21:10:45.776041 4143 raft_consensus.cc:3060] T f693a9c7f1cf4af9bf68f1eb43680c95 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:45.776803 4143 raft_consensus.cc:515] T f693a9c7f1cf4af9bf68f1eb43680c95 P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:45.777129 4143 leader_election.cc:290] T f693a9c7f1cf4af9bf68f1eb43680c95 P 185c63f61a2645928eeb807d145026b1 [CANDIDATE]: Term 1 election: Requested vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335)
I20260203 21:10:45.777501 2922 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f693a9c7f1cf4af9bf68f1eb43680c95" candidate_uuid: "185c63f61a2645928eeb807d145026b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d9e0cecab784cc0acc050ca1c89c5be"
I20260203 21:10:45.777633 2922 raft_consensus.cc:3060] T f693a9c7f1cf4af9bf68f1eb43680c95 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:45.778714 2922 raft_consensus.cc:2468] T f693a9c7f1cf4af9bf68f1eb43680c95 P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 185c63f61a2645928eeb807d145026b1 in term 1.
I20260203 21:10:45.779006 2995 leader_election.cc:304] T f693a9c7f1cf4af9bf68f1eb43680c95 P 185c63f61a2645928eeb807d145026b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be; no voters:
I20260203 21:10:45.779163 4143 raft_consensus.cc:2804] T f693a9c7f1cf4af9bf68f1eb43680c95 P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260203 21:10:45.779243 4143 raft_consensus.cc:697] T f693a9c7f1cf4af9bf68f1eb43680c95 P 185c63f61a2645928eeb807d145026b1 [term 1 LEADER]: Becoming Leader. State: Replica: 185c63f61a2645928eeb807d145026b1, State: Running, Role: LEADER
W20260203 21:10:45.779269 2993 leader_election.cc:343] T f693a9c7f1cf4af9bf68f1eb43680c95 P 185c63f61a2645928eeb807d145026b1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335): Not found: Tablet not found: f693a9c7f1cf4af9bf68f1eb43680c95
I20260203 21:10:45.779381 4143 consensus_queue.cc:237] T f693a9c7f1cf4af9bf68f1eb43680c95 P 185c63f61a2645928eeb807d145026b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
W20260203 21:10:45.782102 2721 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 1: this message will repeat every 5th retry.
W20260203 21:10:45.792261 2858 connection.cc:537] server connection from 127.0.0.1:33948 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260203 21:10:45.792306 2994 connection.cc:537] server connection from 127.0.0.1:44694 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260203 21:10:45.792562 4344 negotiation.cc:337] Failed RPC negotiation. Trace:
0203 21:10:45.610188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57238 (local address 127.2.32.129:34335)
0203 21:10:45.632310 (+ 22122us) server_negotiation.cc:207] Beginning negotiation
0203 21:10:45.632315 (+ 5us) server_negotiation.cc:400] Waiting for connection header
0203 21:10:45.632332 (+ 17us) server_negotiation.cc:408] Connection header received
0203 21:10:45.632383 (+ 51us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
0203 21:10:45.632386 (+ 3us) server_negotiation.cc:462] Received NEGOTIATE request from client
0203 21:10:45.632445 (+ 59us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
0203 21:10:45.632524 (+ 79us) server_negotiation.cc:227] Negotiated authn=CERTIFICATE
0203 21:10:45.792395 (+159871us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57238: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"server-negotiator.queue_time_us":22027,"thread_start_us":64,"threads_started":1}
W20260203 21:10:45.792719 2994 connection.cc:537] client connection to 127.2.32.189:42681 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260203 21:10:45.792989 2858 connection.cc:537] client connection to 127.2.32.189:42681 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260203 21:10:45.793874 3114 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.2.32.189:42681)
W20260203 21:10:45.794016 3114 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.2.32.189:42681)
W20260203 21:10:45.794296 3114 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.2.32.189:42681)
W20260203 21:10:45.794730 4300 negotiation.cc:337] Failed RPC negotiation. Trace:
0203 21:10:45.793477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.32.189:42681 (local address 127.2.32.130:40269)
0203 21:10:45.793672 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0203 21:10:45.793685 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0203 21:10:45.793752 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0203 21:10:45.794628 (+ 876us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":119}
W20260203 21:10:45.794785 4223 negotiation.cc:337] Failed RPC negotiation. Trace:
0203 21:10:45.793301 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.32.189:42681 (local address 127.2.32.131:39523)
0203 21:10:45.793446 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0203 21:10:45.793462 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0203 21:10:45.793550 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0203 21:10:45.794682 (+ 1132us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":50}
W20260203 21:10:45.799777 2720 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 1: this message will repeat every 5th retry.
W20260203 21:10:45.815541 3114 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.2.32.189:42681)
I20260203 21:10:45.822633 4143 raft_consensus.cc:493] T b20b6b42ae9c4adcac2d5993abab6e54 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 21:10:45.822753 4143 raft_consensus.cc:515] T b20b6b42ae9c4adcac2d5993abab6e54 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:45.823161 4143 leader_election.cc:290] T b20b6b42ae9c4adcac2d5993abab6e54 P 185c63f61a2645928eeb807d145026b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335)
I20260203 21:10:45.823457 2922 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b20b6b42ae9c4adcac2d5993abab6e54" candidate_uuid: "185c63f61a2645928eeb807d145026b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" is_pre_election: true
I20260203 21:10:45.823582 2922 raft_consensus.cc:2468] T b20b6b42ae9c4adcac2d5993abab6e54 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 185c63f61a2645928eeb807d145026b1 in term 0.
I20260203 21:10:45.823870 2995 leader_election.cc:304] T b20b6b42ae9c4adcac2d5993abab6e54 P 185c63f61a2645928eeb807d145026b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be; no voters:
W20260203 21:10:45.823974 2993 leader_election.cc:343] T b20b6b42ae9c4adcac2d5993abab6e54 P 185c63f61a2645928eeb807d145026b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335): Not found: Tablet not found: b20b6b42ae9c4adcac2d5993abab6e54
I20260203 21:10:45.824137 4143 raft_consensus.cc:2804] T b20b6b42ae9c4adcac2d5993abab6e54 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 21:10:45.824175 4143 raft_consensus.cc:493] T b20b6b42ae9c4adcac2d5993abab6e54 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 21:10:45.824205 4143 raft_consensus.cc:3060] T b20b6b42ae9c4adcac2d5993abab6e54 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:45.824913 4143 raft_consensus.cc:515] T b20b6b42ae9c4adcac2d5993abab6e54 P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:45.825196 4143 leader_election.cc:290] T b20b6b42ae9c4adcac2d5993abab6e54 P 185c63f61a2645928eeb807d145026b1 [CANDIDATE]: Term 1 election: Requested vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335)
I20260203 21:10:45.825449 2922 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b20b6b42ae9c4adcac2d5993abab6e54" candidate_uuid: "185c63f61a2645928eeb807d145026b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d9e0cecab784cc0acc050ca1c89c5be"
I20260203 21:10:45.825559 2922 raft_consensus.cc:3060] T b20b6b42ae9c4adcac2d5993abab6e54 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Advancing to term 1
W20260203 21:10:45.825747 2993 leader_election.cc:343] T b20b6b42ae9c4adcac2d5993abab6e54 P 185c63f61a2645928eeb807d145026b1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335): Not found: Tablet not found: b20b6b42ae9c4adcac2d5993abab6e54
I20260203 21:10:45.826331 2922 raft_consensus.cc:2468] T b20b6b42ae9c4adcac2d5993abab6e54 P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 185c63f61a2645928eeb807d145026b1 in term 1.
I20260203 21:10:45.826562 2995 leader_election.cc:304] T b20b6b42ae9c4adcac2d5993abab6e54 P 185c63f61a2645928eeb807d145026b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be; no voters: 02bdf326542e474cbe62434dd59087dc
I20260203 21:10:45.826735 4143 raft_consensus.cc:2804] T b20b6b42ae9c4adcac2d5993abab6e54 P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260203 21:10:45.826817 4143 raft_consensus.cc:697] T b20b6b42ae9c4adcac2d5993abab6e54 P 185c63f61a2645928eeb807d145026b1 [term 1 LEADER]: Becoming Leader. State: Replica: 185c63f61a2645928eeb807d145026b1, State: Running, Role: LEADER
I20260203 21:10:45.826948 4143 consensus_queue.cc:237] T b20b6b42ae9c4adcac2d5993abab6e54 P 185c63f61a2645928eeb807d145026b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:45.922366 4143 raft_consensus.cc:493] T b6a9b895d5364efe9f6acb1b3e35db91 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 21:10:45.922480 4143 raft_consensus.cc:515] T b6a9b895d5364efe9f6acb1b3e35db91 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:45.922822 4143 leader_election.cc:290] T b6a9b895d5364efe9f6acb1b3e35db91 P 185c63f61a2645928eeb807d145026b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335)
I20260203 21:10:45.923259 2922 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b6a9b895d5364efe9f6acb1b3e35db91" candidate_uuid: "185c63f61a2645928eeb807d145026b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" is_pre_election: true
I20260203 21:10:45.923414 2922 raft_consensus.cc:2468] T b6a9b895d5364efe9f6acb1b3e35db91 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 185c63f61a2645928eeb807d145026b1 in term 0.
W20260203 21:10:45.923501 2993 leader_election.cc:343] T b6a9b895d5364efe9f6acb1b3e35db91 P 185c63f61a2645928eeb807d145026b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335): Not found: Tablet not found: b6a9b895d5364efe9f6acb1b3e35db91
I20260203 21:10:45.923712 2995 leader_election.cc:304] T b6a9b895d5364efe9f6acb1b3e35db91 P 185c63f61a2645928eeb807d145026b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be; no voters: 02bdf326542e474cbe62434dd59087dc
I20260203 21:10:45.923923 4143 raft_consensus.cc:2804] T b6a9b895d5364efe9f6acb1b3e35db91 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 21:10:45.923966 4143 raft_consensus.cc:493] T b6a9b895d5364efe9f6acb1b3e35db91 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 21:10:45.923992 4143 raft_consensus.cc:3060] T b6a9b895d5364efe9f6acb1b3e35db91 P 185c63f61a2645928eeb807d145026b1 [term 0 FOLLOWER]: Advancing to term 1
I20260203 21:10:45.924734 4143 raft_consensus.cc:515] T b6a9b895d5364efe9f6acb1b3e35db91 P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:45.925045 4143 leader_election.cc:290] T b6a9b895d5364efe9f6acb1b3e35db91 P 185c63f61a2645928eeb807d145026b1 [CANDIDATE]: Term 1 election: Requested vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335)
I20260203 21:10:45.925379 2922 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b6a9b895d5364efe9f6acb1b3e35db91" candidate_uuid: "185c63f61a2645928eeb807d145026b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d9e0cecab784cc0acc050ca1c89c5be"
I20260203 21:10:45.925487 2922 raft_consensus.cc:3060] T b6a9b895d5364efe9f6acb1b3e35db91 P 6d9e0cecab784cc0acc050ca1c89c5be [term 0 FOLLOWER]: Advancing to term 1
W20260203 21:10:45.925606 2993 leader_election.cc:343] T b6a9b895d5364efe9f6acb1b3e35db91 P 185c63f61a2645928eeb807d145026b1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335): Not found: Tablet not found: b6a9b895d5364efe9f6acb1b3e35db91
I20260203 21:10:45.926234 2922 raft_consensus.cc:2468] T b6a9b895d5364efe9f6acb1b3e35db91 P 6d9e0cecab784cc0acc050ca1c89c5be [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 185c63f61a2645928eeb807d145026b1 in term 1.
I20260203 21:10:45.926478 2995 leader_election.cc:304] T b6a9b895d5364efe9f6acb1b3e35db91 P 185c63f61a2645928eeb807d145026b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be; no voters: 02bdf326542e474cbe62434dd59087dc
I20260203 21:10:45.926630 4143 raft_consensus.cc:2804] T b6a9b895d5364efe9f6acb1b3e35db91 P 185c63f61a2645928eeb807d145026b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260203 21:10:45.926728 4143 raft_consensus.cc:697] T b6a9b895d5364efe9f6acb1b3e35db91 P 185c63f61a2645928eeb807d145026b1 [term 1 LEADER]: Becoming Leader. State: Replica: 185c63f61a2645928eeb807d145026b1, State: Running, Role: LEADER
I20260203 21:10:45.926865 4143 consensus_queue.cc:237] T b6a9b895d5364efe9f6acb1b3e35db91 P 185c63f61a2645928eeb807d145026b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
W20260203 21:10:46.024253 2720 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 1: this message will repeat every 5th retry.
W20260203 21:10:46.116238 2721 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 1: this message will repeat every 5th retry.
I20260203 21:10:46.117887 4379 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 35397be7e61f4b27a49e9449b9fdf085)
I20260203 21:10:46.117976 4379 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:10:46.118342 4379 leader_election.cc:290] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419), 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681)
W20260203 21:10:46.119282 3897 leader_election.cc:336] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419): Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111)
W20260203 21:10:46.119374 3896 leader_election.cc:336] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681): Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)
I20260203 21:10:46.119464 3896 leader_election.cc:304] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a7e51013f5041898fe34f4b64a59260; no voters: 35397be7e61f4b27a49e9449b9fdf085, 7344d7cd8dea4fa2ae705320daacaf49
I20260203 21:10:46.119582 4379 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260203 21:10:46.142587 4371 consensus_queue.cc:1048] T 0f866dd1de0849758c55ee78fca2e66d P 185c63f61a2645928eeb807d145026b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260203 21:10:46.146620 2993 consensus_peers.cc:597] T 0f866dd1de0849758c55ee78fca2e66d P 185c63f61a2645928eeb807d145026b1 -> Peer 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335): Couldn't send request to peer 02bdf326542e474cbe62434dd59087dc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0f866dd1de0849758c55ee78fca2e66d. This is attempt 1: this message will repeat every 5th retry.
I20260203 21:10:46.281939 4371 consensus_queue.cc:1048] T f693a9c7f1cf4af9bf68f1eb43680c95 P 185c63f61a2645928eeb807d145026b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260203 21:10:46.285255 2993 consensus_peers.cc:597] T f693a9c7f1cf4af9bf68f1eb43680c95 P 185c63f61a2645928eeb807d145026b1 -> Peer 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335): Couldn't send request to peer 02bdf326542e474cbe62434dd59087dc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f693a9c7f1cf4af9bf68f1eb43680c95. This is attempt 1: this message will repeat every 5th retry.
I20260203 21:10:46.303625 4143 consensus_queue.cc:1048] T b20b6b42ae9c4adcac2d5993abab6e54 P 185c63f61a2645928eeb807d145026b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260203 21:10:46.307746 2993 consensus_peers.cc:597] T b20b6b42ae9c4adcac2d5993abab6e54 P 185c63f61a2645928eeb807d145026b1 -> Peer 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335): Couldn't send request to peer 02bdf326542e474cbe62434dd59087dc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20b6b42ae9c4adcac2d5993abab6e54. This is attempt 1: this message will repeat every 5th retry.
I20260203 21:10:46.491016 4387 raft_consensus.cc:493] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:10:46.491163 4387 raft_consensus.cc:515] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:46.491586 4387 leader_election.cc:290] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:10:46.492211 2721 leader_election.cc:343] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 7786ef435bbd44daae12d3ee4728efb9
W20260203 21:10:46.492314 2720 leader_election.cc:343] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 7786ef435bbd44daae12d3ee4728efb9
I20260203 21:10:46.492406 2720 leader_election.cc:304] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:10:46.492537 4387 raft_consensus.cc:2749] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260203 21:10:46.539906 2993 consensus_peers.cc:597] T b6a9b895d5364efe9f6acb1b3e35db91 P 185c63f61a2645928eeb807d145026b1 -> Peer 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335): Couldn't send request to peer 02bdf326542e474cbe62434dd59087dc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b6a9b895d5364efe9f6acb1b3e35db91. This is attempt 1: this message will repeat every 5th retry.
I20260203 21:10:46.546444 4393 consensus_queue.cc:1048] T b6a9b895d5364efe9f6acb1b3e35db91 P 185c63f61a2645928eeb807d145026b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 21:10:46.629977 4397 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 35397be7e61f4b27a49e9449b9fdf085)
I20260203 21:10:46.630115 4397 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:10:46.630546 4397 leader_election.cc:290] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419), 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681)
W20260203 21:10:46.631745 3897 leader_election.cc:336] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419): Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111)
W20260203 21:10:46.631839 3896 leader_election.cc:336] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681): Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)
I20260203 21:10:46.631913 3896 leader_election.cc:304] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a7e51013f5041898fe34f4b64a59260; no voters: 35397be7e61f4b27a49e9449b9fdf085, 7344d7cd8dea4fa2ae705320daacaf49
I20260203 21:10:46.632047 4397 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260203 21:10:46.639009 4401 ts_tablet_manager.cc:933] T 0f866dd1de0849758c55ee78fca2e66d P 02bdf326542e474cbe62434dd59087dc: Initiating tablet copy from peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
I20260203 21:10:46.639309 4401 tablet_copy_client.cc:323] T 0f866dd1de0849758c55ee78fca2e66d P 02bdf326542e474cbe62434dd59087dc: tablet copy: Beginning tablet copy session from remote peer at address 127.2.32.131:40223
I20260203 21:10:46.639740 3079 tablet_copy_service.cc:140] P 185c63f61a2645928eeb807d145026b1: Received BeginTabletCopySession request for tablet 0f866dd1de0849758c55ee78fca2e66d from peer 02bdf326542e474cbe62434dd59087dc ({username='slave'} at 127.2.32.129:53319)
I20260203 21:10:46.639834 3079 tablet_copy_service.cc:161] P 185c63f61a2645928eeb807d145026b1: Beginning new tablet copy session on tablet 0f866dd1de0849758c55ee78fca2e66d from peer 02bdf326542e474cbe62434dd59087dc at {username='slave'} at 127.2.32.129:53319: session id = 02bdf326542e474cbe62434dd59087dc-0f866dd1de0849758c55ee78fca2e66d
I20260203 21:10:46.640527 3079 tablet_copy_source_session.cc:215] T 0f866dd1de0849758c55ee78fca2e66d P 185c63f61a2645928eeb807d145026b1: Tablet Copy: opened 0 blocks and 1 log segments
I20260203 21:10:46.641229 4401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f866dd1de0849758c55ee78fca2e66d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:46.642931 4401 tablet_copy_client.cc:806] T 0f866dd1de0849758c55ee78fca2e66d P 02bdf326542e474cbe62434dd59087dc: tablet copy: Starting download of 0 data blocks...
I20260203 21:10:46.643066 4401 tablet_copy_client.cc:670] T 0f866dd1de0849758c55ee78fca2e66d P 02bdf326542e474cbe62434dd59087dc: tablet copy: Starting download of 1 WAL segments...
I20260203 21:10:46.644066 4401 tablet_copy_client.cc:538] T 0f866dd1de0849758c55ee78fca2e66d P 02bdf326542e474cbe62434dd59087dc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260203 21:10:46.645535 4401 tablet_bootstrap.cc:492] T 0f866dd1de0849758c55ee78fca2e66d P 02bdf326542e474cbe62434dd59087dc: Bootstrap starting.
I20260203 21:10:46.648207 4401 tablet_bootstrap.cc:492] T 0f866dd1de0849758c55ee78fca2e66d P 02bdf326542e474cbe62434dd59087dc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260203 21:10:46.648382 4401 tablet_bootstrap.cc:492] T 0f866dd1de0849758c55ee78fca2e66d P 02bdf326542e474cbe62434dd59087dc: Bootstrap complete.
I20260203 21:10:46.648492 4401 ts_tablet_manager.cc:1403] T 0f866dd1de0849758c55ee78fca2e66d P 02bdf326542e474cbe62434dd59087dc: Time spent bootstrapping tablet: real 0.003s user 0.003s sys 0.000s
I20260203 21:10:46.648978 4401 raft_consensus.cc:359] T 0f866dd1de0849758c55ee78fca2e66d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:46.649099 4401 raft_consensus.cc:740] T 0f866dd1de0849758c55ee78fca2e66d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02bdf326542e474cbe62434dd59087dc, State: Initialized, Role: FOLLOWER
I20260203 21:10:46.649245 4401 consensus_queue.cc:260] T 0f866dd1de0849758c55ee78fca2e66d P 02bdf326542e474cbe62434dd59087dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:46.649571 4401 ts_tablet_manager.cc:1434] T 0f866dd1de0849758c55ee78fca2e66d P 02bdf326542e474cbe62434dd59087dc: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260203 21:10:46.650791 3079 tablet_copy_service.cc:342] P 185c63f61a2645928eeb807d145026b1: Request end of tablet copy session 02bdf326542e474cbe62434dd59087dc-0f866dd1de0849758c55ee78fca2e66d received from {username='slave'} at 127.2.32.129:53319
I20260203 21:10:46.650882 3079 tablet_copy_service.cc:434] P 185c63f61a2645928eeb807d145026b1: ending tablet copy session 02bdf326542e474cbe62434dd59087dc-0f866dd1de0849758c55ee78fca2e66d on tablet 0f866dd1de0849758c55ee78fca2e66d with peer 02bdf326542e474cbe62434dd59087dc
I20260203 21:10:46.762080 4401 ts_tablet_manager.cc:933] T f693a9c7f1cf4af9bf68f1eb43680c95 P 02bdf326542e474cbe62434dd59087dc: Initiating tablet copy from peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
I20260203 21:10:46.762447 4401 tablet_copy_client.cc:323] T f693a9c7f1cf4af9bf68f1eb43680c95 P 02bdf326542e474cbe62434dd59087dc: tablet copy: Beginning tablet copy session from remote peer at address 127.2.32.131:40223
I20260203 21:10:46.762924 3079 tablet_copy_service.cc:140] P 185c63f61a2645928eeb807d145026b1: Received BeginTabletCopySession request for tablet f693a9c7f1cf4af9bf68f1eb43680c95 from peer 02bdf326542e474cbe62434dd59087dc ({username='slave'} at 127.2.32.129:53319)
I20260203 21:10:46.763033 3079 tablet_copy_service.cc:161] P 185c63f61a2645928eeb807d145026b1: Beginning new tablet copy session on tablet f693a9c7f1cf4af9bf68f1eb43680c95 from peer 02bdf326542e474cbe62434dd59087dc at {username='slave'} at 127.2.32.129:53319: session id = 02bdf326542e474cbe62434dd59087dc-f693a9c7f1cf4af9bf68f1eb43680c95
I20260203 21:10:46.763993 3079 tablet_copy_source_session.cc:215] T f693a9c7f1cf4af9bf68f1eb43680c95 P 185c63f61a2645928eeb807d145026b1: Tablet Copy: opened 0 blocks and 1 log segments
I20260203 21:10:46.764773 4401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f693a9c7f1cf4af9bf68f1eb43680c95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:46.766572 4401 tablet_copy_client.cc:806] T f693a9c7f1cf4af9bf68f1eb43680c95 P 02bdf326542e474cbe62434dd59087dc: tablet copy: Starting download of 0 data blocks...
I20260203 21:10:46.766721 4401 tablet_copy_client.cc:670] T f693a9c7f1cf4af9bf68f1eb43680c95 P 02bdf326542e474cbe62434dd59087dc: tablet copy: Starting download of 1 WAL segments...
I20260203 21:10:46.767853 4401 tablet_copy_client.cc:538] T f693a9c7f1cf4af9bf68f1eb43680c95 P 02bdf326542e474cbe62434dd59087dc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260203 21:10:46.768849 4401 tablet_bootstrap.cc:492] T f693a9c7f1cf4af9bf68f1eb43680c95 P 02bdf326542e474cbe62434dd59087dc: Bootstrap starting.
I20260203 21:10:46.771552 4401 tablet_bootstrap.cc:492] T f693a9c7f1cf4af9bf68f1eb43680c95 P 02bdf326542e474cbe62434dd59087dc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260203 21:10:46.771763 4401 tablet_bootstrap.cc:492] T f693a9c7f1cf4af9bf68f1eb43680c95 P 02bdf326542e474cbe62434dd59087dc: Bootstrap complete.
I20260203 21:10:46.771896 4401 ts_tablet_manager.cc:1403] T f693a9c7f1cf4af9bf68f1eb43680c95 P 02bdf326542e474cbe62434dd59087dc: Time spent bootstrapping tablet: real 0.003s user 0.003s sys 0.001s
I20260203 21:10:46.772282 4401 raft_consensus.cc:359] T f693a9c7f1cf4af9bf68f1eb43680c95 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:46.772377 4401 raft_consensus.cc:740] T f693a9c7f1cf4af9bf68f1eb43680c95 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02bdf326542e474cbe62434dd59087dc, State: Initialized, Role: FOLLOWER
I20260203 21:10:46.772495 4401 consensus_queue.cc:260] T f693a9c7f1cf4af9bf68f1eb43680c95 P 02bdf326542e474cbe62434dd59087dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:46.772745 4401 ts_tablet_manager.cc:1434] T f693a9c7f1cf4af9bf68f1eb43680c95 P 02bdf326542e474cbe62434dd59087dc: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260203 21:10:46.773665 3079 tablet_copy_service.cc:342] P 185c63f61a2645928eeb807d145026b1: Request end of tablet copy session 02bdf326542e474cbe62434dd59087dc-f693a9c7f1cf4af9bf68f1eb43680c95 received from {username='slave'} at 127.2.32.129:53319
I20260203 21:10:46.773738 3079 tablet_copy_service.cc:434] P 185c63f61a2645928eeb807d145026b1: ending tablet copy session 02bdf326542e474cbe62434dd59087dc-f693a9c7f1cf4af9bf68f1eb43680c95 on tablet f693a9c7f1cf4af9bf68f1eb43680c95 with peer 02bdf326542e474cbe62434dd59087dc
I20260203 21:10:46.911136 4401 ts_tablet_manager.cc:933] T b20b6b42ae9c4adcac2d5993abab6e54 P 02bdf326542e474cbe62434dd59087dc: Initiating tablet copy from peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
I20260203 21:10:46.911473 4401 tablet_copy_client.cc:323] T b20b6b42ae9c4adcac2d5993abab6e54 P 02bdf326542e474cbe62434dd59087dc: tablet copy: Beginning tablet copy session from remote peer at address 127.2.32.131:40223
I20260203 21:10:46.911979 3079 tablet_copy_service.cc:140] P 185c63f61a2645928eeb807d145026b1: Received BeginTabletCopySession request for tablet b20b6b42ae9c4adcac2d5993abab6e54 from peer 02bdf326542e474cbe62434dd59087dc ({username='slave'} at 127.2.32.129:53319)
I20260203 21:10:46.912086 3079 tablet_copy_service.cc:161] P 185c63f61a2645928eeb807d145026b1: Beginning new tablet copy session on tablet b20b6b42ae9c4adcac2d5993abab6e54 from peer 02bdf326542e474cbe62434dd59087dc at {username='slave'} at 127.2.32.129:53319: session id = 02bdf326542e474cbe62434dd59087dc-b20b6b42ae9c4adcac2d5993abab6e54
I20260203 21:10:46.912811 3079 tablet_copy_source_session.cc:215] T b20b6b42ae9c4adcac2d5993abab6e54 P 185c63f61a2645928eeb807d145026b1: Tablet Copy: opened 0 blocks and 1 log segments
I20260203 21:10:46.913599 4401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b20b6b42ae9c4adcac2d5993abab6e54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:46.915243 4401 tablet_copy_client.cc:806] T b20b6b42ae9c4adcac2d5993abab6e54 P 02bdf326542e474cbe62434dd59087dc: tablet copy: Starting download of 0 data blocks...
I20260203 21:10:46.915411 4401 tablet_copy_client.cc:670] T b20b6b42ae9c4adcac2d5993abab6e54 P 02bdf326542e474cbe62434dd59087dc: tablet copy: Starting download of 1 WAL segments...
I20260203 21:10:46.916611 4401 tablet_copy_client.cc:538] T b20b6b42ae9c4adcac2d5993abab6e54 P 02bdf326542e474cbe62434dd59087dc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260203 21:10:46.917608 4401 tablet_bootstrap.cc:492] T b20b6b42ae9c4adcac2d5993abab6e54 P 02bdf326542e474cbe62434dd59087dc: Bootstrap starting.
I20260203 21:10:46.920173 4401 tablet_bootstrap.cc:492] T b20b6b42ae9c4adcac2d5993abab6e54 P 02bdf326542e474cbe62434dd59087dc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260203 21:10:46.920358 4401 tablet_bootstrap.cc:492] T b20b6b42ae9c4adcac2d5993abab6e54 P 02bdf326542e474cbe62434dd59087dc: Bootstrap complete.
I20260203 21:10:46.920485 4401 ts_tablet_manager.cc:1403] T b20b6b42ae9c4adcac2d5993abab6e54 P 02bdf326542e474cbe62434dd59087dc: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.003s
I20260203 21:10:46.920888 4401 raft_consensus.cc:359] T b20b6b42ae9c4adcac2d5993abab6e54 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:46.921003 4401 raft_consensus.cc:740] T b20b6b42ae9c4adcac2d5993abab6e54 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02bdf326542e474cbe62434dd59087dc, State: Initialized, Role: FOLLOWER
I20260203 21:10:46.921121 4401 consensus_queue.cc:260] T b20b6b42ae9c4adcac2d5993abab6e54 P 02bdf326542e474cbe62434dd59087dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:46.921370 4401 ts_tablet_manager.cc:1434] T b20b6b42ae9c4adcac2d5993abab6e54 P 02bdf326542e474cbe62434dd59087dc: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260203 21:10:46.922461 3079 tablet_copy_service.cc:342] P 185c63f61a2645928eeb807d145026b1: Request end of tablet copy session 02bdf326542e474cbe62434dd59087dc-b20b6b42ae9c4adcac2d5993abab6e54 received from {username='slave'} at 127.2.32.129:53319
I20260203 21:10:46.922544 3079 tablet_copy_service.cc:434] P 185c63f61a2645928eeb807d145026b1: ending tablet copy session 02bdf326542e474cbe62434dd59087dc-b20b6b42ae9c4adcac2d5993abab6e54 on tablet b20b6b42ae9c4adcac2d5993abab6e54 with peer 02bdf326542e474cbe62434dd59087dc
I20260203 21:10:46.991544 4401 ts_tablet_manager.cc:933] T b6a9b895d5364efe9f6acb1b3e35db91 P 02bdf326542e474cbe62434dd59087dc: Initiating tablet copy from peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
I20260203 21:10:46.991922 4401 tablet_copy_client.cc:323] T b6a9b895d5364efe9f6acb1b3e35db91 P 02bdf326542e474cbe62434dd59087dc: tablet copy: Beginning tablet copy session from remote peer at address 127.2.32.131:40223
I20260203 21:10:46.992451 3079 tablet_copy_service.cc:140] P 185c63f61a2645928eeb807d145026b1: Received BeginTabletCopySession request for tablet b6a9b895d5364efe9f6acb1b3e35db91 from peer 02bdf326542e474cbe62434dd59087dc ({username='slave'} at 127.2.32.129:53319)
I20260203 21:10:46.992564 3079 tablet_copy_service.cc:161] P 185c63f61a2645928eeb807d145026b1: Beginning new tablet copy session on tablet b6a9b895d5364efe9f6acb1b3e35db91 from peer 02bdf326542e474cbe62434dd59087dc at {username='slave'} at 127.2.32.129:53319: session id = 02bdf326542e474cbe62434dd59087dc-b6a9b895d5364efe9f6acb1b3e35db91
I20260203 21:10:46.993321 3079 tablet_copy_source_session.cc:215] T b6a9b895d5364efe9f6acb1b3e35db91 P 185c63f61a2645928eeb807d145026b1: Tablet Copy: opened 0 blocks and 1 log segments
I20260203 21:10:46.994177 4401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6a9b895d5364efe9f6acb1b3e35db91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 21:10:46.996074 4401 tablet_copy_client.cc:806] T b6a9b895d5364efe9f6acb1b3e35db91 P 02bdf326542e474cbe62434dd59087dc: tablet copy: Starting download of 0 data blocks...
I20260203 21:10:46.996212 4401 tablet_copy_client.cc:670] T b6a9b895d5364efe9f6acb1b3e35db91 P 02bdf326542e474cbe62434dd59087dc: tablet copy: Starting download of 1 WAL segments...
I20260203 21:10:46.997260 4401 tablet_copy_client.cc:538] T b6a9b895d5364efe9f6acb1b3e35db91 P 02bdf326542e474cbe62434dd59087dc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260203 21:10:46.998251 4401 tablet_bootstrap.cc:492] T b6a9b895d5364efe9f6acb1b3e35db91 P 02bdf326542e474cbe62434dd59087dc: Bootstrap starting.
I20260203 21:10:47.000876 4401 tablet_bootstrap.cc:492] T b6a9b895d5364efe9f6acb1b3e35db91 P 02bdf326542e474cbe62434dd59087dc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260203 21:10:47.001096 4401 tablet_bootstrap.cc:492] T b6a9b895d5364efe9f6acb1b3e35db91 P 02bdf326542e474cbe62434dd59087dc: Bootstrap complete.
I20260203 21:10:47.001231 4401 ts_tablet_manager.cc:1403] T b6a9b895d5364efe9f6acb1b3e35db91 P 02bdf326542e474cbe62434dd59087dc: Time spent bootstrapping tablet: real 0.003s user 0.003s sys 0.000s
I20260203 21:10:47.001693 4401 raft_consensus.cc:359] T b6a9b895d5364efe9f6acb1b3e35db91 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:47.001782 4401 raft_consensus.cc:740] T b6a9b895d5364efe9f6acb1b3e35db91 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02bdf326542e474cbe62434dd59087dc, State: Initialized, Role: FOLLOWER
I20260203 21:10:47.001904 4401 consensus_queue.cc:260] T b6a9b895d5364efe9f6acb1b3e35db91 P 02bdf326542e474cbe62434dd59087dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:47.002182 4401 ts_tablet_manager.cc:1434] T b6a9b895d5364efe9f6acb1b3e35db91 P 02bdf326542e474cbe62434dd59087dc: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260203 21:10:47.002843 3079 tablet_copy_service.cc:342] P 185c63f61a2645928eeb807d145026b1: Request end of tablet copy session 02bdf326542e474cbe62434dd59087dc-b6a9b895d5364efe9f6acb1b3e35db91 received from {username='slave'} at 127.2.32.129:53319
I20260203 21:10:47.002938 3079 tablet_copy_service.cc:434] P 185c63f61a2645928eeb807d145026b1: ending tablet copy session 02bdf326542e474cbe62434dd59087dc-b6a9b895d5364efe9f6acb1b3e35db91 on tablet b6a9b895d5364efe9f6acb1b3e35db91 with peer 02bdf326542e474cbe62434dd59087dc
I20260203 21:10:47.063503 4388 raft_consensus.cc:493] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:10:47.063642 4388 raft_consensus.cc:515] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:47.064091 4388 leader_election.cc:290] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:10:47.064765 2721 leader_election.cc:343] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 4d6ed92d766244489541e1c280afacb5
W20260203 21:10:47.064849 2720 leader_election.cc:343] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 4d6ed92d766244489541e1c280afacb5
I20260203 21:10:47.064945 2720 leader_election.cc:304] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:10:47.065075 4388 raft_consensus.cc:2749] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:10:47.113919 4388 raft_consensus.cc:493] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d9e0cecab784cc0acc050ca1c89c5be)
I20260203 21:10:47.114085 4388 raft_consensus.cc:515] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:47.114523 4388 leader_election.cc:290] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223), 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897)
W20260203 21:10:47.115190 2720 leader_election.cc:343] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 6606bf5d7de047cda4a0523197210c1a
W20260203 21:10:47.115296 2721 leader_election.cc:343] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 6606bf5d7de047cda4a0523197210c1a
I20260203 21:10:47.115383 2721 leader_election.cc:304] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:10:47.115523 4388 raft_consensus.cc:2749] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:10:47.178923 2784 raft_consensus.cc:1217] T 0f866dd1de0849758c55ee78fca2e66d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Deduplicated request from leader. Original: 0.0->[1.1-1.1] Dedup: 1.1->[]
I20260203 21:10:47.283350 2178 external_mini_cluster.cc:1658] Killing /tmp/dist-test-task0vmSZW/build/debug/bin/kudu with pid 3879
I20260203 21:10:47.286450 2784 raft_consensus.cc:1217] T b20b6b42ae9c4adcac2d5993abab6e54 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Deduplicated request from leader. Original: 0.0->[1.1-1.1] Dedup: 1.1->[]
W20260203 21:10:47.288822 2992 connection.cc:537] client connection to 127.2.32.188:33665 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260203 21:10:47.288822 2718 connection.cc:537] client connection to 127.2.32.188:33665 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260203 21:10:47.355185 2784 raft_consensus.cc:1217] T f693a9c7f1cf4af9bf68f1eb43680c95 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Deduplicated request from leader. Original: 0.0->[1.1-1.1] Dedup: 1.1->[]
I20260203 21:10:47.383631 4387 raft_consensus.cc:493] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d9e0cecab784cc0acc050ca1c89c5be)
I20260203 21:10:47.383810 4387 raft_consensus.cc:515] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:47.384241 4387 leader_election.cc:290] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:10:47.384943 2720 leader_election.cc:343] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: a375114bebc64385827b7b6e0060d1e4
W20260203 21:10:47.385052 2721 leader_election.cc:343] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: a375114bebc64385827b7b6e0060d1e4
I20260203 21:10:47.385151 2721 leader_election.cc:304] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:10:47.385358 4387 raft_consensus.cc:2749] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:10:47.480166 2784 raft_consensus.cc:1217] T b6a9b895d5364efe9f6acb1b3e35db91 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Deduplicated request from leader. Original: 0.0->[1.1-1.1] Dedup: 1.1->[]
I20260203 21:10:47.916749 2178 external_mini_cluster.cc:1366] Running /tmp/dist-test-task0vmSZW/build/debug/bin/kudu
/tmp/dist-test-task0vmSZW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.32.188:33665
--webserver_interface=127.2.32.188
--webserver_port=39751
--builtin_ntp_servers=127.2.32.148:39497
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665
--hive_metastore_uris=thrift://127.0.0.1:33779
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260203 21:10:48.024420 4422 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260203 21:10:48.024663 4422 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260203 21:10:48.024726 4422 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260203 21:10:48.028069 4422 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260203 21:10:48.028128 4422 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260203 21:10:48.028153 4422 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260203 21:10:48.028178 4422 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260203 21:10:48.031967 4422 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.32.148:39497
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-2/wal
--hive_metastore_uris=thrift://127.0.0.1:33779
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.32.188:33665
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.2.32.188
--webserver_port=39751
--never_fsync=true
--heap_profile_path=/tmp/kudu.4422
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 0efbebd487e7d0c7f21ab0d5a91e0fa70046af83
build type DEBUG
built by None at 03 Feb 2026 20:50:43 UTC on 24a791456cd2
build id 10330
I20260203 21:10:48.032996 4422 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260203 21:10:48.034049 4422 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260203 21:10:48.039805 4433 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260203 21:10:48.039822 4431 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260203 21:10:48.039953 4422 server_base.cc:1060] running on GCE node
W20260203 21:10:48.040071 4430 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260203 21:10:48.040616 4422 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260203 21:10:48.041538 4422 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260203 21:10:48.042695 4422 hybrid_clock.cc:648] HybridClock initialized: now 1770153048042677 us; error 37 us; skew 500 ppm
I20260203 21:10:48.044389 4422 webserver.cc:492] Webserver started at http://127.2.32.188:39751/ using document root <none> and password file <none>
I20260203 21:10:48.045027 4422 fs_manager.cc:362] Metadata directory not provided
I20260203 21:10:48.045094 4422 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260203 21:10:48.048631 4422 fs_manager.cc:714] Time spent opening directory manager: real 0.002s user 0.000s sys 0.003s
I20260203 21:10:48.050590 4439 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260203 21:10:48.051743 4422 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260203 21:10:48.051847 4422 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-2/data,/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-2/wal
uuid: "8a7e51013f5041898fe34f4b64a59260"
format_stamp: "Formatted at 2026-02-03 21:10:25 on dist-test-slave-npns"
I20260203 21:10:48.052205 4422 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260203 21:10:48.076685 4422 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260203 21:10:48.077322 4422 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260203 21:10:48.077479 4422 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260203 21:10:48.085080 4422 rpc_server.cc:307] RPC server started. Bound to: 127.2.32.188:33665
I20260203 21:10:48.085078 4493 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.32.188:33665 every 8 connection(s)
I20260203 21:10:48.086133 4422 server_base.cc:1192] Dumped server information to /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-2/data/info.pb
I20260203 21:10:48.086905 2178 external_mini_cluster.cc:1428] Started /tmp/dist-test-task0vmSZW/build/debug/bin/kudu as pid 4422
I20260203 21:10:48.091140 4494 sys_catalog.cc:263] Verifying existing consensus state
I20260203 21:10:48.093254 4494 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260: Bootstrap starting.
I20260203 21:10:48.107951 4494 log.cc:826] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260: Log is configured to *not* fsync() on all Append() calls
I20260203 21:10:48.161794 4494 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260: Bootstrap replayed 1/1 log segments. Stats: ops{read=114 overwritten=0 applied=114 ignored=0} inserts{seen=71 ignored=0} mutations{seen=99 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260203 21:10:48.162153 4494 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260: Bootstrap complete.
I20260203 21:10:48.164753 4494 raft_consensus.cc:359] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:10:48.165078 4494 raft_consensus.cc:740] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a7e51013f5041898fe34f4b64a59260, State: Initialized, Role: FOLLOWER
I20260203 21:10:48.165498 4494 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 114, Last appended: 7.114, Last appended by leader: 114, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:10:48.165903 4498 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 7 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } } }
I20260203 21:10:48.166029 4498 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [sys.catalog]: This master's current role is: FOLLOWER
I20260203 21:10:48.166530 4494 sys_catalog.cc:565] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [sys.catalog]: configured and running, proceeding with master startup.
I20260203 21:10:48.172859 4512 catalog_manager.cc:1269] Loaded cluster ID: f46367a11713484f92c1d2be2585f5a6
I20260203 21:10:48.173017 4512 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260: loading cluster ID for follower catalog manager: success
I20260203 21:10:48.171556 4422 master_runner.cc:186] Error getting master registration for 127.2.32.190:35419: Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111),
I20260203 21:10:48.173660 4422 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260203 21:10:48.178385 4512 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260: acquiring CA information for follower catalog manager: success
I20260203 21:10:48.180622 4512 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260203 21:10:48.243906 2831 heartbeater.cc:344] Connected to a master server at 127.2.32.188:33665
I20260203 21:10:48.246694 4458 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "02bdf326542e474cbe62434dd59087dc" instance_seqno: 1770153026114330) as {username='slave'} at 127.2.32.129:56025; Asking this server to re-register.
I20260203 21:10:48.247339 2831 heartbeater.cc:461] Registering TS with master...
I20260203 21:10:48.248837 4458 ts_manager.cc:194] Registered new tserver with Master: 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335)
I20260203 21:10:48.485709 3105 heartbeater.cc:344] Connected to a master server at 127.2.32.188:33665
I20260203 21:10:48.486922 4458 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "185c63f61a2645928eeb807d145026b1" instance_seqno: 1770153026474418) as {username='slave'} at 127.2.32.131:45631; Asking this server to re-register.
I20260203 21:10:48.487473 3105 heartbeater.cc:461] Registering TS with master...
I20260203 21:10:48.488541 4458 ts_manager.cc:194] Registered new tserver with Master: 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
I20260203 21:10:48.558141 2969 heartbeater.cc:344] Connected to a master server at 127.2.32.188:33665
I20260203 21:10:48.559063 4458 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" instance_seqno: 1770153026289802) as {username='slave'} at 127.2.32.130:44223; Asking this server to re-register.
I20260203 21:10:48.559442 2969 heartbeater.cc:461] Registering TS with master...
I20260203 21:10:48.560320 4458 ts_manager.cc:194] Registered new tserver with Master: 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897)
I20260203 21:10:48.659348 4498 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 21:10:48.659535 4498 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:10:48.660723 4498 leader_election.cc:290] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419), 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681)
W20260203 21:10:48.661120 4445 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111)
W20260203 21:10:48.661834 4444 leader_election.cc:336] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681): Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)
W20260203 21:10:48.661932 4445 leader_election.cc:336] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419): Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111)
I20260203 21:10:48.662015 4445 leader_election.cc:304] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a7e51013f5041898fe34f4b64a59260; no voters: 35397be7e61f4b27a49e9449b9fdf085, 7344d7cd8dea4fa2ae705320daacaf49
I20260203 21:10:48.662220 4498 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260203 21:10:49.012092 4388 raft_consensus.cc:493] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:10:49.012243 4388 raft_consensus.cc:515] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:49.012661 4388 leader_election.cc:290] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:10:49.013463 2721 leader_election.cc:343] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 4d6ed92d766244489541e1c280afacb5
W20260203 21:10:49.013585 2720 leader_election.cc:343] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 4d6ed92d766244489541e1c280afacb5
I20260203 21:10:49.013650 2720 leader_election.cc:304] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:10:49.013777 4388 raft_consensus.cc:2749] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:10:49.141004 4388 raft_consensus.cc:493] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d9e0cecab784cc0acc050ca1c89c5be)
I20260203 21:10:49.141140 4388 raft_consensus.cc:515] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:49.141561 4388 leader_election.cc:290] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223), 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897)
W20260203 21:10:49.142217 2721 leader_election.cc:343] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 6606bf5d7de047cda4a0523197210c1a
W20260203 21:10:49.142344 2720 leader_election.cc:343] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 6606bf5d7de047cda4a0523197210c1a
I20260203 21:10:49.142431 2720 leader_election.cc:304] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:10:49.142580 4388 raft_consensus.cc:2749] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:10:49.285818 4530 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 21:10:49.285934 4530 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:10:49.286347 4530 leader_election.cc:290] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419), 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681)
W20260203 21:10:49.287422 4444 leader_election.cc:336] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681): Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)
W20260203 21:10:49.287515 4445 leader_election.cc:336] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419): Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111)
I20260203 21:10:49.287619 4445 leader_election.cc:304] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a7e51013f5041898fe34f4b64a59260; no voters: 35397be7e61f4b27a49e9449b9fdf085, 7344d7cd8dea4fa2ae705320daacaf49
I20260203 21:10:49.287783 4530 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260203 21:10:49.681178 4388 raft_consensus.cc:493] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:10:49.681360 4388 raft_consensus.cc:515] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } }
I20260203 21:10:49.681843 4388 leader_election.cc:290] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223), 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897)
W20260203 21:10:49.682392 2720 leader_election.cc:343] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 06b80064d47349c2830718f553ba3d7d
W20260203 21:10:49.682572 2721 leader_election.cc:343] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 06b80064d47349c2830718f553ba3d7d
I20260203 21:10:49.682636 2721 leader_election.cc:304] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:10:49.682777 4388 raft_consensus.cc:2749] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:10:50.061803 4388 raft_consensus.cc:493] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:10:50.061928 4388 raft_consensus.cc:515] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:50.062294 4388 leader_election.cc:290] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:10:50.062904 2721 leader_election.cc:343] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 7786ef435bbd44daae12d3ee4728efb9
W20260203 21:10:50.063021 2720 leader_election.cc:343] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 7786ef435bbd44daae12d3ee4728efb9
I20260203 21:10:50.063114 2720 leader_election.cc:304] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:10:50.063262 4388 raft_consensus.cc:2749] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:10:50.199031 4545 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 21:10:50.199151 4545 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:10:50.199532 4545 leader_election.cc:290] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419), 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681)
W20260203 21:10:50.200688 4444 leader_election.cc:336] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681): Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)
W20260203 21:10:50.200835 4445 leader_election.cc:336] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419): Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111)
I20260203 21:10:50.200909 4445 leader_election.cc:304] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a7e51013f5041898fe34f4b64a59260; no voters: 35397be7e61f4b27a49e9449b9fdf085, 7344d7cd8dea4fa2ae705320daacaf49
I20260203 21:10:50.201050 4545 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260203 21:10:50.542686 2178 external_mini_cluster.cc:1658] Killing /tmp/dist-test-task0vmSZW/build/debug/bin/kudu with pid 4422
W20260203 21:10:50.548310 3112 connection.cc:537] client connection to 127.2.32.188:33665 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260203 21:10:50.676442 2720 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 6: this message will repeat every 5th retry.
W20260203 21:10:50.714377 2720 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 6: this message will repeat every 5th retry.
W20260203 21:10:50.884413 2721 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 6: this message will repeat every 5th retry.
W20260203 21:10:51.301184 2721 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 6: this message will repeat every 5th retry.
I20260203 21:10:51.326519 4388 raft_consensus.cc:493] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d9e0cecab784cc0acc050ca1c89c5be)
I20260203 21:10:51.326660 4388 raft_consensus.cc:515] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:51.327107 4388 leader_election.cc:290] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223), 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897)
W20260203 21:10:51.327834 2720 leader_election.cc:343] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 6606bf5d7de047cda4a0523197210c1a
W20260203 21:10:51.327935 2721 leader_election.cc:343] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 6606bf5d7de047cda4a0523197210c1a
I20260203 21:10:51.328017 2721 leader_election.cc:304] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:10:51.328171 4388 raft_consensus.cc:2749] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:10:51.548030 2178 external_mini_cluster.cc:1366] Running /tmp/dist-test-task0vmSZW/build/debug/bin/kudu
/tmp/dist-test-task0vmSZW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.32.188:33665
--webserver_interface=127.2.32.188
--webserver_port=39751
--builtin_ntp_servers=127.2.32.148:39497
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665
--hive_metastore_uris=thrift://127.0.0.1:33779
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260203 21:10:51.652567 4563 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260203 21:10:51.652791 4563 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260203 21:10:51.652837 4563 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260203 21:10:51.656082 4563 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260203 21:10:51.656137 4563 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260203 21:10:51.656159 4563 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260203 21:10:51.656189 4563 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260203 21:10:51.659904 4563 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.32.148:39497
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-2/wal
--hive_metastore_uris=thrift://127.0.0.1:33779
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.32.188:33665
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.2.32.188
--webserver_port=39751
--never_fsync=true
--heap_profile_path=/tmp/kudu.4563
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 0efbebd487e7d0c7f21ab0d5a91e0fa70046af83
build type DEBUG
built by None at 03 Feb 2026 20:50:43 UTC on 24a791456cd2
build id 10330
I20260203 21:10:51.660934 4563 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260203 21:10:51.662000 4563 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260203 21:10:51.667268 4569 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260203 21:10:51.667330 4570 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260203 21:10:51.667325 4572 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260203 21:10:51.667533 4563 server_base.cc:1060] running on GCE node
I20260203 21:10:51.668076 4563 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260203 21:10:51.668960 4563 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260203 21:10:51.670109 4563 hybrid_clock.cc:648] HybridClock initialized: now 1770153051670094 us; error 32 us; skew 500 ppm
I20260203 21:10:51.671716 4563 webserver.cc:492] Webserver started at http://127.2.32.188:39751/ using document root <none> and password file <none>
I20260203 21:10:51.672298 4563 fs_manager.cc:362] Metadata directory not provided
I20260203 21:10:51.672354 4563 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260203 21:10:51.675580 4563 fs_manager.cc:714] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260203 21:10:51.677676 4578 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260203 21:10:51.678630 4563 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260203 21:10:51.678732 4563 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-2/data,/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-2/wal
uuid: "8a7e51013f5041898fe34f4b64a59260"
format_stamp: "Formatted at 2026-02-03 21:10:25 on dist-test-slave-npns"
I20260203 21:10:51.679092 4563 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260203 21:10:51.705092 4563 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260203 21:10:51.705750 4563 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260203 21:10:51.705904 4563 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260203 21:10:51.712791 4630 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.32.188:33665 every 8 connection(s)
I20260203 21:10:51.712796 4563 rpc_server.cc:307] RPC server started. Bound to: 127.2.32.188:33665
I20260203 21:10:51.713873 4563 server_base.cc:1192] Dumped server information to /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-2/data/info.pb
I20260203 21:10:51.717681 4631 sys_catalog.cc:263] Verifying existing consensus state
I20260203 21:10:51.719151 4631 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260: Bootstrap starting.
I20260203 21:10:51.723783 2178 external_mini_cluster.cc:1428] Started /tmp/dist-test-task0vmSZW/build/debug/bin/kudu as pid 4563
I20260203 21:10:51.730561 4631 log.cc:826] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260: Log is configured to *not* fsync() on all Append() calls
I20260203 21:10:51.783416 4631 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260: Bootstrap replayed 1/1 log segments. Stats: ops{read=114 overwritten=0 applied=114 ignored=0} inserts{seen=71 ignored=0} mutations{seen=99 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260203 21:10:51.783874 4631 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260: Bootstrap complete.
I20260203 21:10:51.786800 4631 raft_consensus.cc:359] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:10:51.787226 4631 raft_consensus.cc:740] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a7e51013f5041898fe34f4b64a59260, State: Initialized, Role: FOLLOWER
I20260203 21:10:51.787681 4631 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 114, Last appended: 7.114, Last appended by leader: 114, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:10:51.788707 4631 sys_catalog.cc:565] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [sys.catalog]: configured and running, proceeding with master startup.
I20260203 21:10:51.788681 4635 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 7 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } } }
I20260203 21:10:51.788791 4635 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [sys.catalog]: This master's current role is: FOLLOWER
I20260203 21:10:51.795334 4649 catalog_manager.cc:1269] Loaded cluster ID: f46367a11713484f92c1d2be2585f5a6
I20260203 21:10:51.795441 4649 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260: loading cluster ID for follower catalog manager: success
I20260203 21:10:51.798491 4649 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260: acquiring CA information for follower catalog manager: success
I20260203 21:10:51.800715 4649 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260203 21:10:51.800058 4563 master_runner.cc:186] Error getting master registration for 127.2.32.190:35419: Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111),
I20260203 21:10:51.802069 4563 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260203 21:10:52.000371 3105 heartbeater.cc:344] Connected to a master server at 127.2.32.188:33665
I20260203 21:10:52.001925 4595 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "185c63f61a2645928eeb807d145026b1" instance_seqno: 1770153026474418) as {username='slave'} at 127.2.32.131:33671; Asking this server to re-register.
I20260203 21:10:52.002396 3105 heartbeater.cc:461] Registering TS with master...
I20260203 21:10:52.003525 4595 ts_manager.cc:194] Registered new tserver with Master: 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
I20260203 21:10:52.067376 2831 heartbeater.cc:344] Connected to a master server at 127.2.32.188:33665
I20260203 21:10:52.068806 4595 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "02bdf326542e474cbe62434dd59087dc" instance_seqno: 1770153026114330) as {username='slave'} at 127.2.32.129:34053; Asking this server to re-register.
I20260203 21:10:52.069221 2831 heartbeater.cc:461] Registering TS with master...
I20260203 21:10:52.070276 4595 ts_manager.cc:194] Registered new tserver with Master: 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335)
I20260203 21:10:52.071290 2969 heartbeater.cc:344] Connected to a master server at 127.2.32.188:33665
I20260203 21:10:52.072048 4595 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" instance_seqno: 1770153026289802) as {username='slave'} at 127.2.32.130:58481; Asking this server to re-register.
I20260203 21:10:52.072395 2969 heartbeater.cc:461] Registering TS with master...
I20260203 21:10:52.073232 4595 ts_manager.cc:194] Registered new tserver with Master: 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897)
I20260203 21:10:52.328570 4387 raft_consensus.cc:493] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:10:52.328716 4387 raft_consensus.cc:515] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:52.329156 4387 leader_election.cc:290] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:10:52.329846 2720 leader_election.cc:343] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 4d6ed92d766244489541e1c280afacb5
W20260203 21:10:52.329943 2721 leader_election.cc:343] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 4d6ed92d766244489541e1c280afacb5
I20260203 21:10:52.330036 2721 leader_election.cc:304] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:10:52.330178 4387 raft_consensus.cc:2749] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:10:52.398689 4657 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 21:10:52.398861 4657 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:10:52.400074 4657 leader_election.cc:290] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419), 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681)
W20260203 21:10:52.400651 4582 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111)
W20260203 21:10:52.401423 4581 leader_election.cc:336] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681): Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)
W20260203 21:10:52.401546 4582 leader_election.cc:336] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419): Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111)
I20260203 21:10:52.401625 4582 leader_election.cc:304] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a7e51013f5041898fe34f4b64a59260; no voters: 35397be7e61f4b27a49e9449b9fdf085, 7344d7cd8dea4fa2ae705320daacaf49
I20260203 21:10:52.401844 4657 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260203 21:10:52.813138 4388 raft_consensus.cc:493] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d9e0cecab784cc0acc050ca1c89c5be)
I20260203 21:10:52.813277 4388 raft_consensus.cc:515] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:52.813683 4388 leader_election.cc:290] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:10:52.814309 2720 leader_election.cc:343] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 3ae68905ec1942448b444ecd01836805
W20260203 21:10:52.814440 2721 leader_election.cc:343] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 3ae68905ec1942448b444ecd01836805
I20260203 21:10:52.814497 2721 leader_election.cc:304] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:10:52.814769 4388 raft_consensus.cc:2749] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:10:53.142691 4668 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 21:10:53.142887 4668 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:10:53.143359 4668 leader_election.cc:290] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419), 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681)
W20260203 21:10:53.144531 4582 leader_election.cc:336] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419): Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111)
W20260203 21:10:53.144626 4581 leader_election.cc:336] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681): Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)
I20260203 21:10:53.144706 4581 leader_election.cc:304] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a7e51013f5041898fe34f4b64a59260; no voters: 35397be7e61f4b27a49e9449b9fdf085, 7344d7cd8dea4fa2ae705320daacaf49
I20260203 21:10:53.144850 4668 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260203 21:10:53.710258 4387 raft_consensus.cc:493] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d9e0cecab784cc0acc050ca1c89c5be)
I20260203 21:10:53.710402 4387 raft_consensus.cc:515] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:53.710831 4387 leader_election.cc:290] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:10:53.711536 2720 leader_election.cc:343] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: a375114bebc64385827b7b6e0060d1e4
W20260203 21:10:53.711690 2721 leader_election.cc:343] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: a375114bebc64385827b7b6e0060d1e4
I20260203 21:10:53.711774 2721 leader_election.cc:304] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:10:53.711918 4387 raft_consensus.cc:2749] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:10:53.912130 2178 external_mini_cluster.cc:1658] Killing /tmp/dist-test-task0vmSZW/build/debug/bin/kudu with pid 4563
I20260203 21:10:54.669030 2178 external_mini_cluster.cc:1366] Running /tmp/dist-test-task0vmSZW/build/debug/bin/kudu
/tmp/dist-test-task0vmSZW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.32.188:33665
--webserver_interface=127.2.32.188
--webserver_port=39751
--builtin_ntp_servers=127.2.32.148:39497
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665
--hive_metastore_uris=thrift://127.0.0.1:33779
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260203 21:10:54.776640 4690 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260203 21:10:54.776857 4690 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260203 21:10:54.776901 4690 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260203 21:10:54.780217 4690 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260203 21:10:54.780279 4690 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260203 21:10:54.780298 4690 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260203 21:10:54.780326 4690 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260203 21:10:54.784178 4690 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.32.148:39497
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-2/wal
--hive_metastore_uris=thrift://127.0.0.1:33779
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.32.188:33665
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.2.32.188
--webserver_port=39751
--never_fsync=true
--heap_profile_path=/tmp/kudu.4690
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 0efbebd487e7d0c7f21ab0d5a91e0fa70046af83
build type DEBUG
built by None at 03 Feb 2026 20:50:43 UTC on 24a791456cd2
build id 10330
I20260203 21:10:54.785197 4690 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260203 21:10:54.786257 4690 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260203 21:10:54.791345 4698 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260203 21:10:54.791374 4696 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260203 21:10:54.791522 4695 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260203 21:10:54.791606 4690 server_base.cc:1060] running on GCE node
I20260203 21:10:54.792214 4690 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260203 21:10:54.793085 4690 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260203 21:10:54.794225 4690 hybrid_clock.cc:648] HybridClock initialized: now 1770153054794214 us; error 24 us; skew 500 ppm
I20260203 21:10:54.795876 4690 webserver.cc:492] Webserver started at http://127.2.32.188:39751/ using document root <none> and password file <none>
I20260203 21:10:54.796408 4690 fs_manager.cc:362] Metadata directory not provided
I20260203 21:10:54.796465 4690 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260203 21:10:54.799568 4690 fs_manager.cc:714] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260203 21:10:54.801394 4704 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260203 21:10:54.802471 4690 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260203 21:10:54.802601 4690 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-2/data,/tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-2/wal
uuid: "8a7e51013f5041898fe34f4b64a59260"
format_stamp: "Formatted at 2026-02-03 21:10:25 on dist-test-slave-npns"
I20260203 21:10:54.803013 4690 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260203 21:10:54.815842 4690 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260203 21:10:54.816437 4690 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260203 21:10:54.816587 4690 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260203 21:10:54.823441 4756 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.32.188:33665 every 8 connection(s)
I20260203 21:10:54.823442 4690 rpc_server.cc:307] RPC server started. Bound to: 127.2.32.188:33665
I20260203 21:10:54.824554 4690 server_base.cc:1192] Dumped server information to /tmp/dist-test-task0vmSZW/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1770153010436033-2178-0/minicluster-data/master-2/data/info.pb
I20260203 21:10:54.828438 4757 sys_catalog.cc:263] Verifying existing consensus state
I20260203 21:10:54.829982 4757 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260: Bootstrap starting.
I20260203 21:10:54.834743 2178 external_mini_cluster.cc:1428] Started /tmp/dist-test-task0vmSZW/build/debug/bin/kudu as pid 4690
I20260203 21:10:54.843025 4757 log.cc:826] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260: Log is configured to *not* fsync() on all Append() calls
I20260203 21:10:54.896049 4757 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260: Bootstrap replayed 1/1 log segments. Stats: ops{read=114 overwritten=0 applied=114 ignored=0} inserts{seen=71 ignored=0} mutations{seen=99 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260203 21:10:54.896431 4757 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260: Bootstrap complete.
I20260203 21:10:54.899005 4757 raft_consensus.cc:359] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:10:54.899341 4757 raft_consensus.cc:740] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a7e51013f5041898fe34f4b64a59260, State: Initialized, Role: FOLLOWER
I20260203 21:10:54.899797 4757 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 114, Last appended: 7.114, Last appended by leader: 114, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:10:54.900213 4761 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 7 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } } }
I20260203 21:10:54.900339 4761 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [sys.catalog]: This master's current role is: FOLLOWER
I20260203 21:10:54.900806 4757 sys_catalog.cc:565] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [sys.catalog]: configured and running, proceeding with master startup.
I20260203 21:10:54.907316 4775 catalog_manager.cc:1269] Loaded cluster ID: f46367a11713484f92c1d2be2585f5a6
I20260203 21:10:54.907433 4775 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260: loading cluster ID for follower catalog manager: success
I20260203 21:10:54.905678 4690 master_runner.cc:186] Error getting master registration for 127.2.32.190:35419: Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111),
I20260203 21:10:54.907825 4690 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260203 21:10:54.910645 4775 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260: acquiring CA information for follower catalog manager: success
I20260203 21:10:54.913164 4775 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260203 21:10:54.922887 2831 heartbeater.cc:344] Connected to a master server at 127.2.32.188:33665
I20260203 21:10:54.925206 4715 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "02bdf326542e474cbe62434dd59087dc" instance_seqno: 1770153026114330) as {username='slave'} at 127.2.32.129:50821; Asking this server to re-register.
I20260203 21:10:54.925751 2831 heartbeater.cc:461] Registering TS with master...
I20260203 21:10:54.927244 4715 ts_manager.cc:194] Registered new tserver with Master: 02bdf326542e474cbe62434dd59087dc (127.2.32.129:34335)
I20260203 21:10:55.015957 3105 heartbeater.cc:344] Connected to a master server at 127.2.32.188:33665
I20260203 21:10:55.016988 4715 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "185c63f61a2645928eeb807d145026b1" instance_seqno: 1770153026474418) as {username='slave'} at 127.2.32.131:35561; Asking this server to re-register.
I20260203 21:10:55.017385 3105 heartbeater.cc:461] Registering TS with master...
I20260203 21:10:55.018330 4715 ts_manager.cc:194] Registered new tserver with Master: 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
I20260203 21:10:55.084683 2969 heartbeater.cc:344] Connected to a master server at 127.2.32.188:33665
I20260203 21:10:55.085635 4715 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" instance_seqno: 1770153026289802) as {username='slave'} at 127.2.32.130:54287; Asking this server to re-register.
I20260203 21:10:55.086040 2969 heartbeater.cc:461] Registering TS with master...
I20260203 21:10:55.086889 4715 ts_manager.cc:194] Registered new tserver with Master: 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897)
I20260203 21:10:55.195608 3854 raft_consensus.cc:493] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d9e0cecab784cc0acc050ca1c89c5be)
I20260203 21:10:55.195744 3854 raft_consensus.cc:515] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:10:55.196084 3854 leader_election.cc:290] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223), 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897)
W20260203 21:10:55.196689 2720 leader_election.cc:343] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 6606bf5d7de047cda4a0523197210c1a
W20260203 21:10:55.196791 2721 leader_election.cc:343] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 6606bf5d7de047cda4a0523197210c1a
I20260203 21:10:55.196872 2721 leader_election.cc:304] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:10:55.197018 3854 raft_consensus.cc:2749] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:10:55.334586 4761 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 21:10:55.334770 4761 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:10:55.336051 4761 leader_election.cc:290] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419), 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681)
W20260203 21:10:55.336570 4708 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111)
W20260203 21:10:55.337301 4707 leader_election.cc:336] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681): Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)
W20260203 21:10:55.337410 4708 leader_election.cc:336] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419): Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111)
I20260203 21:10:55.337492 4708 leader_election.cc:304] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a7e51013f5041898fe34f4b64a59260; no voters: 35397be7e61f4b27a49e9449b9fdf085, 7344d7cd8dea4fa2ae705320daacaf49
I20260203 21:10:55.337685 4761 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260203 21:10:55.634549 2720 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 11: this message will repeat every 5th retry.
W20260203 21:10:55.768102 2720 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 11: this message will repeat every 5th retry.
I20260203 21:10:55.847275 4788 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 21:10:55.847419 4788 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:10:55.847911 4788 leader_election.cc:290] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419), 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681)
W20260203 21:10:55.848939 4708 leader_election.cc:336] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419): Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111)
W20260203 21:10:55.849035 4707 leader_election.cc:336] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681): Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)
I20260203 21:10:55.849148 4707 leader_election.cc:304] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a7e51013f5041898fe34f4b64a59260; no voters: 35397be7e61f4b27a49e9449b9fdf085, 7344d7cd8dea4fa2ae705320daacaf49
I20260203 21:10:55.849282 4788 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260203 21:10:55.957633 2721 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 11: this message will repeat every 5th retry.
W20260203 21:10:56.311000 2721 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 11: this message will repeat every 5th retry.
I20260203 21:10:56.848189 4803 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 21:10:56.848328 4803 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:10:56.848762 4803 leader_election.cc:290] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419), 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681)
W20260203 21:10:56.849872 4708 leader_election.cc:336] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419): Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111)
W20260203 21:10:56.849967 4707 leader_election.cc:336] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681): Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)
I20260203 21:10:56.850041 4707 leader_election.cc:304] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a7e51013f5041898fe34f4b64a59260; no voters: 35397be7e61f4b27a49e9449b9fdf085, 7344d7cd8dea4fa2ae705320daacaf49
I20260203 21:10:56.850168 4803 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260203 21:10:56.914712 4388 raft_consensus.cc:493] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:10:56.914958 4388 raft_consensus.cc:515] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:56.915462 4388 leader_election.cc:290] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:10:56.916178 2720 leader_election.cc:343] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 4d6ed92d766244489541e1c280afacb5
W20260203 21:10:56.916296 2721 leader_election.cc:343] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 4d6ed92d766244489541e1c280afacb5
I20260203 21:10:56.916422 2721 leader_election.cc:304] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:10:56.916581 4388 raft_consensus.cc:2749] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:10:57.201022 2178 master-stress-test.cc:577] Killing test thread 1/25
I20260203 21:10:58.047256 4819 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 21:10:58.047394 4819 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:10:58.047856 4819 leader_election.cc:290] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419), 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681)
W20260203 21:10:58.048995 4707 leader_election.cc:336] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681): Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)
W20260203 21:10:58.049085 4708 leader_election.cc:336] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419): Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111)
I20260203 21:10:58.049160 4708 leader_election.cc:304] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a7e51013f5041898fe34f4b64a59260; no voters: 35397be7e61f4b27a49e9449b9fdf085, 7344d7cd8dea4fa2ae705320daacaf49
I20260203 21:10:58.049288 4819 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260203 21:10:58.701375 4388 raft_consensus.cc:493] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:10:58.701522 4388 raft_consensus.cc:515] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:10:58.702064 4388 leader_election.cc:290] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:10:58.702596 2721 leader_election.cc:343] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 4d6ed92d766244489541e1c280afacb5
W20260203 21:10:58.702783 2720 leader_election.cc:343] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 4d6ed92d766244489541e1c280afacb5
I20260203 21:10:58.702841 2720 leader_election.cc:304] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:10:58.702961 4388 raft_consensus.cc:2749] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:10:58.730811 4831 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 21:10:58.730945 4831 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:10:58.731391 4831 leader_election.cc:290] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419), 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681)
W20260203 21:10:58.732630 4707 leader_election.cc:336] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681): Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)
W20260203 21:10:58.732726 4708 leader_election.cc:336] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419): Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111)
I20260203 21:10:58.732805 4708 leader_election.cc:304] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a7e51013f5041898fe34f4b64a59260; no voters: 35397be7e61f4b27a49e9449b9fdf085, 7344d7cd8dea4fa2ae705320daacaf49
I20260203 21:10:58.732939 4831 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260203 21:10:59.908947 4690 master_runner.cc:186] Error getting master registration for 127.2.32.190:35419: Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111),
I20260203 21:10:59.909075 4690 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260203 21:11:00.741703 2720 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 16: this message will repeat every 5th retry.
W20260203 21:11:01.256284 2720 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 16: this message will repeat every 5th retry.
W20260203 21:11:01.260398 2721 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 16: this message will repeat every 5th retry.
W20260203 21:11:01.555769 2721 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 16: this message will repeat every 5th retry.
I20260203 21:11:01.742079 4388 raft_consensus.cc:493] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:11:01.742220 4388 raft_consensus.cc:515] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:11:01.742635 4388 leader_election.cc:290] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:11:01.743412 2720 leader_election.cc:343] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 7786ef435bbd44daae12d3ee4728efb9
W20260203 21:11:01.743513 2721 leader_election.cc:343] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 7786ef435bbd44daae12d3ee4728efb9
I20260203 21:11:01.743597 2721 leader_election.cc:304] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:11:01.743939 4388 raft_consensus.cc:2749] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:11:02.180636 3854 raft_consensus.cc:493] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d9e0cecab784cc0acc050ca1c89c5be)
I20260203 21:11:02.180776 3854 raft_consensus.cc:515] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:11:02.181241 3854 leader_election.cc:290] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223), 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897)
W20260203 21:11:02.181977 2721 leader_election.cc:343] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 6606bf5d7de047cda4a0523197210c1a
W20260203 21:11:02.182094 2720 leader_election.cc:343] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 6606bf5d7de047cda4a0523197210c1a
I20260203 21:11:02.182179 2720 leader_election.cc:304] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:11:02.182348 3854 raft_consensus.cc:2749] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:11:02.475850 4878 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 21:11:02.475988 4878 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:11:02.476436 4878 leader_election.cc:290] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419), 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681)
W20260203 21:11:02.476994 4707 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111) [suppressed 9 similar messages]
W20260203 21:11:02.477640 4708 leader_election.cc:336] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419): Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111)
W20260203 21:11:02.477717 4707 leader_election.cc:336] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681): Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)
I20260203 21:11:02.477793 4707 leader_election.cc:304] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a7e51013f5041898fe34f4b64a59260; no voters: 35397be7e61f4b27a49e9449b9fdf085, 7344d7cd8dea4fa2ae705320daacaf49
I20260203 21:11:02.477932 4878 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260203 21:11:03.377377 4388 raft_consensus.cc:493] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:11:03.377496 4388 raft_consensus.cc:515] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:11:03.377879 4388 leader_election.cc:290] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:11:03.378473 2721 leader_election.cc:343] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 7786ef435bbd44daae12d3ee4728efb9
W20260203 21:11:03.378695 2720 leader_election.cc:343] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 7786ef435bbd44daae12d3ee4728efb9
I20260203 21:11:03.378760 2720 leader_election.cc:304] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:11:03.378876 4388 raft_consensus.cc:2749] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:11:03.795044 4388 raft_consensus.cc:493] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d9e0cecab784cc0acc050ca1c89c5be)
I20260203 21:11:03.795197 4388 raft_consensus.cc:515] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:11:03.795639 4388 leader_election.cc:290] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223), 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897)
W20260203 21:11:03.796341 2720 leader_election.cc:343] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 6606bf5d7de047cda4a0523197210c1a
W20260203 21:11:03.796439 2721 leader_election.cc:343] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 6606bf5d7de047cda4a0523197210c1a
I20260203 21:11:03.796496 2721 leader_election.cc:304] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:11:03.796656 4388 raft_consensus.cc:2749] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:11:04.313711 3854 raft_consensus.cc:493] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:11:04.313853 3854 raft_consensus.cc:515] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:11:04.314284 3854 leader_election.cc:290] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:11:04.314762 2721 leader_election.cc:343] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 4d6ed92d766244489541e1c280afacb5
W20260203 21:11:04.314888 2720 leader_election.cc:343] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 4d6ed92d766244489541e1c280afacb5
I20260203 21:11:04.314962 2720 leader_election.cc:304] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:11:04.315110 3854 raft_consensus.cc:2749] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:11:04.910017 4690 master_runner.cc:186] Error getting master registration for 127.2.32.190:35419: Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111),
I20260203 21:11:04.910138 4690 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260203 21:11:04.992657 3854 raft_consensus.cc:493] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:11:04.992807 3854 raft_consensus.cc:515] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:11:04.993232 3854 leader_election.cc:290] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:11:04.994022 2721 leader_election.cc:343] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 7786ef435bbd44daae12d3ee4728efb9
W20260203 21:11:04.994150 2720 leader_election.cc:343] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 7786ef435bbd44daae12d3ee4728efb9
I20260203 21:11:04.994241 2720 leader_election.cc:304] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:11:04.994410 3854 raft_consensus.cc:2749] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260203 21:11:05.321928 2720 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 21: this message will repeat every 5th retry.
W20260203 21:11:06.033633 2720 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 21: this message will repeat every 5th retry.
I20260203 21:11:06.121021 4387 raft_consensus.cc:493] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:11:06.121165 4387 raft_consensus.cc:515] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } }
I20260203 21:11:06.121584 4387 leader_election.cc:290] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223), 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897)
W20260203 21:11:06.122421 2720 leader_election.cc:343] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 06b80064d47349c2830718f553ba3d7d
W20260203 21:11:06.122570 2721 leader_election.cc:343] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 06b80064d47349c2830718f553ba3d7d
I20260203 21:11:06.122658 2721 leader_election.cc:304] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:11:06.122818 4387 raft_consensus.cc:2749] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260203 21:11:06.345818 2721 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 21: this message will repeat every 5th retry.
I20260203 21:11:06.383366 4387 raft_consensus.cc:493] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d9e0cecab784cc0acc050ca1c89c5be)
I20260203 21:11:06.383513 4387 raft_consensus.cc:515] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:11:06.383958 4387 leader_election.cc:290] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:11:06.384624 2721 leader_election.cc:343] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 3ae68905ec1942448b444ecd01836805
W20260203 21:11:06.384747 2720 leader_election.cc:343] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 3ae68905ec1942448b444ecd01836805
I20260203 21:11:06.384838 2720 leader_election.cc:304] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:11:06.384966 4387 raft_consensus.cc:2749] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260203 21:11:06.616731 2721 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 21: this message will repeat every 5th retry.
I20260203 21:11:06.849956 4931 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 21:11:06.850095 4931 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:11:06.850561 4931 leader_election.cc:290] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419), 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681)
W20260203 21:11:06.851824 4708 leader_election.cc:336] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419): Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111)
W20260203 21:11:06.851940 4707 leader_election.cc:336] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681): Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)
I20260203 21:11:06.852013 4707 leader_election.cc:304] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a7e51013f5041898fe34f4b64a59260; no voters: 35397be7e61f4b27a49e9449b9fdf085, 7344d7cd8dea4fa2ae705320daacaf49
I20260203 21:11:06.852161 4931 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260203 21:11:09.305682 4388 raft_consensus.cc:493] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d9e0cecab784cc0acc050ca1c89c5be)
I20260203 21:11:09.305836 4388 raft_consensus.cc:515] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:11:09.306298 4388 leader_election.cc:290] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:11:09.306990 2721 leader_election.cc:343] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: a375114bebc64385827b7b6e0060d1e4
W20260203 21:11:09.307112 2720 leader_election.cc:343] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: a375114bebc64385827b7b6e0060d1e4
I20260203 21:11:09.307194 2720 leader_election.cc:304] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:11:09.307330 4388 raft_consensus.cc:2749] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:11:09.911171 4690 master_runner.cc:186] Error getting master registration for 127.2.32.190:35419: Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111),
I20260203 21:11:09.911295 4690 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260203 21:11:10.109586 2720 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 26: this message will repeat every 5th retry.
W20260203 21:11:10.935976 2720 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 26: this message will repeat every 5th retry.
I20260203 21:11:11.126966 4983 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 21:11:11.127110 4983 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:11:11.127511 4983 leader_election.cc:290] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419), 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681)
W20260203 21:11:11.128050 4707 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260203 21:11:11.128784 4708 leader_election.cc:336] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419): Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111)
W20260203 21:11:11.128876 4707 leader_election.cc:336] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681): Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)
I20260203 21:11:11.128954 4707 leader_election.cc:304] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a7e51013f5041898fe34f4b64a59260; no voters: 35397be7e61f4b27a49e9449b9fdf085, 7344d7cd8dea4fa2ae705320daacaf49
I20260203 21:11:11.129158 4983 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260203 21:11:11.242635 2721 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 26: this message will repeat every 5th retry.
W20260203 21:11:11.649219 2721 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 26: this message will repeat every 5th retry.
I20260203 21:11:13.006836 3854 raft_consensus.cc:493] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d9e0cecab784cc0acc050ca1c89c5be)
I20260203 21:11:13.006989 3854 raft_consensus.cc:515] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:11:13.007424 3854 leader_election.cc:290] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223), 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897)
W20260203 21:11:13.008199 2720 leader_election.cc:343] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 6606bf5d7de047cda4a0523197210c1a
W20260203 21:11:13.008323 2721 leader_election.cc:343] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 6606bf5d7de047cda4a0523197210c1a
I20260203 21:11:13.008405 2721 leader_election.cc:304] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:11:13.008558 3854 raft_consensus.cc:2749] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:11:14.303519 3854 raft_consensus.cc:493] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:11:14.303704 3854 raft_consensus.cc:515] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:11:14.304257 3854 leader_election.cc:290] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:11:14.305022 2720 leader_election.cc:343] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 7786ef435bbd44daae12d3ee4728efb9
W20260203 21:11:14.305153 2721 leader_election.cc:343] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 7786ef435bbd44daae12d3ee4728efb9
I20260203 21:11:14.305241 2721 leader_election.cc:304] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:11:14.305385 3854 raft_consensus.cc:2749] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:11:14.461170 5017 raft_consensus.cc:493] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:11:14.461318 5017 raft_consensus.cc:515] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:11:14.461736 5017 leader_election.cc:290] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:11:14.462446 2721 leader_election.cc:343] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 4d6ed92d766244489541e1c280afacb5
W20260203 21:11:14.462571 2720 leader_election.cc:343] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 4d6ed92d766244489541e1c280afacb5
I20260203 21:11:14.462662 2720 leader_election.cc:304] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:11:14.462818 5017 raft_consensus.cc:2749] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:11:14.912392 4690 master_runner.cc:186] Error getting master registration for 127.2.32.190:35419: Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111),
I20260203 21:11:14.912528 4690 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260203 21:11:15.380901 2720 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 31: this message will repeat every 5th retry.
W20260203 21:11:15.397078 2720 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 31: this message will repeat every 5th retry.
W20260203 21:11:16.143042 2721 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 31: this message will repeat every 5th retry.
W20260203 21:11:16.605544 2721 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 31: this message will repeat every 5th retry.
I20260203 21:11:19.913502 4690 master_runner.cc:186] Error getting master registration for 127.2.32.190:35419: Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111),
I20260203 21:11:19.913618 4690 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260203 21:11:20.248720 2720 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 36: this message will repeat every 5th retry.
W20260203 21:11:20.534628 2720 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 36: this message will repeat every 5th retry.
I20260203 21:11:20.589967 4387 raft_consensus.cc:493] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d9e0cecab784cc0acc050ca1c89c5be)
I20260203 21:11:20.590109 4387 raft_consensus.cc:515] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:11:20.590550 4387 leader_election.cc:290] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:11:20.591269 2720 leader_election.cc:343] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 3ae68905ec1942448b444ecd01836805
W20260203 21:11:20.591379 2721 leader_election.cc:343] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 3ae68905ec1942448b444ecd01836805
I20260203 21:11:20.591463 2721 leader_election.cc:304] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:11:20.591614 4387 raft_consensus.cc:2749] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260203 21:11:21.270359 2721 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 36: this message will repeat every 5th retry.
W20260203 21:11:21.945284 2721 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 36: this message will repeat every 5th retry.
I20260203 21:11:23.127210 5119 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 21:11:23.127336 5119 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:11:23.127815 5119 leader_election.cc:290] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419), 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681)
W20260203 21:11:23.128376 4708 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260203 21:11:23.129101 4708 leader_election.cc:336] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419): Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111)
W20260203 21:11:23.129187 4707 leader_election.cc:336] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681): Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)
I20260203 21:11:23.129247 4707 leader_election.cc:304] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a7e51013f5041898fe34f4b64a59260; no voters: 35397be7e61f4b27a49e9449b9fdf085, 7344d7cd8dea4fa2ae705320daacaf49
I20260203 21:11:23.129372 5119 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260203 21:11:23.389132 5017 raft_consensus.cc:493] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:11:23.389310 5017 raft_consensus.cc:515] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } }
I20260203 21:11:23.389799 5017 leader_election.cc:290] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223), 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897)
W20260203 21:11:23.390600 2720 leader_election.cc:343] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 06b80064d47349c2830718f553ba3d7d
W20260203 21:11:23.390702 2721 leader_election.cc:343] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 06b80064d47349c2830718f553ba3d7d
I20260203 21:11:23.390790 2721 leader_election.cc:304] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:11:23.390960 5017 raft_consensus.cc:2749] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:11:23.436093 5017 raft_consensus.cc:493] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d9e0cecab784cc0acc050ca1c89c5be)
I20260203 21:11:23.436235 5017 raft_consensus.cc:515] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:11:23.436673 5017 leader_election.cc:290] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223), 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897)
W20260203 21:11:23.437340 2720 leader_election.cc:343] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 6606bf5d7de047cda4a0523197210c1a
W20260203 21:11:23.437456 2721 leader_election.cc:343] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 6606bf5d7de047cda4a0523197210c1a
I20260203 21:11:23.437548 2721 leader_election.cc:304] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:11:23.437695 5017 raft_consensus.cc:2749] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:11:24.327418 5017 raft_consensus.cc:493] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d9e0cecab784cc0acc050ca1c89c5be)
I20260203 21:11:24.327569 5017 raft_consensus.cc:515] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:11:24.328032 5017 leader_election.cc:290] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:11:24.328667 2720 leader_election.cc:343] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: a375114bebc64385827b7b6e0060d1e4
W20260203 21:11:24.328771 2721 leader_election.cc:343] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: a375114bebc64385827b7b6e0060d1e4
I20260203 21:11:24.328863 2721 leader_election.cc:304] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:11:24.329020 5017 raft_consensus.cc:2749] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:11:24.349367 5017 raft_consensus.cc:493] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:11:24.349511 5017 raft_consensus.cc:515] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:11:24.349982 5017 leader_election.cc:290] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:11:24.350757 2720 leader_election.cc:343] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 4d6ed92d766244489541e1c280afacb5
W20260203 21:11:24.350881 2721 leader_election.cc:343] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 4d6ed92d766244489541e1c280afacb5
I20260203 21:11:24.350996 2721 leader_election.cc:304] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:11:24.351137 5017 raft_consensus.cc:2749] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:11:24.465205 5135 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 21:11:24.465339 5135 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:11:24.465762 5135 leader_election.cc:290] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419), 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681)
W20260203 21:11:24.466995 4707 leader_election.cc:336] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681): Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)
W20260203 21:11:24.467100 4708 leader_election.cc:336] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419): Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111)
I20260203 21:11:24.467164 4708 leader_election.cc:304] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a7e51013f5041898fe34f4b64a59260; no voters: 35397be7e61f4b27a49e9449b9fdf085, 7344d7cd8dea4fa2ae705320daacaf49
I20260203 21:11:24.467294 5135 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260203 21:11:24.914548 4690 master_runner.cc:186] Error getting master registration for 127.2.32.190:35419: Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111),
I20260203 21:11:24.914681 4690 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260203 21:11:25.008325 4387 raft_consensus.cc:493] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:11:25.008448 4387 raft_consensus.cc:515] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:11:25.008837 4387 leader_election.cc:290] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:11:25.009433 2720 leader_election.cc:343] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 7786ef435bbd44daae12d3ee4728efb9
W20260203 21:11:25.009541 2721 leader_election.cc:343] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 7786ef435bbd44daae12d3ee4728efb9
I20260203 21:11:25.009690 2721 leader_election.cc:304] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:11:25.009876 4387 raft_consensus.cc:2749] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260203 21:11:25.261803 2720 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 41: this message will repeat every 5th retry.
W20260203 21:11:25.447723 2720 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 41: this message will repeat every 5th retry.
I20260203 21:11:26.276156 4387 raft_consensus.cc:493] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:11:26.276301 4387 raft_consensus.cc:515] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:11:26.276716 4387 leader_election.cc:290] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:11:26.277431 2721 leader_election.cc:343] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 4d6ed92d766244489541e1c280afacb5
W20260203 21:11:26.277549 2720 leader_election.cc:343] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 4d6ed92d766244489541e1c280afacb5
I20260203 21:11:26.277635 2720 leader_election.cc:304] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:11:26.277808 4387 raft_consensus.cc:2749] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260203 21:11:26.404897 2721 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 41: this message will repeat every 5th retry.
W20260203 21:11:26.686739 2833 heartbeater.cc:646] Failed to heartbeat to 127.2.32.189:42681 (334 consecutive failures): Network error: Failed to ping master at 127.2.32.189:42681: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)
W20260203 21:11:27.055398 3106 heartbeater.cc:646] Failed to heartbeat to 127.2.32.190:35419 (149 consecutive failures): Network error: Failed to ping master at 127.2.32.190:35419: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111)
W20260203 21:11:27.082691 2721 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 41: this message will repeat every 5th retry.
W20260203 21:11:27.127902 2970 heartbeater.cc:646] Failed to heartbeat to 127.2.32.190:35419 (142 consecutive failures): Network error: Failed to ping master at 127.2.32.190:35419: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111)
I20260203 21:11:29.915856 4690 master_runner.cc:186] Error getting master registration for 127.2.32.190:35419: Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111),
I20260203 21:11:29.915979 4690 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260203 21:11:30.557161 2720 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 46: this message will repeat every 5th retry.
W20260203 21:11:30.771562 2720 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 46: this message will repeat every 5th retry.
I20260203 21:11:30.787979 4387 raft_consensus.cc:493] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d9e0cecab784cc0acc050ca1c89c5be)
I20260203 21:11:30.788141 4387 raft_consensus.cc:515] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:11:30.788698 4387 leader_election.cc:290] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223), 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897)
W20260203 21:11:30.789345 2720 leader_election.cc:343] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 6606bf5d7de047cda4a0523197210c1a
W20260203 21:11:30.789445 2721 leader_election.cc:343] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 6606bf5d7de047cda4a0523197210c1a
I20260203 21:11:30.789510 2721 leader_election.cc:304] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:11:30.789662 4387 raft_consensus.cc:2749] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260203 21:11:31.512372 2721 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 46: this message will repeat every 5th retry.
W20260203 21:11:31.518900 2721 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 46: this message will repeat every 5th retry.
I20260203 21:11:33.018734 4387 raft_consensus.cc:493] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:11:33.018908 4387 raft_consensus.cc:515] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } }
I20260203 21:11:33.019423 4387 leader_election.cc:290] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223), 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897)
W20260203 21:11:33.020072 2721 leader_election.cc:343] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 06b80064d47349c2830718f553ba3d7d
W20260203 21:11:33.020224 2720 leader_election.cc:343] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 06b80064d47349c2830718f553ba3d7d
I20260203 21:11:33.020315 2720 leader_election.cc:304] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:11:33.020498 4387 raft_consensus.cc:2749] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:11:34.098177 4387 raft_consensus.cc:493] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d9e0cecab784cc0acc050ca1c89c5be)
I20260203 21:11:34.098327 4387 raft_consensus.cc:515] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:11:34.098755 4387 leader_election.cc:290] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223), 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897)
W20260203 21:11:34.099454 2721 leader_election.cc:343] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 6606bf5d7de047cda4a0523197210c1a
W20260203 21:11:34.099570 2720 leader_election.cc:343] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 6606bf5d7de047cda4a0523197210c1a
I20260203 21:11:34.099689 2720 leader_election.cc:304] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:11:34.099849 4387 raft_consensus.cc:2749] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:11:34.686298 5173 raft_consensus.cc:493] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:11:34.686443 5173 raft_consensus.cc:515] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } }
I20260203 21:11:34.686839 5173 leader_election.cc:290] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223), 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897)
W20260203 21:11:34.687678 2721 leader_election.cc:343] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 06b80064d47349c2830718f553ba3d7d
W20260203 21:11:34.687803 2720 leader_election.cc:343] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 06b80064d47349c2830718f553ba3d7d
I20260203 21:11:34.687893 2720 leader_election.cc:304] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:11:34.688052 5173 raft_consensus.cc:2749] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:11:34.917038 4690 master_runner.cc:186] Error getting master registration for 127.2.32.190:35419: Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111),
I20260203 21:11:34.917165 4690 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260203 21:11:35.586248 2720 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 51: this message will repeat every 5th retry.
W20260203 21:11:35.768620 2720 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 51: this message will repeat every 5th retry.
W20260203 21:11:36.554616 2721 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 51: this message will repeat every 5th retry.
W20260203 21:11:36.799026 2721 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 51: this message will repeat every 5th retry.
I20260203 21:11:36.814162 5279 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 21:11:36.814325 5279 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:11:36.814764 5279 leader_election.cc:290] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419), 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681)
W20260203 21:11:36.815382 4708 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260203 21:11:36.816346 4708 leader_election.cc:336] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419): Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111)
W20260203 21:11:36.816500 4707 leader_election.cc:336] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681): Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)
I20260203 21:11:36.816593 4707 leader_election.cc:304] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a7e51013f5041898fe34f4b64a59260; no voters: 35397be7e61f4b27a49e9449b9fdf085, 7344d7cd8dea4fa2ae705320daacaf49
I20260203 21:11:36.816809 5279 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260203 21:11:38.630219 5017 raft_consensus.cc:493] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d9e0cecab784cc0acc050ca1c89c5be)
I20260203 21:11:38.630463 5017 raft_consensus.cc:515] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:11:38.631075 5017 leader_election.cc:290] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:11:38.632017 2720 leader_election.cc:343] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: a375114bebc64385827b7b6e0060d1e4
W20260203 21:11:38.633366 2721 leader_election.cc:343] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: a375114bebc64385827b7b6e0060d1e4
I20260203 21:11:38.633450 2721 leader_election.cc:304] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:11:38.633656 4387 raft_consensus.cc:2749] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:11:39.023799 5017 raft_consensus.cc:493] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:11:39.023936 5017 raft_consensus.cc:515] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:11:39.024351 5017 leader_election.cc:290] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:11:39.024822 2721 leader_election.cc:343] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 4d6ed92d766244489541e1c280afacb5
W20260203 21:11:39.024909 2720 leader_election.cc:343] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 4d6ed92d766244489541e1c280afacb5
I20260203 21:11:39.024998 2720 leader_election.cc:304] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:11:39.025117 5017 raft_consensus.cc:2749] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:11:39.370749 5017 raft_consensus.cc:493] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d9e0cecab784cc0acc050ca1c89c5be)
I20260203 21:11:39.370878 5017 raft_consensus.cc:515] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:11:39.371297 5017 leader_election.cc:290] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:11:39.372042 2721 leader_election.cc:343] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 3ae68905ec1942448b444ecd01836805
W20260203 21:11:39.372133 2720 leader_election.cc:343] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 3ae68905ec1942448b444ecd01836805
I20260203 21:11:39.372223 2720 leader_election.cc:304] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:11:39.372352 5017 raft_consensus.cc:2749] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:11:39.918191 4690 master_runner.cc:186] Error getting master registration for 127.2.32.190:35419: Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111),
I20260203 21:11:39.918305 4690 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260203 21:11:40.705191 2720 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 56: this message will repeat every 5th retry.
W20260203 21:11:40.904211 2720 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 56: this message will repeat every 5th retry.
W20260203 21:11:41.297497 2721 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 56: this message will repeat every 5th retry.
W20260203 21:11:41.983685 2721 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 56: this message will repeat every 5th retry.
I20260203 21:11:42.137343 4387 raft_consensus.cc:493] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d9e0cecab784cc0acc050ca1c89c5be)
I20260203 21:11:42.137490 4387 raft_consensus.cc:515] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:11:42.137943 4387 leader_election.cc:290] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:11:42.138698 2721 leader_election.cc:343] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: a375114bebc64385827b7b6e0060d1e4
W20260203 21:11:42.138809 2720 leader_election.cc:343] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: a375114bebc64385827b7b6e0060d1e4
I20260203 21:11:42.138870 2720 leader_election.cc:304] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:11:42.139003 4387 raft_consensus.cc:2749] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:11:43.128263 5017 raft_consensus.cc:493] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:11:43.128403 5017 raft_consensus.cc:515] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:11:43.128816 5017 leader_election.cc:290] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:11:43.129558 2721 leader_election.cc:343] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 4d6ed92d766244489541e1c280afacb5
W20260203 21:11:43.129654 2720 leader_election.cc:343] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 4d6ed92d766244489541e1c280afacb5
I20260203 21:11:43.129748 2720 leader_election.cc:304] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:11:43.129881 5017 raft_consensus.cc:2749] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:11:44.843640 5173 raft_consensus.cc:493] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:11:44.843811 5173 raft_consensus.cc:515] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:11:44.844249 5173 leader_election.cc:290] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:11:44.845117 2721 leader_election.cc:343] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 7786ef435bbd44daae12d3ee4728efb9
W20260203 21:11:44.845242 2720 leader_election.cc:343] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 7786ef435bbd44daae12d3ee4728efb9
I20260203 21:11:44.845310 2720 leader_election.cc:304] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:11:44.845450 5173 raft_consensus.cc:2749] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:11:44.919317 4690 master_runner.cc:186] Error getting master registration for 127.2.32.190:35419: Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111),
I20260203 21:11:44.919440 4690 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260203 21:11:46.065477 2720 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 61: this message will repeat every 5th retry.
W20260203 21:11:46.185218 2720 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 61: this message will repeat every 5th retry.
W20260203 21:11:46.195367 2721 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 61: this message will repeat every 5th retry.
I20260203 21:11:46.977439 5017 raft_consensus.cc:493] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d9e0cecab784cc0acc050ca1c89c5be)
I20260203 21:11:46.977579 5017 raft_consensus.cc:515] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:11:46.978029 5017 leader_election.cc:290] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:11:46.978600 2721 leader_election.cc:343] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: a375114bebc64385827b7b6e0060d1e4
W20260203 21:11:46.978694 2720 leader_election.cc:343] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: a375114bebc64385827b7b6e0060d1e4
I20260203 21:11:46.978780 2720 leader_election.cc:304] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:11:46.978920 5017 raft_consensus.cc:2749] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260203 21:11:47.023082 2721 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 61: this message will repeat every 5th retry.
I20260203 21:11:47.454988 5173 raft_consensus.cc:493] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d9e0cecab784cc0acc050ca1c89c5be)
I20260203 21:11:47.455142 5173 raft_consensus.cc:515] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:11:47.455565 5173 leader_election.cc:290] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:11:47.456408 2720 leader_election.cc:343] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 3ae68905ec1942448b444ecd01836805
W20260203 21:11:47.456521 2721 leader_election.cc:343] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 3ae68905ec1942448b444ecd01836805
I20260203 21:11:47.456601 2721 leader_election.cc:304] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:11:47.456735 5173 raft_consensus.cc:2749] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:11:47.840350 5017 raft_consensus.cc:493] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d9e0cecab784cc0acc050ca1c89c5be)
I20260203 21:11:47.840499 5017 raft_consensus.cc:515] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:11:47.840920 5017 leader_election.cc:290] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223), 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897)
W20260203 21:11:47.841665 2720 leader_election.cc:343] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 6606bf5d7de047cda4a0523197210c1a
W20260203 21:11:47.841777 2721 leader_election.cc:343] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 6606bf5d7de047cda4a0523197210c1a
I20260203 21:11:47.841836 2721 leader_election.cc:304] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:11:47.841984 5017 raft_consensus.cc:2749] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:11:47.870538 5173 raft_consensus.cc:493] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:11:47.870678 5173 raft_consensus.cc:515] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:11:47.871069 5173 leader_election.cc:290] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:11:47.871757 2721 leader_election.cc:343] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 4d6ed92d766244489541e1c280afacb5
W20260203 21:11:47.871877 2720 leader_election.cc:343] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 4d6ed92d766244489541e1c280afacb5
I20260203 21:11:47.871966 2720 leader_election.cc:304] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:11:47.872117 5173 raft_consensus.cc:2749] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:11:49.920548 4690 master_runner.cc:186] Error getting master registration for 127.2.32.190:35419: Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111),
I20260203 21:11:49.920686 4690 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260203 21:11:50.944619 2720 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 66: this message will repeat every 5th retry.
W20260203 21:11:51.031652 2720 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 66: this message will repeat every 5th retry.
W20260203 21:11:51.480808 2721 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 66: this message will repeat every 5th retry.
I20260203 21:11:51.527778 5173 raft_consensus.cc:493] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d9e0cecab784cc0acc050ca1c89c5be)
I20260203 21:11:51.527938 5173 raft_consensus.cc:515] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:11:51.528405 5173 leader_election.cc:290] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223), 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897)
W20260203 21:11:51.529168 2720 leader_election.cc:343] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 6606bf5d7de047cda4a0523197210c1a
W20260203 21:11:51.529306 2721 leader_election.cc:343] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 6606bf5d7de047cda4a0523197210c1a
I20260203 21:11:51.529408 2721 leader_election.cc:304] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:11:51.529562 5173 raft_consensus.cc:2749] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:11:51.840678 4387 raft_consensus.cc:493] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:11:51.840801 4387 raft_consensus.cc:515] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:11:51.841198 4387 leader_election.cc:290] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:11:51.841742 2721 leader_election.cc:343] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 4d6ed92d766244489541e1c280afacb5
W20260203 21:11:51.841846 2720 leader_election.cc:343] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 4d6ed92d766244489541e1c280afacb5
I20260203 21:11:51.841933 2720 leader_election.cc:304] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:11:51.842059 4387 raft_consensus.cc:2749] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:11:51.891100 5173 raft_consensus.cc:493] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d9e0cecab784cc0acc050ca1c89c5be)
I20260203 21:11:51.891258 5173 raft_consensus.cc:515] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:11:51.891759 5173 leader_election.cc:290] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:11:51.892499 2721 leader_election.cc:343] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 3ae68905ec1942448b444ecd01836805
W20260203 21:11:51.892614 2720 leader_election.cc:343] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 3ae68905ec1942448b444ecd01836805
I20260203 21:11:51.892681 2720 leader_election.cc:304] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:11:51.892820 5173 raft_consensus.cc:2749] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260203 21:11:52.278159 2721 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 66: this message will repeat every 5th retry.
I20260203 21:11:52.507234 4387 raft_consensus.cc:493] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:11:52.507357 4387 raft_consensus.cc:515] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } }
I20260203 21:11:52.507755 4387 leader_election.cc:290] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223), 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897)
W20260203 21:11:52.508312 2721 leader_election.cc:343] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 06b80064d47349c2830718f553ba3d7d
W20260203 21:11:52.508425 2720 leader_election.cc:343] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 06b80064d47349c2830718f553ba3d7d
I20260203 21:11:52.508513 2720 leader_election.cc:304] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:11:52.508653 4387 raft_consensus.cc:2749] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:11:53.839713 5471 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 21:11:53.839840 5471 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:11:53.840365 5471 leader_election.cc:290] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419), 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681)
W20260203 21:11:53.840894 4708 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260203 21:11:53.841543 4707 leader_election.cc:336] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681): Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)
W20260203 21:11:53.841640 4708 leader_election.cc:336] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419): Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111)
I20260203 21:11:53.841717 4708 leader_election.cc:304] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a7e51013f5041898fe34f4b64a59260; no voters: 35397be7e61f4b27a49e9449b9fdf085, 7344d7cd8dea4fa2ae705320daacaf49
I20260203 21:11:53.841843 5471 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260203 21:11:54.921655 4690 master_runner.cc:186] Error getting master registration for 127.2.32.190:35419: Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111),
I20260203 21:11:54.921767 4690 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260203 21:11:55.744587 2720 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 71: this message will repeat every 5th retry.
W20260203 21:11:56.102756 2721 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 71: this message will repeat every 5th retry.
W20260203 21:11:56.363924 2720 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 71: this message will repeat every 5th retry.
W20260203 21:11:57.143771 2721 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 71: this message will repeat every 5th retry.
I20260203 21:11:58.997993 5173 raft_consensus.cc:493] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:11:58.998138 5173 raft_consensus.cc:515] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:11:58.998620 5173 leader_election.cc:290] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:11:58.999359 2721 leader_election.cc:343] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 7786ef435bbd44daae12d3ee4728efb9
W20260203 21:11:58.999459 2720 leader_election.cc:343] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 7786ef435bbd44daae12d3ee4728efb9
I20260203 21:11:58.999536 2720 leader_election.cc:304] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:11:58.999694 5173 raft_consensus.cc:2749] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:11:59.922907 4690 master_runner.cc:186] Error getting master registration for 127.2.32.190:35419: Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111),
I20260203 21:11:59.923043 4690 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260203 21:12:00.616679 2720 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 76: this message will repeat every 5th retry.
I20260203 21:12:00.831451 5017 raft_consensus.cc:493] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d9e0cecab784cc0acc050ca1c89c5be)
I20260203 21:12:00.831604 5017 raft_consensus.cc:515] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:12:00.832155 5017 leader_election.cc:290] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:12:00.832893 2720 leader_election.cc:343] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: a375114bebc64385827b7b6e0060d1e4
W20260203 21:12:00.833001 2721 leader_election.cc:343] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: a375114bebc64385827b7b6e0060d1e4
I20260203 21:12:00.833083 2721 leader_election.cc:304] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:12:00.833215 5017 raft_consensus.cc:2749] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260203 21:12:01.014196 2721 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 76: this message will repeat every 5th retry.
W20260203 21:12:01.432502 2720 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 76: this message will repeat every 5th retry.
I20260203 21:12:01.591151 5173 raft_consensus.cc:493] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:12:01.591269 5173 raft_consensus.cc:515] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } }
I20260203 21:12:01.591652 5173 leader_election.cc:290] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223), 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897)
W20260203 21:12:01.592219 2721 leader_election.cc:343] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 06b80064d47349c2830718f553ba3d7d
W20260203 21:12:01.592300 2720 leader_election.cc:343] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 06b80064d47349c2830718f553ba3d7d
I20260203 21:12:01.592438 2720 leader_election.cc:304] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:12:01.592564 5173 raft_consensus.cc:2749] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260203 21:12:02.087217 2721 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 76: this message will repeat every 5th retry.
I20260203 21:12:04.923936 4690 master_runner.cc:186] Error getting master registration for 127.2.32.190:35419: Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111),
I20260203 21:12:04.924075 4690 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260203 21:12:05.446141 2720 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 81: this message will repeat every 5th retry.
W20260203 21:12:06.144773 2721 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 81: this message will repeat every 5th retry.
W20260203 21:12:06.496004 2720 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 81: this message will repeat every 5th retry.
I20260203 21:12:06.663784 5017 raft_consensus.cc:493] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:12:06.663924 5017 raft_consensus.cc:515] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:12:06.664439 5017 leader_election.cc:290] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:12:06.665109 2721 leader_election.cc:343] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 7786ef435bbd44daae12d3ee4728efb9
W20260203 21:12:06.665217 2720 leader_election.cc:343] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 7786ef435bbd44daae12d3ee4728efb9
I20260203 21:12:06.665325 2720 leader_election.cc:304] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:12:06.665465 5017 raft_consensus.cc:2749] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260203 21:12:06.904546 2721 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 81: this message will repeat every 5th retry.
I20260203 21:12:07.802358 4387 raft_consensus.cc:493] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d9e0cecab784cc0acc050ca1c89c5be)
I20260203 21:12:07.802508 4387 raft_consensus.cc:515] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:12:07.802992 4387 leader_election.cc:290] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223), 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897)
W20260203 21:12:07.803683 2721 leader_election.cc:343] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 6606bf5d7de047cda4a0523197210c1a
W20260203 21:12:07.803798 2720 leader_election.cc:343] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 6606bf5d7de047cda4a0523197210c1a
I20260203 21:12:07.803892 2720 leader_election.cc:304] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:12:07.804032 4387 raft_consensus.cc:2749] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:12:07.872525 4387 raft_consensus.cc:493] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:12:07.872678 4387 raft_consensus.cc:515] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:12:07.873119 4387 leader_election.cc:290] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:12:07.873792 2720 leader_election.cc:343] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 4d6ed92d766244489541e1c280afacb5
W20260203 21:12:07.873909 2721 leader_election.cc:343] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 4d6ed92d766244489541e1c280afacb5
I20260203 21:12:07.873993 2721 leader_election.cc:304] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:12:07.874140 4387 raft_consensus.cc:2749] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:12:08.901103 5639 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 21:12:08.901255 5639 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:12:08.901858 5639 leader_election.cc:290] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419), 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681)
W20260203 21:12:08.902566 4707 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260203 21:12:08.903304 4708 leader_election.cc:336] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419): Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111)
W20260203 21:12:08.903398 4707 leader_election.cc:336] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681): Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)
I20260203 21:12:08.903477 4707 leader_election.cc:304] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a7e51013f5041898fe34f4b64a59260; no voters: 35397be7e61f4b27a49e9449b9fdf085, 7344d7cd8dea4fa2ae705320daacaf49
I20260203 21:12:08.903640 5639 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260203 21:12:09.925133 4690 master_runner.cc:186] Error getting master registration for 127.2.32.190:35419: Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111),
I20260203 21:12:09.925249 4690 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260203 21:12:10.496726 5017 raft_consensus.cc:493] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d9e0cecab784cc0acc050ca1c89c5be)
I20260203 21:12:10.496851 5017 raft_consensus.cc:515] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:12:10.497238 5017 leader_election.cc:290] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:12:10.497877 2721 leader_election.cc:343] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 3ae68905ec1942448b444ecd01836805
W20260203 21:12:10.497978 2720 leader_election.cc:343] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 3ae68905ec1942448b444ecd01836805
I20260203 21:12:10.498037 2720 leader_election.cc:304] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:12:10.498160 5017 raft_consensus.cc:2749] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260203 21:12:10.584789 2720 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 86: this message will repeat every 5th retry.
I20260203 21:12:11.100848 5661 raft_consensus.cc:493] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d9e0cecab784cc0acc050ca1c89c5be)
I20260203 21:12:11.100984 5661 raft_consensus.cc:515] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:12:11.101434 5661 leader_election.cc:290] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:12:11.102169 2720 leader_election.cc:343] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: a375114bebc64385827b7b6e0060d1e4
W20260203 21:12:11.102263 2721 leader_election.cc:343] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: a375114bebc64385827b7b6e0060d1e4
I20260203 21:12:11.102403 2721 leader_election.cc:304] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:12:11.102582 5661 raft_consensus.cc:2749] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260203 21:12:11.320590 2721 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 86: this message will repeat every 5th retry.
W20260203 21:12:11.623996 2721 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 86: this message will repeat every 5th retry.
W20260203 21:12:11.865689 2720 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 86: this message will repeat every 5th retry.
I20260203 21:12:12.987888 5173 raft_consensus.cc:493] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:12:12.988046 5173 raft_consensus.cc:515] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } }
I20260203 21:12:12.988476 5173 leader_election.cc:290] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223), 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897)
W20260203 21:12:12.989277 2720 leader_election.cc:343] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 06b80064d47349c2830718f553ba3d7d
W20260203 21:12:12.989410 2721 leader_election.cc:343] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 06b80064d47349c2830718f553ba3d7d
I20260203 21:12:12.989499 2721 leader_election.cc:304] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:12:12.989632 5173 raft_consensus.cc:2749] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:12:13.672353 5697 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 21:12:13.672482 5697 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:12:13.672920 5697 leader_election.cc:290] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419), 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681)
W20260203 21:12:13.674098 4708 leader_election.cc:336] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419): Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111)
W20260203 21:12:13.674235 4707 leader_election.cc:336] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681): Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)
I20260203 21:12:13.674304 4707 leader_election.cc:304] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a7e51013f5041898fe34f4b64a59260; no voters: 35397be7e61f4b27a49e9449b9fdf085, 7344d7cd8dea4fa2ae705320daacaf49
I20260203 21:12:13.674430 5697 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260203 21:12:14.926316 4690 master_runner.cc:186] Error getting master registration for 127.2.32.190:35419: Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111),
I20260203 21:12:14.926448 4690 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260203 21:12:15.638203 2720 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 91: this message will repeat every 5th retry.
W20260203 21:12:16.199587 2721 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 91: this message will repeat every 5th retry.
W20260203 21:12:16.743181 2721 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 91: this message will repeat every 5th retry.
W20260203 21:12:16.948020 2720 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 91: this message will repeat every 5th retry.
I20260203 21:12:18.349749 5710 raft_consensus.cc:493] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:12:18.349901 5710 raft_consensus.cc:515] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:12:18.350329 5710 leader_election.cc:290] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:12:18.351068 2721 leader_election.cc:343] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 4d6ed92d766244489541e1c280afacb5
W20260203 21:12:18.351173 2720 leader_election.cc:343] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 4d6ed92d766244489541e1c280afacb5
I20260203 21:12:18.351263 2720 leader_election.cc:304] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:12:18.351400 5710 raft_consensus.cc:2749] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:12:18.484354 5710 raft_consensus.cc:493] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d9e0cecab784cc0acc050ca1c89c5be)
I20260203 21:12:18.484522 5710 raft_consensus.cc:515] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:12:18.485019 5710 leader_election.cc:290] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:12:18.486456 2720 leader_election.cc:343] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: a375114bebc64385827b7b6e0060d1e4
W20260203 21:12:18.486546 2721 leader_election.cc:343] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: a375114bebc64385827b7b6e0060d1e4
I20260203 21:12:18.486660 2721 leader_election.cc:304] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:12:18.486864 5017 raft_consensus.cc:2749] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:12:19.927460 4690 master_runner.cc:186] Error getting master registration for 127.2.32.190:35419: Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111),
I20260203 21:12:19.927589 4690 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260203 21:12:20.711345 2720 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 96: this message will repeat every 5th retry.
W20260203 21:12:21.182798 2721 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 96: this message will repeat every 5th retry.
I20260203 21:12:21.302918 5710 raft_consensus.cc:493] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:12:21.303067 5710 raft_consensus.cc:515] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } }
I20260203 21:12:21.303501 5710 leader_election.cc:290] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223), 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897)
W20260203 21:12:21.304198 2721 leader_election.cc:343] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 06b80064d47349c2830718f553ba3d7d
W20260203 21:12:21.304339 2720 leader_election.cc:343] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 06b80064d47349c2830718f553ba3d7d
I20260203 21:12:21.304436 2720 leader_election.cc:304] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:12:21.304589 5710 raft_consensus.cc:2749] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260203 21:12:21.997228 2721 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 96: this message will repeat every 5th retry.
I20260203 21:12:22.018596 5722 raft_consensus.cc:493] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:12:22.018718 5722 raft_consensus.cc:515] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:12:22.019241 5722 leader_election.cc:290] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:12:22.019832 2721 leader_election.cc:343] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 7786ef435bbd44daae12d3ee4728efb9
W20260203 21:12:22.019943 2720 leader_election.cc:343] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 7786ef435bbd44daae12d3ee4728efb9
I20260203 21:12:22.020006 2720 leader_election.cc:304] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:12:22.020138 5722 raft_consensus.cc:2749] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260203 21:12:22.551301 2720 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 96: this message will repeat every 5th retry.
I20260203 21:12:23.467051 5710 raft_consensus.cc:493] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d9e0cecab784cc0acc050ca1c89c5be)
I20260203 21:12:23.467198 5710 raft_consensus.cc:515] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:12:23.467622 5710 leader_election.cc:290] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223), 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897)
W20260203 21:12:23.468405 2721 leader_election.cc:343] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 6606bf5d7de047cda4a0523197210c1a
W20260203 21:12:23.468495 2720 leader_election.cc:343] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 6606bf5d7de047cda4a0523197210c1a
I20260203 21:12:23.468602 2720 leader_election.cc:304] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:12:23.468741 5710 raft_consensus.cc:2749] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:12:24.928481 4690 master_runner.cc:186] Error getting master registration for 127.2.32.190:35419: Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111),
I20260203 21:12:24.928611 4690 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260203 21:12:25.721933 2720 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 101: this message will repeat every 5th retry.
W20260203 21:12:26.069082 2721 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 101: this message will repeat every 5th retry.
I20260203 21:12:26.455504 5017 raft_consensus.cc:493] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d9e0cecab784cc0acc050ca1c89c5be)
I20260203 21:12:26.455647 5017 raft_consensus.cc:515] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:12:26.456091 5017 leader_election.cc:290] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:12:26.456936 2721 leader_election.cc:343] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 3ae68905ec1942448b444ecd01836805
W20260203 21:12:26.457051 2720 leader_election.cc:343] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 3ae68905ec1942448b444ecd01836805
I20260203 21:12:26.457119 2720 leader_election.cc:304] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:12:26.457245 5017 raft_consensus.cc:2749] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260203 21:12:26.744328 2832 heartbeater.cc:646] Failed to heartbeat to 127.2.32.190:35419 (885 consecutive failures): Network error: Failed to ping master at 127.2.32.190:35419: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111)
W20260203 21:12:26.947337 2721 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 101: this message will repeat every 5th retry.
W20260203 21:12:27.035308 2720 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 101: this message will repeat every 5th retry.
W20260203 21:12:27.168689 3107 heartbeater.cc:646] Failed to heartbeat to 127.2.32.189:42681 (212 consecutive failures): Network error: Failed to ping master at 127.2.32.189:42681: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)
W20260203 21:12:27.242075 2970 heartbeater.cc:646] Failed to heartbeat to 127.2.32.190:35419 (262 consecutive failures): Network error: Failed to ping master at 127.2.32.190:35419: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111)
I20260203 21:12:28.004202 5848 raft_consensus.cc:493] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:12:28.004348 5848 raft_consensus.cc:515] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } }
I20260203 21:12:28.004875 5848 leader_election.cc:290] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223), 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897)
W20260203 21:12:28.005545 2721 leader_election.cc:343] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 06b80064d47349c2830718f553ba3d7d
W20260203 21:12:28.005652 2720 leader_election.cc:343] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 06b80064d47349c2830718f553ba3d7d
I20260203 21:12:28.005748 2720 leader_election.cc:304] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:12:28.005892 5848 raft_consensus.cc:2749] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:12:29.363484 5710 raft_consensus.cc:493] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d9e0cecab784cc0acc050ca1c89c5be)
I20260203 21:12:29.363624 5710 raft_consensus.cc:515] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:12:29.364068 5710 leader_election.cc:290] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223), 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897)
W20260203 21:12:29.364775 2720 leader_election.cc:343] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 6606bf5d7de047cda4a0523197210c1a
W20260203 21:12:29.364907 2721 leader_election.cc:343] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 6606bf5d7de047cda4a0523197210c1a
I20260203 21:12:29.364948 2721 leader_election.cc:304] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:12:29.365087 5710 raft_consensus.cc:2749] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:12:29.575564 5877 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 21:12:29.575726 5877 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:12:29.576248 5877 leader_election.cc:290] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419), 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681)
W20260203 21:12:29.576757 4708 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260203 21:12:29.577368 4707 leader_election.cc:336] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681): Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)
W20260203 21:12:29.577441 4708 leader_election.cc:336] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419): Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111)
I20260203 21:12:29.577514 4708 leader_election.cc:304] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a7e51013f5041898fe34f4b64a59260; no voters: 35397be7e61f4b27a49e9449b9fdf085, 7344d7cd8dea4fa2ae705320daacaf49
I20260203 21:12:29.577739 5877 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260203 21:12:29.929369 4690 master_runner.cc:186] Error getting master registration for 127.2.32.190:35419: Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111),
I20260203 21:12:29.929492 4690 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260203 21:12:30.846232 2720 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 106: this message will repeat every 5th retry.
I20260203 21:12:30.887598 5017 raft_consensus.cc:493] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d9e0cecab784cc0acc050ca1c89c5be)
I20260203 21:12:30.887775 5017 raft_consensus.cc:515] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:12:30.888218 5017 leader_election.cc:290] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:12:30.888999 2721 leader_election.cc:343] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: a375114bebc64385827b7b6e0060d1e4
W20260203 21:12:30.889142 2720 leader_election.cc:343] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: a375114bebc64385827b7b6e0060d1e4
I20260203 21:12:30.889202 2720 leader_election.cc:304] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:12:30.889336 5017 raft_consensus.cc:2749] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260203 21:12:31.007067 2721 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 106: this message will repeat every 5th retry.
W20260203 21:12:31.636036 2721 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 106: this message will repeat every 5th retry.
W20260203 21:12:31.925064 2720 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 106: this message will repeat every 5th retry.
I20260203 21:12:32.268821 5710 raft_consensus.cc:493] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:12:32.268975 5710 raft_consensus.cc:515] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:12:32.269368 5710 leader_election.cc:290] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:12:32.270028 2720 leader_election.cc:343] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 7786ef435bbd44daae12d3ee4728efb9
W20260203 21:12:32.270136 2721 leader_election.cc:343] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 7786ef435bbd44daae12d3ee4728efb9
I20260203 21:12:32.270231 2721 leader_election.cc:304] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:12:32.270383 5710 raft_consensus.cc:2749] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:12:32.489009 5848 raft_consensus.cc:493] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:12:32.489135 5848 raft_consensus.cc:515] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:12:32.489522 5848 leader_election.cc:290] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:12:32.490067 2721 leader_election.cc:343] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 4d6ed92d766244489541e1c280afacb5
W20260203 21:12:32.490173 2720 leader_election.cc:343] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 4d6ed92d766244489541e1c280afacb5
I20260203 21:12:32.490270 2720 leader_election.cc:304] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:12:32.490406 5848 raft_consensus.cc:2749] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:12:34.931269 4690 master_runner.cc:186] Error getting master registration for 127.2.32.190:35419: Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111),
I20260203 21:12:34.931386 4690 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260203 21:12:35.861536 2721 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 111: this message will repeat every 5th retry.
W20260203 21:12:35.963469 2720 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 111: this message will repeat every 5th retry.
W20260203 21:12:36.892118 2721 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 111: this message will repeat every 5th retry.
W20260203 21:12:37.070724 2720 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 111: this message will repeat every 5th retry.
I20260203 21:12:39.932374 4690 master_runner.cc:186] Error getting master registration for 127.2.32.190:35419: Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111),
I20260203 21:12:39.932505 4690 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260203 21:12:40.778702 2721 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 116: this message will repeat every 5th retry.
W20260203 21:12:40.838824 2720 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 116: this message will repeat every 5th retry.
I20260203 21:12:41.125398 5974 raft_consensus.cc:493] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:12:41.125546 5974 raft_consensus.cc:515] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:12:41.126096 5974 leader_election.cc:290] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:12:41.126750 2721 leader_election.cc:343] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 4d6ed92d766244489541e1c280afacb5
W20260203 21:12:41.126860 2720 leader_election.cc:343] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 4d6ed92d766244489541e1c280afacb5
I20260203 21:12:41.126950 2720 leader_election.cc:304] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:12:41.127085 5974 raft_consensus.cc:2749] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260203 21:12:41.756495 2721 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 116: this message will repeat every 5th retry.
W20260203 21:12:42.162568 2720 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 116: this message will repeat every 5th retry.
I20260203 21:12:42.397009 5848 raft_consensus.cc:493] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d9e0cecab784cc0acc050ca1c89c5be)
I20260203 21:12:42.397161 5848 raft_consensus.cc:515] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:12:42.397578 5848 leader_election.cc:290] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:12:42.398253 2721 leader_election.cc:343] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: a375114bebc64385827b7b6e0060d1e4
W20260203 21:12:42.398347 2720 leader_election.cc:343] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: a375114bebc64385827b7b6e0060d1e4
I20260203 21:12:42.398438 2720 leader_election.cc:304] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:12:42.398725 5848 raft_consensus.cc:2749] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:12:43.048684 5974 raft_consensus.cc:493] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:12:43.048836 5974 raft_consensus.cc:515] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } }
I20260203 21:12:43.049249 5974 leader_election.cc:290] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223), 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897)
W20260203 21:12:43.049872 2720 leader_election.cc:343] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 06b80064d47349c2830718f553ba3d7d
W20260203 21:12:43.049974 2721 leader_election.cc:343] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 06b80064d47349c2830718f553ba3d7d
I20260203 21:12:43.050061 2721 leader_election.cc:304] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:12:43.050206 5974 raft_consensus.cc:2749] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:12:43.097610 5974 raft_consensus.cc:493] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:12:43.097739 5974 raft_consensus.cc:515] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:12:43.098129 5974 leader_election.cc:290] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:12:43.098773 2721 leader_election.cc:343] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 7786ef435bbd44daae12d3ee4728efb9
W20260203 21:12:43.098901 2720 leader_election.cc:343] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 7786ef435bbd44daae12d3ee4728efb9
I20260203 21:12:43.098958 2720 leader_election.cc:304] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:12:43.099080 5974 raft_consensus.cc:2749] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:12:44.558028 5848 raft_consensus.cc:493] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d9e0cecab784cc0acc050ca1c89c5be)
I20260203 21:12:44.558158 5848 raft_consensus.cc:515] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:12:44.558547 5848 leader_election.cc:290] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:12:44.559193 2720 leader_election.cc:343] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 3ae68905ec1942448b444ecd01836805
W20260203 21:12:44.559295 2721 leader_election.cc:343] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 3ae68905ec1942448b444ecd01836805
I20260203 21:12:44.559393 2721 leader_election.cc:304] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:12:44.559602 5848 raft_consensus.cc:2749] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:12:44.933528 4690 master_runner.cc:186] Error getting master registration for 127.2.32.190:35419: Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111),
I20260203 21:12:44.933652 4690 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260203 21:12:45.554905 5848 raft_consensus.cc:493] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:12:45.555042 5848 raft_consensus.cc:515] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } }
I20260203 21:12:45.555473 5848 leader_election.cc:290] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223), 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897)
W20260203 21:12:45.556102 2720 leader_election.cc:343] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 06b80064d47349c2830718f553ba3d7d
W20260203 21:12:45.556209 2721 leader_election.cc:343] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 06b80064d47349c2830718f553ba3d7d
I20260203 21:12:45.556303 2721 leader_election.cc:304] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:12:45.556432 5848 raft_consensus.cc:2749] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260203 21:12:45.560396 2721 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 121: this message will repeat every 5th retry.
I20260203 21:12:45.583294 6055 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 21:12:45.583420 6055 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:12:45.583945 6055 leader_election.cc:290] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419), 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681)
W20260203 21:12:45.584540 4708 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260203 21:12:45.585242 4707 leader_election.cc:336] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681): Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)
W20260203 21:12:45.585321 4708 leader_election.cc:336] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419): Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111)
I20260203 21:12:45.585395 4708 leader_election.cc:304] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a7e51013f5041898fe34f4b64a59260; no voters: 35397be7e61f4b27a49e9449b9fdf085, 7344d7cd8dea4fa2ae705320daacaf49
I20260203 21:12:45.585521 6055 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260203 21:12:45.750485 2720 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 121: this message will repeat every 5th retry.
I20260203 21:12:46.180351 5974 raft_consensus.cc:493] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d9e0cecab784cc0acc050ca1c89c5be)
I20260203 21:12:46.180492 5974 raft_consensus.cc:515] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:12:46.180893 5974 leader_election.cc:290] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223), 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897)
W20260203 21:12:46.181550 2720 leader_election.cc:343] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 6606bf5d7de047cda4a0523197210c1a
W20260203 21:12:46.181643 2721 leader_election.cc:343] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 6606bf5d7de047cda4a0523197210c1a
I20260203 21:12:46.181737 2721 leader_election.cc:304] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:12:46.181874 5974 raft_consensus.cc:2749] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260203 21:12:46.677176 2721 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 121: this message will repeat every 5th retry.
W20260203 21:12:47.162319 2720 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 121: this message will repeat every 5th retry.
I20260203 21:12:48.642177 6086 raft_consensus.cc:493] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:12:48.642347 6086 raft_consensus.cc:515] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:12:48.642767 6086 leader_election.cc:290] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:12:48.643489 2721 leader_election.cc:343] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 7786ef435bbd44daae12d3ee4728efb9
W20260203 21:12:48.643580 2720 leader_election.cc:343] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 7786ef435bbd44daae12d3ee4728efb9
I20260203 21:12:48.643702 2720 leader_election.cc:304] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:12:48.643843 6086 raft_consensus.cc:2749] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:12:49.934741 4690 master_runner.cc:186] Error getting master registration for 127.2.32.190:35419: Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111),
I20260203 21:12:49.934872 4690 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260203 21:12:50.665493 2721 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 126: this message will repeat every 5th retry.
W20260203 21:12:50.723323 2720 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 126: this message will repeat every 5th retry.
W20260203 21:12:51.197089 2721 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 126: this message will repeat every 5th retry.
W20260203 21:12:52.226999 2720 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 126: this message will repeat every 5th retry.
I20260203 21:12:53.152503 5974 raft_consensus.cc:493] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:12:53.152635 5974 raft_consensus.cc:515] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:12:53.153074 5974 leader_election.cc:290] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:12:53.153734 2720 leader_election.cc:343] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 4d6ed92d766244489541e1c280afacb5
W20260203 21:12:53.153843 2721 leader_election.cc:343] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 4d6ed92d766244489541e1c280afacb5
I20260203 21:12:53.153931 2721 leader_election.cc:304] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:12:53.154069 5974 raft_consensus.cc:2749] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:12:53.339461 5017 raft_consensus.cc:493] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d9e0cecab784cc0acc050ca1c89c5be)
I20260203 21:12:53.339608 5017 raft_consensus.cc:515] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:12:53.340073 5017 leader_election.cc:290] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:12:53.340755 2721 leader_election.cc:343] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: a375114bebc64385827b7b6e0060d1e4
W20260203 21:12:53.340852 2720 leader_election.cc:343] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: a375114bebc64385827b7b6e0060d1e4
I20260203 21:12:53.340952 2720 leader_election.cc:304] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:12:53.341107 5017 raft_consensus.cc:2749] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:12:53.960626 5017 raft_consensus.cc:493] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d9e0cecab784cc0acc050ca1c89c5be)
I20260203 21:12:53.960750 5017 raft_consensus.cc:515] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:12:53.961161 5017 leader_election.cc:290] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:12:53.961709 2721 leader_election.cc:343] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 3ae68905ec1942448b444ecd01836805
W20260203 21:12:53.961810 2720 leader_election.cc:343] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 3ae68905ec1942448b444ecd01836805
I20260203 21:12:53.961900 2720 leader_election.cc:304] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:12:53.962025 5017 raft_consensus.cc:2749] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:12:54.935885 4690 master_runner.cc:186] Error getting master registration for 127.2.32.190:35419: Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111),
I20260203 21:12:54.936062 4690 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260203 21:12:54.960098 4710 maintenance_manager.cc:419] P 8a7e51013f5041898fe34f4b64a59260: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033350
I20260203 21:12:55.009644 4709 maintenance_manager.cc:643] P 8a7e51013f5041898fe34f4b64a59260: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.049s user 0.021s sys 0.000s Metrics: {"bytes_written":24788,"cfile_init":1,"dirs.queue_time_us":212,"dirs.run_cpu_time_us":165,"dirs.run_wall_time_us":652,"drs_written":1,"lbm_read_time_us":53,"lbm_reads_lt_1ms":4,"lbm_write_time_us":524,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":62,"thread_start_us":167,"threads_started":2,"wal-append.queue_time_us":173}
I20260203 21:12:55.010505 4710 maintenance_manager.cc:419] P 8a7e51013f5041898fe34f4b64a59260: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 4172 bytes on disk
I20260203 21:12:55.011085 4709 maintenance_manager.cc:643] P 8a7e51013f5041898fe34f4b64a59260: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":49,"lbm_reads_lt_1ms":4}
W20260203 21:12:55.475786 2721 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 131: this message will repeat every 5th retry.
I20260203 21:12:55.576579 6086 raft_consensus.cc:493] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d9e0cecab784cc0acc050ca1c89c5be)
I20260203 21:12:55.576732 6086 raft_consensus.cc:515] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:12:55.577158 6086 leader_election.cc:290] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223), 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897)
W20260203 21:12:55.577803 2720 leader_election.cc:343] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 6606bf5d7de047cda4a0523197210c1a
W20260203 21:12:55.577903 2721 leader_election.cc:343] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 6606bf5d7de047cda4a0523197210c1a
I20260203 21:12:55.578038 2721 leader_election.cc:304] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:12:55.578194 6086 raft_consensus.cc:2749] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:12:55.654762 6086 raft_consensus.cc:493] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d9e0cecab784cc0acc050ca1c89c5be)
I20260203 21:12:55.654907 6086 raft_consensus.cc:515] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:12:55.655360 6086 leader_election.cc:290] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:12:55.656172 2721 leader_election.cc:343] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 3ae68905ec1942448b444ecd01836805
W20260203 21:12:55.656306 2720 leader_election.cc:343] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 3ae68905ec1942448b444ecd01836805
I20260203 21:12:55.656369 2720 leader_election.cc:304] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:12:55.656498 6086 raft_consensus.cc:2749] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260203 21:12:55.832454 2720 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 131: this message will repeat every 5th retry.
W20260203 21:12:56.276450 2721 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 131: this message will repeat every 5th retry.
W20260203 21:12:57.347115 2720 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 131: this message will repeat every 5th retry.
I20260203 21:12:58.367429 6086 raft_consensus.cc:493] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:12:58.367578 6086 raft_consensus.cc:515] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:12:58.368158 6086 leader_election.cc:290] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:12:58.368927 2720 leader_election.cc:343] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 4d6ed92d766244489541e1c280afacb5
W20260203 21:12:58.369040 2721 leader_election.cc:343] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 4d6ed92d766244489541e1c280afacb5
I20260203 21:12:58.369122 2721 leader_election.cc:304] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:12:58.369557 5974 raft_consensus.cc:2749] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:12:59.937283 4690 master_runner.cc:186] Error getting master registration for 127.2.32.190:35419: Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111),
I20260203 21:12:59.937422 4690 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260203 21:13:00.387956 2721 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 136: this message will repeat every 5th retry.
W20260203 21:13:00.820791 2720 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 136: this message will repeat every 5th retry.
W20260203 21:13:01.715111 2721 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 136: this message will repeat every 5th retry.
W20260203 21:13:02.041464 2720 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 136: this message will repeat every 5th retry.
I20260203 21:13:02.937860 6302 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 21:13:02.937999 6302 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:13:02.938488 6302 leader_election.cc:290] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419), 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681)
W20260203 21:13:02.939090 4707 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)
W20260203 21:13:02.939090 4708 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260203 21:13:02.939787 4707 leader_election.cc:336] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681): Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)
W20260203 21:13:02.939867 4708 leader_election.cc:336] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419): Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111)
I20260203 21:13:02.939955 4708 leader_election.cc:304] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a7e51013f5041898fe34f4b64a59260; no voters: 35397be7e61f4b27a49e9449b9fdf085, 7344d7cd8dea4fa2ae705320daacaf49
I20260203 21:13:02.940111 6302 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260203 21:13:03.878458 5974 raft_consensus.cc:493] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:13:03.878623 5974 raft_consensus.cc:515] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } }
I20260203 21:13:03.879076 5974 leader_election.cc:290] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223), 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897)
W20260203 21:13:03.880050 2721 leader_election.cc:343] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 06b80064d47349c2830718f553ba3d7d
W20260203 21:13:03.880151 2720 leader_election.cc:343] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 06b80064d47349c2830718f553ba3d7d
I20260203 21:13:03.880259 2720 leader_election.cc:304] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:13:03.880395 5974 raft_consensus.cc:2749] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:13:03.888569 5974 raft_consensus.cc:493] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d9e0cecab784cc0acc050ca1c89c5be)
I20260203 21:13:03.888698 5974 raft_consensus.cc:515] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:13:03.889094 5974 leader_election.cc:290] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223), 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897)
W20260203 21:13:03.889739 2720 leader_election.cc:343] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 6606bf5d7de047cda4a0523197210c1a
W20260203 21:13:03.889835 2721 leader_election.cc:343] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 6606bf5d7de047cda4a0523197210c1a
I20260203 21:13:03.889928 2721 leader_election.cc:304] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:13:03.890062 5974 raft_consensus.cc:2749] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:13:03.914096 5974 raft_consensus.cc:493] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:13:03.914254 5974 raft_consensus.cc:515] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:13:03.914752 5974 leader_election.cc:290] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:13:03.915351 2721 leader_election.cc:343] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 7786ef435bbd44daae12d3ee4728efb9
W20260203 21:13:03.915477 2720 leader_election.cc:343] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 7786ef435bbd44daae12d3ee4728efb9
I20260203 21:13:03.915550 2720 leader_election.cc:304] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:13:03.915699 5974 raft_consensus.cc:2749] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:13:04.130146 6086 raft_consensus.cc:493] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:13:04.130292 6086 raft_consensus.cc:515] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:13:04.130879 6086 leader_election.cc:290] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:13:04.131809 2720 leader_election.cc:343] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 4d6ed92d766244489541e1c280afacb5
W20260203 21:13:04.131984 2721 leader_election.cc:343] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 4d6ed92d766244489541e1c280afacb5
I20260203 21:13:04.132109 2721 leader_election.cc:304] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:13:04.132274 6086 raft_consensus.cc:2749] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:13:04.938503 4690 master_runner.cc:186] Error getting master registration for 127.2.32.190:35419: Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111),
I20260203 21:13:04.938658 4690 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260203 21:13:05.428059 2721 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 141: this message will repeat every 5th retry.
W20260203 21:13:06.305155 2720 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 141: this message will repeat every 5th retry.
W20260203 21:13:06.482052 2721 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 141: this message will repeat every 5th retry.
I20260203 21:13:06.614091 5974 raft_consensus.cc:493] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:13:06.614272 5974 raft_consensus.cc:515] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:13:06.614723 5974 leader_election.cc:290] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:13:06.615589 2721 leader_election.cc:343] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 4d6ed92d766244489541e1c280afacb5
W20260203 21:13:06.615725 2720 leader_election.cc:343] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 4d6ed92d766244489541e1c280afacb5
I20260203 21:13:06.615813 2720 leader_election.cc:304] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:13:06.615975 5974 raft_consensus.cc:2749] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:13:06.758404 5974 raft_consensus.cc:493] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d9e0cecab784cc0acc050ca1c89c5be)
I20260203 21:13:06.758538 5974 raft_consensus.cc:515] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:13:06.758939 5974 leader_election.cc:290] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:13:06.759548 2721 leader_election.cc:343] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: a375114bebc64385827b7b6e0060d1e4
W20260203 21:13:06.759649 2720 leader_election.cc:343] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: a375114bebc64385827b7b6e0060d1e4
I20260203 21:13:06.759756 2720 leader_election.cc:304] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:13:06.759913 5974 raft_consensus.cc:2749] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260203 21:13:07.220094 2720 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 141: this message will repeat every 5th retry.
I20260203 21:13:08.578166 6086 raft_consensus.cc:493] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:13:08.578320 6086 raft_consensus.cc:515] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:13:08.578787 6086 leader_election.cc:290] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:13:08.579394 2720 leader_election.cc:343] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 7786ef435bbd44daae12d3ee4728efb9
W20260203 21:13:08.579485 2721 leader_election.cc:343] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 7786ef435bbd44daae12d3ee4728efb9
I20260203 21:13:08.579582 2721 leader_election.cc:304] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:13:08.579741 6086 raft_consensus.cc:2749] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:13:08.867938 6198 raft_consensus.cc:493] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d9e0cecab784cc0acc050ca1c89c5be)
I20260203 21:13:08.868075 6198 raft_consensus.cc:515] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:13:08.868496 6198 leader_election.cc:290] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:13:08.869282 2721 leader_election.cc:343] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 3ae68905ec1942448b444ecd01836805
W20260203 21:13:08.869390 2720 leader_election.cc:343] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 3ae68905ec1942448b444ecd01836805
I20260203 21:13:08.869479 2720 leader_election.cc:304] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:13:08.869622 6198 raft_consensus.cc:2749] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:13:09.939893 4690 master_runner.cc:186] Error getting master registration for 127.2.32.190:35419: Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111),
I20260203 21:13:09.940032 4690 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260203 21:13:10.393644 2721 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 146: this message will repeat every 5th retry.
W20260203 21:13:11.219918 2720 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 146: this message will repeat every 5th retry.
W20260203 21:13:11.265844 2721 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 146: this message will repeat every 5th retry.
W20260203 21:13:12.281900 2720 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 146: this message will repeat every 5th retry.
I20260203 21:13:13.323829 6460 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 21:13:13.323966 6460 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:13:13.324370 6460 leader_election.cc:290] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419), 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681)
W20260203 21:13:13.324975 4707 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)
W20260203 21:13:13.325630 4707 leader_election.cc:336] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681): Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)
W20260203 21:13:13.325752 4708 leader_election.cc:336] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419): Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111)
I20260203 21:13:13.325834 4708 leader_election.cc:304] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a7e51013f5041898fe34f4b64a59260; no voters: 35397be7e61f4b27a49e9449b9fdf085, 7344d7cd8dea4fa2ae705320daacaf49
I20260203 21:13:13.325963 6460 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260203 21:13:14.738188 6371 raft_consensus.cc:493] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d9e0cecab784cc0acc050ca1c89c5be)
I20260203 21:13:14.738462 6371 raft_consensus.cc:515] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:13:14.739020 6371 leader_election.cc:290] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:13:14.739743 2721 leader_election.cc:343] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 3ae68905ec1942448b444ecd01836805
W20260203 21:13:14.739861 2720 leader_election.cc:343] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 3ae68905ec1942448b444ecd01836805
I20260203 21:13:14.739920 2720 leader_election.cc:304] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:13:14.740072 6371 raft_consensus.cc:2749] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:13:14.941112 4690 master_runner.cc:186] Error getting master registration for 127.2.32.190:35419: Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111),
I20260203 21:13:14.941250 4690 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260203 21:13:15.145817 2721 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 151: this message will repeat every 5th retry.
W20260203 21:13:16.173195 2720 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 151: this message will repeat every 5th retry.
W20260203 21:13:16.472841 2721 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 151: this message will repeat every 5th retry.
I20260203 21:13:16.819278 6198 raft_consensus.cc:493] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d9e0cecab784cc0acc050ca1c89c5be)
I20260203 21:13:16.819423 6198 raft_consensus.cc:515] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:13:16.819885 6198 leader_election.cc:290] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:13:16.820611 2720 leader_election.cc:343] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 3ae68905ec1942448b444ecd01836805
W20260203 21:13:16.820709 2721 leader_election.cc:343] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 3ae68905ec1942448b444ecd01836805
I20260203 21:13:16.820786 2721 leader_election.cc:304] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:13:16.820933 6198 raft_consensus.cc:2749] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260203 21:13:17.276053 2720 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 151: this message will repeat every 5th retry.
I20260203 21:13:18.383000 6198 raft_consensus.cc:493] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:13:18.383217 6198 raft_consensus.cc:515] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:13:18.383692 6198 leader_election.cc:290] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:13:18.384466 2721 leader_election.cc:343] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 4d6ed92d766244489541e1c280afacb5
W20260203 21:13:18.384687 2720 leader_election.cc:343] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 4d6ed92d766244489541e1c280afacb5
I20260203 21:13:18.384785 2720 leader_election.cc:304] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:13:18.384949 6198 raft_consensus.cc:2749] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:13:19.942517 4690 master_runner.cc:186] Error getting master registration for 127.2.32.190:35419: Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111),
I20260203 21:13:19.942668 4690 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260203 21:13:20.512651 2721 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 156: this message will repeat every 5th retry.
I20260203 21:13:20.576102 6198 raft_consensus.cc:493] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:13:20.576228 6198 raft_consensus.cc:515] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } }
I20260203 21:13:20.576599 6198 leader_election.cc:290] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223), 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897)
W20260203 21:13:20.577210 2720 leader_election.cc:343] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 06b80064d47349c2830718f553ba3d7d
W20260203 21:13:20.577368 2721 leader_election.cc:343] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 06b80064d47349c2830718f553ba3d7d
I20260203 21:13:20.577445 2721 leader_election.cc:304] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:13:20.577574 6198 raft_consensus.cc:2749] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260203 21:13:20.975144 2721 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 156: this message will repeat every 5th retry.
I20260203 21:13:21.031193 6086 raft_consensus.cc:493] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d9e0cecab784cc0acc050ca1c89c5be)
I20260203 21:13:21.031361 6086 raft_consensus.cc:515] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:13:21.031822 6086 leader_election.cc:290] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223), 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897)
W20260203 21:13:21.032526 2721 leader_election.cc:343] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 6606bf5d7de047cda4a0523197210c1a
W20260203 21:13:21.032631 2720 leader_election.cc:343] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 6606bf5d7de047cda4a0523197210c1a
I20260203 21:13:21.032713 2720 leader_election.cc:304] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:13:21.032860 6086 raft_consensus.cc:2749] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260203 21:13:21.377661 2720 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 156: this message will repeat every 5th retry.
W20260203 21:13:22.465399 2720 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 156: this message will repeat every 5th retry.
I20260203 21:13:22.518117 6371 raft_consensus.cc:493] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d9e0cecab784cc0acc050ca1c89c5be)
I20260203 21:13:22.518281 6371 raft_consensus.cc:515] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:13:22.518841 6371 leader_election.cc:290] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:13:22.519465 2720 leader_election.cc:343] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: a375114bebc64385827b7b6e0060d1e4
W20260203 21:13:22.519639 2721 leader_election.cc:343] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: a375114bebc64385827b7b6e0060d1e4
I20260203 21:13:22.519727 2721 leader_election.cc:304] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:13:22.519866 6371 raft_consensus.cc:2749] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:13:22.962888 6607 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 21:13:22.963027 6607 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:13:22.963439 6607 leader_election.cc:290] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419), 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681)
W20260203 21:13:22.964005 4708 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260203 21:13:22.964645 4707 leader_election.cc:336] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681): Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)
W20260203 21:13:22.964728 4708 leader_election.cc:336] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419): Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111)
I20260203 21:13:22.964804 4708 leader_election.cc:304] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a7e51013f5041898fe34f4b64a59260; no voters: 35397be7e61f4b27a49e9449b9fdf085, 7344d7cd8dea4fa2ae705320daacaf49
I20260203 21:13:22.965031 6607 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260203 21:13:23.538209 6198 raft_consensus.cc:493] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:13:23.538345 6198 raft_consensus.cc:515] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:13:23.538738 6198 leader_election.cc:290] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:13:23.539415 2721 leader_election.cc:343] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 4d6ed92d766244489541e1c280afacb5
W20260203 21:13:23.539527 2720 leader_election.cc:343] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 4d6ed92d766244489541e1c280afacb5
I20260203 21:13:23.539585 2720 leader_election.cc:304] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:13:23.539746 6198 raft_consensus.cc:2749] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:13:23.593861 6198 raft_consensus.cc:493] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d9e0cecab784cc0acc050ca1c89c5be)
I20260203 21:13:23.594038 6198 raft_consensus.cc:515] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:13:23.594450 6198 leader_election.cc:290] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:13:23.595184 2720 leader_election.cc:343] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 3ae68905ec1942448b444ecd01836805
W20260203 21:13:23.595281 2721 leader_election.cc:343] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 3ae68905ec1942448b444ecd01836805
I20260203 21:13:23.595376 2721 leader_election.cc:304] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:13:23.595537 6198 raft_consensus.cc:2749] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:13:24.943797 4690 master_runner.cc:186] Error getting master registration for 127.2.32.190:35419: Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111),
I20260203 21:13:24.943931 4690 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260203 21:13:25.065397 2721 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 161: this message will repeat every 5th retry.
W20260203 21:13:25.672813 2721 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 161: this message will repeat every 5th retry.
I20260203 21:13:25.939940 6641 raft_consensus.cc:493] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d9e0cecab784cc0acc050ca1c89c5be)
I20260203 21:13:25.940089 6641 raft_consensus.cc:515] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:13:25.940639 6641 leader_election.cc:290] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:13:25.941473 2720 leader_election.cc:343] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 3ae68905ec1942448b444ecd01836805
W20260203 21:13:25.941579 2721 leader_election.cc:343] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 3ae68905ec1942448b444ecd01836805
I20260203 21:13:25.941689 2721 leader_election.cc:304] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:13:25.941845 6641 raft_consensus.cc:2749] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260203 21:13:26.284726 2720 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 161: this message will repeat every 5th retry.
I20260203 21:13:26.907049 6371 raft_consensus.cc:493] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:13:26.907218 6371 raft_consensus.cc:515] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:13:26.907701 6371 leader_election.cc:290] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:13:26.908334 2720 leader_election.cc:343] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 7786ef435bbd44daae12d3ee4728efb9
W20260203 21:13:26.908489 2721 leader_election.cc:343] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 7786ef435bbd44daae12d3ee4728efb9
I20260203 21:13:26.908581 2721 leader_election.cc:304] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:13:26.908737 6371 raft_consensus.cc:2749] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260203 21:13:27.091295 2832 heartbeater.cc:646] Failed to heartbeat to 127.2.32.190:35419 (1368 consecutive failures): Network error: Failed to ping master at 127.2.32.190:35419: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111)
W20260203 21:13:27.284073 3106 heartbeater.cc:646] Failed to heartbeat to 127.2.32.190:35419 (389 consecutive failures): Network error: Failed to ping master at 127.2.32.190:35419: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111)
W20260203 21:13:27.357816 2971 heartbeater.cc:646] Failed to heartbeat to 127.2.32.189:42681 (331 consecutive failures): Network error: Failed to ping master at 127.2.32.189:42681: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)
W20260203 21:13:27.663636 2720 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 161: this message will repeat every 5th retry.
I20260203 21:13:29.823648 6371 raft_consensus.cc:493] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d9e0cecab784cc0acc050ca1c89c5be)
I20260203 21:13:29.823805 6371 raft_consensus.cc:515] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:13:29.824316 6371 leader_election.cc:290] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223), 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897)
W20260203 21:13:29.825016 2721 leader_election.cc:343] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 6606bf5d7de047cda4a0523197210c1a
W20260203 21:13:29.825126 2720 leader_election.cc:343] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 6606bf5d7de047cda4a0523197210c1a
I20260203 21:13:29.825187 2720 leader_election.cc:304] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:13:29.825314 6371 raft_consensus.cc:2749] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:13:29.944947 4690 master_runner.cc:186] Error getting master registration for 127.2.32.190:35419: Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111),
I20260203 21:13:29.945071 4690 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260203 21:13:30.000746 6086 raft_consensus.cc:493] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d9e0cecab784cc0acc050ca1c89c5be)
I20260203 21:13:30.000897 6086 raft_consensus.cc:515] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:13:30.001333 6086 leader_election.cc:290] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:13:30.002100 2720 leader_election.cc:343] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: a375114bebc64385827b7b6e0060d1e4
W20260203 21:13:30.002223 2721 leader_election.cc:343] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: a375114bebc64385827b7b6e0060d1e4
I20260203 21:13:30.002305 2721 leader_election.cc:304] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:13:30.002451 6086 raft_consensus.cc:2749] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260203 21:13:30.226979 2721 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 166: this message will repeat every 5th retry.
W20260203 21:13:30.775784 2721 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 166: this message will repeat every 5th retry.
W20260203 21:13:31.162751 2720 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 166: this message will repeat every 5th retry.
W20260203 21:13:32.928188 2720 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 166: this message will repeat every 5th retry.
I20260203 21:13:33.039979 6371 raft_consensus.cc:493] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:13:33.040135 6371 raft_consensus.cc:515] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } }
I20260203 21:13:33.040539 6371 leader_election.cc:290] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223), 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897)
W20260203 21:13:33.041260 2720 leader_election.cc:343] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 06b80064d47349c2830718f553ba3d7d
W20260203 21:13:33.041370 2721 leader_election.cc:343] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 06b80064d47349c2830718f553ba3d7d
I20260203 21:13:33.041467 2721 leader_election.cc:304] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:13:33.041615 6371 raft_consensus.cc:2749] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:13:33.139778 6641 raft_consensus.cc:493] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:13:33.139886 6641 raft_consensus.cc:515] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:13:33.140264 6641 leader_election.cc:290] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:13:33.140796 2721 leader_election.cc:343] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 4d6ed92d766244489541e1c280afacb5
W20260203 21:13:33.140887 2720 leader_election.cc:343] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 4d6ed92d766244489541e1c280afacb5
I20260203 21:13:33.140971 2720 leader_election.cc:304] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:13:33.141103 6641 raft_consensus.cc:2749] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:13:34.945962 4690 master_runner.cc:186] Error getting master registration for 127.2.32.190:35419: Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111),
I20260203 21:13:34.946082 4690 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260203 21:13:35.120908 6371 raft_consensus.cc:493] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:13:35.121017 6371 raft_consensus.cc:515] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:13:35.121349 6371 leader_election.cc:290] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:13:35.121883 2720 leader_election.cc:343] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 7786ef435bbd44daae12d3ee4728efb9
W20260203 21:13:35.121992 2721 leader_election.cc:343] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 7786ef435bbd44daae12d3ee4728efb9
I20260203 21:13:35.122048 2721 leader_election.cc:304] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:13:35.122176 6371 raft_consensus.cc:2749] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260203 21:13:35.692377 2721 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 171: this message will repeat every 5th retry.
W20260203 21:13:35.710747 2721 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 171: this message will repeat every 5th retry.
W20260203 21:13:36.480670 2720 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 171: this message will repeat every 5th retry.
I20260203 21:13:36.794806 6371 raft_consensus.cc:493] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d9e0cecab784cc0acc050ca1c89c5be)
I20260203 21:13:36.794967 6371 raft_consensus.cc:515] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:13:36.795397 6371 leader_election.cc:290] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:13:36.796118 2721 leader_election.cc:343] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: a375114bebc64385827b7b6e0060d1e4
W20260203 21:13:36.796218 2720 leader_election.cc:343] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: a375114bebc64385827b7b6e0060d1e4
I20260203 21:13:36.796303 2720 leader_election.cc:304] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:13:36.796433 6371 raft_consensus.cc:2749] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260203 21:13:38.145262 2720 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 171: this message will repeat every 5th retry.
I20260203 21:13:39.947160 4690 master_runner.cc:186] Error getting master registration for 127.2.32.190:35419: Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111),
I20260203 21:13:39.947290 4690 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260203 21:13:40.805557 6868 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 21:13:40.805698 6868 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:13:40.806164 6868 leader_election.cc:290] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419), 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681)
W20260203 21:13:40.806721 4707 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260203 21:13:40.807325 4708 leader_election.cc:336] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419): Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111)
W20260203 21:13:40.807410 4707 leader_election.cc:336] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681): Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)
I20260203 21:13:40.807488 4707 leader_election.cc:304] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a7e51013f5041898fe34f4b64a59260; no voters: 35397be7e61f4b27a49e9449b9fdf085, 7344d7cd8dea4fa2ae705320daacaf49
I20260203 21:13:40.807632 6868 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260203 21:13:40.930334 2721 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 176: this message will repeat every 5th retry.
W20260203 21:13:40.960940 2721 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 176: this message will repeat every 5th retry.
W20260203 21:13:41.268195 2720 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 176: this message will repeat every 5th retry.
I20260203 21:13:41.398695 6841 raft_consensus.cc:493] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:13:41.398838 6841 raft_consensus.cc:515] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:13:41.399255 6841 leader_election.cc:290] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:13:41.399910 2721 leader_election.cc:343] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 4d6ed92d766244489541e1c280afacb5
W20260203 21:13:41.400017 2720 leader_election.cc:343] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 4d6ed92d766244489541e1c280afacb5
I20260203 21:13:41.400102 2720 leader_election.cc:304] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:13:41.400229 6841 raft_consensus.cc:2749] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260203 21:13:43.123818 2720 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 176: this message will repeat every 5th retry.
I20260203 21:13:44.640547 6841 raft_consensus.cc:493] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d9e0cecab784cc0acc050ca1c89c5be)
I20260203 21:13:44.640681 6841 raft_consensus.cc:515] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:13:44.641304 6841 leader_election.cc:290] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:13:44.641923 2721 leader_election.cc:343] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: a375114bebc64385827b7b6e0060d1e4
W20260203 21:13:44.642025 2720 leader_election.cc:343] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: a375114bebc64385827b7b6e0060d1e4
I20260203 21:13:44.642110 2720 leader_election.cc:304] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:13:44.642242 6841 raft_consensus.cc:2749] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:13:44.948328 4690 master_runner.cc:186] Error getting master registration for 127.2.32.190:35419: Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111),
I20260203 21:13:44.948457 4690 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260203 21:13:45.371791 6934 raft_consensus.cc:493] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d9e0cecab784cc0acc050ca1c89c5be)
I20260203 21:13:45.371930 6934 raft_consensus.cc:515] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:13:45.372432 6934 leader_election.cc:290] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:13:45.373116 2720 leader_election.cc:343] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 3ae68905ec1942448b444ecd01836805
W20260203 21:13:45.373210 2721 leader_election.cc:343] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 3ae68905ec1942448b444ecd01836805
I20260203 21:13:45.373289 2721 leader_election.cc:304] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:13:45.373459 6934 raft_consensus.cc:2749] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260203 21:13:46.078133 2720 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 181: this message will repeat every 5th retry.
W20260203 21:13:46.262966 2721 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 181: this message will repeat every 5th retry.
W20260203 21:13:46.277608 2721 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 181: this message will repeat every 5th retry.
I20260203 21:13:47.196518 6959 raft_consensus.cc:493] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:13:47.196666 6959 raft_consensus.cc:515] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } }
I20260203 21:13:47.197113 6959 leader_election.cc:290] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223), 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897)
W20260203 21:13:47.197757 2720 leader_election.cc:343] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 06b80064d47349c2830718f553ba3d7d
W20260203 21:13:47.197856 2721 leader_election.cc:343] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 06b80064d47349c2830718f553ba3d7d
I20260203 21:13:47.197935 2721 leader_election.cc:304] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:13:47.198091 6959 raft_consensus.cc:2749] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260203 21:13:48.091130 2720 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 181: this message will repeat every 5th retry.
I20260203 21:13:48.147403 6371 raft_consensus.cc:493] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d9e0cecab784cc0acc050ca1c89c5be)
I20260203 21:13:48.147531 6371 raft_consensus.cc:515] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:13:48.147966 6371 leader_election.cc:290] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223), 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897)
W20260203 21:13:48.148541 2721 leader_election.cc:343] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 6606bf5d7de047cda4a0523197210c1a
W20260203 21:13:48.148631 2720 leader_election.cc:343] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 6606bf5d7de047cda4a0523197210c1a
I20260203 21:13:48.148710 2720 leader_election.cc:304] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:13:48.148864 6371 raft_consensus.cc:2749] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:13:49.949506 4690 master_runner.cc:186] Error getting master registration for 127.2.32.190:35419: Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111),
I20260203 21:13:49.949640 4690 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260203 21:13:50.793768 2720 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 186: this message will repeat every 5th retry.
I20260203 21:13:51.231600 7020 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 21:13:51.231794 7020 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:13:51.232223 7020 leader_election.cc:290] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419), 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681)
W20260203 21:13:51.232882 4708 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260203 21:13:51.234113 4708 leader_election.cc:336] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419): Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111)
W20260203 21:13:51.234634 4707 leader_election.cc:336] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681): Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)
I20260203 21:13:51.234826 4707 leader_election.cc:304] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a7e51013f5041898fe34f4b64a59260; no voters: 35397be7e61f4b27a49e9449b9fdf085, 7344d7cd8dea4fa2ae705320daacaf49
I20260203 21:13:51.234972 7020 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260203 21:13:51.280344 2721 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 186: this message will repeat every 5th retry.
W20260203 21:13:51.398895 2721 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 186: this message will repeat every 5th retry.
I20260203 21:13:52.018327 6840 raft_consensus.cc:493] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:13:52.018481 6840 raft_consensus.cc:515] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:13:52.018929 6840 leader_election.cc:290] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:13:52.019816 2720 leader_election.cc:343] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 7786ef435bbd44daae12d3ee4728efb9
W20260203 21:13:52.019929 2721 leader_election.cc:343] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 7786ef435bbd44daae12d3ee4728efb9
I20260203 21:13:52.019990 2721 leader_election.cc:304] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:13:52.020115 6840 raft_consensus.cc:2749] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260203 21:13:53.206378 2720 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 186: this message will repeat every 5th retry.
I20260203 21:13:54.026203 6959 raft_consensus.cc:493] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d9e0cecab784cc0acc050ca1c89c5be)
I20260203 21:13:54.026330 6959 raft_consensus.cc:515] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:13:54.026739 6959 leader_election.cc:290] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:13:54.027339 2721 leader_election.cc:343] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: a375114bebc64385827b7b6e0060d1e4
W20260203 21:13:54.027428 2720 leader_election.cc:343] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: a375114bebc64385827b7b6e0060d1e4
I20260203 21:13:54.027506 2720 leader_election.cc:304] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:13:54.027637 6959 raft_consensus.cc:2749] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:13:54.754164 6840 raft_consensus.cc:493] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:13:54.754361 6840 raft_consensus.cc:515] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:13:54.754889 6840 leader_election.cc:290] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:13:54.756117 2721 leader_election.cc:343] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 4d6ed92d766244489541e1c280afacb5
W20260203 21:13:54.756240 2720 leader_election.cc:343] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 4d6ed92d766244489541e1c280afacb5
I20260203 21:13:54.756465 2720 leader_election.cc:304] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:13:54.756646 6840 raft_consensus.cc:2749] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:13:54.953665 4690 master_runner.cc:186] Error getting master registration for 127.2.32.190:35419: Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111),
I20260203 21:13:54.953806 4690 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260203 21:13:54.955032 6371 raft_consensus.cc:493] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:13:54.955164 6371 raft_consensus.cc:515] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } }
I20260203 21:13:54.955578 6371 leader_election.cc:290] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223), 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897)
W20260203 21:13:54.956429 2720 leader_election.cc:343] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 06b80064d47349c2830718f553ba3d7d
W20260203 21:13:54.956553 2721 leader_election.cc:343] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 06b80064d47349c2830718f553ba3d7d
I20260203 21:13:54.956621 2721 leader_election.cc:304] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:13:54.956751 6959 raft_consensus.cc:2749] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260203 21:13:55.587477 2720 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 191: this message will repeat every 5th retry.
W20260203 21:13:56.120447 2721 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 191: this message will repeat every 5th retry.
W20260203 21:13:56.134809 2721 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 191: this message will repeat every 5th retry.
I20260203 21:13:56.514462 6959 raft_consensus.cc:493] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:13:56.514611 6959 raft_consensus.cc:515] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:13:56.515030 6959 leader_election.cc:290] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:13:56.515745 2720 leader_election.cc:343] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 7786ef435bbd44daae12d3ee4728efb9
W20260203 21:13:56.515847 2721 leader_election.cc:343] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 7786ef435bbd44daae12d3ee4728efb9
I20260203 21:13:56.515939 2721 leader_election.cc:304] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:13:56.516156 6959 raft_consensus.cc:2749] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260203 21:13:57.732019 2720 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 191: this message will repeat every 5th retry.
I20260203 21:13:59.954713 4690 master_runner.cc:186] Error getting master registration for 127.2.32.190:35419: Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111),
I20260203 21:13:59.954831 4690 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260203 21:14:00.405591 6371 raft_consensus.cc:493] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:14:00.405750 6371 raft_consensus.cc:515] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:14:00.406293 6371 leader_election.cc:290] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:14:00.407452 2721 leader_election.cc:343] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 7786ef435bbd44daae12d3ee4728efb9
W20260203 21:14:00.407780 2720 leader_election.cc:343] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 7786ef435bbd44daae12d3ee4728efb9
I20260203 21:14:00.407897 2720 leader_election.cc:304] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:14:00.408088 6371 raft_consensus.cc:2749] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:14:00.412431 6371 raft_consensus.cc:493] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:14:00.412540 6371 raft_consensus.cc:515] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:14:00.412941 6371 leader_election.cc:290] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:14:00.413548 2721 leader_election.cc:343] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 4d6ed92d766244489541e1c280afacb5
W20260203 21:14:00.413650 2720 leader_election.cc:343] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 4d6ed92d766244489541e1c280afacb5
I20260203 21:14:00.413727 2720 leader_election.cc:304] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:14:00.413858 6371 raft_consensus.cc:2749] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260203 21:14:00.575090 2720 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 196: this message will repeat every 5th retry.
W20260203 21:14:01.104099 2721 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 196: this message will repeat every 5th retry.
W20260203 21:14:01.318334 2721 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 196: this message will repeat every 5th retry.
W20260203 21:14:02.932755 2720 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 196: this message will repeat every 5th retry.
I20260203 21:14:03.675856 6959 raft_consensus.cc:493] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d9e0cecab784cc0acc050ca1c89c5be)
I20260203 21:14:03.676008 6959 raft_consensus.cc:515] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:14:03.676438 6959 leader_election.cc:290] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223), 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897)
W20260203 21:14:03.677248 2720 leader_election.cc:343] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 6606bf5d7de047cda4a0523197210c1a
W20260203 21:14:03.677357 2721 leader_election.cc:343] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 6606bf5d7de047cda4a0523197210c1a
I20260203 21:14:03.677435 2721 leader_election.cc:304] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:14:03.677567 6959 raft_consensus.cc:2749] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:14:03.930068 6959 raft_consensus.cc:493] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d9e0cecab784cc0acc050ca1c89c5be)
I20260203 21:14:03.930223 6959 raft_consensus.cc:515] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:14:03.930603 6959 leader_election.cc:290] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:14:03.931277 2721 leader_election.cc:343] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 3ae68905ec1942448b444ecd01836805
W20260203 21:14:03.931366 2720 leader_election.cc:343] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 3ae68905ec1942448b444ecd01836805
I20260203 21:14:03.931445 2720 leader_election.cc:304] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:14:03.931588 6959 raft_consensus.cc:2749] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:14:04.804009 7218 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 21:14:04.804147 7218 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:14:04.804569 7218 leader_election.cc:290] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419), 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681)
W20260203 21:14:04.805096 4707 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260203 21:14:04.805734 4708 leader_election.cc:336] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419): Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111)
W20260203 21:14:04.805812 4707 leader_election.cc:336] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681): Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)
I20260203 21:14:04.805900 4707 leader_election.cc:304] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a7e51013f5041898fe34f4b64a59260; no voters: 35397be7e61f4b27a49e9449b9fdf085, 7344d7cd8dea4fa2ae705320daacaf49
I20260203 21:14:04.806097 7218 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260203 21:14:04.955996 4690 master_runner.cc:186] Error getting master registration for 127.2.32.190:35419: Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111),
I20260203 21:14:04.956142 4690 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260203 21:14:05.760243 2721 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 201: this message will repeat every 5th retry.
I20260203 21:14:05.948807 6371 raft_consensus.cc:493] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:14:05.948957 6371 raft_consensus.cc:515] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:14:05.949366 6371 leader_election.cc:290] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:14:05.950143 2720 leader_election.cc:343] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 7786ef435bbd44daae12d3ee4728efb9
W20260203 21:14:05.950248 2721 leader_election.cc:343] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 7786ef435bbd44daae12d3ee4728efb9
I20260203 21:14:05.950322 2721 leader_election.cc:304] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:14:05.950529 6371 raft_consensus.cc:2749] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260203 21:14:06.012706 2720 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 201: this message will repeat every 5th retry.
W20260203 21:14:06.363546 2721 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 201: this message will repeat every 5th retry.
I20260203 21:14:06.564916 6959 raft_consensus.cc:493] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d9e0cecab784cc0acc050ca1c89c5be)
I20260203 21:14:06.565062 6959 raft_consensus.cc:515] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:14:06.565613 6959 leader_election.cc:290] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223), 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897)
W20260203 21:14:06.566306 2721 leader_election.cc:343] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 6606bf5d7de047cda4a0523197210c1a
W20260203 21:14:06.566401 2720 leader_election.cc:343] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 6606bf5d7de047cda4a0523197210c1a
I20260203 21:14:06.566459 2720 leader_election.cc:304] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:14:06.566638 6959 raft_consensus.cc:2749] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:14:07.020712 6371 raft_consensus.cc:493] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:14:07.020861 6371 raft_consensus.cc:515] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } }
I20260203 21:14:07.021347 6371 leader_election.cc:290] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223), 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897)
W20260203 21:14:07.022459 2720 leader_election.cc:343] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 06b80064d47349c2830718f553ba3d7d
W20260203 21:14:07.022668 2721 leader_election.cc:343] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 06b80064d47349c2830718f553ba3d7d
I20260203 21:14:07.022827 2721 leader_election.cc:304] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:14:07.023074 6371 raft_consensus.cc:2749] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260203 21:14:07.658601 2720 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 201: this message will repeat every 5th retry.
I20260203 21:14:07.824362 6371 raft_consensus.cc:493] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d9e0cecab784cc0acc050ca1c89c5be)
I20260203 21:14:07.824594 6371 raft_consensus.cc:515] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:14:07.825170 6371 leader_election.cc:290] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:14:07.826122 2721 leader_election.cc:343] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: a375114bebc64385827b7b6e0060d1e4
W20260203 21:14:07.826288 2720 leader_election.cc:343] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: a375114bebc64385827b7b6e0060d1e4
I20260203 21:14:07.826349 2720 leader_election.cc:304] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:14:07.826512 6371 raft_consensus.cc:2749] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:14:09.072723 7282 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 21:14:09.072868 7282 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:14:09.073330 7282 leader_election.cc:290] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419), 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681)
W20260203 21:14:09.074404 4708 leader_election.cc:336] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419): Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111)
W20260203 21:14:09.074506 4707 leader_election.cc:336] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681): Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)
I20260203 21:14:09.074570 4707 leader_election.cc:304] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a7e51013f5041898fe34f4b64a59260; no voters: 35397be7e61f4b27a49e9449b9fdf085, 7344d7cd8dea4fa2ae705320daacaf49
I20260203 21:14:09.074709 7282 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260203 21:14:09.611930 7172 raft_consensus.cc:493] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d9e0cecab784cc0acc050ca1c89c5be)
I20260203 21:14:09.612062 7172 raft_consensus.cc:515] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:14:09.612488 7172 leader_election.cc:290] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:14:09.613116 2720 leader_election.cc:343] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: a375114bebc64385827b7b6e0060d1e4
W20260203 21:14:09.613235 2721 leader_election.cc:343] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: a375114bebc64385827b7b6e0060d1e4
I20260203 21:14:09.613327 2721 leader_election.cc:304] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:14:09.613463 7172 raft_consensus.cc:2749] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:14:09.957080 4690 master_runner.cc:186] Error getting master registration for 127.2.32.190:35419: Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111),
I20260203 21:14:09.957206 4690 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260203 21:14:10.602674 2721 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 206: this message will repeat every 5th retry.
W20260203 21:14:10.915999 2720 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 206: this message will repeat every 5th retry.
W20260203 21:14:11.084254 2721 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 206: this message will repeat every 5th retry.
I20260203 21:14:12.355535 7322 raft_consensus.cc:493] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:14:12.355719 7322 raft_consensus.cc:515] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:14:12.356182 7322 leader_election.cc:290] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:14:12.356977 2720 leader_election.cc:343] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 7786ef435bbd44daae12d3ee4728efb9
W20260203 21:14:12.357072 2721 leader_election.cc:343] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 7786ef435bbd44daae12d3ee4728efb9
I20260203 21:14:12.357173 2721 leader_election.cc:304] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:14:12.357368 7322 raft_consensus.cc:2749] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260203 21:14:12.691892 2720 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 206: this message will repeat every 5th retry.
I20260203 21:14:14.653407 7322 raft_consensus.cc:493] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:14:14.653568 7322 raft_consensus.cc:515] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } }
I20260203 21:14:14.654014 7322 leader_election.cc:290] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223), 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897)
W20260203 21:14:14.654876 2721 leader_election.cc:343] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 06b80064d47349c2830718f553ba3d7d
W20260203 21:14:14.655043 2720 leader_election.cc:343] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 06b80064d47349c2830718f553ba3d7d
I20260203 21:14:14.655118 2720 leader_election.cc:304] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:14:14.655265 7322 raft_consensus.cc:2749] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:14:14.958385 4690 master_runner.cc:186] Error getting master registration for 127.2.32.190:35419: Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111),
I20260203 21:14:14.958532 4690 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260203 21:14:15.450124 2721 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 211: this message will repeat every 5th retry.
W20260203 21:14:15.879189 2721 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 211: this message will repeat every 5th retry.
W20260203 21:14:15.893584 2720 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 211: this message will repeat every 5th retry.
I20260203 21:14:16.772619 6959 raft_consensus.cc:493] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d9e0cecab784cc0acc050ca1c89c5be)
I20260203 21:14:16.772778 6959 raft_consensus.cc:515] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:14:16.773339 6959 leader_election.cc:290] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223), 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897)
W20260203 21:14:16.774375 2721 leader_election.cc:343] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 6606bf5d7de047cda4a0523197210c1a
W20260203 21:14:16.774497 2720 leader_election.cc:343] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 6606bf5d7de047cda4a0523197210c1a
I20260203 21:14:16.774636 2720 leader_election.cc:304] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:14:16.774886 6959 raft_consensus.cc:2749] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:14:16.914543 6959 raft_consensus.cc:493] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:14:16.914721 6959 raft_consensus.cc:515] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:14:16.915180 6959 leader_election.cc:290] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:14:16.915972 2721 leader_election.cc:343] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 4d6ed92d766244489541e1c280afacb5
W20260203 21:14:16.916127 2720 leader_election.cc:343] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 4d6ed92d766244489541e1c280afacb5
I20260203 21:14:16.916190 2720 leader_election.cc:304] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:14:16.916323 6959 raft_consensus.cc:2749] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260203 21:14:17.651868 2720 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 211: this message will repeat every 5th retry.
I20260203 21:14:19.960423 4690 master_runner.cc:186] Error getting master registration for 127.2.32.190:35419: Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111),
I20260203 21:14:19.960675 4690 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260203 21:14:20.481235 2721 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 216: this message will repeat every 5th retry.
W20260203 21:14:20.737864 2721 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 216: this message will repeat every 5th retry.
W20260203 21:14:20.943390 2720 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 216: this message will repeat every 5th retry.
I20260203 21:14:22.540190 7479 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 21:14:22.540386 7479 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:14:22.540999 7479 leader_election.cc:290] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419), 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681)
W20260203 21:14:22.541749 4708 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260203 21:14:22.542673 4708 leader_election.cc:336] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419): Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111)
W20260203 21:14:22.542860 4707 leader_election.cc:336] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681): Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)
I20260203 21:14:22.542960 4707 leader_election.cc:304] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a7e51013f5041898fe34f4b64a59260; no voters: 35397be7e61f4b27a49e9449b9fdf085, 7344d7cd8dea4fa2ae705320daacaf49
I20260203 21:14:22.543126 7479 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260203 21:14:22.648969 2720 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 216: this message will repeat every 5th retry.
I20260203 21:14:23.908720 6959 raft_consensus.cc:493] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d9e0cecab784cc0acc050ca1c89c5be)
I20260203 21:14:23.908875 6959 raft_consensus.cc:515] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:14:23.909307 6959 leader_election.cc:290] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:14:23.910035 2720 leader_election.cc:343] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 3ae68905ec1942448b444ecd01836805
W20260203 21:14:23.910166 2721 leader_election.cc:343] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 3ae68905ec1942448b444ecd01836805
I20260203 21:14:23.910241 2721 leader_election.cc:304] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:14:23.910398 6959 raft_consensus.cc:2749] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:14:24.962201 4690 master_runner.cc:186] Error getting master registration for 127.2.32.190:35419: Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111),
I20260203 21:14:24.962435 4690 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260203 21:14:25.295508 2721 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 221: this message will repeat every 5th retry.
W20260203 21:14:25.644222 2721 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 221: this message will repeat every 5th retry.
I20260203 21:14:25.707405 7172 raft_consensus.cc:493] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d9e0cecab784cc0acc050ca1c89c5be)
I20260203 21:14:25.707585 7172 raft_consensus.cc:515] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:14:25.708084 7172 leader_election.cc:290] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:14:25.708849 2720 leader_election.cc:343] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: a375114bebc64385827b7b6e0060d1e4
W20260203 21:14:25.709091 2721 leader_election.cc:343] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: a375114bebc64385827b7b6e0060d1e4
I20260203 21:14:25.709195 2721 leader_election.cc:304] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:14:25.709404 7172 raft_consensus.cc:2749] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260203 21:14:26.085595 2720 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 221: this message will repeat every 5th retry.
W20260203 21:14:27.408489 3106 heartbeater.cc:646] Failed to heartbeat to 127.2.32.190:35419 (509 consecutive failures): Network error: Failed to ping master at 127.2.32.190:35419: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111)
W20260203 21:14:27.408795 2833 heartbeater.cc:646] Failed to heartbeat to 127.2.32.189:42681 (1775 consecutive failures): Network error: Failed to ping master at 127.2.32.189:42681: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)
W20260203 21:14:27.485781 2971 heartbeater.cc:646] Failed to heartbeat to 127.2.32.189:42681 (451 consecutive failures): Network error: Failed to ping master at 127.2.32.189:42681: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)
W20260203 21:14:27.884995 2720 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 221: this message will repeat every 5th retry.
I20260203 21:14:29.964181 4690 master_runner.cc:186] Error getting master registration for 127.2.32.190:35419: Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111),
I20260203 21:14:29.964357 4690 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260203 21:14:30.469319 2721 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 226: this message will repeat every 5th retry.
W20260203 21:14:30.611541 2721 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 226: this message will repeat every 5th retry.
W20260203 21:14:30.766162 2720 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 226: this message will repeat every 5th retry.
I20260203 21:14:30.984578 6959 raft_consensus.cc:493] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:14:30.984769 6959 raft_consensus.cc:515] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:14:30.985167 6959 leader_election.cc:290] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:14:30.986075 2721 leader_election.cc:343] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 7786ef435bbd44daae12d3ee4728efb9
W20260203 21:14:30.986169 2720 leader_election.cc:343] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 7786ef435bbd44daae12d3ee4728efb9
I20260203 21:14:30.986279 2720 leader_election.cc:304] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:14:30.986567 6959 raft_consensus.cc:2749] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260203 21:14:32.337641 2720 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 226: this message will repeat every 5th retry.
I20260203 21:14:33.002805 7322 raft_consensus.cc:493] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:14:33.002964 7322 raft_consensus.cc:515] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:14:33.003530 7322 leader_election.cc:290] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:14:33.004500 2720 leader_election.cc:343] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 4d6ed92d766244489541e1c280afacb5
W20260203 21:14:33.004630 2721 leader_election.cc:343] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 4d6ed92d766244489541e1c280afacb5
I20260203 21:14:33.004837 2721 leader_election.cc:304] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:14:33.005031 7322 raft_consensus.cc:2749] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:14:33.574360 6959 raft_consensus.cc:493] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:14:33.574508 6959 raft_consensus.cc:515] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:14:33.574946 6959 leader_election.cc:290] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:14:33.575585 2720 leader_election.cc:343] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 7786ef435bbd44daae12d3ee4728efb9
W20260203 21:14:33.575698 2721 leader_election.cc:343] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 7786ef435bbd44daae12d3ee4728efb9
I20260203 21:14:33.575771 2721 leader_election.cc:304] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:14:33.575896 6959 raft_consensus.cc:2749] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:14:33.665300 6959 raft_consensus.cc:493] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:14:33.665474 6959 raft_consensus.cc:515] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } }
I20260203 21:14:33.665905 6959 leader_election.cc:290] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223), 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897)
W20260203 21:14:33.667062 2720 leader_election.cc:343] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 06b80064d47349c2830718f553ba3d7d
W20260203 21:14:33.667227 2721 leader_election.cc:343] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 06b80064d47349c2830718f553ba3d7d
I20260203 21:14:33.667317 2721 leader_election.cc:304] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:14:33.667464 6959 raft_consensus.cc:2749] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:14:34.966084 4690 master_runner.cc:186] Error getting master registration for 127.2.32.190:35419: Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111),
I20260203 21:14:34.966321 4690 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260203 21:14:35.350559 2721 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 231: this message will repeat every 5th retry.
W20260203 21:14:35.545442 2721 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 231: this message will repeat every 5th retry.
W20260203 21:14:35.920780 2720 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 231: this message will repeat every 5th retry.
I20260203 21:14:36.615334 7322 raft_consensus.cc:493] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d9e0cecab784cc0acc050ca1c89c5be)
I20260203 21:14:36.615511 7322 raft_consensus.cc:515] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:14:36.616254 7322 leader_election.cc:290] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223), 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897)
W20260203 21:14:36.617292 2720 leader_election.cc:343] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 6606bf5d7de047cda4a0523197210c1a
W20260203 21:14:36.617547 2721 leader_election.cc:343] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 6606bf5d7de047cda4a0523197210c1a
I20260203 21:14:36.617728 2721 leader_election.cc:304] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:14:36.617942 7322 raft_consensus.cc:2749] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:14:36.693732 7322 raft_consensus.cc:493] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:14:36.693902 7322 raft_consensus.cc:515] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } }
I20260203 21:14:36.694384 7322 leader_election.cc:290] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223), 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897)
W20260203 21:14:36.695142 2720 leader_election.cc:343] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 06b80064d47349c2830718f553ba3d7d
W20260203 21:14:36.695223 2721 leader_election.cc:343] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 06b80064d47349c2830718f553ba3d7d
I20260203 21:14:36.695307 2721 leader_election.cc:304] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:14:36.695448 7322 raft_consensus.cc:2749] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260203 21:14:37.519776 2720 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 231: this message will repeat every 5th retry.
I20260203 21:14:38.155594 6959 raft_consensus.cc:493] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d9e0cecab784cc0acc050ca1c89c5be)
I20260203 21:14:38.155757 6959 raft_consensus.cc:515] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:14:38.156220 6959 leader_election.cc:290] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:14:38.156984 2720 leader_election.cc:343] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 3ae68905ec1942448b444ecd01836805
W20260203 21:14:38.157073 2721 leader_election.cc:343] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 3ae68905ec1942448b444ecd01836805
I20260203 21:14:38.157176 2721 leader_election.cc:304] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:14:38.157322 6959 raft_consensus.cc:2749] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:14:39.796015 7172 raft_consensus.cc:493] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d9e0cecab784cc0acc050ca1c89c5be)
I20260203 21:14:39.796234 7172 raft_consensus.cc:515] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:14:39.797122 7172 leader_election.cc:290] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:14:39.797861 2721 leader_election.cc:343] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: a375114bebc64385827b7b6e0060d1e4
W20260203 21:14:39.797961 2720 leader_election.cc:343] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: a375114bebc64385827b7b6e0060d1e4
I20260203 21:14:39.798022 2720 leader_election.cc:304] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:14:39.798146 6959 raft_consensus.cc:2749] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:14:39.967413 4690 master_runner.cc:186] Error getting master registration for 127.2.32.190:35419: Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111),
I20260203 21:14:39.967542 4690 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260203 21:14:40.441228 2721 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 236: this message will repeat every 5th retry.
W20260203 21:14:40.973557 2721 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 236: this message will repeat every 5th retry.
W20260203 21:14:41.205232 2720 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 236: this message will repeat every 5th retry.
I20260203 21:14:41.729609 7720 raft_consensus.cc:493] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d9e0cecab784cc0acc050ca1c89c5be)
I20260203 21:14:41.729771 7720 raft_consensus.cc:515] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:14:41.730252 7720 leader_election.cc:290] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:14:41.730986 2720 leader_election.cc:343] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 3ae68905ec1942448b444ecd01836805
W20260203 21:14:41.731084 2721 leader_election.cc:343] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 3ae68905ec1942448b444ecd01836805
I20260203 21:14:41.731161 2721 leader_election.cc:304] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:14:41.731285 7720 raft_consensus.cc:2749] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:14:42.439875 7756 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 21:14:42.440035 7756 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:14:42.440680 7756 leader_election.cc:290] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419), 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681)
W20260203 21:14:42.441382 4708 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260203 21:14:42.442335 4707 leader_election.cc:336] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681): Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)
W20260203 21:14:42.442574 4708 leader_election.cc:336] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419): Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111)
I20260203 21:14:42.442652 4708 leader_election.cc:304] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a7e51013f5041898fe34f4b64a59260; no voters: 35397be7e61f4b27a49e9449b9fdf085, 7344d7cd8dea4fa2ae705320daacaf49
I20260203 21:14:42.442840 7756 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260203 21:14:42.803843 2720 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 236: this message will repeat every 5th retry.
I20260203 21:14:43.337087 7322 raft_consensus.cc:493] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:14:43.337232 7322 raft_consensus.cc:515] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } }
I20260203 21:14:43.337607 7322 leader_election.cc:290] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223), 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897)
W20260203 21:14:43.338243 2720 leader_election.cc:343] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 06b80064d47349c2830718f553ba3d7d
W20260203 21:14:43.338376 2721 leader_election.cc:343] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 06b80064d47349c2830718f553ba3d7d
I20260203 21:14:43.338428 2721 leader_election.cc:304] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:14:43.338552 7322 raft_consensus.cc:2749] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:14:44.968580 4690 master_runner.cc:186] Error getting master registration for 127.2.32.190:35419: Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111),
I20260203 21:14:44.968711 4690 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260203 21:14:45.333027 2721 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 241: this message will repeat every 5th retry.
W20260203 21:14:45.525360 2721 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 241: this message will repeat every 5th retry.
W20260203 21:14:46.152961 2720 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 241: this message will repeat every 5th retry.
W20260203 21:14:47.967264 2720 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 241: this message will repeat every 5th retry.
I20260203 21:14:48.340231 6959 raft_consensus.cc:493] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:14:48.340363 6959 raft_consensus.cc:515] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:14:48.340864 6959 leader_election.cc:290] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:14:48.341535 2720 leader_election.cc:343] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 4d6ed92d766244489541e1c280afacb5
W20260203 21:14:48.341859 2721 leader_election.cc:343] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 4d6ed92d766244489541e1c280afacb5
I20260203 21:14:48.341939 2721 leader_election.cc:304] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:14:48.342133 6959 raft_consensus.cc:2749] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:14:49.477428 7720 raft_consensus.cc:493] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:14:49.477591 7720 raft_consensus.cc:515] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:14:49.478025 7720 leader_election.cc:290] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:14:49.479038 2720 leader_election.cc:343] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 7786ef435bbd44daae12d3ee4728efb9
W20260203 21:14:49.479255 2721 leader_election.cc:343] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 7786ef435bbd44daae12d3ee4728efb9
I20260203 21:14:49.479365 2721 leader_election.cc:304] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:14:49.479499 7720 raft_consensus.cc:2749] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:14:49.969756 4690 master_runner.cc:186] Error getting master registration for 127.2.32.190:35419: Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111),
I20260203 21:14:49.969879 4690 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260203 21:14:50.439543 2721 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 246: this message will repeat every 5th retry.
W20260203 21:14:50.841400 2721 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 246: this message will repeat every 5th retry.
W20260203 21:14:50.978713 2720 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 246: this message will repeat every 5th retry.
I20260203 21:14:51.510737 6959 raft_consensus.cc:493] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d9e0cecab784cc0acc050ca1c89c5be)
I20260203 21:14:51.510890 6959 raft_consensus.cc:515] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:14:51.511330 6959 leader_election.cc:290] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223), 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897)
W20260203 21:14:51.512164 2721 leader_election.cc:343] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 6606bf5d7de047cda4a0523197210c1a
W20260203 21:14:51.512434 2720 leader_election.cc:343] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 6606bf5d7de047cda4a0523197210c1a
I20260203 21:14:51.512523 2720 leader_election.cc:304] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:14:51.512701 7322 raft_consensus.cc:2749] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:14:52.683862 7720 raft_consensus.cc:493] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d9e0cecab784cc0acc050ca1c89c5be)
I20260203 21:14:52.684015 7720 raft_consensus.cc:515] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:14:52.684433 7720 leader_election.cc:290] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:14:52.685169 2721 leader_election.cc:343] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 3ae68905ec1942448b444ecd01836805
W20260203 21:14:52.685392 2720 leader_election.cc:343] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 3ae68905ec1942448b444ecd01836805
I20260203 21:14:52.685576 2720 leader_election.cc:304] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:14:52.685788 7720 raft_consensus.cc:2749] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260203 21:14:53.137173 2720 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 246: this message will repeat every 5th retry.
I20260203 21:14:53.559006 7914 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 21:14:53.559136 7914 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:14:53.559540 7914 leader_election.cc:290] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419), 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681)
W20260203 21:14:53.560173 4708 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260203 21:14:53.560976 4708 leader_election.cc:336] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419): Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111)
W20260203 21:14:53.561101 4707 leader_election.cc:336] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681): Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)
I20260203 21:14:53.561159 4707 leader_election.cc:304] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a7e51013f5041898fe34f4b64a59260; no voters: 35397be7e61f4b27a49e9449b9fdf085, 7344d7cd8dea4fa2ae705320daacaf49
I20260203 21:14:53.561281 7914 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260203 21:14:54.970621 4690 master_runner.cc:186] Error getting master registration for 127.2.32.190:35419: Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111),
I20260203 21:14:54.970741 4690 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260203 21:14:55.441540 2721 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 251: this message will repeat every 5th retry.
W20260203 21:14:55.890131 2721 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 251: this message will repeat every 5th retry.
I20260203 21:14:55.903838 7720 raft_consensus.cc:493] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:14:55.903955 7720 raft_consensus.cc:515] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:14:55.904305 7720 leader_election.cc:290] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:14:55.904850 2721 leader_election.cc:343] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 4d6ed92d766244489541e1c280afacb5
W20260203 21:14:55.904927 2720 leader_election.cc:343] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 4d6ed92d766244489541e1c280afacb5
I20260203 21:14:55.905000 2720 leader_election.cc:304] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:14:55.905126 7720 raft_consensus.cc:2749] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260203 21:14:56.240482 2720 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 251: this message will repeat every 5th retry.
I20260203 21:14:56.934130 7720 raft_consensus.cc:493] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d9e0cecab784cc0acc050ca1c89c5be)
I20260203 21:14:56.934291 7720 raft_consensus.cc:515] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:14:56.935005 7720 leader_election.cc:290] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223), 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897)
W20260203 21:14:56.936004 2720 leader_election.cc:343] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 6606bf5d7de047cda4a0523197210c1a
W20260203 21:14:56.936113 2721 leader_election.cc:343] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 6606bf5d7de047cda4a0523197210c1a
I20260203 21:14:56.936172 2721 leader_election.cc:304] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:14:56.936292 7720 raft_consensus.cc:2749] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:14:57.557857 7720 raft_consensus.cc:493] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d9e0cecab784cc0acc050ca1c89c5be)
I20260203 21:14:57.558005 7720 raft_consensus.cc:515] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:14:57.558434 7720 leader_election.cc:290] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:14:57.559127 2721 leader_election.cc:343] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: a375114bebc64385827b7b6e0060d1e4
W20260203 21:14:57.559221 2720 leader_election.cc:343] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: a375114bebc64385827b7b6e0060d1e4
I20260203 21:14:57.559295 2720 leader_election.cc:304] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:14:57.559440 7720 raft_consensus.cc:2749] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260203 21:14:58.139375 2720 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 251: this message will repeat every 5th retry.
I20260203 21:14:59.971473 4690 master_runner.cc:186] Error getting master registration for 127.2.32.190:35419: Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111),
I20260203 21:14:59.971575 4690 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260203 21:15:00.565294 2721 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 256: this message will repeat every 5th retry.
W20260203 21:15:00.651927 2721 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 256: this message will repeat every 5th retry.
W20260203 21:15:01.512542 2720 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 256: this message will repeat every 5th retry.
W20260203 21:15:02.678851 2720 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 256: this message will repeat every 5th retry.
I20260203 21:15:02.892822 7720 raft_consensus.cc:493] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:15:02.893043 7720 raft_consensus.cc:515] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } }
I20260203 21:15:02.893460 7720 leader_election.cc:290] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223), 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897)
W20260203 21:15:02.894177 2721 leader_election.cc:343] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 06b80064d47349c2830718f553ba3d7d
W20260203 21:15:02.894258 2720 leader_election.cc:343] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 06b80064d47349c2830718f553ba3d7d
I20260203 21:15:02.894333 2720 leader_election.cc:304] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:15:02.894483 7720 raft_consensus.cc:2749] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:15:04.338142 7322 raft_consensus.cc:493] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d9e0cecab784cc0acc050ca1c89c5be)
I20260203 21:15:04.338327 7322 raft_consensus.cc:515] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:15:04.338946 7322 leader_election.cc:290] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:15:04.339742 2721 leader_election.cc:343] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 3ae68905ec1942448b444ecd01836805
W20260203 21:15:04.339893 2720 leader_election.cc:343] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 3ae68905ec1942448b444ecd01836805
I20260203 21:15:04.339957 2720 leader_election.cc:304] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:15:04.340101 7322 raft_consensus.cc:2749] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:15:04.972601 4690 master_runner.cc:186] Error getting master registration for 127.2.32.190:35419: Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111),
I20260203 21:15:04.972713 4690 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260203 21:15:05.488914 2721 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 261: this message will repeat every 5th retry.
W20260203 21:15:05.729899 2721 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 261: this message will repeat every 5th retry.
W20260203 21:15:06.597904 2720 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 261: this message will repeat every 5th retry.
W20260203 21:15:07.589191 2720 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 261: this message will repeat every 5th retry.
I20260203 21:15:07.828238 6959 raft_consensus.cc:493] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d9e0cecab784cc0acc050ca1c89c5be)
I20260203 21:15:07.828377 6959 raft_consensus.cc:515] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:15:07.828763 6959 leader_election.cc:290] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:15:07.829456 2720 leader_election.cc:343] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: a375114bebc64385827b7b6e0060d1e4
W20260203 21:15:07.829543 2721 leader_election.cc:343] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: a375114bebc64385827b7b6e0060d1e4
I20260203 21:15:07.829630 2721 leader_election.cc:304] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:15:07.829759 6959 raft_consensus.cc:2749] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:15:07.961676 7720 raft_consensus.cc:493] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:15:07.961818 7720 raft_consensus.cc:515] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:15:07.962260 7720 leader_election.cc:290] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:15:07.962945 2720 leader_election.cc:343] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 7786ef435bbd44daae12d3ee4728efb9
W20260203 21:15:07.963035 2721 leader_election.cc:343] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 7786ef435bbd44daae12d3ee4728efb9
I20260203 21:15:07.963120 2721 leader_election.cc:304] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:15:07.963245 7720 raft_consensus.cc:2749] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:15:09.093971 6959 raft_consensus.cc:493] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d9e0cecab784cc0acc050ca1c89c5be)
I20260203 21:15:09.094107 6959 raft_consensus.cc:515] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:15:09.094499 6959 leader_election.cc:290] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223), 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897)
W20260203 21:15:09.095182 2720 leader_election.cc:343] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 6606bf5d7de047cda4a0523197210c1a
W20260203 21:15:09.095285 2721 leader_election.cc:343] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 6606bf5d7de047cda4a0523197210c1a
I20260203 21:15:09.095366 2721 leader_election.cc:304] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:15:09.095482 6959 raft_consensus.cc:2749] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:15:09.973644 4690 master_runner.cc:186] Error getting master registration for 127.2.32.190:35419: Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111),
I20260203 21:15:09.973763 4690 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260203 21:15:10.208920 2721 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 266: this message will repeat every 5th retry.
I20260203 21:15:10.732735 7720 raft_consensus.cc:493] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:15:10.732860 7720 raft_consensus.cc:515] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:15:10.733234 7720 leader_election.cc:290] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:15:10.733798 2720 leader_election.cc:343] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 4d6ed92d766244489541e1c280afacb5
W20260203 21:15:10.733888 2721 leader_election.cc:343] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 4d6ed92d766244489541e1c280afacb5
I20260203 21:15:10.733971 2721 leader_election.cc:304] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:15:10.734095 7720 raft_consensus.cc:2749] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260203 21:15:10.898746 2721 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 266: this message will repeat every 5th retry.
I20260203 21:15:11.681933 8167 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 21:15:11.682070 8167 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:15:11.682571 8167 leader_election.cc:290] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419), 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681)
W20260203 21:15:11.683096 4708 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260203 21:15:11.683738 4708 leader_election.cc:336] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419): Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111)
W20260203 21:15:11.684013 4707 leader_election.cc:336] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681): Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)
I20260203 21:15:11.684075 4707 leader_election.cc:304] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a7e51013f5041898fe34f4b64a59260; no voters: 35397be7e61f4b27a49e9449b9fdf085, 7344d7cd8dea4fa2ae705320daacaf49
I20260203 21:15:11.684209 8167 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260203 21:15:11.891652 2720 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 266: this message will repeat every 5th retry.
W20260203 21:15:12.668293 2720 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 266: this message will repeat every 5th retry.
I20260203 21:15:14.974660 4690 master_runner.cc:186] Error getting master registration for 127.2.32.190:35419: Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111),
I20260203 21:15:14.974778 4690 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260203 21:15:15.173847 2721 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 271: this message will repeat every 5th retry.
W20260203 21:15:15.922210 2721 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 271: this message will repeat every 5th retry.
W20260203 21:15:16.770008 2720 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 271: this message will repeat every 5th retry.
I20260203 21:15:17.052171 6959 raft_consensus.cc:493] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:15:17.052333 6959 raft_consensus.cc:515] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:15:17.052742 6959 leader_election.cc:290] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:15:17.053314 2721 leader_election.cc:343] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 4d6ed92d766244489541e1c280afacb5
W20260203 21:15:17.053416 2720 leader_election.cc:343] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 4d6ed92d766244489541e1c280afacb5
I20260203 21:15:17.053472 2720 leader_election.cc:304] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:15:17.053596 6959 raft_consensus.cc:2749] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260203 21:15:17.830844 2720 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 271: this message will repeat every 5th retry.
I20260203 21:15:19.459896 7322 raft_consensus.cc:493] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d9e0cecab784cc0acc050ca1c89c5be)
I20260203 21:15:19.460012 7322 raft_consensus.cc:515] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:15:19.460430 7322 leader_election.cc:290] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:15:19.461020 2720 leader_election.cc:343] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 3ae68905ec1942448b444ecd01836805
W20260203 21:15:19.461835 2721 leader_election.cc:343] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 3ae68905ec1942448b444ecd01836805
I20260203 21:15:19.461892 2721 leader_election.cc:304] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:15:19.462060 7720 raft_consensus.cc:2749] T 3ae68905ec1942448b444ecd01836805 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:15:19.472844 7720 raft_consensus.cc:493] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d9e0cecab784cc0acc050ca1c89c5be)
I20260203 21:15:19.472959 7720 raft_consensus.cc:515] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:15:19.473270 7720 leader_election.cc:290] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:15:19.473817 2720 leader_election.cc:343] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: a375114bebc64385827b7b6e0060d1e4
W20260203 21:15:19.473951 2721 leader_election.cc:343] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: a375114bebc64385827b7b6e0060d1e4
I20260203 21:15:19.474000 2721 leader_election.cc:304] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:15:19.474124 7720 raft_consensus.cc:2749] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:15:19.975698 4690 master_runner.cc:186] Error getting master registration for 127.2.32.190:35419: Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111),
I20260203 21:15:19.975822 4690 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260203 21:15:20.420197 2721 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 276: this message will repeat every 5th retry.
I20260203 21:15:20.908888 7322 raft_consensus.cc:493] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:15:20.909017 7322 raft_consensus.cc:515] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } }
I20260203 21:15:20.909359 7322 leader_election.cc:290] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223), 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897)
W20260203 21:15:20.909976 2721 leader_election.cc:343] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 06b80064d47349c2830718f553ba3d7d
W20260203 21:15:20.910085 2720 leader_election.cc:343] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 06b80064d47349c2830718f553ba3d7d
I20260203 21:15:20.910143 2720 leader_election.cc:304] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:15:20.910259 7322 raft_consensus.cc:2749] T 06b80064d47349c2830718f553ba3d7d P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:15:20.950136 7322 raft_consensus.cc:493] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d9e0cecab784cc0acc050ca1c89c5be)
I20260203 21:15:20.950248 7322 raft_consensus.cc:515] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:15:20.950588 7322 leader_election.cc:290] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223), 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897)
W20260203 21:15:20.951152 2720 leader_election.cc:343] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 6606bf5d7de047cda4a0523197210c1a
W20260203 21:15:20.951241 2721 leader_election.cc:343] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 6606bf5d7de047cda4a0523197210c1a
I20260203 21:15:20.951329 2721 leader_election.cc:304] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:15:20.951454 7322 raft_consensus.cc:2749] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260203 21:15:20.984825 2721 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 276: this message will repeat every 5th retry.
W20260203 21:15:21.710809 2720 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 276: this message will repeat every 5th retry.
I20260203 21:15:21.798689 8306 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 21:15:21.798810 8306 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:15:21.799238 8306 leader_election.cc:290] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419), 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681)
W20260203 21:15:21.799886 4707 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260203 21:15:21.800487 4708 leader_election.cc:336] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419): Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111)
W20260203 21:15:21.800570 4707 leader_election.cc:336] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681): Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)
I20260203 21:15:21.800625 4707 leader_election.cc:304] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a7e51013f5041898fe34f4b64a59260; no voters: 35397be7e61f4b27a49e9449b9fdf085, 7344d7cd8dea4fa2ae705320daacaf49
I20260203 21:15:21.800750 8306 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260203 21:15:22.688705 2720 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 276: this message will repeat every 5th retry.
I20260203 21:15:23.915930 8327 raft_consensus.cc:493] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:15:23.916113 8327 raft_consensus.cc:515] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:15:23.916563 8327 leader_election.cc:290] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:15:23.917333 2720 leader_election.cc:343] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 4d6ed92d766244489541e1c280afacb5
W20260203 21:15:23.917449 2721 leader_election.cc:343] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 4d6ed92d766244489541e1c280afacb5
I20260203 21:15:23.917537 2721 leader_election.cc:304] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:15:23.917694 8327 raft_consensus.cc:2749] T 4d6ed92d766244489541e1c280afacb5 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:15:24.731876 8327 raft_consensus.cc:493] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 185c63f61a2645928eeb807d145026b1)
I20260203 21:15:24.732003 8327 raft_consensus.cc:515] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } }
I20260203 21:15:24.732415 8327 leader_election.cc:290] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:15:24.732971 2720 leader_election.cc:343] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 7786ef435bbd44daae12d3ee4728efb9
W20260203 21:15:24.733062 2721 leader_election.cc:343] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 7786ef435bbd44daae12d3ee4728efb9
I20260203 21:15:24.733139 2721 leader_election.cc:304] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:15:24.733270 8327 raft_consensus.cc:2749] T 7786ef435bbd44daae12d3ee4728efb9 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 21:15:24.976600 4690 master_runner.cc:186] Error getting master registration for 127.2.32.190:35419: Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111),
I20260203 21:15:24.976706 4690 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260203 21:15:25.420284 2721 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 281: this message will repeat every 5th retry.
I20260203 21:15:25.478533 7720 raft_consensus.cc:493] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d9e0cecab784cc0acc050ca1c89c5be)
I20260203 21:15:25.478664 7720 raft_consensus.cc:515] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:15:25.479067 7720 leader_election.cc:290] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223), 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897)
W20260203 21:15:25.479693 2720 leader_election.cc:343] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: 6606bf5d7de047cda4a0523197210c1a
W20260203 21:15:25.479779 2721 leader_election.cc:343] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: 6606bf5d7de047cda4a0523197210c1a
I20260203 21:15:25.479837 2721 leader_election.cc:304] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:15:25.479954 7720 raft_consensus.cc:2749] T 6606bf5d7de047cda4a0523197210c1a P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260203 21:15:25.970360 2721 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Couldn't send request to peer 6d9e0cecab784cc0acc050ca1c89c5be. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 281: this message will repeat every 5th retry.
I20260203 21:15:26.470134 7322 raft_consensus.cc:493] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d9e0cecab784cc0acc050ca1c89c5be)
I20260203 21:15:26.470273 7322 raft_consensus.cc:515] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9e0cecab784cc0acc050ca1c89c5be" member_type: VOTER last_known_addr { host: "127.2.32.130" port: 38897 } } peers { permanent_uuid: "185c63f61a2645928eeb807d145026b1" member_type: VOTER last_known_addr { host: "127.2.32.131" port: 40223 } } peers { permanent_uuid: "02bdf326542e474cbe62434dd59087dc" member_type: VOTER last_known_addr { host: "127.2.32.129" port: 34335 } }
I20260203 21:15:26.470721 7322 leader_election.cc:290] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897), 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223)
W20260203 21:15:26.471325 2721 leader_election.cc:343] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d9e0cecab784cc0acc050ca1c89c5be (127.2.32.130:38897): Not found: Tablet not found: a375114bebc64385827b7b6e0060d1e4
W20260203 21:15:26.471410 2720 leader_election.cc:343] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Not found: Tablet not found: a375114bebc64385827b7b6e0060d1e4
I20260203 21:15:26.471493 2720 leader_election.cc:304] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02bdf326542e474cbe62434dd59087dc; no voters: 185c63f61a2645928eeb807d145026b1, 6d9e0cecab784cc0acc050ca1c89c5be
I20260203 21:15:26.471613 7322 raft_consensus.cc:2749] T a375114bebc64385827b7b6e0060d1e4 P 02bdf326542e474cbe62434dd59087dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260203 21:15:26.747054 2720 consensus_peers.cc:597] T 8a206d0a0a1947bdabc1123ff6c281f0 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a206d0a0a1947bdabc1123ff6c281f0. This is attempt 281: this message will repeat every 5th retry.
I20260203 21:15:27.259146 8388 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 21:15:27.259289 8388 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7344d7cd8dea4fa2ae705320daacaf49" member_type: VOTER last_known_addr { host: "127.2.32.190" port: 35419 } } peers { permanent_uuid: "35397be7e61f4b27a49e9449b9fdf085" member_type: VOTER last_known_addr { host: "127.2.32.189" port: 42681 } } peers { permanent_uuid: "8a7e51013f5041898fe34f4b64a59260" member_type: VOTER last_known_addr { host: "127.2.32.188" port: 33665 } }
I20260203 21:15:27.259732 8388 leader_election.cc:290] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419), 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681)
W20260203 21:15:27.260231 4707 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260203 21:15:27.260833 4708 leader_election.cc:336] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7344d7cd8dea4fa2ae705320daacaf49 (127.2.32.190:35419): Network error: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111)
W20260203 21:15:27.260929 4707 leader_election.cc:336] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 35397be7e61f4b27a49e9449b9fdf085 (127.2.32.189:42681): Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)
I20260203 21:15:27.261003 4707 leader_election.cc:304] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a7e51013f5041898fe34f4b64a59260; no voters: 35397be7e61f4b27a49e9449b9fdf085, 7344d7cd8dea4fa2ae705320daacaf49
I20260203 21:15:27.261145 8388 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8a7e51013f5041898fe34f4b64a59260 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260203 21:15:27.458773 2833 heartbeater.cc:646] Failed to heartbeat to 127.2.32.189:42681 (2254 consecutive failures): Network error: Failed to ping master at 127.2.32.189:42681: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)
W20260203 21:15:27.528590 3106 heartbeater.cc:646] Failed to heartbeat to 127.2.32.190:35419 (629 consecutive failures): Network error: Failed to ping master at 127.2.32.190:35419: Client connection negotiation failed: client connection to 127.2.32.190:35419: connect: Connection refused (error 111)
W20260203 21:15:27.608767 2971 heartbeater.cc:646] Failed to heartbeat to 127.2.32.189:42681 (571 consecutive failures): Network error: Failed to ping master at 127.2.32.189:42681: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)
W20260203 21:15:27.900003 2720 consensus_peers.cc:597] T b20e604665624843b957080dc6016d78 P 02bdf326542e474cbe62434dd59087dc -> Peer 185c63f61a2645928eeb807d145026b1 (127.2.32.131:40223): Couldn't send request to peer 185c63f61a2645928eeb807d145026b1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b20e604665624843b957080dc6016d78. This is attempt 281: this message will repeat every 5th retry.
W20260203 21:15:29.438086 3112 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToClusterRpc(addrs: 127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665, num_attempts: 750) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)
W20260203 21:15:29.438237 3112 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToClusterRpc(addrs: 127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665, num_attempts: 750) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)
W20260203 21:15:29.438304 3112 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToClusterRpc(addrs: 127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665, num_attempts: 750) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)
W20260203 21:15:29.438392 3112 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToClusterRpc(addrs: 127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665, num_attempts: 750) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)
F20260203 21:15:29.448907 3138 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665, num_attempts: 750) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260203 21:15:29.448967 3127 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_76bef700d9b64243b6b4e93ffbc64f7a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665, num_attempts: 750) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)
*** Check failure stack trace: ***
*** Aborted at 1770153329 (unix time) try "date -d @1770153329" if you are using GNU date ***
F20260203 21:15:29.448967 3127 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_76bef700d9b64243b6b4e93ffbc64f7a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665, num_attempts: 750) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)F20260203 21:15:29.450302 3137 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665, num_attempts: 750) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)
*** Check failure stack trace: ***
W20260203 21:15:29.451226 3114 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.2.32.189:42681)
W20260203 21:15:29.451367 3114 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.2.32.189:42681)
F20260203 21:15:29.448967 3127 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_76bef700d9b64243b6b4e93ffbc64f7a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665, num_attempts: 750) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)F20260203 21:15:29.450302 3137 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665, num_attempts: 750) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)F20260203 21:15:29.451706 3139 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665, num_attempts: 750) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260203 21:15:29.448967 3127 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_76bef700d9b64243b6b4e93ffbc64f7a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665, num_attempts: 750) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)F20260203 21:15:29.450302 3137 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665, num_attempts: 750) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)F20260203 21:15:29.451706 3139 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665, num_attempts: 750) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)F20260203 21:15:29.452426 3135 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665, num_attempts: 750) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260203 21:15:29.448967 3127 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_76bef700d9b64243b6b4e93ffbc64f7a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665, num_attempts: 750) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)F20260203 21:15:29.450302 3137 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665, num_attempts: 750) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)F20260203 21:15:29.451706 3139 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665, num_attempts: 750) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)F20260203 21:15:29.452426 3135 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665, num_attempts: 750) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)F20260203 21:15:29.452631 3131 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665, num_attempts: 750) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260203 21:15:29.448967 3127 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_76bef700d9b64243b6b4e93ffbc64f7a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665, num_attempts: 750) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)F20260203 21:15:29.450302 3137 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665, num_attempts: 750) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)F20260203 21:15:29.451706 3139 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665, num_attempts: 750) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)F20260203 21:15:29.452426 3135 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665, num_attempts: 750) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)F20260203 21:15:29.452631 3131 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665, num_attempts: 750) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)F20260203 21:15:29.452777 3130 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665, num_attempts: 750) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260203 21:15:29.448967 3127 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_76bef700d9b64243b6b4e93ffbc64f7a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665, num_attempts: 750) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)F20260203 21:15:29.450302 3137 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665, num_attempts: 750) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)F20260203 21:15:29.451706 3139 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665, num_attempts: 750) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)F20260203 21:15:29.452426 3135 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665, num_attempts: 750) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)F20260203 21:15:29.452631 3131 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665, num_attempts: 750) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)F20260203 21:15:29.452777 3130 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665, num_attempts: 750) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)F20260203 21:15:29.452808 3132 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665, num_attempts: 750) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)
*** Check failure stack trace: ***
PC: @ 0x0 (unknown)
*** SIGABRT (@0x3e800000882) received by PID 2178 (TID 0x7fbfe47e7700) from PID 2178; stack trace: ***
F20260203 21:15:29.448967 3127 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_76bef700d9b64243b6b4e93ffbc64f7a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665, num_attempts: 750) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)F20260203 21:15:29.450302 3137 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665, num_attempts: 750) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)F20260203 21:15:29.451706 3139 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665, num_attempts: 750) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)F20260203 21:15:29.452426 3135 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665, num_attempts: 750) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)F20260203 21:15:29.452631 3131 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665, num_attempts: 750) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)F20260203 21:15:29.452777 3130 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665, num_attempts: 750) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)F20260203 21:15:29.452808 3132 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665, num_attempts: 750) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)F20260203 21:15:29.454865 3125 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_8bbf49750e3f4eccbcf97c6346c65635 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665, num_attempts: 750) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260203 21:15:29.448967 3127 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_76bef700d9b64243b6b4e93ffbc64f7a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665, num_attempts: 750) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)F20260203 21:15:29.450302 3137 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665, num_attempts: 750) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)F20260203 21:15:29.451706 3139 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665, num_attempts: 750) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)F20260203 21:15:29.452426 3135 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665, num_attempts: 750) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)F20260203 21:15:29.452631 3131 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665, num_attempts: 750) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)F20260203 21:15:29.452777 3130 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665, num_attempts: 750) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)F20260203 21:15:29.452808 3132 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665, num_attempts: 750) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)F20260203 21:15:29.454865 3125 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_8bbf49750e3f4eccbcf97c6346c65635 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665, num_attempts: 750) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)F20260203 21:15:29.454975 3134 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665, num_attempts: 750) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)
*** Check failure stack trace: ***
@ 0x7fc001870980 (unknown) at ??:0
F20260203 21:15:29.448967 3127 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_76bef700d9b64243b6b4e93ffbc64f7a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665, num_attempts: 750) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)F20260203 21:15:29.450302 3137 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665, num_attempts: 750) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)F20260203 21:15:29.451706 3139 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665, num_attempts: 750) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)F20260203 21:15:29.452426 3135 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665, num_attempts: 750) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)F20260203 21:15:29.452631 3131 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665, num_attempts: 750) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)F20260203 21:15:29.452777 3130 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665, num_attempts: 750) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)F20260203 21:15:29.452808 3132 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665, num_attempts: 750) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)F20260203 21:15:29.454865 3125 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_8bbf49750e3f4eccbcf97c6346c65635 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665, num_attempts: 750) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)F20260203 21:15:29.454975 3134 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665, num_attempts: 750) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)F20260203 21:15:29.456269 3133 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665, num_attempts: 750) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260203 21:15:29.448967 3127 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_76bef700d9b64243b6b4e93ffbc64f7a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665, num_attempts: 750) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)F20260203 21:15:29.450302 3137 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665, num_attempts: 750) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)F20260203 21:15:29.451706 3139 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665, num_attempts: 750) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)F20260203 21:15:29.452426 3135 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665, num_attempts: 750) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)F20260203 21:15:29.452631 3131 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665, num_attempts: 750) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)F20260203 21:15:29.452777 3130 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665, num_attempts: 750) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)F20260203 21:15:29.452808 3132 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665, num_attempts: 750) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)F20260203 21:15:29.454865 3125 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_8bbf49750e3f4eccbcf97c6346c65635 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665, num_attempts: 750) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)F20260203 21:15:29.454975 3134 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665, num_attempts: 750) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)F20260203 21:15:29.456269 3133 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665, num_attempts: 750) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)F20260203 21:15:29.457708 3136 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665, num_attempts: 750) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)
*** Check failure stack trace: ***
@ 0x7fbfff3d1fb7 gsignal at ??:0
F20260203 21:15:29.448967 3127 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_76bef700d9b64243b6b4e93ffbc64f7a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665, num_attempts: 750) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)F20260203 21:15:29.450302 3137 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665, num_attempts: 750) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)F20260203 21:15:29.451706 3139 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665, num_attempts: 750) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)F20260203 21:15:29.452426 3135 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665, num_attempts: 750) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)F20260203 21:15:29.452631 3131 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665, num_attempts: 750) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)F20260203 21:15:29.452777 3130 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665, num_attempts: 750) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)F20260203 21:15:29.452808 3132 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665, num_attempts: 750) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)F20260203 21:15:29.454865 3125 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_8bbf49750e3f4eccbcf97c6346c65635 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665, num_attempts: 750) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)F20260203 21:15:29.454975 3134 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665, num_attempts: 750) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)F20260203 21:15:29.456269 3133 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665, num_attempts: 750) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)F20260203 21:15:29.457708 3136 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665, num_attempts: 750) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)F20260203 21:15:29.458164 3119 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_75f7568b9f28464e8d4ce934087b320e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.32.190:35419,127.2.32.189:42681,127.2.32.188:33665, num_attempts: 750) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.32.189:42681: connect: Connection refused (error 111)
*** Check failure stack trace: ***
@ 0x7fbfff3d3921 abort at ??:0
@ 0x7fc00023adcd google::LogMessage::Fail() at ??:0
@ 0x7fc00023eb93 google::LogMessage::SendToLog() at ??:0
@ 0x7fc00023a7cc google::LogMessage::Flush() at ??:0
@ 0x7fc00023bf59 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x5632c94e5686 kudu::MasterStressTest::DeleteTableThread() at ??:0
@ 0x5632c94f7a04 std::__invoke_impl<>() at ??:0
@ 0x5632c94f5740 std::__invoke<>() at ??:0
@ 0x5632c94fcd91 _ZNSt6thread8_InvokerISt5tupleIJMN4kudu16MasterStressTestEFvvEPNS2_26MasterStressTest_Test_TestEEEE9_M_invokeIJLm0ELm1EEEEDTcl8__invokespcl10_S_declvalIXT_EEEEESt12_Index_tupleIJXspT_EEE at ??:0
@ 0x5632c94fbd95 std::thread::_Invoker<>::operator()() at ??:0
@ 0x5632c94fab12 std::thread::_State_impl<>::_M_run() at ??:0
@ 0x7fbfffa596df (unknown) at ??:0
@ 0x7fc0018656db start_thread at ??:0
@ 0x7fbfff4b471f clone at ??:0